2024-09-13T18:53:07.354 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:53:07.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:53:07.699 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7904033' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-qa-rgw-squid-65651 sha1: 24ee2aeecf070bf47d80960334abd82047ad2def owner: scheduled_cbodley@teuthology priority: 90 repo: https://github.com/ceph/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9887 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 suite: rgw suite_branch: wip-qa-rgw-squid-65651 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 24ee2aeecf070bf47d80960334abd82047ad2def targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQmwGG69X21pkzpPbqrdoll2lwdo23tzUWRKNqceHUyIwTzcd9kXTMCD0tNu8jffPr6+sPQI2GPMWJIh0A3GP8= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKCGbwn5BRIgUQKlqGp+HSoXXDjZXmysnfpKt3W0BeYEg04dw5C8zydezTeI/rktuN3522DLSisUsQVlRhzSa4= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_16:28:49 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:53:07.700 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa; will attempt to use it 2024-09-13T18:53:07.700 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa/tasks 2024-09-13T18:53:07.701 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:53:07.702 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:53:07.725 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T18:53:07.725 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:53:07.725 INFO:teuthology.packaging:ref: None 2024-09-13T18:53:07.725 INFO:teuthology.packaging:tag: None 2024-09-13T18:53:07.725 INFO:teuthology.packaging:branch: squid 2024-09-13T18:53:07.725 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T18:53:07.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-13T18:53:07.956 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322-g7741f7f9-1jammy 2024-09-13T18:53:07.958 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:53:07.963 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:53:07.964 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:53:07.970 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:53:07.982 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:53:07.989 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:53:08.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:47:21.113448', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIErL6Lbr+m6cI/o4GQKXWjgspUQXIe4X4Aehf/JqCzwa'} 2024-09-13T18:53:08.054 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:47:21.112020', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICDlUVVMKKTUF7fLneEL7GXMn85I2m33v6FONRycXhw3'} 2024-09-13T18:53:08.054 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:53:08.060 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-13T18:53:08.060 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-13T18:53:08.060 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:53:08.221 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c80abd360>, signals=[15]) 2024-09-13T18:53:08.221 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:53:08.227 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:53:08.227 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-09-13T18:53:08.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:53:08.320 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T18:53:08.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:53:08.408 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:53:08.414 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-09-13T18:53:08.420 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-09-13T18:53:08.420 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-09-13T18:53:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T18:53:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2024-09-13T18:53:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="22.04" 2024-09-13T18:53:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=jammy 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:53:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=jammy 2024-09-13T18:53:08.467 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-09-13T18:53:08.507 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-09-13T18:53:08.512 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-09-13T18:53:08.512 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-09-13T18:53:08.560 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:53:08.561 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy 2024-09-13T18:53:08.562 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-09-13T18:53:08.589 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:53:08.597 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:53:08.604 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:53:08.604 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:53:08.607 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:53:08.612 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:53:08.617 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:53:08.618 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:53:08.654 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:53:08.667 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:53:08.738 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:53:08.752 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:53:08.752 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T18:53:08.753 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:53:08.753 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:53:08.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:53:08.758 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-13T18:53:08.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:53:08.759 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-13T18:53:08.805 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-56-generic 2024-09-13T18:53:08.805 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.15.0-56-generic 2024-09-13T18:53:08.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2024-09-13T18:53:08.811 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-56-generic 2024-09-13T18:53:08.811 INFO:teuthology.task.kernel:Running kernel on smithi151: 5.15.0-56-generic 2024-09-13T18:53:08.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-13T18:53:08.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-13T18:53:08.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-13T18:53:09.050 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:53:09.083 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T18:53:09.157 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T18:53:09.170 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T18:53:09.223 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:53:09.223 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T18:53:09.253 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T18:53:09.275 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T18:53:09.350 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T18:53:09.355 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T18:53:09.357 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T18:53:09.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T18:53:09.358 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T18:53:09.376 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T18:53:09.380 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T18:53:09.380 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T18:53:09.384 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T18:53:09.392 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T18:53:09.393 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T18:53:09.394 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T18:53:09.434 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T18:53:09.435 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T18:53:09.437 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T18:53:09.437 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T18:53:09.438 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T18:53:09.438 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T18:53:09.438 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T18:53:09.439 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T18:53:09.452 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T18:53:09.452 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T18:53:09.469 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T18:53:09.612 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T18:53:09.631 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T18:53:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T18:53:09.769 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T18:53:09.895 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T18:53:10.067 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T18:53:10.080 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T18:53:10.081 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T18:53:10.082 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T18:53:10.083 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T18:53:10.087 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T18:53:10.099 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T18:53:10.108 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T18:53:10.109 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T18:53:10.110 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T18:53:10.122 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T18:53:10.136 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T18:53:10.137 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T18:53:10.138 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T18:53:10.166 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T18:53:10.174 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T18:53:10.175 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T18:53:10.190 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T18:53:10.206 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T18:53:10.207 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T18:53:10.219 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T18:53:10.225 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T18:53:10.231 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T18:53:10.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T18:53:10.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T18:53:10.233 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T18:53:10.280 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T18:53:10.280 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T18:53:10.280 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T18:53:10.290 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T18:53:10.293 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T18:53:10.306 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T18:53:10.309 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T18:53:10.309 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T18:53:10.310 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T18:53:10.311 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T18:53:10.312 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T18:53:10.316 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T18:53:10.321 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T18:53:10.322 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T18:53:10.323 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T18:53:10.323 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T18:53:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T18:53:10.349 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T18:53:10.405 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T18:53:10.406 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T18:53:10.408 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T18:53:10.408 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T18:53:10.409 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T18:53:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T18:53:10.419 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T18:53:10.420 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T18:53:15.775 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 16.0 MB in 2s (7,571 kB/s) 2024-09-13T18:53:16.648 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 16.0 MB in 3s (5,632 kB/s) 2024-09-13T18:53:17.155 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T18:53:17.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:53:17.228 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T18:53:17.415 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-13T18:53:17.415 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-13T18:53:17.583 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:53:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:53:17.583 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:53:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:53:17.584 INFO:teuthology.orchestra.run.smithi151.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T18:53:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: python2.7-minimal 2024-09-13T18:53:17.585 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:53:17.585 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-13T18:53:17.585 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:53:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T18:53:17.586 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T18:53:17.587 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-13T18:53:17.587 INFO:teuthology.orchestra.run.smithi151.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T18:53:17.587 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-13T18:53:17.588 INFO:teuthology.orchestra.run.smithi151.stdout: thermald 2024-09-13T18:53:17.637 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-13T18:53:17.637 INFO:teuthology.orchestra.run.smithi151.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:53:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T18:53:17.638 INFO:teuthology.orchestra.run.smithi151.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T18:53:17.639 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages will be upgraded: 2024-09-13T18:53:17.640 INFO:teuthology.orchestra.run.smithi151.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:53:17.691 INFO:teuthology.orchestra.run.smithi151.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:53:17.691 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 113 MB of archives. 2024-09-13T18:53:17.691 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T18:53:17.692 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T18:53:18.084 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T18:53:18.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:53:18.150 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T18:53:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T18:53:18.256 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T18:53:18.388 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-13T18:53:18.388 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-13T18:53:18.587 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:53:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:53:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:53:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:53:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T18:53:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: python2.7-minimal 2024-09-13T18:53:18.588 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:53:18.589 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2024-09-13T18:53:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:53:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T18:53:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T18:53:18.591 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2024-09-13T18:53:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T18:53:18.591 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2024-09-13T18:53:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: thermald 2024-09-13T18:53:18.650 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2024-09-13T18:53:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T18:53:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T18:53:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T18:53:18.652 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2024-09-13T18:53:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T18:53:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:53:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 113 MB of archives. 2024-09-13T18:53:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T18:53:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T18:53:19.086 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T18:53:19.086 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T18:53:19.086 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T18:53:19.210 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T18:53:19.232 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T18:53:19.633 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 113 MB in 2s (68.5 MB/s) 2024-09-13T18:53:19.813 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T18:53:20.232 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T18:53:20.587 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T18:53:21.987 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T18:53:21.991 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:22.135 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:22.820 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T18:53:22.820 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T18:53:22.820 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T18:53:23.247 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T18:53:23.342 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T18:53:23.748 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 113 MB in 5s (24.2 MB/s) 2024-09-13T18:53:23.906 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T18:53:24.245 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T18:53:24.266 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:24.364 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:24.806 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T18:53:24.827 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:24.855 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:25.925 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T18:53:25.929 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:25.995 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:27.980 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T18:53:28.002 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:28.109 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:28.550 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T18:53:28.571 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:28.608 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:31.791 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:31.916 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:32.248 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:32.344 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:32.614 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T18:53:32.636 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T18:53:32.680 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:53:34.584 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:34.686 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:35.004 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:35.131 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T18:53:35.456 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T18:53:35.500 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:53:38.615 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T18:53:38.652 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:41.345 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:41.476 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T18:53:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T18:53:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:41.818 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:53:41.922 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:42.048 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T18:53:42.176 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:43.512 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:53:43.512 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T18:53:43.512 INFO:teuthology.orchestra.run.smithi151.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:53:43.512 INFO:teuthology.orchestra.run.smithi151.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T18:53:43.663 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:44.250 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T18:53:44.374 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T18:53:45.455 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:45.575 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T18:53:45.696 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:45.822 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T18:53:45.958 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:46.865 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T18:53:46.991 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T18:53:47.117 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:47.187 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:53:47.187 INFO:teuthology.orchestra.run.smithi151.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:53:47.324 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:53:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T18:53:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:53:47.325 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T18:53:47.478 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:48.895 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:50.305 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T18:53:50.582 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T18:53:51.052 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T18:53:51.052 INFO:teuthology.orchestra.run.smithi012.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:54:01.994 INFO:teuthology.orchestra.run.smithi151.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:54:01.994 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:54:02.010 INFO:teuthology.orchestra.run.smithi151.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:54:02.028 INFO:teuthology.orchestra.run.smithi151.stdout:Generating grub configuration file ... 2024-09-13T18:54:02.271 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:54:02.294 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:54:02.560 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:54:02.566 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:54:02.638 INFO:teuthology.orchestra.run.smithi151.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:54:02.645 INFO:teuthology.orchestra.run.smithi151.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:54:02.795 INFO:teuthology.orchestra.run.smithi151.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:54:02.795 INFO:teuthology.orchestra.run.smithi151.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:54:02.795 INFO:teuthology.orchestra.run.smithi151.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:54:02.838 INFO:teuthology.orchestra.run.smithi151.stdout:done 2024-09-13T18:54:03.328 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-13T18:54:03.350 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.121.121 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:54:03.351 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-13T18:54:03.351 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T18:54:03.352 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:54:03.352 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:54:03.352 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-13T18:54:03.352 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:54:03.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get clean 2024-09-13T18:54:03.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-13T18:54:03.633 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:54:03.633 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T18:54:03.642 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:54:03.660 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:54:05.095 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T18:54:05.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:54:05.167 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T18:54:05.354 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-13T18:54:05.354 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-13T18:54:05.523 INFO:teuthology.orchestra.run.smithi151.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T18:54:05.523 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:54:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:54:05.523 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:54:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:54:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:54:05.524 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:54:05.524 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:54:05.565 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:54:05.566 DEBUG:teuthology.orchestra.run.smithi151:> dpkg -s linux-image-generic 2024-09-13T18:54:05.625 INFO:teuthology.orchestra.run.smithi151.stdout:Package: linux-image-generic 2024-09-13T18:54:05.625 INFO:teuthology.orchestra.run.smithi151.stdout:Status: install ok installed 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Priority: optional 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Section: kernel 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Installed-Size: 21 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: amd64 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Source: linux-meta 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Version: 5.15.0.121.121 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:54:05.626 INFO:teuthology.orchestra.run.smithi151.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:54:05.627 INFO:teuthology.orchestra.run.smithi151.stdout:Recommends: thermald 2024-09-13T18:54:05.627 INFO:teuthology.orchestra.run.smithi151.stdout:Description: Generic Linux kernel image 2024-09-13T18:54:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:54:05.627 INFO:teuthology.orchestra.run.smithi151.stdout: available. 2024-09-13T18:54:05.627 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2024-09-13T18:54:05.671 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Swbkw96v1I 2024-09-13T18:54:05.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Swbkw96v1I 2024-09-13T18:54:05.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Swbkw96v1I 2024-09-13T18:54:05.846 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Swbkw96v1I is 10KB 2024-09-13T18:54:05.858 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Swbkw96v1I 2024-09-13T18:54:05.864 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:54:05.919 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T18:54:05.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:54:05.919 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:54:05.986 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T18:54:05.986 DEBUG:teuthology.orchestra.run.smithi151:> sudo update-grub 2024-09-13T18:54:06.076 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T18:54:06.076 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub' 2024-09-13T18:54:06.083 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:54:06.102 INFO:teuthology.orchestra.run.smithi012.stdout:Generating grub configuration file ... 2024-09-13T18:54:06.374 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:54:06.398 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:54:06.653 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:54:06.658 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:54:06.742 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:54:06.749 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:54:06.920 INFO:teuthology.orchestra.run.smithi012.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:54:06.921 INFO:teuthology.orchestra.run.smithi012.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:54:06.921 INFO:teuthology.orchestra.run.smithi012.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:54:06.955 INFO:teuthology.orchestra.run.smithi012.stdout:done 2024-09-13T18:54:07.307 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:54:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:54:07.318 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2024-09-13T18:54:07.412 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2024-09-13T18:54:07.435 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2024-09-13T18:54:07.435 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2024-09-13T18:54:07.435 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2024-09-13T18:54:07.435 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2024-09-13T18:54:07.435 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 21 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.121.121 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:54:07.436 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2024-09-13T18:54:07.436 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T18:54:07.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T18:54:07.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T18:54:07.437 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T18:54:07.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T18:54:07.437 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2024-09-13T18:54:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:54:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:54:07.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-13T18:54:07.727 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T18:54:07.736 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T18:54:07.753 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T18:54:07.763 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:54:07.769 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:54:07.812 INFO:teuthology.orchestra.run.smithi151.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:54:07.817 INFO:teuthology.orchestra.run.smithi151.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:54:07.848 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T18:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:54:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:54:07.975 INFO:teuthology.orchestra.run.smithi151.stderr:done 2024-09-13T18:54:07.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2024-09-13T18:54:09.204 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T18:54:09.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T18:54:09.282 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-13T18:54:09.695 INFO:teuthology.orchestra.run.smithi012.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T18:54:09.695 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:54:09.695 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T18:54:09.695 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T18:54:09.695 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T18:54:09.696 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T18:54:09.696 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T18:54:09.696 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:54:09.743 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T18:54:09.745 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 21 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.15.0.121.121 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2024-09-13T18:54:09.762 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.GgcLfmGWoR 2024-09-13T18:54:09.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GgcLfmGWoR 2024-09-13T18:54:09.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.GgcLfmGWoR 2024-09-13T18:54:09.978 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.GgcLfmGWoR is 10KB 2024-09-13T18:54:09.993 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.GgcLfmGWoR 2024-09-13T18:54:09.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T18:54:10.054 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T18:54:10.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T18:54:10.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T18:54:10.126 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T18:54:10.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo update-grub 2024-09-13T18:54:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:54:11.254 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:54:11.256 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2024-09-13T18:54:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T18:54:11.438 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T18:54:11.669 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T18:54:11.674 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T18:54:11.719 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T18:54:11.725 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T18:54:11.841 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T18:54:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T18:54:11.842 INFO:teuthology.orchestra.run.smithi012.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T18:54:11.853 INFO:teuthology.orchestra.run.smithi012.stderr:done 2024-09-13T18:54:11.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2024-09-13T18:54:38.009 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-13T18:54:38.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T18:54:38.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:54:41.873 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T18:54:41.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T18:54:41.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:54:56.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-13T18:55:00.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-13T18:55:05.577 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T18:55:05.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:08.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-13T18:55:09.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T18:55:09.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:20.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T18:55:20.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:27.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-13T18:55:39.069 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2024-09-13T18:55:39.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T18:55:39.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:42.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-09-13T18:55:54.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T18:55:54.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:54.414 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-13T18:55:57.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T18:55:57.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:55:58.126 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-13T18:55:58.501 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-13T18:55:58.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T18:55:58.650 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T18:55:58.650 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-09-13T18:55:58.699 INFO:teuthology.orchestra.run.smithi012.stdout:5.15.0-121-generic 2024-09-13T18:55:58.700 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T18:55:58.700 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:55:58.700 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:55:59.360 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T18:55:59.360 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-121-generic"... 2024-09-13T18:55:59.360 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2024-09-13T18:55:59.405 INFO:teuthology.orchestra.run.smithi151.stdout:5.15.0-121-generic 2024-09-13T18:55:59.405 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T18:55:59.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:55:59.406 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:55:59.701 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T18:55:59.701 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:55:59.771 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2024-09-13T18:55:59.796 DEBUG:teuthology.parallel:result is None 2024-09-13T18:56:00.407 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-13T18:56:00.407 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T18:56:00.501 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2024-09-13T18:56:00.523 DEBUG:teuthology.parallel:result is None 2024-09-13T18:56:00.523 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:56:00.531 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:56:00.531 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:56:00.534 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:56:00.539 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:56:00.545 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:56:00.555 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:56:00.555 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:56:00.579 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:56:00.599 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:56:00.605 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:56:00.605 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:56:00.640 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:56:00.662 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:56:00.667 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:56:00.671 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:56:00.675 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:56:00.677 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:56:00.683 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:56:00.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:56:00.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:56:00.733 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:56:00.742 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:56:00.742 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:56:00.771 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:56:00.782 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:56:00.823 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:56:00.871 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T18:56:00.871 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:56:00.965 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:56:00.971 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:56:01.018 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T18:56:01.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:56:01.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-09-13T18:56:01.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-09-13T18:56:01.148 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:56:01.162 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:56:01.163 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:56:01.173 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:56:01.181 DEBUG:teuthology.task.selinux:Excluding smithi012: OS 'ubuntu' does not support SELinux 2024-09-13T18:56:01.181 DEBUG:teuthology.task.selinux:Excluding smithi151: OS 'ubuntu' does not support SELinux 2024-09-13T18:56:01.181 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:56:01.181 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T18:56:01.181 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:56:01.181 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:56:01.190 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:56:01.193 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:56:01.312 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:56:01.323 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:56:01.324 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T19:03:40.167 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-09-13T19:03:40.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T19:03:40.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:03:40.260 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-09-13T19:03:40.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-09-13T19:03:40.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T19:03:40.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T19:03:40.429 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-09-13T19:03:40.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-09-13T19:03:40.505 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T19:03:40.515 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T19:03:40.516 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:03:40.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:03:40.519 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T19:03:40.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:03:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T19:03:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Command line: ntpd -gq 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: ---------------------------------------------------- 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: corporation. Support and training for ntp-4 are 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: available at https://www.nwtime.org/support 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: ---------------------------------------------------- 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: proto: precision = 0.046 usec (-24) 2024-09-13T19:03:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: basedate set to 2022-02-04 2024-09-13T19:03:40.552 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: gps base set to 2022-02-06 (week 2196) 2024-09-13T19:03:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:03:40.552 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:03:40.552 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:03:40.553 INFO:teuthology.orchestra.run.smithi012.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:03:40.553 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T19:03:40.553 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T19:03:40.554 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T19:03:40.554 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen normally on 3 ens1f0 172.21.15.12:123 2024-09-13T19:03:40.554 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen normally on 4 lo [::1]:123 2024-09-13T19:03:40.554 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25ea%4]:123 2024-09-13T19:03:40.554 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:40 ntpd[18395]: Listening on routing socket on fd #22 for interface updates 2024-09-13T19:03:40.573 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Command line: ntpd -gq 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: ---------------------------------------------------- 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: corporation. Support and training for ntp-4 are 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: available at https://www.nwtime.org/support 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: ---------------------------------------------------- 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: proto: precision = 0.044 usec (-24) 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: basedate set to 2022-02-04 2024-09-13T19:03:40.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: gps base set to 2022-02-06 (week 2196) 2024-09-13T19:03:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:03:40.575 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T19:03:40.575 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:03:40.575 INFO:teuthology.orchestra.run.smithi151.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T19:03:40.576 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T19:03:40.576 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T19:03:40.576 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T19:03:40.577 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen normally on 3 enp3s0f1 172.21.15.151:123 2024-09-13T19:03:40.577 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen normally on 4 lo [::1]:123 2024-09-13T19:03:40.577 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f63%5]:123 2024-09-13T19:03:40.577 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:40 ntpd[18452]: Listening on routing socket on fd #22 for interface updates 2024-09-13T19:03:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:41 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:41.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:41 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:42 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:43 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:43 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:44.576 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:44 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:45 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:45.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:45 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:46 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:47.551 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:47.552 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:47.553 INFO:teuthology.orchestra.run.smithi012.stdout:13 Sep 19:03:47 ntpd[18395]: ntpd: time slew -0.004478 s 2024-09-13T19:03:47.553 INFO:teuthology.orchestra.run.smithi012.stdout:ntpd: time slew -0.004478s 2024-09-13T19:03:47.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T19:03:47.553 INFO:teuthology.orchestra.run.smithi012.stderr:13 Sep 19:03:47 ntpd[18395]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stdout:13 Sep 19:03:47 ntpd[18452]: ntpd: time slew -0.000585 s 2024-09-13T19:03:47.574 INFO:teuthology.orchestra.run.smithi151.stdout:ntpd: time slew -0.000585s 2024-09-13T19:03:47.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T19:03:47.575 INFO:teuthology.orchestra.run.smithi151.stderr:13 Sep 19:03:47 ntpd[18452]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.605 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:03:47.628 INFO:teuthology.run_tasks:Running task install... 2024-09-13T19:03:47.636 DEBUG:teuthology.task.install:project ceph 2024-09-13T19:03:47.636 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T19:03:47.636 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T19:03:47.636 INFO:teuthology.task.install:Using flavor: default 2024-09-13T19:03:47.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T19:03:47.641 INFO:teuthology.task.install:extra packages: [] 2024-09-13T19:03:47.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-key list | grep Ceph 2024-09-13T19:03:47.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-key list | grep Ceph 2024-09-13T19:03:47.712 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T19:03:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T19:03:47.743 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T19:03:47.743 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T19:03:47.744 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T19:03:47.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:03:47.758 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T19:03:47.758 INFO:teuthology.orchestra.run.smithi151.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T19:03:47.758 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-13T19:03:47.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:03:47.900 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default/ 2024-09-13T19:03:47.901 INFO:teuthology.task.install.deb:Package version is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:03:47.917 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default/ 2024-09-13T19:03:47.917 INFO:teuthology.task.install.deb:Package version is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:03:48.021 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:03:48.022 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T19:03:48.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo apt-get update 2024-09-13T19:03:48.037 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:03:48.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T19:03:48.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2024-09-13T19:03:48.253 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T19:03:48.274 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T19:03:48.277 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T19:03:48.297 INFO:teuthology.orchestra.run.smithi151.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T19:03:48.299 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T19:03:48.318 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-13T19:03:48.322 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T19:03:48.328 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:03:48.328 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:03:48.353 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T19:03:48.353 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T19:03:48.354 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T19:03:48.357 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-13T19:03:48.382 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-09-13T19:03:48.400 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:03:48.424 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T19:03:48.481 INFO:teuthology.orchestra.run.smithi151.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:03:48.505 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T19:03:48.690 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 29.0 kB in 0s (60.5 kB/s) 2024-09-13T19:03:48.740 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 29.0 kB in 1s (57.6 kB/s) 2024-09-13T19:03:49.713 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T19:03:49.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-322-g7741f7f9-1jammy cephadm=19.1.1-322-g7741f7f9-1jammy ceph-mds=19.1.1-322-g7741f7f9-1jammy ceph-mgr=19.1.1-322-g7741f7f9-1jammy ceph-common=19.1.1-322-g7741f7f9-1jammy ceph-fuse=19.1.1-322-g7741f7f9-1jammy ceph-test=19.1.1-322-g7741f7f9-1jammy ceph-volume=19.1.1-322-g7741f7f9-1jammy radosgw=19.1.1-322-g7741f7f9-1jammy python3-rados=19.1.1-322-g7741f7f9-1jammy python3-rgw=19.1.1-322-g7741f7f9-1jammy python3-cephfs=19.1.1-322-g7741f7f9-1jammy python3-rbd=19.1.1-322-g7741f7f9-1jammy libcephfs2=19.1.1-322-g7741f7f9-1jammy libcephfs-dev=19.1.1-322-g7741f7f9-1jammy librados2=19.1.1-322-g7741f7f9-1jammy librbd1=19.1.1-322-g7741f7f9-1jammy rbd-fuse=19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:03:49.773 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T19:03:49.786 INFO:teuthology.orchestra.run.smithi151.stdout:Reading package lists... 2024-09-13T19:03:49.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-322-g7741f7f9-1jammy cephadm=19.1.1-322-g7741f7f9-1jammy ceph-mds=19.1.1-322-g7741f7f9-1jammy ceph-mgr=19.1.1-322-g7741f7f9-1jammy ceph-common=19.1.1-322-g7741f7f9-1jammy ceph-fuse=19.1.1-322-g7741f7f9-1jammy ceph-test=19.1.1-322-g7741f7f9-1jammy ceph-volume=19.1.1-322-g7741f7f9-1jammy radosgw=19.1.1-322-g7741f7f9-1jammy python3-rados=19.1.1-322-g7741f7f9-1jammy python3-rgw=19.1.1-322-g7741f7f9-1jammy python3-cephfs=19.1.1-322-g7741f7f9-1jammy python3-rbd=19.1.1-322-g7741f7f9-1jammy libcephfs2=19.1.1-322-g7741f7f9-1jammy libcephfs-dev=19.1.1-322-g7741f7f9-1jammy librados2=19.1.1-322-g7741f7f9-1jammy librbd1=19.1.1-322-g7741f7f9-1jammy rbd-fuse=19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:03:49.854 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2024-09-13T19:03:49.972 INFO:teuthology.orchestra.run.smithi151.stdout:Building dependency tree... 2024-09-13T19:03:49.973 INFO:teuthology.orchestra.run.smithi151.stdout:Reading state information... 2024-09-13T19:03:50.069 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2024-09-13T19:03:50.070 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2024-09-13T19:03:50.167 INFO:teuthology.orchestra.run.smithi151.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:03:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:03:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:03:50.167 INFO:teuthology.orchestra.run.smithi151.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:03:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:03:50.168 INFO:teuthology.orchestra.run.smithi151.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:03:50.168 INFO:teuthology.orchestra.run.smithi151.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:03:50.169 INFO:teuthology.orchestra.run.smithi151.stdout:The following additional packages will be installed: 2024-09-13T19:03:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T19:03:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T19:03:50.169 INFO:teuthology.orchestra.run.smithi151.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:03:50.170 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T19:03:50.171 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet zip 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout:Suggested packages: 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout:Recommended packages: 2024-09-13T19:03:50.172 INFO:teuthology.orchestra.run.smithi151.stdout: btrfs-tools 2024-09-13T19:03:50.275 INFO:teuthology.orchestra.run.smithi151.stdout:The following NEW packages will be installed: 2024-09-13T19:03:50.275 INFO:teuthology.orchestra.run.smithi151.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T19:03:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T19:03:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T19:03:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T19:03:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T19:03:50.276 INFO:teuthology.orchestra.run.smithi151.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T19:03:50.277 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T19:03:50.278 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T19:03:50.279 INFO:teuthology.orchestra.run.smithi151.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T19:03:50.291 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T19:03:50.291 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T19:03:50.291 INFO:teuthology.orchestra.run.smithi012.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T19:03:50.291 INFO:teuthology.orchestra.run.smithi012.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T19:03:50.292 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T19:03:50.292 INFO:teuthology.orchestra.run.smithi012.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T19:03:50.292 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T19:03:50.293 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2024-09-13T19:03:50.293 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T19:03:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T19:03:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-13T19:03:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T19:03:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-13T19:03:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T19:03:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet zip 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-13T19:03:50.296 INFO:teuthology.orchestra.run.smithi012.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-13T19:03:50.297 INFO:teuthology.orchestra.run.smithi012.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-13T19:03:50.297 INFO:teuthology.orchestra.run.smithi012.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T19:03:50.297 INFO:teuthology.orchestra.run.smithi012.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-13T19:03:50.297 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2024-09-13T19:03:50.297 INFO:teuthology.orchestra.run.smithi012.stdout: btrfs-tools 2024-09-13T19:03:50.337 INFO:teuthology.orchestra.run.smithi151.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T19:03:50.337 INFO:teuthology.orchestra.run.smithi151.stdout:Need to get 181 MB of archives. 2024-09-13T19:03:50.337 INFO:teuthology.orchestra.run.smithi151.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T19:03:50.337 INFO:teuthology.orchestra.run.smithi151.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T19:03:50.405 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2024-09-13T19:03:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T19:03:50.405 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T19:03:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-13T19:03:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-13T19:03:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-13T19:03:50.406 INFO:teuthology.orchestra.run.smithi012.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-13T19:03:50.407 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-13T19:03:50.408 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-13T19:03:50.409 INFO:teuthology.orchestra.run.smithi012.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-13T19:03:50.418 INFO:teuthology.orchestra.run.smithi151.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-322-g7741f7f9-1jammy [3,591 kB] 2024-09-13T19:03:50.425 INFO:teuthology.orchestra.run.smithi151.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T19:03:50.428 INFO:teuthology.orchestra.run.smithi151.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T19:03:50.445 INFO:teuthology.orchestra.run.smithi151.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T19:03:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T19:03:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 181 MB of archives. 2024-09-13T19:03:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-13T19:03:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T19:03:50.504 INFO:teuthology.orchestra.run.smithi151.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T19:03:50.509 INFO:teuthology.orchestra.run.smithi151.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T19:03:50.522 INFO:teuthology.orchestra.run.smithi151.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T19:03:50.526 INFO:teuthology.orchestra.run.smithi151.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T19:03:50.526 INFO:teuthology.orchestra.run.smithi151.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T19:03:50.527 INFO:teuthology.orchestra.run.smithi151.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T19:03:50.535 INFO:teuthology.orchestra.run.smithi151.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T19:03:50.538 INFO:teuthology.orchestra.run.smithi151.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T19:03:50.540 INFO:teuthology.orchestra.run.smithi151.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T19:03:50.541 INFO:teuthology.orchestra.run.smithi151.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T19:03:50.543 INFO:teuthology.orchestra.run.smithi151.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T19:03:50.545 INFO:teuthology.orchestra.run.smithi151.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T19:03:50.555 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-322-g7741f7f9-1jammy [3,591 kB] 2024-09-13T19:03:50.556 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T19:03:50.558 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T19:03:50.559 INFO:teuthology.orchestra.run.smithi151.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T19:03:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T19:03:50.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T19:03:50.562 INFO:teuthology.orchestra.run.smithi151.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T19:03:50.563 INFO:teuthology.orchestra.run.smithi151.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T19:03:50.564 INFO:teuthology.orchestra.run.smithi151.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T19:03:50.564 INFO:teuthology.orchestra.run.smithi151.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T19:03:50.564 INFO:teuthology.orchestra.run.smithi151.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T19:03:50.575 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T19:03:50.577 INFO:teuthology.orchestra.run.smithi151.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T19:03:50.578 INFO:teuthology.orchestra.run.smithi151.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T19:03:50.594 INFO:teuthology.orchestra.run.smithi151.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T19:03:50.597 INFO:teuthology.orchestra.run.smithi151.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T19:03:50.597 INFO:teuthology.orchestra.run.smithi151.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T19:03:50.598 INFO:teuthology.orchestra.run.smithi151.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T19:03:50.598 INFO:teuthology.orchestra.run.smithi151.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T19:03:50.600 INFO:teuthology.orchestra.run.smithi151.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T19:03:50.600 INFO:teuthology.orchestra.run.smithi151.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T19:03:50.600 INFO:teuthology.orchestra.run.smithi151.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T19:03:50.603 INFO:teuthology.orchestra.run.smithi151.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-322-g7741f7f9-1jammy [3,243 kB] 2024-09-13T19:03:50.611 INFO:teuthology.orchestra.run.smithi151.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T19:03:50.612 INFO:teuthology.orchestra.run.smithi151.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T19:03:50.629 INFO:teuthology.orchestra.run.smithi151.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T19:03:50.634 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T19:03:50.634 INFO:teuthology.orchestra.run.smithi151.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T19:03:50.634 INFO:teuthology.orchestra.run.smithi151.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T19:03:50.635 INFO:teuthology.orchestra.run.smithi151.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T19:03:50.635 INFO:teuthology.orchestra.run.smithi151.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T19:03:50.637 INFO:teuthology.orchestra.run.smithi151.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T19:03:50.639 INFO:teuthology.orchestra.run.smithi151.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T19:03:50.639 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T19:03:50.639 INFO:teuthology.orchestra.run.smithi151.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T19:03:50.649 INFO:teuthology.orchestra.run.smithi151.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T19:03:50.650 INFO:teuthology.orchestra.run.smithi151.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T19:03:50.652 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T19:03:50.656 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T19:03:50.657 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T19:03:50.658 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T19:03:50.664 INFO:teuthology.orchestra.run.smithi151.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-322-g7741f7f9-1jammy [719 kB] 2024-09-13T19:03:50.667 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-13T19:03:50.667 INFO:teuthology.orchestra.run.smithi151.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T19:03:50.668 INFO:teuthology.orchestra.run.smithi151.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T19:03:50.669 INFO:teuthology.orchestra.run.smithi151.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T19:03:50.669 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-13T19:03:50.671 INFO:teuthology.orchestra.run.smithi151.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T19:03:50.672 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-13T19:03:50.673 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-13T19:03:50.673 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-13T19:03:50.680 INFO:teuthology.orchestra.run.smithi151.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-322-g7741f7f9-1jammy [357 kB] 2024-09-13T19:03:50.686 INFO:teuthology.orchestra.run.smithi151.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-322-g7741f7f9-1jammy [32.8 kB] 2024-09-13T19:03:50.686 INFO:teuthology.orchestra.run.smithi151.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-322-g7741f7f9-1jammy [180 kB] 2024-09-13T19:03:50.689 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-13T19:03:50.690 INFO:teuthology.orchestra.run.smithi151.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-322-g7741f7f9-1jammy [67.8 kB] 2024-09-13T19:03:50.691 INFO:teuthology.orchestra.run.smithi151.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-322-g7741f7f9-1jammy [333 kB] 2024-09-13T19:03:50.691 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-13T19:03:50.693 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T19:03:50.694 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T19:03:50.694 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T19:03:50.706 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T19:03:50.706 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T19:03:50.707 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T19:03:50.707 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T19:03:50.708 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T19:03:50.713 INFO:teuthology.orchestra.run.smithi151.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-322-g7741f7f9-1jammy [6,874 kB] 2024-09-13T19:03:50.723 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T19:03:50.723 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T19:03:50.725 INFO:teuthology.orchestra.run.smithi151.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T19:03:50.725 INFO:teuthology.orchestra.run.smithi151.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T19:03:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T19:03:50.726 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T19:03:50.727 INFO:teuthology.orchestra.run.smithi151.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T19:03:50.727 INFO:teuthology.orchestra.run.smithi151.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T19:03:50.727 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T19:03:50.728 INFO:teuthology.orchestra.run.smithi151.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T19:03:50.740 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T19:03:50.741 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T19:03:50.741 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T19:03:50.741 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T19:03:50.743 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T19:03:50.745 INFO:teuthology.orchestra.run.smithi151.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T19:03:50.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T19:03:50.747 INFO:teuthology.orchestra.run.smithi151.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T19:03:50.757 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T19:03:50.757 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T19:03:50.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T19:03:50.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T19:03:50.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T19:03:50.762 INFO:teuthology.orchestra.run.smithi151.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T19:03:50.762 INFO:teuthology.orchestra.run.smithi151.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T19:03:50.763 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T19:03:50.763 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T19:03:50.763 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T19:03:50.763 INFO:teuthology.orchestra.run.smithi151.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T19:03:50.774 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T19:03:50.775 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T19:03:50.777 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T19:03:50.777 INFO:teuthology.orchestra.run.smithi012.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T19:03:50.778 INFO:teuthology.orchestra.run.smithi151.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T19:03:50.779 INFO:teuthology.orchestra.run.smithi151.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T19:03:50.779 INFO:teuthology.orchestra.run.smithi012.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T19:03:50.781 INFO:teuthology.orchestra.run.smithi151.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T19:03:50.790 INFO:teuthology.orchestra.run.smithi012.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T19:03:50.793 INFO:teuthology.orchestra.run.smithi012.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T19:03:50.793 INFO:teuthology.orchestra.run.smithi012.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T19:03:50.794 INFO:teuthology.orchestra.run.smithi012.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T19:03:50.795 INFO:teuthology.orchestra.run.smithi151.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T19:03:50.797 INFO:teuthology.orchestra.run.smithi151.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T19:03:50.797 INFO:teuthology.orchestra.run.smithi151.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T19:03:50.797 INFO:teuthology.orchestra.run.smithi012.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T19:03:50.800 INFO:teuthology.orchestra.run.smithi151.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T19:03:50.802 INFO:teuthology.orchestra.run.smithi151.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T19:03:50.803 INFO:teuthology.orchestra.run.smithi151.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T19:03:50.803 INFO:teuthology.orchestra.run.smithi151.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T19:03:50.803 INFO:teuthology.orchestra.run.smithi012.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-322-g7741f7f9-1jammy [3,243 kB] 2024-09-13T19:03:50.812 INFO:teuthology.orchestra.run.smithi151.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T19:03:50.813 INFO:teuthology.orchestra.run.smithi151.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T19:03:50.816 INFO:teuthology.orchestra.run.smithi151.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T19:03:50.830 INFO:teuthology.orchestra.run.smithi151.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T19:03:50.830 INFO:teuthology.orchestra.run.smithi151.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T19:03:50.830 INFO:teuthology.orchestra.run.smithi151.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T19:03:50.832 INFO:teuthology.orchestra.run.smithi151.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T19:03:50.832 INFO:teuthology.orchestra.run.smithi151.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T19:03:50.838 INFO:teuthology.orchestra.run.smithi151.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T19:03:50.838 INFO:teuthology.orchestra.run.smithi151.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T19:03:50.847 INFO:teuthology.orchestra.run.smithi151.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T19:03:50.848 INFO:teuthology.orchestra.run.smithi151.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T19:03:50.849 INFO:teuthology.orchestra.run.smithi151.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T19:03:50.849 INFO:teuthology.orchestra.run.smithi012.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T19:03:50.851 INFO:teuthology.orchestra.run.smithi012.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T19:03:50.851 INFO:teuthology.orchestra.run.smithi012.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T19:03:50.852 INFO:teuthology.orchestra.run.smithi012.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T19:03:50.853 INFO:teuthology.orchestra.run.smithi012.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T19:03:50.871 INFO:teuthology.orchestra.run.smithi012.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T19:03:50.873 INFO:teuthology.orchestra.run.smithi012.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T19:03:50.873 INFO:teuthology.orchestra.run.smithi012.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T19:03:50.885 INFO:teuthology.orchestra.run.smithi151.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-322-g7741f7f9-1jammy [112 kB] 2024-09-13T19:03:50.888 INFO:teuthology.orchestra.run.smithi151.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-322-g7741f7f9-1jammy [472 kB] 2024-09-13T19:03:50.888 INFO:teuthology.orchestra.run.smithi012.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T19:03:50.888 INFO:teuthology.orchestra.run.smithi012.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T19:03:50.890 INFO:teuthology.orchestra.run.smithi012.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T19:03:50.891 INFO:teuthology.orchestra.run.smithi012.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T19:03:50.891 INFO:teuthology.orchestra.run.smithi012.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T19:03:50.891 INFO:teuthology.orchestra.run.smithi012.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T19:03:50.896 INFO:teuthology.orchestra.run.smithi151.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-322-g7741f7f9-1jammy [25.9 MB] 2024-09-13T19:03:50.907 INFO:teuthology.orchestra.run.smithi012.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T19:03:50.907 INFO:teuthology.orchestra.run.smithi012.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T19:03:50.910 INFO:teuthology.orchestra.run.smithi012.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T19:03:50.912 INFO:teuthology.orchestra.run.smithi012.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T19:03:50.913 INFO:teuthology.orchestra.run.smithi012.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T19:03:50.914 INFO:teuthology.orchestra.run.smithi012.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T19:03:50.915 INFO:teuthology.orchestra.run.smithi012.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-322-g7741f7f9-1jammy [719 kB] 2024-09-13T19:03:50.924 INFO:teuthology.orchestra.run.smithi012.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T19:03:50.926 INFO:teuthology.orchestra.run.smithi012.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-13T19:03:50.927 INFO:teuthology.orchestra.run.smithi012.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-13T19:03:50.927 INFO:teuthology.orchestra.run.smithi012.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T19:03:50.940 INFO:teuthology.orchestra.run.smithi012.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-13T19:03:50.941 INFO:teuthology.orchestra.run.smithi012.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T19:03:50.944 INFO:teuthology.orchestra.run.smithi012.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T19:03:50.944 INFO:teuthology.orchestra.run.smithi012.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T19:03:50.944 INFO:teuthology.orchestra.run.smithi012.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T19:03:50.945 INFO:teuthology.orchestra.run.smithi012.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T19:03:50.952 INFO:teuthology.orchestra.run.smithi012.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-322-g7741f7f9-1jammy [357 kB] 2024-09-13T19:03:50.957 INFO:teuthology.orchestra.run.smithi012.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T19:03:50.958 INFO:teuthology.orchestra.run.smithi012.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T19:03:50.961 INFO:teuthology.orchestra.run.smithi012.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-322-g7741f7f9-1jammy [32.8 kB] 2024-09-13T19:03:50.962 INFO:teuthology.orchestra.run.smithi012.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-322-g7741f7f9-1jammy [180 kB] 2024-09-13T19:03:50.964 INFO:teuthology.orchestra.run.smithi012.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T19:03:50.964 INFO:teuthology.orchestra.run.smithi012.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T19:03:50.966 INFO:teuthology.orchestra.run.smithi012.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-322-g7741f7f9-1jammy [67.8 kB] 2024-09-13T19:03:50.968 INFO:teuthology.orchestra.run.smithi012.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-322-g7741f7f9-1jammy [333 kB] 2024-09-13T19:03:50.974 INFO:teuthology.orchestra.run.smithi012.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T19:03:50.976 INFO:teuthology.orchestra.run.smithi012.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T19:03:50.977 INFO:teuthology.orchestra.run.smithi012.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T19:03:50.998 INFO:teuthology.orchestra.run.smithi012.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-322-g7741f7f9-1jammy [6,874 kB] 2024-09-13T19:03:51.251 INFO:teuthology.orchestra.run.smithi012.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-322-g7741f7f9-1jammy [112 kB] 2024-09-13T19:03:51.254 INFO:teuthology.orchestra.run.smithi012.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-322-g7741f7f9-1jammy [472 kB] 2024-09-13T19:03:51.264 INFO:teuthology.orchestra.run.smithi012.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-322-g7741f7f9-1jammy [25.9 MB] 2024-09-13T19:03:51.809 INFO:teuthology.orchestra.run.smithi151.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-322-g7741f7f9-1jammy [5,145 kB] 2024-09-13T19:03:51.888 INFO:teuthology.orchestra.run.smithi151.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-322-g7741f7f9-1jammy [245 kB] 2024-09-13T19:03:51.891 INFO:teuthology.orchestra.run.smithi151.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-322-g7741f7f9-1jammy [124 kB] 2024-09-13T19:03:51.892 INFO:teuthology.orchestra.run.smithi151.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-322-g7741f7f9-1jammy [1,555 kB] 2024-09-13T19:03:51.911 INFO:teuthology.orchestra.run.smithi151.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-322-g7741f7f9-1jammy [6,143 kB] 2024-09-13T19:03:52.072 INFO:teuthology.orchestra.run.smithi151.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-322-g7741f7f9-1jammy [22.8 MB] 2024-09-13T19:03:52.353 INFO:teuthology.orchestra.run.smithi012.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-322-g7741f7f9-1jammy [5,145 kB] 2024-09-13T19:03:52.517 INFO:teuthology.orchestra.run.smithi012.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-322-g7741f7f9-1jammy [245 kB] 2024-09-13T19:03:52.546 INFO:teuthology.orchestra.run.smithi012.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-322-g7741f7f9-1jammy [124 kB] 2024-09-13T19:03:52.549 INFO:teuthology.orchestra.run.smithi012.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-322-g7741f7f9-1jammy [1,555 kB] 2024-09-13T19:03:52.653 INFO:teuthology.orchestra.run.smithi012.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-322-g7741f7f9-1jammy [6,143 kB] 2024-09-13T19:03:52.761 INFO:teuthology.orchestra.run.smithi151.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-322-g7741f7f9-1jammy [14.1 kB] 2024-09-13T19:03:52.762 INFO:teuthology.orchestra.run.smithi151.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-322-g7741f7f9-1jammy [877 kB] 2024-09-13T19:03:52.777 INFO:teuthology.orchestra.run.smithi151.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-322-g7741f7f9-1jammy [2,462 kB] 2024-09-13T19:03:52.818 INFO:teuthology.orchestra.run.smithi151.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-322-g7741f7f9-1jammy [794 kB] 2024-09-13T19:03:52.824 INFO:teuthology.orchestra.run.smithi012.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-322-g7741f7f9-1jammy [22.8 MB] 2024-09-13T19:03:52.828 INFO:teuthology.orchestra.run.smithi151.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-322-g7741f7f9-1jammy [152 kB] 2024-09-13T19:03:52.830 INFO:teuthology.orchestra.run.smithi151.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-322-g7741f7f9-1jammy [2,275 kB] 2024-09-13T19:03:52.862 INFO:teuthology.orchestra.run.smithi151.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-322-g7741f7f9-1jammy [8,625 kB] 2024-09-13T19:03:53.098 INFO:teuthology.orchestra.run.smithi151.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-322-g7741f7f9-1jammy [14.2 kB] 2024-09-13T19:03:53.099 INFO:teuthology.orchestra.run.smithi151.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-322-g7741f7f9-1jammy [51.4 MB] 2024-09-13T19:03:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-322-g7741f7f9-1jammy [14.1 kB] 2024-09-13T19:03:53.774 INFO:teuthology.orchestra.run.smithi012.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-322-g7741f7f9-1jammy [877 kB] 2024-09-13T19:03:53.791 INFO:teuthology.orchestra.run.smithi012.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-322-g7741f7f9-1jammy [2,462 kB] 2024-09-13T19:03:53.835 INFO:teuthology.orchestra.run.smithi012.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-322-g7741f7f9-1jammy [794 kB] 2024-09-13T19:03:53.845 INFO:teuthology.orchestra.run.smithi012.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-322-g7741f7f9-1jammy [152 kB] 2024-09-13T19:03:53.847 INFO:teuthology.orchestra.run.smithi012.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-322-g7741f7f9-1jammy [2,275 kB] 2024-09-13T19:03:53.896 INFO:teuthology.orchestra.run.smithi012.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-322-g7741f7f9-1jammy [8,625 kB] 2024-09-13T19:03:54.189 INFO:teuthology.orchestra.run.smithi012.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-322-g7741f7f9-1jammy [14.2 kB] 2024-09-13T19:03:54.190 INFO:teuthology.orchestra.run.smithi012.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-322-g7741f7f9-1jammy [51.4 MB] 2024-09-13T19:03:54.991 INFO:teuthology.orchestra.run.smithi151.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-322-g7741f7f9-1jammy [130 kB] 2024-09-13T19:03:54.994 INFO:teuthology.orchestra.run.smithi151.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-322-g7741f7f9-1jammy [39.0 kB] 2024-09-13T19:03:54.995 INFO:teuthology.orchestra.run.smithi151.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-322-g7741f7f9-1jammy [13.6 MB] 2024-09-13T19:03:55.405 INFO:teuthology.orchestra.run.smithi151.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-322-g7741f7f9-1jammy [91.5 kB] 2024-09-13T19:03:55.755 INFO:teuthology.orchestra.run.smithi012.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-322-g7741f7f9-1jammy [130 kB] 2024-09-13T19:03:55.757 INFO:teuthology.orchestra.run.smithi012.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-322-g7741f7f9-1jammy [39.0 kB] 2024-09-13T19:03:55.758 INFO:teuthology.orchestra.run.smithi012.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-322-g7741f7f9-1jammy [13.6 MB] 2024-09-13T19:03:55.947 INFO:teuthology.orchestra.run.smithi012.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/7741f7f9ee20524f89b8f61d1609b32fb3b1570a/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-322-g7741f7f9-1jammy [91.5 kB] 2024-09-13T19:03:55.988 INFO:teuthology.orchestra.run.smithi151.stdout:Fetched 181 MB in 5s (35.3 MB/s) 2024-09-13T19:03:56.155 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T19:03:56.256 INFO:teuthology.orchestra.run.smithi151.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T19:03:56.262 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T19:03:56.346 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:03:56.549 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 181 MB in 6s (32.7 MB/s) 2024-09-13T19:03:56.633 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T19:03:56.659 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T19:03:56.691 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:03:56.715 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T19:03:56.817 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T19:03:56.822 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T19:03:56.905 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:03:57.037 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T19:03:57.063 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T19:03:57.104 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:03:57.242 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T19:03:57.269 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T19:03:57.308 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:03:57.533 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T19:03:57.559 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:57.607 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:57.645 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T19:03:57.671 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T19:03:57.711 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:03:58.003 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T19:03:58.030 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:58.081 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T19:03:58.108 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:58.173 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:58.407 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T19:03:58.433 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:58.490 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:58.585 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T19:03:58.611 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:58.651 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:58.828 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T19:03:58.844 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T19:03:58.877 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:03:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T19:03:59.022 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T19:03:59.062 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:03:59.173 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librados2. 2024-09-13T19:03:59.199 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../007-librados2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:03:59.239 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:03:59.373 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T19:03:59.389 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T19:03:59.432 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:03:59.693 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librbd1. 2024-09-13T19:03:59.719 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../008-librbd1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:03:59.759 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:03:59.776 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librados2. 2024-09-13T19:03:59.803 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../007-librados2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:03:59.843 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:00.171 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T19:04:00.198 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:00.229 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:00.296 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librbd1. 2024-09-13T19:04:00.323 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../008-librbd1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:00.362 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:00.524 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rados. 2024-09-13T19:04:00.539 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../010-python3-rados_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:00.582 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:00.782 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T19:04:00.808 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:00.848 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:00.903 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T19:04:00.929 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:00.969 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.109 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rados. 2024-09-13T19:04:01.125 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../010-python3-rados_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:01.167 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.214 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T19:04:01.240 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:01.272 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.487 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T19:04:01.514 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:01.553 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.567 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T19:04:01.593 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:01.634 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.806 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T19:04:01.832 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:01.872 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:01.963 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T19:04:01.989 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T19:04:02.029 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:04:02.184 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T19:04:02.210 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:02.275 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:02.350 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T19:04:02.376 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T19:04:02.423 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T19:04:02.678 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T19:04:02.693 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:02.736 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:02.787 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T19:04:02.814 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T19:04:02.853 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:04:03.082 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T19:04:03.108 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T19:04:03.122 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T19:04:03.139 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T19:04:03.148 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:04:03.172 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T19:04:03.425 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T19:04:03.426 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T19:04:03.441 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:03.441 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T19:04:03.484 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:03.484 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:04:03.755 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T19:04:03.773 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T19:04:03.828 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T19:04:03.855 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T19:04:03.895 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:04:03.930 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:04:04.172 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-13T19:04:04.199 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-13T19:04:04.239 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:04:04.301 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua5.1. 2024-09-13T19:04:04.327 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T19:04:04.367 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:04:04.517 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-13T19:04:04.533 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-13T19:04:04.567 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:04:04.671 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-any. 2024-09-13T19:04:04.686 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T19:04:04.729 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T19:04:04.887 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua5.1. 2024-09-13T19:04:04.913 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-13T19:04:04.953 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:04:04.982 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package zip. 2024-09-13T19:04:04.997 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T19:04:05.041 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T19:04:05.264 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-any. 2024-09-13T19:04:05.280 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-13T19:04:05.331 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-13T19:04:05.336 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package unzip. 2024-09-13T19:04:05.362 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T19:04:05.394 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:04:05.567 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package zip. 2024-09-13T19:04:05.583 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-13T19:04:05.617 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking zip (3.0-12build2) ... 2024-09-13T19:04:05.783 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package luarocks. 2024-09-13T19:04:05.809 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T19:04:05.849 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:04:05.912 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package unzip. 2024-09-13T19:04:05.939 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-13T19:04:05.978 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:04:06.238 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package librgw2. 2024-09-13T19:04:06.260 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../025-librgw2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:06.300 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:06.416 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package luarocks. 2024-09-13T19:04:06.443 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-13T19:04:06.482 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:04:06.845 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T19:04:06.860 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:06.865 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librgw2. 2024-09-13T19:04:06.892 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../025-librgw2_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:06.895 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:06.931 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:07.224 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T19:04:07.250 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T19:04:07.290 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:04:07.467 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T19:04:07.483 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T19:04:07.629 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:07.669 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:07.692 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:08.070 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T19:04:08.090 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-common. 2024-09-13T19:04:08.097 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T19:04:08.116 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../029-ceph-common_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:08.136 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:04:08.156 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:08.439 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T19:04:08.466 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:08.876 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-common. 2024-09-13T19:04:08.903 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../029-ceph-common_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:08.934 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:09.863 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-base. 2024-09-13T19:04:09.890 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../030-ceph-base_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:09.939 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:10.306 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-base. 2024-09-13T19:04:10.333 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../030-ceph-base_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:10.382 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:10.485 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T19:04:10.501 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T19:04:10.544 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:04:10.856 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T19:04:10.882 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T19:04:10.922 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:04:10.969 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T19:04:10.984 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T19:04:11.027 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:04:11.243 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T19:04:11.269 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T19:04:11.309 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:04:11.313 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T19:04:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T19:04:11.379 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:04:11.579 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T19:04:11.605 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T19:04:11.646 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:04:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T19:04:11.751 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T19:04:11.791 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:04:11.949 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T19:04:11.976 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T19:04:12.016 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:04:12.052 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T19:04:12.079 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T19:04:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:04:12.303 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T19:04:12.329 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T19:04:12.369 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T19:04:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T19:04:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T19:04:12.471 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:04:12.648 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-portend. 2024-09-13T19:04:12.674 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T19:04:12.715 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T19:04:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T19:04:12.793 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T19:04:12.832 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T19:04:13.018 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T19:04:13.044 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T19:04:13.085 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T19:04:13.260 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-portend. 2024-09-13T19:04:13.287 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-13T19:04:13.318 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T19:04:13.372 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T19:04:13.398 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T19:04:13.430 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:04:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T19:04:13.648 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T19:04:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T19:04:13.785 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T19:04:13.811 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T19:04:13.851 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T19:04:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T19:04:14.034 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T19:04:14.074 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:04:14.163 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T19:04:14.189 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T19:04:14.230 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T19:04:14.411 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T19:04:14.438 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T19:04:14.477 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T19:04:14.517 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T19:04:14.543 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T19:04:14.583 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:04:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T19:04:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T19:04:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T19:04:14.887 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-mako. 2024-09-13T19:04:14.913 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T19:04:14.945 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:04:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T19:04:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T19:04:15.191 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:04:15.268 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T19:04:15.283 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T19:04:15.318 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:04:15.477 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-mako. 2024-09-13T19:04:15.504 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T19:04:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:04:15.613 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T19:04:15.639 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T19:04:15.679 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:04:15.872 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T19:04:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T19:04:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:04:15.975 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webob. 2024-09-13T19:04:16.001 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T19:04:16.041 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:04:16.225 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T19:04:16.252 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T19:04:16.291 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:04:16.386 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T19:04:16.413 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T19:04:16.456 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:04:16.560 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webob. 2024-09-13T19:04:16.576 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T19:04:16.610 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:04:16.732 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T19:04:16.758 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T19:04:16.798 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:04:16.930 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T19:04:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T19:04:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:04:17.110 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-paste. 2024-09-13T19:04:17.137 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T19:04:17.177 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:04:17.308 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T19:04:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T19:04:17.374 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:04:17.464 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T19:04:17.479 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T19:04:17.514 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:04:17.661 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-paste. 2024-09-13T19:04:17.688 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T19:04:17.727 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:04:17.826 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T19:04:17.852 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T19:04:17.892 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:04:18.022 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T19:04:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T19:04:18.124 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:04:18.204 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T19:04:18.231 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T19:04:18.271 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T19:04:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T19:04:18.527 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T19:04:18.558 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T19:04:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:04:18.585 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T19:04:18.616 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:04:18.919 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T19:04:18.946 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T19:04:18.964 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T19:04:18.979 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T19:04:18.986 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T19:04:19.014 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T19:04:19.297 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T19:04:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T19:04:19.343 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-idna. 2024-09-13T19:04:19.363 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:04:19.369 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T19:04:19.409 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:04:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T19:04:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T19:04:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T19:04:19.930 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T19:04:19.956 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T19:04:19.996 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:04:20.113 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-idna. 2024-09-13T19:04:20.140 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T19:04:20.179 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:04:20.333 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests. 2024-09-13T19:04:20.360 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T19:04:20.400 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:04:20.449 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T19:04:20.476 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T19:04:20.515 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:04:20.670 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T19:04:20.685 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T19:04:20.720 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:04:20.844 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests. 2024-09-13T19:04:20.871 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T19:04:20.910 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:04:21.024 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T19:04:21.050 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:21.090 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:21.205 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T19:04:21.232 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T19:04:21.271 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:04:21.496 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T19:04:21.523 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:21.563 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:21.566 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T19:04:21.582 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:21.624 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:21.908 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T19:04:21.935 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T19:04:21.975 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:04:22.046 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T19:04:22.073 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:22.112 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:22.237 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T19:04:22.263 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T19:04:22.295 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T19:04:22.423 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T19:04:22.450 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T19:04:22.490 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:04:22.632 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T19:04:22.658 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:22.698 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:22.818 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T19:04:22.845 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T19:04:22.884 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T19:04:23.128 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T19:04:23.154 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:23.162 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T19:04:23.178 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:23.194 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:23.354 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:24.558 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T19:04:24.585 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:24.608 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T19:04:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:24.635 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:24.674 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:25.253 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T19:04:25.280 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:25.319 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:25.703 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph. 2024-09-13T19:04:25.719 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../066-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:25.761 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:26.039 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T19:04:26.055 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:26.089 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:26.422 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph. 2024-09-13T19:04:26.438 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../066-ceph_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:26.452 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T19:04:26.468 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:26.480 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:26.510 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:26.825 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T19:04:26.852 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:26.891 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package cephadm. 2024-09-13T19:04:26.941 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../069-cephadm_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:26.980 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:27.242 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T19:04:27.253 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T19:04:27.258 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T19:04:27.280 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:27.292 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T19:04:27.319 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:27.579 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T19:04:27.605 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:04:27.637 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:04:27.639 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephadm. 2024-09-13T19:04:27.655 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../069-cephadm_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:27.689 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:27.985 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T19:04:28.012 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T19:04:28.051 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T19:04:28.521 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T19:04:28.549 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:04:28.552 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-babel. 2024-09-13T19:04:28.579 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:04:28.587 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:04:28.618 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:04:28.930 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T19:04:28.956 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T19:04:28.996 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:04:29.342 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T19:04:29.369 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:29.424 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:29.651 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-babel. 2024-09-13T19:04:29.679 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T19:04:29.717 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:04:29.746 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T19:04:29.773 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T19:04:29.812 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T19:04:30.029 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T19:04:30.056 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T19:04:30.095 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:04:30.116 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-routes. 2024-09-13T19:04:30.143 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T19:04:30.322 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:04:30.448 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T19:04:30.476 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:30.515 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:30.686 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T19:04:30.713 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:30.753 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:30.835 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T19:04:30.851 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T19:04:30.910 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T19:04:31.179 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-routes. 2024-09-13T19:04:31.207 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T19:04:31.245 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:04:31.523 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T19:04:31.540 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:31.573 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:32.068 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T19:04:32.095 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T19:04:32.134 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:04:32.589 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T19:04:32.616 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T19:04:32.647 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:04:32.770 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T19:04:32.799 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T19:04:32.837 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:04:33.018 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T19:04:33.045 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T19:04:33.084 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:04:33.340 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T19:04:33.368 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T19:04:33.388 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T19:04:33.406 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:04:33.415 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T19:04:33.454 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:04:33.869 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T19:04:33.896 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T19:04:33.935 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:04:34.115 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T19:04:34.142 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:34.229 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T19:04:34.257 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T19:04:34.267 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:04:35.021 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T19:04:35.052 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:35.173 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:35.222 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T19:04:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T19:04:35.288 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T19:04:35.592 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T19:04:35.619 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T19:04:35.650 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:04:35.954 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T19:04:35.981 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T19:04:36.021 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:04:36.143 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T19:04:36.171 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T19:04:36.209 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T19:04:36.316 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T19:04:36.343 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T19:04:36.382 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T19:04:36.471 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T19:04:36.498 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T19:04:36.537 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:04:36.704 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T19:04:36.731 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T19:04:36.771 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T19:04:36.840 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T19:04:36.868 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T19:04:36.907 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:04:37.075 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T19:04:37.102 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T19:04:37.141 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:04:37.227 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T19:04:37.255 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-13T19:04:37.293 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T19:04:37.453 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T19:04:37.480 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T19:04:37.520 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T19:04:37.614 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T19:04:37.642 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T19:04:37.680 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T19:04:37.832 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T19:04:37.860 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T19:04:37.898 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:04:37.983 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T19:04:38.011 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T19:04:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:04:38.295 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T19:04:38.323 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T19:04:38.361 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T19:04:38.530 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T19:04:38.558 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:38.597 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:38.639 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T19:04:38.667 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T19:04:38.705 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:04:38.925 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T19:04:38.953 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T19:04:38.992 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:04:39.262 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T19:04:39.290 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:04:39.320 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:04:39.370 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T19:04:39.398 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:39.436 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:39.590 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package jq. 2024-09-13T19:04:39.606 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:04:39.649 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T19:04:39.756 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T19:04:39.785 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T19:04:39.822 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:04:39.902 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package socat. 2024-09-13T19:04:39.918 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T19:04:39.961 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:04:40.125 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T19:04:40.153 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:04:40.192 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:04:40.231 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T19:04:40.258 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T19:04:40.297 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:04:40.444 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package jq. 2024-09-13T19:04:40.461 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T19:04:40.502 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T19:04:40.721 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-test. 2024-09-13T19:04:40.738 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package socat. 2024-09-13T19:04:40.744 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../097-ceph-test_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:40.767 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T19:04:40.805 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:04:40.895 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:41.125 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T19:04:41.141 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T19:04:41.184 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:04:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-test. 2024-09-13T19:04:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../097-ceph-test_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:43.233 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T19:04:43.260 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:43.291 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:43.604 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T19:04:43.620 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:43.663 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:43.974 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T19:04:44.002 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T19:04:44.041 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:04:44.183 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T19:04:44.211 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-322-g7741f7f9-1jammy_all.deb ... 2024-09-13T19:04:44.249 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:44.338 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T19:04:44.366 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T19:04:44.404 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:04:44.553 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T19:04:44.581 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:44.620 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:44.776 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T19:04:44.803 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T19:04:44.842 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:04:44.931 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-13T19:04:44.959 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-13T19:04:45.022 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:04:45.310 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-13T19:04:45.327 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-13T19:04:45.360 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:04:45.374 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package pkg-config. 2024-09-13T19:04:45.402 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T19:04:45.432 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:04:45.688 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T19:04:45.702 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T19:04:45.722 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T19:04:45.744 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:04:45.750 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T19:04:45.789 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:04:46.186 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package pkg-config. 2024-09-13T19:04:46.189 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T19:04:46.214 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-13T19:04:46.217 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T19:04:46.244 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:04:46.256 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T19:04:46.480 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T19:04:46.497 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T19:04:46.538 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:04:46.543 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T19:04:46.570 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T19:04:46.609 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T19:04:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T19:04:46.921 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T19:04:46.955 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:04:46.958 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T19:04:46.986 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T19:04:47.024 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T19:04:47.259 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T19:04:47.286 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T19:04:47.325 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T19:04:47.352 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T19:04:47.381 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T19:04:47.418 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T19:04:47.679 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-py. 2024-09-13T19:04:47.706 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T19:04:47.739 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T19:04:47.745 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T19:04:47.767 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T19:04:47.805 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:04:48.075 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T19:04:48.102 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T19:04:48.116 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T19:04:48.141 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:04:48.145 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T19:04:48.191 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T19:04:48.511 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-py. 2024-09-13T19:04:48.540 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-13T19:04:48.577 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T19:04:48.580 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T19:04:48.607 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T19:04:48.638 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:04:48.881 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T19:04:48.909 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T19:04:48.924 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-toml. 2024-09-13T19:04:48.947 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:04:48.952 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T19:04:48.991 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T19:04:49.295 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T19:04:49.322 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T19:04:49.361 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:04:49.435 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T19:04:49.464 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T19:04:49.501 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:04:49.665 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T19:04:49.682 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T19:04:49.723 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:04:49.829 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-toml. 2024-09-13T19:04:49.858 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-13T19:04:49.895 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T19:04:49.960 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T19:04:49.976 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T19:04:50.009 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:04:50.249 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T19:04:50.277 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T19:04:50.314 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:04:50.669 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T19:04:50.697 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T19:04:50.731 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package radosgw. 2024-09-13T19:04:50.735 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:04:50.759 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../116-radosgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:50.798 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:51.012 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T19:04:51.029 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T19:04:51.070 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:04:51.727 INFO:teuthology.orchestra.run.smithi151.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T19:04:51.755 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:51.785 INFO:teuthology.orchestra.run.smithi151.stdout:Unpacking rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:51.791 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package radosgw. 2024-09-13T19:04:51.820 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../116-radosgw_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:51.857 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:52.092 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T19:04:52.342 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:04:52.468 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:04:52.694 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T19:04:52.711 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-322-g7741f7f9-1jammy_amd64.deb ... 2024-09-13T19:04:52.727 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T19:04:52.744 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:53.046 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T19:04:53.049 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T19:04:53.307 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T19:04:53.441 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T19:04:53.472 INFO:teuthology.orchestra.run.smithi151.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T19:04:53.553 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:53.698 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T19:04:54.022 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T19:04:54.153 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user cephadm....done 2024-09-13T19:04:54.326 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:04:54.457 INFO:teuthology.orchestra.run.smithi012.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T19:04:54.718 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:54.815 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:04:55.071 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:04:55.197 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:04:55.334 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user cephadm....done 2024-09-13T19:04:55.449 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T19:04:55.508 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T19:04:55.708 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:04:55.801 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T19:04:55.850 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T19:04:56.052 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T19:04:56.153 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T19:04:56.168 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:04:56.487 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T19:04:56.512 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T19:04:56.763 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T19:04:56.764 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T19:04:56.889 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T19:04:57.031 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:04:57.224 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T19:04:57.265 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:04:57.525 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:04:57.601 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T19:04:57.792 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:04:57.844 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T19:04:58.087 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-13T19:04:58.185 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:58.339 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T19:04:58.427 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:04:58.529 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:04:58.598 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T19:04:58.655 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:04:58.781 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:04:58.949 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T19:04:59.031 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:04:59.209 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-argparse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:04:59.427 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T19:04:59.454 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T19:04:59.460 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T19:04:59.510 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:04:59.585 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-13T19:04:59.619 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T19:04:59.686 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-13T19:04:59.812 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T19:04:59.978 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:05:00.072 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-13T19:05:00.104 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T19:05:00.372 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:05:00.456 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-13T19:05:00.479 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-13T19:05:00.542 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T19:05:00.631 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:05:00.651 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T19:05:00.933 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T19:05:01.019 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T19:05:01.050 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:05:01.145 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T19:05:01.421 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T19:05:01.697 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T19:05:02.007 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up zip (3.0-12build2) ... 2024-09-13T19:05:02.036 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:05:02.108 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T19:05:02.278 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:05:02.404 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:05:02.530 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:05:02.785 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T19:05:02.839 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T19:05:03.044 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T19:05:03.170 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T19:05:03.216 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T19:05:03.296 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T19:05:03.467 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:05:03.614 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T19:05:03.860 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:05:04.040 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T19:05:04.136 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:05:04.274 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T19:05:04.454 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:05:04.659 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T19:05:04.697 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:05:04.823 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:04.969 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T19:05:05.124 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:05:05.320 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T19:05:05.442 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:05:05.579 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T19:05:05.697 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:05.982 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T19:05:06.308 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T19:05:06.589 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:05:06.848 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:06.983 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T19:05:07.242 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:05:07.368 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:05:07.486 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:05:07.547 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-13T19:05:07.754 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:05:07.798 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:07.908 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T19:05:08.021 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T19:05:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T19:05:08.297 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:08.301 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T19:05:08.423 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:05:08.427 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T19:05:08.729 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T19:05:08.750 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:05:08.988 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T19:05:09.009 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T19:05:09.239 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:09.285 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T19:05:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T19:05:09.536 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:05:09.650 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T19:05:09.770 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T19:05:10.046 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:05:10.059 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T19:05:10.172 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T19:05:10.327 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T19:05:10.448 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:05:10.574 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:05:10.603 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T19:05:10.862 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T19:05:10.884 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:05:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T19:05:11.184 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:05:11.231 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T19:05:11.435 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:05:11.507 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T19:05:11.545 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:05:11.633 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T19:05:11.671 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:05:11.761 INFO:teuthology.orchestra.run.smithi151.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T19:05:11.926 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T19:05:12.014 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:05:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:05:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T19:05:12.487 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-13T19:05:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-13T19:05:12.708 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:05:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T19:05:12.836 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T19:05:12.967 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T19:05:13.082 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T19:05:13.085 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T19:05:13.192 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T19:05:13.336 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:13.445 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:05:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T19:05:13.772 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:05:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-13T19:05:13.970 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T19:05:14.072 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:05:14.230 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T19:05:14.339 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T19:05:14.365 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T19:05:14.483 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T19:05:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T19:05:14.758 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T19:05:14.941 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T19:05:15.027 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:05:15.226 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T19:05:15.348 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:05:15.352 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T19:05:15.628 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T19:05:15.739 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T19:05:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T19:05:16.032 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:05:16.284 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T19:05:16.376 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:05:16.503 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:16.637 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T19:05:16.763 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:05:16.962 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T19:05:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.200 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.301 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T19:05:17.315 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T19:05:17.416 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librados2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.534 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libsqlite3-mod-ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.577 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.660 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-13T19:05:17.695 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.821 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.042 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:05:18.042 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:05:18.122 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libradosstriper1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.248 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T19:05:18.490 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.533 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librbd1 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.607 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.659 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-modules-core (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.708 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:18.809 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:05:19.003 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:05:19.003 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T19:05:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs-dev (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:19.571 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rados (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:19.697 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librgw2 (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T19:05:19.929 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:20.055 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:20.181 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:20.441 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:20.941 INFO:teuthology.orchestra.run.smithi151.stdout:Adding group ceph....done 2024-09-13T19:05:21.085 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rbd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:21.211 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up rbd-fuse (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:21.327 INFO:teuthology.orchestra.run.smithi151.stdout:Adding system user ceph....done 2024-09-13T19:05:21.337 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:21.454 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cephfs (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:21.486 INFO:teuthology.orchestra.run.smithi151.stdout:Setting system user ceph properties....done 2024-09-13T19:05:21.505 INFO:teuthology.orchestra.run.smithi151.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T19:05:21.564 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-common (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:21.642 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T19:05:21.985 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T19:05:22.099 INFO:teuthology.orchestra.run.smithi012.stdout:Adding group ceph....done 2024-09-13T19:05:22.458 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:22.483 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user ceph....done 2024-09-13T19:05:22.576 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:22.651 INFO:teuthology.orchestra.run.smithi012.stdout:Setting system user ceph properties....done 2024-09-13T19:05:22.669 INFO:teuthology.orchestra.run.smithi012.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T19:05:22.822 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T19:05:23.043 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:05:23.043 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:05:23.142 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T19:05:23.511 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:23.615 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-test (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:23.754 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up radosgw (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:23.874 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T19:05:24.214 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:05:24.214 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T19:05:24.330 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:24.567 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:05:24.567 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:05:24.660 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-base (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:24.956 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:25.015 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T19:05:25.145 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:05:25.145 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:05:25.520 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mds (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:25.633 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:25.749 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:05:25.750 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T19:05:25.907 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:05:25.907 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:05:26.197 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:26.433 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:05:26.433 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T19:05:26.493 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:26.644 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:26.867 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:05:26.867 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:05:26.890 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-osd (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.185 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:05:27.185 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T19:05:27.329 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.472 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.598 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.658 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-k8sevents (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.732 INFO:teuthology.orchestra.run.smithi151.stdout:Setting up ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.784 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:27.935 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mon (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:28.110 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T19:05:28.153 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:05:28.153 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T19:05:28.202 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T19:05:28.355 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T19:05:28.645 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-cephadm (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:28.796 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:28.922 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-dashboard (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:29.073 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-volume (19.1.1-322-g7741f7f9-1jammy) ... 2024-09-13T19:05:29.443 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T19:05:29.472 INFO:teuthology.orchestra.run.smithi151.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T19:05:29.560 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T19:05:29.713 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T19:05:30.080 INFO:teuthology.orchestra.run.smithi151.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T19:05:30.088 DEBUG:teuthology.parallel:result is None 2024-09-13T19:05:30.864 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T19:05:31.532 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T19:05:31.538 DEBUG:teuthology.parallel:result is None 2024-09-13T19:05:31.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:05:31.685 DEBUG:teuthology.orchestra.run.smithi012:> dpkg-query -W -f '${Version}' ceph 2024-09-13T19:05:31.705 INFO:teuthology.orchestra.run.smithi012.stdout:19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:05:31.705 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:05:31.706 INFO:teuthology.task.install:The correct ceph version 19.1.1-322-g7741f7f9-1jammy is installed. 2024-09-13T19:05:31.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T19:05:31.847 DEBUG:teuthology.orchestra.run.smithi151:> dpkg-query -W -f '${Version}' ceph 2024-09-13T19:05:31.866 INFO:teuthology.orchestra.run.smithi151.stdout:19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:05:31.867 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-322-g7741f7f9-1jammy 2024-09-13T19:05:31.867 INFO:teuthology.task.install:The correct ceph version 19.1.1-322-g7741f7f9-1jammy is installed. 2024-09-13T19:05:31.869 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T19:05:31.869 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:31.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:05:31.884 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:31.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T19:05:31.921 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T19:05:31.921 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:31.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:05:31.940 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:05:31.994 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:31.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T19:05:32.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T19:05:32.059 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T19:05:32.060 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:32.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:05:32.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:05:32.126 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:32.126 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T19:05:32.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T19:05:32.191 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T19:05:32.192 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:32.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:05:32.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:05:32.259 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:32.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T19:05:32.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T19:05:32.328 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T19:05:32.405 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T19:05:32.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-09-13T19:05:32.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2024-09-13T19:05:32.420 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T19:05:32.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:05:32.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T19:05:32.476 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T19:05:32.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:05:32.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T19:05:32.541 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T19:05:32.541 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T19:05:32.541 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7904033', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-qa-rgw-squid-65651', 'sha1': '24ee2aeecf070bf47d80960334abd82047ad2def'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9887, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-qa-rgw-squid-65651', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_24ee2aeecf070bf47d80960334abd82047ad2def/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '24ee2aeecf070bf47d80960334abd82047ad2def', 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQmwGG69X21pkzpPbqrdoll2lwdo23tzUWRKNqceHUyIwTzcd9kXTMCD0tNu8jffPr6+sPQI2GPMWJIh0A3GP8=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKCGbwn5BRIgUQKlqGp+HSoXXDjZXmysnfpKt3W0BeYEg04dw5C8zydezTeI/rktuN3522DLSisUsQVlRhzSa4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_16:28:49', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T19:05:32.542 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:05:32.580 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T19:05:32.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:05:32.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T19:05:32.641 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:32.641 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:05:32.688 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:05:32.688 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-13 19:00:06.340508058 +0000 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-13 19:00:06.116510060 +0000 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-13 19:00:06.116510060 +0000 2024-09-13T19:05:32.736 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-13T19:05:32.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:05:32.790 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-13T19:05:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-13T19:05:32.791 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000380326 s, 1.3 MB/s 2024-09-13T19:05:32.792 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:05:32.841 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-09-13T19:05:32.887 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:05:32.887 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:32.887 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-13T19:05:32.888 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:32.888 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-13 19:00:06.852503485 +0000 2024-09-13T19:05:32.888 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-13 19:00:06.580505916 +0000 2024-09-13T19:05:32.888 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-13 19:00:06.580505916 +0000 2024-09-13T19:05:32.888 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-13T19:05:32.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:05:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-13T19:05:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-13T19:05:32.941 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00040359 s, 1.3 MB/s 2024-09-13T19:05:32.943 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:05:32.992 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-13 19:00:07.332499198 +0000 2024-09-13T19:05:33.039 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-13 19:00:07.068501556 +0000 2024-09-13T19:05:33.040 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-13 19:00:07.068501556 +0000 2024-09-13T19:05:33.040 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-13T19:05:33.040 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:05:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-13T19:05:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-13T19:05:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000417937 s, 1.2 MB/s 2024-09-13T19:05:33.096 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:05:33.145 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-09-13T19:05:33.191 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:05:33.191 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.191 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-13T19:05:33.191 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-09-13 19:00:07.552497233 +0000 2024-09-13T19:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-09-13 19:00:07.548497269 +0000 2024-09-13T19:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-09-13 19:00:07.548497269 +0000 2024-09-13T19:05:33.192 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2024-09-13T19:05:33.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:05:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-09-13T19:05:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-09-13T19:05:33.246 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000385294 s, 1.3 MB/s 2024-09-13T19:05:33.247 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:05:33.296 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:05:33.296 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:33.297 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T19:05:33.302 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T19:05:33.303 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-13 19:00:01.319513558 +0000 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-13 19:00:01.071515773 +0000 2024-09-13T19:05:33.349 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-13 19:00:01.071515773 +0000 2024-09-13T19:05:33.350 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-13T19:05:33.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T19:05:33.403 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-13T19:05:33.403 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-13T19:05:33.404 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000457416 s, 1.1 MB/s 2024-09-13T19:05:33.405 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T19:05:33.454 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-09-13T19:05:33.500 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-13 19:00:01.799509270 +0000 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-13 19:00:01.551511485 +0000 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-13 19:00:01.551511485 +0000 2024-09-13T19:05:33.501 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-13T19:05:33.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T19:05:33.554 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-13T19:05:33.554 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-13T19:05:33.555 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000451567 s, 1.1 MB/s 2024-09-13T19:05:33.556 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T19:05:33.605 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-13 19:00:02.263505126 +0000 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-13 19:00:02.031507198 +0000 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-13 19:00:02.031507198 +0000 2024-09-13T19:05:33.653 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-13T19:05:33.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T19:05:33.707 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-13T19:05:33.707 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-13T19:05:33.707 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000436273 s, 1.2 MB/s 2024-09-13T19:05:33.709 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T19:05:33.758 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-09-13 19:00:02.759500696 +0000 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-09-13 19:00:02.487503125 +0000 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-09-13 19:00:02.487503125 +0000 2024-09-13T19:05:33.805 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2024-09-13T19:05:33.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T19:05:33.859 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-09-13T19:05:33.859 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-09-13T19:05:33.859 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000386786 s, 1.3 MB/s 2024-09-13T19:05:33.860 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T19:05:33.910 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:05:33.910 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:05:33.910 INFO:tasks.ceph:Generating config... 2024-09-13T19:05:33.911 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T19:05:33.911 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-13T19:05:33.911 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-13T19:05:33.911 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-13T19:05:33.911 INFO:tasks.ceph:[client] setuser = ceph 2024-09-13T19:05:33.911 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T19:05:33.912 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T19:05:33.913 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T19:05:33.913 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T19:05:33.913 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T19:05:33.913 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T19:05:33.913 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T19:05:33.913 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T19:05:33.913 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T19:05:33.913 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T19:05:33.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T19:05:33.949 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T19:05:33.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T19:05:34.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:05:34.091 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12')] 2024-09-13T19:05:34.092 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-13T19:05:34.093 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:34.093 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:05:34.140 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:05:34.218 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 0ec6a80a-19c9-443d-b0bf-f69600ef4862 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 0ec6a80a-19c9-443d-b0bf-f69600ef4862 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-09-13T19:05:34.214019+0000 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-09-13T19:05:34.214019+0000 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-09-13T19:05:34.219 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-09-13T19:05:34.220 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T19:05:34.221 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T19:05:34.267 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ec6a80a-19c9-443d-b0bf-f69600ef4862... 2024-09-13T19:05:34.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:05:34.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T19:05:34.343 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2024-09-13T19:05:34.343 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2024-09-13T19:05:34.343 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2024-09-13T19:05:34.344 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.345 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:05:34.346 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = 172.21.15.12 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 0ec6a80a-19c9-443d-b0bf-f69600ef4862 2024-09-13T19:05:34.347 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2024-09-13T19:05:34.348 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2024-09-13T19:05:34.349 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug objclass = 20 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:05:34.350 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2024-09-13T19:05:34.351 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:05:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2024-09-13T19:05:34.353 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: rgw gc obj min wait = 15 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: debug rgw = 20 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: setgroup = ceph 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout: setuser = ceph 2024-09-13T19:05:34.354 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-09-13T19:05:34.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-09-13T19:05:34.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T19:05:34.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = 172.21.15.12 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 0ec6a80a-19c9-443d-b0bf-f69600ef4862 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.359 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-09-13T19:05:34.360 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-09-13T19:05:34.361 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: debug objclass = 20 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2024-09-13T19:05:34.362 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-09-13T19:05:34.363 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-09-13T19:05:34.364 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T19:05:34.365 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: rgw gc obj min wait = 15 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: debug rgw = 20 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: setgroup = ceph 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout: setuser = ceph 2024-09-13T19:05:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-09-13T19:05:34.368 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T19:05:34.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T19:05:34.447 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T19:05:34.448 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:34.448 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T19:05:34.453 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:34.453 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T19:05:34.499 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-09-13T19:05:34.499 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:34.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:05:34.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:05:34.565 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:34.565 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:34.611 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:05:34.611 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:34.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T19:05:34.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T19:05:34.633 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:34.633 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:34.681 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T19:05:34.681 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T19:05:34.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:05:34.765 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T19:05:34.777 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T19:05:34.777 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T19:05:34.777 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T19:05:34.853 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T19:05:34.864 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T19:05:34.864 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-13T19:05:34.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T19:05:34.879 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-13T19:05:34.879 INFO:tasks.ceph:role: osd.0 2024-09-13T19:05:34.879 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-13T19:05:34.879 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:05:34.943 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:05:34.943 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:05:34.943 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:05:34.943 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:05:34.944 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:05:35.433 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-09-13T19:05:35.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-09-13T19:05:35.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T19:05:35.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T19:05:35.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:05:35.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:35.700+0000 7fde2a4397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T19:05:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:35.700+0000 7fde2a4397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T19:05:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:35.700+0000 7fde2a4397c0 -1 bdev(0x562a992fb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-13T19:05:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:35.700+0000 7fde2a4397c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T19:05:38.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T19:05:38.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T19:05:38.888 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:05:38.888 INFO:tasks.ceph:role: osd.1 2024-09-13T19:05:38.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:05:38.889 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:05:38.952 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:05:39.404 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-13T19:05:39.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-13T19:05:39.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-13T19:05:39.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T19:05:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:05:39.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:39.512 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T19:05:39.566 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:05:39.566 INFO:tasks.ceph:role: osd.2 2024-09-13T19:05:39.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:05:39.566 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T19:05:39.628 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:05:39.629 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:05:40.093 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-13T19:05:40.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-13T19:05:40.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-13T19:05:40.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T19:05:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:05:40.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:40.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T19:05:40.308 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-13T19:05:40.308 INFO:tasks.ceph:role: osd.3 2024-09-13T19:05:40.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:05:40.309 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T19:05:40.372 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T19:05:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T19:05:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T19:05:40.372 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T19:05:40.372 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T19:05:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2024-09-13T19:05:40.373 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T19:05:40.373 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T19:05:40.373 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T19:05:40.373 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T19:05:40.850 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2024-09-13T19:05:40.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2024-09-13T19:05:40.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-13T19:05:40.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T19:05:40.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:05:40.994 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T19:05:40.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:41.103+0000 7f76ff2b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T19:05:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:41.103+0000 7f76ff2b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T19:05:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:41.103+0000 7f76ff2b77c0 -1 bdev(0x5568c9a61800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-13T19:05:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:41.103+0000 7f76ff2b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T19:05:44.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T19:05:44.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:44.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:44.375+0000 7fd9944ec7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T19:05:44.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:44.375+0000 7fd9944ec7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T19:05:44.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:44.375+0000 7fd9944ec7c0 -1 bdev(0x559cb5e7b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-13T19:05:44.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:44.379+0000 7fd9944ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T19:05:47.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T19:05:47.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:47.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:47.919+0000 7f9599a8b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T19:05:47.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:47.919+0000 7f9599a8b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T19:05:47.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:47.919+0000 7f9599a8b7c0 -1 bdev(0x55caeb5a9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-13T19:05:47.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:47.919+0000 7f9599a8b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T19:05:51.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T19:05:51.129 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T19:05:51.130 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:51.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T19:05:51.146 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:51.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T19:05:51.184 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:51.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T19:05:51.240 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:51.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T19:05:51.297 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:51.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T19:05:51.353 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:51.353 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T19:05:51.401 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T19:05:51.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD/jORmQT3wKRAAIiY8/9M/wRkyaCkPf4SVbA== 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD+jORmwBqpLRAAa9Er4YZjAIDdMdrLEfiR+A== 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAFjeRmTb1dBhAAz4NzrI7N8/Yz2HtU9HAB2A== 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAIjeRmhBSkFhAAl2PsWZVPDrukrsW7o9Sq6Q== 2024-09-13T19:05:51.414 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-09-13T19:05:51.415 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQALjeRm++8BNxAAVEkpzgpcjRajLkP6wb7qXg== 2024-09-13T19:05:51.415 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-09-13T19:05:51.415 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD+jORmzindMhAApWwIkHxPqz91Fm70f8GNLA== 2024-09-13T19:05:51.416 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:05:51.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T19:05:51.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:05:51.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:05:51.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T19:05:51.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T19:05:51.909 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T19:05:51.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T19:05:51.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T19:05:52.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T19:05:52.035 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T19:05:52.087 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T19:05:52.087 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T19:05:52.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T19:05:52.132 INFO:tasks.ceph.mon.a:Started 2024-09-13T19:05:52.133 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T19:05:52.133 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T19:05:52.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T19:05:52.135 INFO:tasks.ceph.mgr.x:Started 2024-09-13T19:05:52.136 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T19:05:52.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T19:05:52.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f523b516640 1 Processor -- start 2024-09-13T19:05:52.261 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f523b516640 1 -- start start 2024-09-13T19:05:52.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f523b516640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f523b516640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5234098d50 con 0x7f523412f1c0 2024-09-13T19:05:52.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f523b516640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f523406eba0 con 0x7f523412e6f0 2024-09-13T19:05:52.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42862/0 (socket says 172.21.15.12:42862) 2024-09-13T19:05:52.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 -- 172.21.15.12:0/2594352962 learned_addr learned my addr 172.21.15.12:0/2594352962 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:05:52.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 -- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 msgr2=0x7f523412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T19:05:52.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 -- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 msgr2=0x7f523412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T19:05:52.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 --2- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T19:05:52.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.252+0000 7f52392b2640 1 --2- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343210938 0 0) 0x7f5224001120 con 0x7f523412f1c0 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5220003530 con 0x7f523412f1c0 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1191016814 0 0) 0x7f5220003530 con 0x7f523412f1c0 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 msgr2=0x7f523412ec80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 --2- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523406ed60 con 0x7f523412f1c0 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1751275224 0 0) 0x7f5224001780 con 0x7f523412f1c0 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 >> v1:172.21.15.12:6789/0 conn(0x7f523412f1c0 legacy=0x7f523412b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 --2- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f5220003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.289 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5220004580 con 0x7f5220003a10 2024-09-13T19:05:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f52392b2640 1 --2- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f5220003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.280+0000 7f52392b2640 1 -- 172.21.15.12:0/2594352962 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5220003530 con 0x7f5220003a10 2024-09-13T19:05:52.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.296+0000 7f52392b2640 1 --2- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f5220003e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5230009810 tx=0x7f523001c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbfb0765cb66657 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.296+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f523000f040 con 0x7f5220003a10 2024-09-13T19:05:52.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.296+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52300a9560 con 0x7f5220003a10 2024-09-13T19:05:52.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.296+0000 7f522bfff640 1 -- 172.21.15.12:0/2594352962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52300a9880 con 0x7f5220003a10 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 msgr2=0x7f5220003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 --2- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f5220003e10 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5230009810 tx=0x7f523001c6b0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- 172.21.15.12:0/2594352962 shutdown_connections 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 --2- 172.21.15.12:0/2594352962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f5220003e10 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 --2- 172.21.15.12:0/2594352962 >> v2:172.21.15.12:3300/0 conn(0x7f523412e6f0 0x7f523412ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- 172.21.15.12:0/2594352962 >> 172.21.15.12:0/2594352962 conn(0x7f52340a1030 msgr2=0x7f52340a1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- 172.21.15.12:0/2594352962 shutdown_connections 2024-09-13T19:05:52.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- 172.21.15.12:0/2594352962 wait complete. 2024-09-13T19:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 Processor -- start 2024-09-13T19:05:52.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- start start 2024-09-13T19:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f523b516640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5234137490 con 0x7f5220003a10 2024-09-13T19:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f52392b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f52392b2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42878/0 (socket says 172.21.15.12:42878) 2024-09-13T19:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f52392b2640 1 -- 172.21.15.12:0/4247888258 learned_addr learned my addr 172.21.15.12:0/4247888258 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:05:52.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.300+0000 7f52392b2640 1 -- 172.21.15.12:0/4247888258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5234131f00 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f52392b2640 1 --2- 172.21.15.12:0/4247888258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f523001c6f0 tx=0x7f5220005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52300c1070 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523000f000 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5234133ef0 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52300bc5a0 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52341325e0 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52300c4070 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f52300b8030 con 0x7f5220003a10 2024-09-13T19:05:52.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.304+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523412ec80 con 0x7f5220003a10 2024-09-13T19:05:52.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.316+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f52300ad020 con 0x7f5220003a10 2024-09-13T19:05:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.380+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f523406e910 con 0x7f5220003a10 2024-09-13T19:05:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.380+0000 7f5229ffb640 1 -- 172.21.15.12:0/4247888258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f52300162a0 con 0x7f5220003a10 2024-09-13T19:05:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 msgr2=0x7f52340972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 --2- 172.21.15.12:0/4247888258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f523001c6f0 tx=0x7f5220005840 comp rx=0 tx=0).stop 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 shutdown_connections 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 --2- 172.21.15.12:0/4247888258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5220003a10 0x7f52340972f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 >> 172.21.15.12:0/4247888258 conn(0x7f52340a1030 msgr2=0x7f523409b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 shutdown_connections 2024-09-13T19:05:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:52.384+0000 7f523b516640 1 -- 172.21.15.12:0/4247888258 wait complete. 2024-09-13T19:05:52.409 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T19:05:52.409 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T19:05:52.409 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-09-13T19:05:52.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T19:05:52.421 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:52.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T19:05:52.435 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:52.435 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T19:05:52.488 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-09-13T19:05:52.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T19:05:52.501 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:52.499+0000 7f5465a31180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T19:05:52.512 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 6eb345cc-c71e-45dc-9a86-b90a714a9166 0 2024-09-13T19:05:52.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e34bcc640 1 Processor -- start 2024-09-13T19:05:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e34bcc640 1 -- start start 2024-09-13T19:05:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e34bcc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e30114c00 0x7f1e30114fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e34bcc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3010f950 con 0x7f1e3010ed90 2024-09-13T19:05:52.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e34bcc640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1e3010fb20 con 0x7f1e30114c00 2024-09-13T19:05:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e2e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e30114c00 0x7f1e30114fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e2e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e30114c00 0x7f1e30114fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51160/0 (socket says 172.21.15.151:51160) 2024-09-13T19:05:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e2e59c640 1 -- 172.21.15.151:0/385123887 learned_addr learned my addr 172.21.15.151:0/385123887 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e2e59c640 1 -- 172.21.15.151:0/385123887 >> v1:172.21.15.12:6789/0 conn(0x7f1e3010ed90 legacy=0x7f1e3010f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.675+0000 7f1e2e59c640 1 -- 172.21.15.151:0/385123887 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3011b930 con 0x7f1e30114c00 2024-09-13T19:05:52.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e2e59c640 1 --2- 172.21.15.151:0/385123887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30114c00 0x7f1e30114fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009e50 tx=0x7f1e2801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c248ffa783f7e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e2d59a640 1 -- 172.21.15.151:0/385123887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e28009200 con 0x7f1e30114c00 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e2d59a640 1 -- 172.21.15.151:0/385123887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e280a56d0 con 0x7f1e30114c00 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e2d59a640 1 -- 172.21.15.151:0/385123887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e280a59d0 con 0x7f1e30114c00 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- 172.21.15.151:0/385123887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30114c00 msgr2=0x7f1e30114fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 --2- 172.21.15.151:0/385123887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30114c00 0x7f1e30114fe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009e50 tx=0x7f1e2801c980 comp rx=0 tx=0).stop 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- 172.21.15.151:0/385123887 shutdown_connections 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 --2- 172.21.15.151:0/385123887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e30114c00 0x7f1e30114fe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- 172.21.15.151:0/385123887 >> 172.21.15.151:0/385123887 conn(0x7f1e3006fff0 msgr2=0x7f1e30072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- 172.21.15.151:0/385123887 shutdown_connections 2024-09-13T19:05:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- 172.21.15.151:0/385123887 wait complete. 2024-09-13T19:05:52.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 Processor -- start 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- start start 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.679+0000 7f1e34bcc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3011b5b0 con 0x7f1e3010ed90 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e2e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51162/0 (socket says 172.21.15.151:51162) 2024-09-13T19:05:52.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e2e59c640 1 -- 172.21.15.151:0/3877623594 learned_addr learned my addr 172.21.15.151:0/3877623594 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e2e59c640 1 -- 172.21.15.151:0/3877623594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e301af570 con 0x7f1e3010ed90 2024-09-13T19:05:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e2e59c640 1 --2- 172.21.15.151:0/3877623594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1e2801a5b0 tx=0x7f1e28019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e280bc020 con 0x7f1e3010ed90 2024-09-13T19:05:52.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e280078b0 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e301af7a0 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e28007bd0 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301a90c0 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e280bf020 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1e280b64d0 con 0x7f1e3010ed90 2024-09-13T19:05:52.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.683+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e30114c00 con 0x7f1e3010ed90 2024-09-13T19:05:52.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.691+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1e280c6030 con 0x7f1e3010ed90 2024-09-13T19:05:52.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.759+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6eb345cc-c71e-45dc-9a86-b90a714a9166", "id": 0} v 0) -- 0x7f1e30114e20 con 0x7f1e3010ed90 2024-09-13T19:05:52.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.759+0000 7f1e1effd640 1 -- 172.21.15.151:0/3877623594 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6eb345cc-c71e-45dc-9a86-b90a714a9166", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1e28016600 con 0x7f1e3010ed90 2024-09-13T19:05:52.764 INFO:teuthology.orchestra.run.smithi151.stdout:0 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 msgr2=0x7f1e301aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 --2- 172.21.15.151:0/3877623594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1e2801a5b0 tx=0x7f1e28019720 comp rx=0 tx=0).stop 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 shutdown_connections 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 --2- 172.21.15.151:0/3877623594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e3010ed90 0x7f1e301aefa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 >> 172.21.15.151:0/3877623594 conn(0x7f1e3006fff0 msgr2=0x7f1e3006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 shutdown_connections 2024-09-13T19:05:52.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.763+0000 7f1e34bcc640 1 -- 172.21.15.151:0/3877623594 wait complete. 2024-09-13T19:05:52.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 4214a92f-35bb-448a-8a0f-4e50ce770961 1 2024-09-13T19:05:52.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d9edb640 1 Processor -- start 2024-09-13T19:05:52.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d9edb640 1 -- start start 2024-09-13T19:05:52.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d9edb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9d4114c00 0x7ff9d4114fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d9edb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9d410f930 con 0x7ff9d410ed90 2024-09-13T19:05:52.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d9edb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff9d41156a0 con 0x7ff9d4114c00 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9d4114c00 0x7ff9d4114fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9d4114c00 0x7ff9d4114fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51164/0 (socket says 172.21.15.151:51164) 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d2ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff9d410ed90 0x7ff9d410f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:50758/0 (socket says 172.21.15.151:50758) 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 -- 172.21.15.151:0/4068716798 learned_addr learned my addr 172.21.15.151:0/4068716798 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 -- 172.21.15.151:0/4068716798 >> v1:172.21.15.12:6789/0 conn(0x7ff9d410ed90 legacy=0x7ff9d410f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 -- 172.21.15.151:0/4068716798 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d410fb00 con 0x7ff9d4114c00 2024-09-13T19:05:52.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.895+0000 7ff9d37fe640 1 --2- 172.21.15.151:0/4068716798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d4114c00 0x7ff9d4114fe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80097f0 tx=0x7ff9c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7284ed5b1fe5335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d27fc640 1 -- 172.21.15.151:0/4068716798 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c80ab580 con 0x7ff9d4114c00 2024-09-13T19:05:52.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d27fc640 1 -- 172.21.15.151:0/4068716798 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c80b0070 con 0x7ff9d4114c00 2024-09-13T19:05:52.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d27fc640 1 -- 172.21.15.151:0/4068716798 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c80ab870 con 0x7ff9d4114c00 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/4068716798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d4114c00 msgr2=0x7ff9d4114fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 --2- 172.21.15.151:0/4068716798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d4114c00 0x7ff9d4114fe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80097f0 tx=0x7ff9c801c430 comp rx=0 tx=0).stop 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/4068716798 shutdown_connections 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 --2- 172.21.15.151:0/4068716798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d4114c00 0x7ff9d4114fe0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/4068716798 >> 172.21.15.151:0/4068716798 conn(0x7ff9d4070080 msgr2=0x7ff9d40724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/4068716798 shutdown_connections 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/4068716798 wait complete. 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 Processor -- start 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- start start 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:52.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d411d6b0 con 0x7ff9d410ed90 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51174/0 (socket says 172.21.15.151:51174) 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d37fe640 1 -- 172.21.15.151:0/1731554638 learned_addr learned my addr 172.21.15.151:0/1731554638 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d37fe640 1 -- 172.21.15.151:0/1731554638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d41af4b0 con 0x7ff9d410ed90 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d37fe640 1 --2- 172.21.15.151:0/1731554638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9c801a060 tx=0x7ff9c80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c80aa8f0 con 0x7ff9d410ed90 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d41af6e0 con 0x7ff9d410ed90 2024-09-13T19:05:52.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c80aaa90 con 0x7ff9d410ed90 2024-09-13T19:05:52.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c80aad70 con 0x7ff9d410ed90 2024-09-13T19:05:52.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.899+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d41a8f80 con 0x7ff9d410ed90 2024-09-13T19:05:52.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.903+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff9c80bd020 con 0x7ff9d410ed90 2024-09-13T19:05:52.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.903+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ff9c80b5a30 con 0x7ff9d410ed90 2024-09-13T19:05:52.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.903+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d4114c00 con 0x7ff9d410ed90 2024-09-13T19:05:52.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.907+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff9c80160b0 con 0x7ff9d410ed90 2024-09-13T19:05:52.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.975+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4214a92f-35bb-448a-8a0f-4e50ce770961", "id": 1} v 0) -- 0x7ff9d4114dd0 con 0x7ff9d410ed90 2024-09-13T19:05:52.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9bbfff640 1 -- 172.21.15.151:0/1731554638 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4214a92f-35bb-448a-8a0f-4e50ce770961", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ff9c80b5c30 con 0x7ff9d410ed90 2024-09-13T19:05:52.982 INFO:teuthology.orchestra.run.smithi151.stdout:1 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 msgr2=0x7ff9d41aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 --2- 172.21.15.151:0/1731554638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9c801a060 tx=0x7ff9c80191d0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 shutdown_connections 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 --2- 172.21.15.151:0/1731554638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9d410ed90 0x7ff9d41aeee0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 >> 172.21.15.151:0/1731554638 conn(0x7ff9d4070080 msgr2=0x7ff9d4119d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:52.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 shutdown_connections 2024-09-13T19:05:52.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:52.979+0000 7ff9d9edb640 1 -- 172.21.15.151:0/1731554638 wait complete. 2024-09-13T19:05:52.992 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:52.991+0000 7f5465a31180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T19:05:52.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 4f5e1e40-7bab-4580-ba99-278403516cfa 2 2024-09-13T19:05:53.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc79de56640 1 Processor -- start 2024-09-13T19:05:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc79de56640 1 -- start start 2024-09-13T19:05:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc79de56640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc79810f4a0 0x7fc79811d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc79de56640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc79810f9e0 con 0x7fc798074000 2024-09-13T19:05:53.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc79de56640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc79810fbb0 con 0x7fc79810f4a0 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.111+0000 7fc796ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc79810f4a0 0x7fc79811d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc796ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc79810f4a0 0x7fc79811d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51178/0 (socket says 172.21.15.151:51178) 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc796ffd640 1 -- 172.21.15.151:0/303749574 learned_addr learned my addr 172.21.15.151:0/303749574 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc7977fe640 1 --1- 172.21.15.151:0/303749574 >> v1:172.21.15.12:6789/0 conn(0x7fc798074000 0x7fc79810ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:50768/0 (socket says 172.21.15.151:50768) 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc796ffd640 1 -- 172.21.15.151:0/303749574 >> v1:172.21.15.12:6789/0 conn(0x7fc798074000 legacy=0x7fc79810ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc7967fc640 1 -- 172.21.15.151:0/303749574 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168465125 0 0) 0x7fc79810f9e0 con 0x7fc798074000 2024-09-13T19:05:53.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc796ffd640 1 -- 172.21.15.151:0/303749574 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc79811ea60 con 0x7fc79810f4a0 2024-09-13T19:05:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc796ffd640 1 --2- 172.21.15.151:0/303749574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc79810f4a0 0x7fc79811d510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097f0 tx=0x7fc78c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcba22de8da9a45d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc7967fc640 1 -- 172.21.15.151:0/303749574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c0ab580 con 0x7fc79810f4a0 2024-09-13T19:05:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc7967fc640 1 -- 172.21.15.151:0/303749574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c0b0070 con 0x7fc79810f4a0 2024-09-13T19:05:53.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc7967fc640 1 -- 172.21.15.151:0/303749574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc78c0ab870 con 0x7fc79810f4a0 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 -- 172.21.15.151:0/303749574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc79810f4a0 msgr2=0x7fc79811d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 --2- 172.21.15.151:0/303749574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc79810f4a0 0x7fc79811d510 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097f0 tx=0x7fc78c01c430 comp rx=0 tx=0).stop 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 -- 172.21.15.151:0/303749574 shutdown_connections 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 --2- 172.21.15.151:0/303749574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc79810f4a0 0x7fc79811d510 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 -- 172.21.15.151:0/303749574 >> 172.21.15.151:0/303749574 conn(0x7fc79806f840 msgr2=0x7fc798071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 -- 172.21.15.151:0/303749574 shutdown_connections 2024-09-13T19:05:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.115+0000 7fc79de56640 1 -- 172.21.15.151:0/303749574 wait complete. 2024-09-13T19:05:53.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 Processor -- start 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 -- start start 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc79811e740 con 0x7fc798074000 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc7977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc7977fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51182/0 (socket says 172.21.15.151:51182) 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc7977fe640 1 -- 172.21.15.151:0/2334527415 learned_addr learned my addr 172.21.15.151:0/2334527415 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:53.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc7977fe640 1 -- 172.21.15.151:0/2334527415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7981af260 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc7977fe640 1 --2- 172.21.15.151:0/2334527415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c420 tx=0x7fc78800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc788018070 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7981af4f0 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7880074d0 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc788004960 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7981a8f80 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc78801b070 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc78801c3b0 con 0x7fc798074000 2024-09-13T19:05:53.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.119+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79810ed90 con 0x7fc798074000 2024-09-13T19:05:53.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.127+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc788022020 con 0x7fc798074000 2024-09-13T19:05:53.174 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.171+0000 7f5465a31180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T19:05:53.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.195+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4f5e1e40-7bab-4580-ba99-278403516cfa", "id": 2} v 0) -- 0x7fc7981af6c0 con 0x7fc798074000 2024-09-13T19:05:53.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc77ffff640 1 -- 172.21.15.151:0/2334527415 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4f5e1e40-7bab-4580-ba99-278403516cfa", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc788004b00 con 0x7fc798074000 2024-09-13T19:05:53.201 INFO:teuthology.orchestra.run.smithi151.stdout:2 2024-09-13T19:05:53.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 msgr2=0x7fc7981aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 --2- 172.21.15.151:0/2334527415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c420 tx=0x7fc78800c8e0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 shutdown_connections 2024-09-13T19:05:53.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 --2- 172.21.15.151:0/2334527415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc798074000 0x7fc7981aec90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 >> 172.21.15.151:0/2334527415 conn(0x7fc79806f840 msgr2=0x7fc798070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 shutdown_connections 2024-09-13T19:05:53.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.199+0000 7fc79de56640 1 -- 172.21.15.151:0/2334527415 wait complete. 2024-09-13T19:05:53.218 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new c07cde09-7729-4895-a716-4926f111d78b 3 2024-09-13T19:05:53.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a2dfcd640 1 Processor -- start 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a2dfcd640 1 -- start start 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a2dfcd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a281178f0 0x7f4a28119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a2dfcd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2811a310 con 0x7f4a28114c60 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a2dfcd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2811b510 con 0x7f4a281178f0 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a26ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a281178f0 0x7f4a28119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a277fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a28114c60 0x7f4a28115040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:50774/0 (socket says 172.21.15.151:50774) 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a277fe640 1 -- 172.21.15.151:0/2901643533 learned_addr learned my addr 172.21.15.151:0/2901643533 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a267fc640 1 -- 172.21.15.151:0/2901643533 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197233625 0 0) 0x7f4a2811a310 con 0x7f4a28114c60 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a267fc640 1 -- 172.21.15.151:0/2901643533 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a10003530 con 0x7f4a28114c60 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a26ffd640 1 -- 172.21.15.151:0/2901643533 >> v1:172.21.15.12:6789/0 conn(0x7f4a28114c60 legacy=0x7f4a28115040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.331+0000 7f4a26ffd640 1 -- 172.21.15.151:0/2901643533 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2811b6c0 con 0x7f4a281178f0 2024-09-13T19:05:53.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a26ffd640 1 --2- 172.21.15.151:0/2901643533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a281178f0 0x7f4a28119ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009740 tx=0x7f4a1c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d5fc9f7825e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a267fc640 1 -- 172.21.15.151:0/2901643533 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0b1070 con 0x7f4a281178f0 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a267fc640 1 -- 172.21.15.151:0/2901643533 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0ac520 con 0x7f4a281178f0 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a267fc640 1 -- 172.21.15.151:0/2901643533 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a1c0ac800 con 0x7f4a281178f0 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/2901643533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a281178f0 msgr2=0x7f4a28119ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 --2- 172.21.15.151:0/2901643533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a281178f0 0x7f4a28119ce0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009740 tx=0x7f4a1c01c370 comp rx=0 tx=0).stop 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/2901643533 shutdown_connections 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 --2- 172.21.15.151:0/2901643533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a281178f0 0x7f4a28119ce0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/2901643533 >> 172.21.15.151:0/2901643533 conn(0x7f4a28070090 msgr2=0x7f4a280724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/2901643533 shutdown_connections 2024-09-13T19:05:53.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/2901643533 wait complete. 2024-09-13T19:05:53.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 Processor -- start 2024-09-13T19:05:53.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- start start 2024-09-13T19:05:53.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.335+0000 7f4a2dfcd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2811b210 con 0x7f4a28114c60 2024-09-13T19:05:53.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a277fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51202/0 (socket says 172.21.15.151:51202) 2024-09-13T19:05:53.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a277fe640 1 -- 172.21.15.151:0/929849184 learned_addr learned my addr 172.21.15.151:0/929849184 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:05:53.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a277fe640 1 -- 172.21.15.151:0/929849184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a281af220 con 0x7f4a28114c60 2024-09-13T19:05:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a277fe640 1 --2- 172.21.15.151:0/929849184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c450 tx=0x7f4a1800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18017070 con 0x7f4a28114c60 2024-09-13T19:05:53.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a18005c20 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a281af4b0 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a18007070 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a281a8f40 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4a1801a070 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4a180076a0 con 0x7f4a28114c60 2024-09-13T19:05:53.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.339+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a28115040 con 0x7f4a28114c60 2024-09-13T19:05:53.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.347+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4a1801c440 con 0x7f4a28114c60 2024-09-13T19:05:53.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.411+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c07cde09-7729-4895-a716-4926f111d78b", "id": 3} v 0) -- 0x7f4a281af6e0 con 0x7f4a28114c60 2024-09-13T19:05:53.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a0ffff640 1 -- 172.21.15.151:0/929849184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c07cde09-7729-4895-a716-4926f111d78b", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4a1801cba0 con 0x7f4a28114c60 2024-09-13T19:05:53.418 INFO:teuthology.orchestra.run.smithi151.stdout:3 2024-09-13T19:05:53.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 msgr2=0x7f4a281aec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 --2- 172.21.15.151:0/929849184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800c450 tx=0x7f4a1800c910 comp rx=0 tx=0).stop 2024-09-13T19:05:53.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 shutdown_connections 2024-09-13T19:05:53.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 --2- 172.21.15.151:0/929849184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a28114c60 0x7f4a281aec50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 >> 172.21.15.151:0/929849184 conn(0x7f4a28070090 msgr2=0x7f4a2806c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 shutdown_connections 2024-09-13T19:05:53.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:05:53.415+0000 7f4a2dfcd640 1 -- 172.21.15.151:0/929849184 wait complete. 2024-09-13T19:05:53.434 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T19:05:53.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T19:05:53.438 INFO:tasks.ceph.osd.0:Started 2024-09-13T19:05:53.438 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T19:05:53.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T19:05:53.440 INFO:tasks.ceph.osd.1:Started 2024-09-13T19:05:53.440 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T19:05:53.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T19:05:53.442 INFO:tasks.ceph.osd.2:Started 2024-09-13T19:05:53.442 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T19:05:53.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T19:05:53.444 INFO:tasks.ceph.osd.3:Started 2024-09-13T19:05:53.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:05:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5f8e5640 1 Processor -- start 2024-09-13T19:05:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5f8e5640 1 -- start start 2024-09-13T19:05:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5f8e5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f5812bf80 0x7f7f581307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5f8e5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5812c390 con 0x7f7f5812b490 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5f8e5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5806d970 con 0x7f7f5812bf80 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5d681640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f5812b490 0x7f7f5812b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38992/0 (socket says 172.21.15.12:38992) 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5d681640 1 -- 172.21.15.12:0/3828743905 learned_addr learned my addr 172.21.15.12:0/3828743905 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5ce80640 1 --2- 172.21.15.12:0/3828743905 >> v2:172.21.15.12:3300/0 conn(0x7f7f5812bf80 0x7f7f581307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f4ffff640 1 -- 172.21.15.12:0/3828743905 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547226910 0 0) 0x7f7f5812c390 con 0x7f7f5812b490 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f4ffff640 1 -- 172.21.15.12:0/3828743905 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f44003530 con 0x7f7f5812b490 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5ce80640 1 -- 172.21.15.12:0/3828743905 >> v1:172.21.15.12:6789/0 conn(0x7f7f5812b490 legacy=0x7f7f5812b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.560+0000 7f7f5ce80640 1 -- 172.21.15.12:0/3828743905 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f58097d10 con 0x7f7f5812bf80 2024-09-13T19:05:53.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5ce80640 1 --2- 172.21.15.12:0/3828743905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812bf80 0x7f7f581307b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009740 tx=0x7f7f4801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e774a5f618a89aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4ffff640 1 -- 172.21.15.12:0/3828743905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f480b0070 con 0x7f7f5812bf80 2024-09-13T19:05:53.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4ffff640 1 -- 172.21.15.12:0/3828743905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f480ab530 con 0x7f7f5812bf80 2024-09-13T19:05:53.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4ffff640 1 -- 172.21.15.12:0/3828743905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f480ab830 con 0x7f7f5812bf80 2024-09-13T19:05:53.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/3828743905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812bf80 msgr2=0x7f7f581307b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 --2- 172.21.15.12:0/3828743905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812bf80 0x7f7f581307b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009740 tx=0x7f7f4801c370 comp rx=0 tx=0).stop 2024-09-13T19:05:53.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/3828743905 shutdown_connections 2024-09-13T19:05:53.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 --2- 172.21.15.12:0/3828743905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812bf80 0x7f7f581307b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/3828743905 >> 172.21.15.12:0/3828743905 conn(0x7f7f5809ab00 msgr2=0x7f7f5809af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/3828743905 shutdown_connections 2024-09-13T19:05:53.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/3828743905 wait complete. 2024-09-13T19:05:53.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 Processor -- start 2024-09-13T19:05:53.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- start start 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58133720 con 0x7f7f5812b490 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5d681640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5d681640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42920/0 (socket says 172.21.15.12:42920) 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5d681640 1 -- 172.21.15.12:0/4069378680 learned_addr learned my addr 172.21.15.12:0/4069378680 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5d681640 1 -- 172.21.15.12:0/4069378680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f580725d0 con 0x7f7f5812b490 2024-09-13T19:05:53.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5d681640 1 --2- 172.21.15.12:0/4069378680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c3a0 tx=0x7f7f5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f54017070 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f54005c20 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5812ffd0 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f540070d0 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f58123200 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7f5401a070 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f7f54012910 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.564+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f5812b870 con 0x7f7f5812b490 2024-09-13T19:05:53.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.568+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f7f54021070 con 0x7f7f5812b490 2024-09-13T19:05:53.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f58125cf0 con 0x7f7f5812b490 2024-09-13T19:05:53.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f4dffb640 1 -- 172.21.15.12:0/4069378680 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f7f54012d20 con 0x7f7f5812b490 2024-09-13T19:05:53.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:05:53.636 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:05:53.411410+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 msgr2=0x7f7f58122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 --2- 172.21.15.12:0/4069378680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c3a0 tx=0x7f7f5400c860 comp rx=0 tx=0).stop 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 shutdown_connections 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 --2- 172.21.15.12:0/4069378680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f5812b490 0x7f7f58122cc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 >> 172.21.15.12:0/4069378680 conn(0x7f7f5809ab00 msgr2=0x7f7f5806bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 shutdown_connections 2024-09-13T19:05:53.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:05:53.628+0000 7f7f5f8e5640 1 -- 172.21.15.12:0/4069378680 wait complete. 2024-09-13T19:05:53.654 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T19:05:53.654 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T19:05:53.762 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.759+0000 7f5465a31180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T19:05:53.816 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.811+0000 7f5465a31180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T19:05:53.868 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.867+0000 7f5465a31180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T19:05:53.945 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.943+0000 7f5465a31180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T19:05:53.996 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:53.995+0000 7f5465a31180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T19:05:54.057 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:05:54.072 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:54.071+0000 7f5465a31180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T19:05:54.125 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:54.123+0000 7f5465a31180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T19:05:54.183 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0c390640 1 Processor -- start 2024-09-13T19:05:54.183 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0c390640 1 -- start start 2024-09-13T19:05:54.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0c390640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e0412ad50 0x7f9e0412b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:54.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0c390640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e0412b670 con 0x7f9e04071da0 2024-09-13T19:05:54.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0c390640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9e04072890 con 0x7f9e0412ad50 2024-09-13T19:05:54.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0a12c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e0412ad50 0x7f9e0412b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:54.184 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0992b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e04071da0 0x7f9e04070410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39004/0 (socket says 172.21.15.12:39004) 2024-09-13T19:05:54.185 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0992b640 1 -- 172.21.15.12:0/544309372 learned_addr learned my addr 172.21.15.12:0/544309372 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:05:54.185 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0a12c640 1 -- 172.21.15.12:0/544309372 >> v1:172.21.15.12:6789/0 conn(0x7f9e04071da0 legacy=0x7f9e04070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:54.185 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0a12c640 1 -- 172.21.15.12:0/544309372 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0412b840 con 0x7f9e0412ad50 2024-09-13T19:05:54.185 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0912a640 1 -- 172.21.15.12:0/544309372 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275352724 0 0) 0x7f9e0412b670 con 0x7f9e04071da0 2024-09-13T19:05:54.186 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0a12c640 1 --2- 172.21.15.12:0/544309372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e0412ad50 0x7f9e0412b130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b9e0 tx=0x7f9e0001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf9213292011017 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:54.187 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0912a640 1 -- 172.21.15.12:0/544309372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e000b4070 con 0x7f9e0412ad50 2024-09-13T19:05:54.187 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0912a640 1 -- 172.21.15.12:0/544309372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e000a7960 con 0x7f9e0412ad50 2024-09-13T19:05:54.187 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.176+0000 7f9e0912a640 1 -- 172.21.15.12:0/544309372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e000a7c60 con 0x7f9e0412ad50 2024-09-13T19:05:54.189 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/544309372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e0412ad50 msgr2=0x7f9e0412b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:54.189 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 --2- 172.21.15.12:0/544309372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e0412ad50 0x7f9e0412b130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b9e0 tx=0x7f9e0001ea40 comp rx=0 tx=0).stop 2024-09-13T19:05:54.189 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/544309372 shutdown_connections 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 --2- 172.21.15.12:0/544309372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e0412ad50 0x7f9e0412b130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/544309372 >> 172.21.15.12:0/544309372 conn(0x7f9e0409db90 msgr2=0x7f9e04099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/544309372 shutdown_connections 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/544309372 wait complete. 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 Processor -- start 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- start start 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9e04071700 con 0x7f9e04071da0 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0a12c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0a12c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42944/0 (socket says 172.21.15.12:42944) 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0a12c640 1 -- 172.21.15.12:0/1916898793 learned_addr learned my addr 172.21.15.12:0/1916898793 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0a12c640 1 -- 172.21.15.12:0/1916898793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e04120120 con 0x7f9e04071da0 2024-09-13T19:05:54.190 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0a12c640 1 --2- 172.21.15.12:0/1916898793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e0001c670 tx=0x7f9e0001b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e000bf070 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e00004180 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e000b4040 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e041205e0 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e041c6aa0 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e000c2070 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9e00003b80 con 0x7f9e04071da0 2024-09-13T19:05:54.191 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.180+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e04120810 con 0x7f9e04071da0 2024-09-13T19:05:54.192 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.184+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9e000c9070 con 0x7f9e04071da0 2024-09-13T19:05:54.251 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e04075770 con 0x7f9e04071da0 2024-09-13T19:05:54.252 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9dfaffd640 1 -- 172.21.15.12:0/1916898793 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f9e000186c0 con 0x7f9e04071da0 2024-09-13T19:05:54.252 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-13T19:05:54.252 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":6,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:05:53.411410+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 msgr2=0x7f9e041c6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 --2- 172.21.15.12:0/1916898793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9e0001c670 tx=0x7f9e0001b7e0 comp rx=0 tx=0).stop 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 shutdown_connections 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 --2- 172.21.15.12:0/1916898793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e04071da0 0x7f9e041c6390 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 >> 172.21.15.12:0/1916898793 conn(0x7f9e0409db90 msgr2=0x7f9e0412ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:05:54.253 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 shutdown_connections 2024-09-13T19:05:54.254 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:05:54.244+0000 7f9e0c390640 1 -- 172.21.15.12:0/1916898793 wait complete. 2024-09-13T19:05:54.269 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:05:54.274 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:54.271+0000 7f5465a31180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T19:05:54.335 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:54.331+0000 7f5465a31180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T19:05:54.994 INFO:tasks.ceph.mgr.x.smithi151.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T19:05:54.994 INFO:tasks.ceph.mgr.x.smithi151.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T19:05:54.994 INFO:tasks.ceph.mgr.x.smithi151.stderr: from numpy import show_config as show_numpy_config 2024-09-13T19:05:55.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-13T19:05:54.992+0000 7f778a2927c0 -1 Falling back to public interface 2024-09-13T19:05:55.062 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:55.059+0000 7f5465a31180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T19:05:55.216 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:55.215+0000 7f5465a31180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:05:55.383 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:55.379+0000 7f5465a31180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T19:05:55.406 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-13T19:05:55.403+0000 7fb86a29f7c0 -1 Falling back to public interface 2024-09-13T19:05:55.446 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:55.443+0000 7f5465a31180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T19:05:55.562 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-13T19:05:55.559+0000 7fda769be7c0 -1 Falling back to public interface 2024-09-13T19:05:55.580 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:55.579+0000 7f5465a31180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T19:05:55.617 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-13T19:05:55.615+0000 7f506d1167c0 -1 Falling back to public interface 2024-09-13T19:05:56.188 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.183+0000 7f5465a31180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T19:05:56.263 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.259+0000 7f5465a31180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T19:05:56.445 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.443+0000 7f5465a31180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T19:05:56.518 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.515+0000 7f5465a31180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T19:05:56.808 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.803+0000 7f5465a31180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T19:05:56.870 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:56.867+0000 7f5465a31180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T19:05:57.904 INFO:tasks.ceph.mgr.x.smithi151.stderr:2024-09-13T19:05:57.903+0000 7f540c568640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T19:05:59.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-13T19:05:59.588+0000 7f778a2927c0 -1 osd.0 0 log_to_monitors true 2024-09-13T19:05:59.612 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-13T19:05:59.611+0000 7fb86a29f7c0 -1 osd.3 0 log_to_monitors true 2024-09-13T19:05:59.715 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-13T19:05:59.711+0000 7fda769be7c0 -1 osd.2 0 log_to_monitors true 2024-09-13T19:05:59.848 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-13T19:05:59.847+0000 7f506d1167c0 -1 osd.1 0 log_to_monitors true 2024-09-13T19:06:00.673 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:06:00.799 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2c668640 1 Processor -- start 2024-09-13T19:06:00.799 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2c668640 1 -- start start 2024-09-13T19:06:00.800 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2c668640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f24097780 0x7f4f24097b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:00.800 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2c668640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2409b440 con 0x7f4f2412e500 2024-09-13T19:06:00.800 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2c668640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4f2409af60 con 0x7f4f24097780 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2a404640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f24097780 0x7f4f24097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f29c03640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4f2412e500 0x7f4f2412e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46414/0 (socket says 172.21.15.12:46414) 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f29c03640 1 -- 172.21.15.12:0/2217784461 learned_addr learned my addr 172.21.15.12:0/2217784461 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f29402640 1 -- 172.21.15.12:0/2217784461 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764021031 0 0) 0x7f4f2409b440 con 0x7f4f2412e500 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f29402640 1 -- 172.21.15.12:0/2217784461 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f10003530 con 0x7f4f2412e500 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2a404640 1 -- 172.21.15.12:0/2217784461 >> v1:172.21.15.12:6789/0 conn(0x7f4f2412e500 legacy=0x7f4f2412e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:00.801 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.792+0000 7f4f2a404640 1 -- 172.21.15.12:0/2217784461 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f24098650 con 0x7f4f24097780 2024-09-13T19:06:00.804 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 --2- 172.21.15.12:0/2217784461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f24097b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009740 tx=0x7f4f2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0558cce1fcbd5cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:00.804 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f29402640 1 -- 172.21.15.12:0/2217784461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f200b0070 con 0x7f4f24097780 2024-09-13T19:06:00.804 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f29402640 1 -- 172.21.15.12:0/2217784461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200ab530 con 0x7f4f24097780 2024-09-13T19:06:00.804 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f29402640 1 -- 172.21.15.12:0/2217784461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f200ab830 con 0x7f4f24097780 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/2217784461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 msgr2=0x7f4f24097b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 --2- 172.21.15.12:0/2217784461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f24097b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009740 tx=0x7f4f2001c400 comp rx=0 tx=0).stop 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/2217784461 shutdown_connections 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 --2- 172.21.15.12:0/2217784461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f24097b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/2217784461 >> 172.21.15.12:0/2217784461 conn(0x7f4f240a0fd0 msgr2=0x7f4f240a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/2217784461 shutdown_connections 2024-09-13T19:06:00.805 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/2217784461 wait complete. 2024-09-13T19:06:00.806 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 Processor -- start 2024-09-13T19:06:00.806 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- start start 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4f241371d0 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37832/0 (socket says 172.21.15.12:37832) 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 -- 172.21.15.12:0/1410875040 learned_addr learned my addr 172.21.15.12:0/1410875040 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 -- 172.21.15.12:0/1410875040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2412acf0 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2a404640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4f2001a030 tx=0x7f4f200191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f200b0050 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f200b1040 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2406deb0 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.796+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f200b7580 con 0x7f4f24097780 2024-09-13T19:06:00.807 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f241c6a20 con 0x7f4f24097780 2024-09-13T19:06:00.808 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f2412b8b0 con 0x7f4f24097780 2024-09-13T19:06:00.808 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f4f200be030 con 0x7f4f24097780 2024-09-13T19:06:00.808 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f1affd640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 0x7f4f080381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:00.808 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1339+0+0 (secure 0 0 0) 0x7f4f200bc070 con 0x7f4f24097780 2024-09-13T19:06:00.808 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f29c03640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 0x7f4f080381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:00.809 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.800+0000 7f4f29c03640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 0x7f4f080381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007fd0 tx=0x7f4f14007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:00.813 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.804+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f200c5020 con 0x7f4f24097780 2024-09-13T19:06:00.983 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f2406dcb0 con 0x7f4f24097780 2024-09-13T19:06:00.983 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f1affd640 1 -- 172.21.15.12:0/1410875040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f4f20015ff0 con 0x7f4f24097780 2024-09-13T19:06:00.984 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-13T19:06:00.984 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":8,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:06:00.949629+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 msgr2=0x7f4f080381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 0x7f4f080381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4f14007fd0 tx=0x7f4f14007980 comp rx=0 tx=0).stop 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 msgr2=0x7f4f241c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4f2001a030 tx=0x7f4f200191a0 comp rx=0 tx=0).stop 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 shutdown_connections 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4f08035d20 0x7f4f080381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 --2- 172.21.15.12:0/1410875040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f24097780 0x7f4f241c64e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 >> 172.21.15.12:0/1410875040 conn(0x7f4f240a0fd0 msgr2=0x7f4f2409d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 shutdown_connections 2024-09-13T19:06:00.986 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:00.976+0000 7f4f2c668640 1 -- 172.21.15.12:0/1410875040 wait complete. 2024-09-13T19:06:01.003 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-13T19:06:02.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-13T19:06:02.004+0000 7f7785a18640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T19:06:02.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-09-13T19:06:02.024+0000 7f777e05f640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:06:02.738 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-13T19:06:02.735+0000 7fb866a5a640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T19:06:02.753 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-13T19:06:02.751+0000 7fda72144640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T19:06:02.756 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-13T19:06:02.755+0000 7f50698d1640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T19:06:02.777 INFO:tasks.ceph.osd.3.smithi151.stderr:2024-09-13T19:06:02.775+0000 7fb85e06c640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:06:02.797 INFO:tasks.ceph.osd.2.smithi151.stderr:2024-09-13T19:06:02.795+0000 7fda6a78b640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:06:02.813 INFO:tasks.ceph.osd.1.smithi151.stderr:2024-09-13T19:06:02.811+0000 7f5060ee3640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T19:06:07.407 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T19:06:07.534 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb34776640 1 Processor -- start 2024-09-13T19:06:07.534 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb34776640 1 -- start start 2024-09-13T19:06:07.534 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb34776640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb2c12ca90 0x7fbb2c12ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.534 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb34776640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2c09ece0 con 0x7fbb2c12d3b0 2024-09-13T19:06:07.535 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb34776640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbb2c09eff0 con 0x7fbb2c12ca90 2024-09-13T19:06:07.535 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb32512640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbb2c12ca90 0x7fbb2c12ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.536 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb31d11640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbb2c12d3b0 0x7fbb2c09ba20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34114/0 (socket says 172.21.15.12:34114) 2024-09-13T19:06:07.536 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.524+0000 7fbb31d11640 1 -- 172.21.15.12:0/840186809 learned_addr learned my addr 172.21.15.12:0/840186809 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:07.536 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.528+0000 7fbb32512640 1 -- 172.21.15.12:0/840186809 >> v1:172.21.15.12:6789/0 conn(0x7fbb2c12d3b0 legacy=0x7fbb2c09ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.536 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.528+0000 7fbb32512640 1 -- 172.21.15.12:0/840186809 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c09e2e0 con 0x7fbb2c12ca90 2024-09-13T19:06:07.537 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.528+0000 7fbb32512640 1 --2- 172.21.15.12:0/840186809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c12ce70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009740 tx=0x7fbb2801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41154bb8b5eb686 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.541 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb31510640 1 -- 172.21.15.12:0/840186809 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb280b0070 con 0x7fbb2c12ca90 2024-09-13T19:06:07.541 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb31510640 1 -- 172.21.15.12:0/840186809 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb280ab530 con 0x7fbb2c12ca90 2024-09-13T19:06:07.541 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb31510640 1 -- 172.21.15.12:0/840186809 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb280ab830 con 0x7fbb2c12ca90 2024-09-13T19:06:07.542 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 -- 172.21.15.12:0/840186809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 msgr2=0x7fbb2c12ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 --2- 172.21.15.12:0/840186809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c12ce70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009740 tx=0x7fbb2801c370 comp rx=0 tx=0).stop 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 -- 172.21.15.12:0/840186809 shutdown_connections 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 --2- 172.21.15.12:0/840186809 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c12ce70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 -- 172.21.15.12:0/840186809 >> 172.21.15.12:0/840186809 conn(0x7fbb2c0715b0 msgr2=0x7fbb2c0719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 -- 172.21.15.12:0/840186809 shutdown_connections 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.532+0000 7fbb34776640 1 -- 172.21.15.12:0/840186809 wait complete. 2024-09-13T19:06:07.543 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 Processor -- start 2024-09-13T19:06:07.544 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 -- start start 2024-09-13T19:06:07.544 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.544 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2c09ccd0 con 0x7fbb2c12ca90 2024-09-13T19:06:07.545 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb32512640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.545 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb32512640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42710/0 (socket says 172.21.15.12:42710) 2024-09-13T19:06:07.545 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb32512640 1 -- 172.21.15.12:0/4214240433 learned_addr learned my addr 172.21.15.12:0/4214240433 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:07.545 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb32512640 1 -- 172.21.15.12:0/4214240433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2c09f560 con 0x7fbb2c12ca90 2024-09-13T19:06:07.545 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb32512640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb28019fa0 tx=0x7fbb2801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.546 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb280b0050 con 0x7fbb2c12ca90 2024-09-13T19:06:07.546 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb280b1040 con 0x7fbb2c12ca90 2024-09-13T19:06:07.546 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2c11e580 con 0x7fbb2c12ca90 2024-09-13T19:06:07.546 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb280aab40 con 0x7fbb2c12ca90 2024-09-13T19:06:07.546 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb2c11ea10 con 0x7fbb2c12ca90 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2c12ce70 con 0x7fbb2c12ca90 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb280be030 con 0x7fbb2c12ca90 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 0x7fbb10038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.536+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fbb280bc070 con 0x7fbb2c12ca90 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.540+0000 7fbb31d11640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 0x7fbb10038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.547 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.540+0000 7fbb31d11640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 0x7fbb10038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005890 tx=0x7fbb1c007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.552 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.544+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbb280c5020 con 0x7fbb2c12ca90 2024-09-13T19:06:07.713 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.704+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb2c11c9c0 con 0x7fbb2c12ca90 2024-09-13T19:06:07.714 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.704+0000 7fbb22ffd640 1 -- 172.21.15.12:0/4214240433 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8011 (secure 0 0 0) 0x7fbb28015ff0 con 0x7fbb2c12ca90 2024-09-13T19:06:07.714 INFO:teuthology.misc.health.smithi012.stdout: 2024-09-13T19:06:07.715 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":13,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:06:07.028918+0000","last_up_change":"2024-09-13T19:06:03.013143+0000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:06:04.971530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6801","nonce":3844244554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6803","nonce":3844244554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6807","nonce":3844244554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6805","nonce":3844244554}]},"public_addr":"172.21.15.12:6801/3844244554","cluster_addr":"172.21.15.12:6803/3844244554","heartbeat_back_addr":"172.21.15.12:6807/3844244554","heartbeat_front_addr":"172.21.15.12:6805/3844244554","state":["exists","up"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6817","nonce":4016279334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6819","nonce":4016279334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6823","nonce":4016279334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6821","nonce":4016279334}]},"public_addr":"172.21.15.151:6817/4016279334","cluster_addr":"172.21.15.151:6819/4016279334","heartbeat_back_addr":"172.21.15.151:6823/4016279334","heartbeat_front_addr":"172.21.15.151:6821/4016279334","state":["exists","up"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6809","nonce":3546065622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6811","nonce":3546065622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6815","nonce":3546065622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6813","nonce":3546065622}]},"public_addr":"172.21.15.151:6809/3546065622","cluster_addr":"172.21.15.151:6811/3546065622","heartbeat_back_addr":"172.21.15.151:6815/3546065622","heartbeat_front_addr":"172.21.15.151:6813/3546065622","state":["exists","up"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6801","nonce":3085220080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6803","nonce":3085220080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6807","nonce":3085220080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6805","nonce":3085220080}]},"public_addr":"172.21.15.151:6801/3085220080","cluster_addr":"172.21.15.151:6803/3085220080","heartbeat_back_addr":"172.21.15.151:6807/3085220080","heartbeat_front_addr":"172.21.15.151:6805/3085220080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.627416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.890789+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.751149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.612481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:06:07.716 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 msgr2=0x7fbb10038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.716 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 0x7fbb10038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c005890 tx=0x7fbb1c007a90 comp rx=0 tx=0).stop 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 msgr2=0x7fbb2c11b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbb28019fa0 tx=0x7fbb2801abb0 comp rx=0 tx=0).stop 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 shutdown_connections 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbb10035db0 0x7fbb10038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 --2- 172.21.15.12:0/4214240433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbb2c12ca90 0x7fbb2c11b7c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 >> 172.21.15.12:0/4214240433 conn(0x7fbb2c0715b0 msgr2=0x7fbb2c131330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 shutdown_connections 2024-09-13T19:06:07.717 INFO:teuthology.misc.health.smithi012.stderr:2024-09-13T19:06:07.708+0000 7fbb34776640 1 -- 172.21.15.12:0/4214240433 wait complete. 2024-09-13T19:06:07.731 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-13T19:06:07.731 INFO:tasks.ceph:Creating RBD pool 2024-09-13T19:06:07.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-13T19:06:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd40a6640 1 Processor -- start 2024-09-13T19:06:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd40a6640 1 -- start start 2024-09-13T19:06:07.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd40a6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbcc12d160 0x7fcbcc1319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd40a6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbcc070d40 con 0x7fcbcc12c670 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd40a6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fcbcc12d570 con 0x7fcbcc12d160 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd1641640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbcc12d160 0x7fcbcc1319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd1e42640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcbcc12c670 0x7fcbcc12ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34128/0 (socket says 172.21.15.12:34128) 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd1e42640 1 -- 172.21.15.12:0/1803388994 learned_addr learned my addr 172.21.15.12:0/1803388994 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd1641640 1 -- 172.21.15.12:0/1803388994 >> v1:172.21.15.12:6789/0 conn(0x7fcbcc12c670 legacy=0x7fcbcc12ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.848+0000 7fcbd1641640 1 -- 172.21.15.12:0/1803388994 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc071420 con 0x7fcbcc12d160 2024-09-13T19:06:07.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd1641640 1 --2- 172.21.15.12:0/1803388994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12d160 0x7fcbcc1319f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009740 tx=0x7fcbc001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17b238f50cd7939 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd0e40640 1 -- 172.21.15.12:0/1803388994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc00b0070 con 0x7fcbcc12d160 2024-09-13T19:06:07.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd0e40640 1 -- 172.21.15.12:0/1803388994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc00ab530 con 0x7fcbcc12d160 2024-09-13T19:06:07.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd0e40640 1 -- 172.21.15.12:0/1803388994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc00ab830 con 0x7fcbcc12d160 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- 172.21.15.12:0/1803388994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12d160 msgr2=0x7fcbcc1319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/1803388994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12d160 0x7fcbcc1319f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0009740 tx=0x7fcbc001c370 comp rx=0 tx=0).stop 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- 172.21.15.12:0/1803388994 shutdown_connections 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/1803388994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12d160 0x7fcbcc1319f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- 172.21.15.12:0/1803388994 >> 172.21.15.12:0/1803388994 conn(0x7fcbcc09a8a0 msgr2=0x7fcbcc09acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- 172.21.15.12:0/1803388994 shutdown_connections 2024-09-13T19:06:07.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- 172.21.15.12:0/1803388994 wait complete. 2024-09-13T19:06:07.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 Processor -- start 2024-09-13T19:06:07.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.852+0000 7fcbd40a6640 1 -- start start 2024-09-13T19:06:07.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd40a6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd40a6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc134960 con 0x7fcbcc12c670 2024-09-13T19:06:07.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1e42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1e42640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42724/0 (socket says 172.21.15.12:42724) 2024-09-13T19:06:07.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1e42640 1 -- 172.21.15.12:0/2836213676 learned_addr learned my addr 172.21.15.12:0/2836213676 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1e42640 1 -- 172.21.15.12:0/2836213676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc1264b0 con 0x7fcbcc12c670 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1e42640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400cb20 tx=0x7fcbc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc4017070 con 0x7fcbcc12c670 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc400abf0 con 0x7fcbcc12c670 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbc4012400 con 0x7fcbcc12c670 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc06fe20 con 0x7fcbcc12c670 2024-09-13T19:06:07.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc06f190 con 0x7fcbcc12c670 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcbc401a070 con 0x7fcbcc12c670 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc12ca50 con 0x7fcbcc12c670 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 0x7fcbb8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fcbc4048260 con 0x7fcbcc12c670 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1641640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 0x7fcbb8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:07.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.856+0000 7fcbd1641640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 0x7fcbb8038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00ad000 tx=0x7fcbc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:07.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:07.860+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcbc40078c0 con 0x7fcbcc12c670 2024-09-13T19:06:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.028+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fcbcc126da0 con 0x7fcbcc12c670 2024-09-13T19:06:08.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbca7fc640 1 -- 172.21.15.12:0/2836213676 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7fcbc4007aa0 con 0x7fcbcc12c670 2024-09-13T19:06:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2024-09-13T19:06:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 msgr2=0x7fcbb8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 0x7fcbb8038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00ad000 tx=0x7fcbc0008040 comp rx=0 tx=0).stop 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 msgr2=0x7fcbcc06ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400cb20 tx=0x7fcbc400a060 comp rx=0 tx=0).stop 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 shutdown_connections 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcbb8035db0 0x7fcbb8038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 --2- 172.21.15.12:0/2836213676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbcc12c670 0x7fcbcc06ea80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 >> 172.21.15.12:0/2836213676 conn(0x7fcbcc09a8a0 msgr2=0x7fcbcc126fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 shutdown_connections 2024-09-13T19:06:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.200+0000 7fcbd40a6640 1 -- 172.21.15.12:0/2836213676 wait complete. 2024-09-13T19:06:08.235 DEBUG:teuthology.orchestra.run.smithi012:> rbd --cluster ceph pool init rbd 2024-09-13T19:06:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:08.297 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.288+0000 7f4f077bcf80 1 Processor -- start 2024-09-13T19:06:08.298 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.288+0000 7f4f077bcf80 1 -- start start 2024-09-13T19:06:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f077bcf80 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55795b7dcfa0 0x55795b7dd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f077bcf80 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55795b665ea0 con 0x55795b7dd8c0 2024-09-13T19:06:08.299 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f077bcf80 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55795b65ae20 con 0x55795b7dcfa0 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f062d0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55795b7dcfa0 0x55795b7dd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f05acf640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55795b7dd8c0 0x55795b873050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34144/0 (socket says 172.21.15.12:34144) 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f062d0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55795b7dcfa0 0x55795b7dd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42738/0 (socket says 172.21.15.12:42738) 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f05acf640 1 -- 172.21.15.12:0/457583781 learned_addr learned my addr 172.21.15.12:0/457583781 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f062d0640 1 -- 172.21.15.12:0/457583781 >> v1:172.21.15.12:6789/0 conn(0x55795b7dd8c0 legacy=0x55795b873050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:08.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f062d0640 1 -- 172.21.15.12:0/457583781 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55795b64c180 con 0x55795b7dcfa0 2024-09-13T19:06:08.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f052ce640 1 -- 172.21.15.12:0/457583781 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614794943 0 0) 0x55795b665ea0 con 0x55795b7dd8c0 2024-09-13T19:06:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f062d0640 1 --2- 172.21.15.12:0/457583781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b7dd380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800a4b0 tx=0x7f4ef801b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8b6554ff2888c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f052ce640 1 -- 172.21.15.12:0/457583781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef80af070 con 0x55795b7dcfa0 2024-09-13T19:06:08.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f052ce640 1 -- 172.21.15.12:0/457583781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef80aa530 con 0x55795b7dcfa0 2024-09-13T19:06:08.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.292+0000 7f4f052ce640 1 -- 172.21.15.12:0/457583781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef80aa830 con 0x55795b7dcfa0 2024-09-13T19:06:08.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/457583781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 msgr2=0x55795b7dd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:08.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/457583781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b7dd380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800a4b0 tx=0x7f4ef801b2d0 comp rx=0 tx=0).stop 2024-09-13T19:06:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/457583781 shutdown_connections 2024-09-13T19:06:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/457583781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b7dd380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/457583781 >> 172.21.15.12:0/457583781 conn(0x55795b7e5f50 msgr2=0x55795b7e2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/457583781 shutdown_connections 2024-09-13T19:06:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/457583781 wait complete. 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 Processor -- start 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- start start 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55795b6b1800 con 0x55795b7dcfa0 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f062d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f062d0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42742/0 (socket says 172.21.15.12:42742) 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f062d0640 1 -- 172.21.15.12:0/14840314 learned_addr learned my addr 172.21.15.12:0/14840314 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f062d0640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55795b636990 con 0x55795b7dcfa0 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f062d0640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80ad040 tx=0x7f4ef8018070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef80ba070 con 0x55795b7dcfa0 2024-09-13T19:06:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef80b5440 con 0x55795b7dcfa0 2024-09-13T19:06:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef80af040 con 0x55795b7dcfa0 2024-09-13T19:06:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55795b7df820 con 0x55795b7dcfa0 2024-09-13T19:06:08.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55795b860ba0 con 0x55795b7dcfa0 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.296+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ef80bd070 con 0x55795b7dcfa0 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.300+0000 7f4ef67fc640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 0x7f4ee8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.300+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f4ef80e2610 con 0x55795b7dcfa0 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.300+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55795b85e6d0 con 0x55795b7dcfa0 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.300+0000 7f4f05acf640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 0x7f4ee8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:08.300+0000 7f4f05acf640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 0x7f4ee8036bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4efc000c10 tx=0x7f4efc0013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.204+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x7f4ef8014ec0 con 0x55795b7dcfa0 2024-09-13T19:06:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.204+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ef80aa530 con 0x55795b7dcfa0 2024-09-13T19:06:09.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.204+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f4ef80c7710 con 0x55795b7dcfa0 2024-09-13T19:06:09.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.204+0000 7f4f04acd640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f4eec002af0 con 0x55795b7dcfa0 2024-09-13T19:06:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.208+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f4ef80bd520 con 0x55795b7dcfa0 2024-09-13T19:06:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.208+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 0x55795b885270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.208+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x55795b889bd0 con 0x55795b7dd8c0 2024-09-13T19:06:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.208+0000 7f4f07532640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 0x55795b885270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.208+0000 7f4f07532640 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 0x55795b885270 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.220+0000 7f4f07532640 1 -- 172.21.15.12:0/14840314 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f4f0000a4d0 con 0x55795b7dd8c0 2024-09-13T19:06:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.224+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55795b8db320 con 0x55795b7dd8c0 2024-09-13T19:06:09.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.224+0000 7f4f07532640 1 -- 172.21.15.12:0/14840314 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4f0000a4d0 con 0x55795b7dd8c0 2024-09-13T19:06:09.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.224+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x55795b8da430 con 0x55795b7dd8c0 2024-09-13T19:06:09.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.228+0000 7f4f07532640 1 -- 172.21.15.12:0/14840314 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4f0000a4d0 con 0x55795b7dd8c0 2024-09-13T19:06:09.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:09.228+0000 7f4ef7fff640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f4ee0001f10 con 0x55795b7dcfa0 2024-09-13T19:06:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.208+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f4ef80d9020 con 0x55795b7dcfa0 2024-09-13T19:06:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.208+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f4ee803a1f0 con 0x55795b7dcfa0 2024-09-13T19:06:10.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.208+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f4ef80bd780 con 0x55795b7dcfa0 2024-09-13T19:06:10.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.208+0000 7f4f04acd640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f4eec005690 con 0x55795b7dd8c0 2024-09-13T19:06:10.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.216+0000 7f4f07532640 1 -- 172.21.15.12:0/14840314 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4f0000a4d0 con 0x55795b7dd8c0 2024-09-13T19:06:10.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:10.216+0000 7f4ef7fff640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f4ee0003360 con 0x55795b7dcfa0 2024-09-13T19:06:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.212+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f4ef80b43e0 con 0x55795b7dcfa0 2024-09-13T19:06:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.212+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f4ee803a470 con 0x55795b7dcfa0 2024-09-13T19:06:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.212+0000 7f4ef67fc640 1 -- 172.21.15.12:0/14840314 <== mon.0 v2:172.21.15.12:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f4ef80e7020 con 0x55795b7dcfa0 2024-09-13T19:06:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.212+0000 7f4f04acd640 1 -- 172.21.15.12:0/14840314 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f4eec005a50 con 0x55795b7dd8c0 2024-09-13T19:06:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f07532640 1 -- 172.21.15.12:0/14840314 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f0000a4d0 con 0x55795b7dd8c0 2024-09-13T19:06:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 msgr2=0x55795b885270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 0x55795b885270 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 msgr2=0x7f4ee8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 0x7f4ee8036bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4efc000c10 tx=0x7f4efc0013c0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 msgr2=0x55795b85de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ef80ad040 tx=0x7f4ef8018070 comp rx=0 tx=0).stop 2024-09-13T19:06:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 shutdown_connections 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55795b7dd8c0 0x55795b885270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4ee80346f0 0x7f4ee8036bb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 --2- 172.21.15.12:0/14840314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55795b7dcfa0 0x55795b85de60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 >> 172.21.15.12:0/14840314 conn(0x55795b7e5f50 msgr2=0x55795b7e1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.220+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 shutdown_connections 2024-09-13T19:06:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.224+0000 7f4f077bcf80 1 -- 172.21.15.12:0/14840314 wait complete. 2024-09-13T19:06:11.237 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T19:06:11.237 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T19:06:11.237 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T19:06:11.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T19:06:11.238 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T19:06:11.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fad253640 1 Processor -- start 2024-09-13T19:06:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fad253640 1 -- start start 2024-09-13T19:06:11.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fad253640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9fa806dbd0 0x7f9fa8131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fad253640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fa8071c10 con 0x7f9fa806d0e0 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fad253640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f9fa8072230 con 0x7f9fa806dbd0 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fa659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9fa806dbd0 0x7f9fa8131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fa6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9fa806d0e0 0x7f9fa806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34160/0 (socket says 172.21.15.12:34160) 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fa6d9d640 1 -- 172.21.15.12:0/547439630 learned_addr learned my addr 172.21.15.12:0/547439630 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fa659c640 1 -- 172.21.15.12:0/547439630 >> v1:172.21.15.12:6789/0 conn(0x7f9fa806d0e0 legacy=0x7f9fa806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.360+0000 7f9fa659c640 1 -- 172.21.15.12:0/547439630 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa80709e0 con 0x7f9fa806dbd0 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa659c640 1 --2- 172.21.15.12:0/547439630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806dbd0 0x7f9fa8131e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009740 tx=0x7f9f9801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18ad4117ca99893 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa5d9b640 1 -- 172.21.15.12:0/547439630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f980b0070 con 0x7f9fa806dbd0 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa5d9b640 1 -- 172.21.15.12:0/547439630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f980ab530 con 0x7f9fa806dbd0 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa5d9b640 1 -- 172.21.15.12:0/547439630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f980ab830 con 0x7f9fa806dbd0 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- 172.21.15.12:0/547439630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806dbd0 msgr2=0x7f9fa8131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 --2- 172.21.15.12:0/547439630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806dbd0 0x7f9fa8131e60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009740 tx=0x7f9f9801c370 comp rx=0 tx=0).stop 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- 172.21.15.12:0/547439630 shutdown_connections 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 --2- 172.21.15.12:0/547439630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806dbd0 0x7f9fa8131e60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- 172.21.15.12:0/547439630 >> 172.21.15.12:0/547439630 conn(0x7f9fa8099a50 msgr2=0x7f9fa80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:11.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- 172.21.15.12:0/547439630 shutdown_connections 2024-09-13T19:06:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- 172.21.15.12:0/547439630 wait complete. 2024-09-13T19:06:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 Processor -- start 2024-09-13T19:06:11.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- start start 2024-09-13T19:06:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fad253640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8134d40 con 0x7f9fa806d0e0 2024-09-13T19:06:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.364+0000 7f9fa6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42766/0 (socket says 172.21.15.12:42766) 2024-09-13T19:06:11.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fa6d9d640 1 -- 172.21.15.12:0/1067877338 learned_addr learned my addr 172.21.15.12:0/1067877338 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fa6d9d640 1 -- 172.21.15.12:0/1067877338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa812a770 con 0x7f9fa806d0e0 2024-09-13T19:06:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fa6d9d640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c3a0 tx=0x7f9f9000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f90017070 con 0x7f9fa806d0e0 2024-09-13T19:06:11.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f90005c20 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa81291c0 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f900070d0 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa8129c70 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa806d4c0 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f9001a070 con 0x7f9fa806d0e0 2024-09-13T19:06:11.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 0x7f9f88038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f9f90047970 con 0x7f9fa806d0e0 2024-09-13T19:06:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fa659c640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 0x7f9f88038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.368+0000 7f9fa659c640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 0x7f9f88038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ad000 tx=0x7f9f980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.372+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9f90007270 con 0x7f9fa806d0e0 2024-09-13T19:06:11.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.576+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9fa8126d30 con 0x7f9fa806d0e0 2024-09-13T19:06:11.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.580+0000 7f9f9f7fe640 1 -- 172.21.15.12:0/1067877338 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84178 (secure 0 0 0) 0x7f9f90012400 con 0x7f9fa806d0e0 2024-09-13T19:06:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:11.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 msgr2=0x7f9f88038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 0x7f9f88038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9f980ad000 tx=0x7f9f980a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:11.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 msgr2=0x7f9fa8129730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f9000c3a0 tx=0x7f9f9000c860 comp rx=0 tx=0).stop 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 shutdown_connections 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9f88035db0 0x7f9f88038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 --2- 172.21.15.12:0/1067877338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa806d0e0 0x7f9fa8129730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 >> 172.21.15.12:0/1067877338 conn(0x7f9fa8099a50 msgr2=0x7f9fa809b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 shutdown_connections 2024-09-13T19:06:11.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.584+0000 7f9fad253640 1 -- 172.21.15.12:0/1067877338 wait complete. 2024-09-13T19:06:11.607 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3943350610},{"type":"v1","addr":"172.21.15.151:6825","nonce":3943350610}]},"active_addr":"172.21.15.151:6825/3943350610","active_change":"2024-09-13T19:05:56.885254+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1496912264}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":716333281}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":72447916}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1915676575}]}]} 2024-09-13T19:06:11.609 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T19:06:11.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T19:06:11.609 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:06:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.724+0000 7f6385c18640 1 Processor -- start 2024-09-13T19:06:11.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.724+0000 7f6385c18640 1 -- start start 2024-09-13T19:06:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.724+0000 7f6385c18640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f638012ed70 0x7f638012f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.724+0000 7f6385c18640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638006f8a0 con 0x7f638012f690 2024-09-13T19:06:11.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.724+0000 7f6385c18640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f638006eac0 con 0x7f638012ed70 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f638012f690 0x7f638006d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34172/0 (socket says 172.21.15.12:34172) 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637effd640 1 -- 172.21.15.12:0/1900059718 learned_addr learned my addr 172.21.15.12:0/1900059718 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637f7fe640 1 --2- 172.21.15.12:0/1900059718 >> v2:172.21.15.12:3300/0 conn(0x7f638012ed70 0x7f638012f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637e7fc640 1 -- 172.21.15.12:0/1900059718 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494759298 0 0) 0x7f638006f8a0 con 0x7f638012f690 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637e7fc640 1 -- 172.21.15.12:0/1900059718 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6368003530 con 0x7f638012f690 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637f7fe640 1 -- 172.21.15.12:0/1900059718 >> v1:172.21.15.12:6789/0 conn(0x7f638012f690 legacy=0x7f638006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637f7fe640 1 -- 172.21.15.12:0/1900059718 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638006fbb0 con 0x7f638012ed70 2024-09-13T19:06:11.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637f7fe640 1 --2- 172.21.15.12:0/1900059718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f638012f150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6370009740 tx=0x7f637001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41e5e5efb1499ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637e7fc640 1 -- 172.21.15.12:0/1900059718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63700b1070 con 0x7f638012ed70 2024-09-13T19:06:11.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637e7fc640 1 -- 172.21.15.12:0/1900059718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63700ac570 con 0x7f638012ed70 2024-09-13T19:06:11.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.728+0000 7f637e7fc640 1 -- 172.21.15.12:0/1900059718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63700ac870 con 0x7f638012ed70 2024-09-13T19:06:11.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/1900059718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 msgr2=0x7f638012f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 --2- 172.21.15.12:0/1900059718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f638012f150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6370009740 tx=0x7f637001c400 comp rx=0 tx=0).stop 2024-09-13T19:06:11.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/1900059718 shutdown_connections 2024-09-13T19:06:11.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 --2- 172.21.15.12:0/1900059718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f638012f150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/1900059718 >> 172.21.15.12:0/1900059718 conn(0x7f638009cd30 msgr2=0x7f638009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:11.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/1900059718 shutdown_connections 2024-09-13T19:06:11.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/1900059718 wait complete. 2024-09-13T19:06:11.741 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 Processor -- start 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- start start 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f638006e420 con 0x7f638012ed70 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f637f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f637f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42776/0 (socket says 172.21.15.12:42776) 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f637f7fe640 1 -- 172.21.15.12:0/4075888171 learned_addr learned my addr 172.21.15.12:0/4075888171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f637f7fe640 1 -- 172.21.15.12:0/4075888171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6380094cc0 con 0x7f638012ed70 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f637f7fe640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63700af040 tx=0x7f637001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63700b1050 con 0x7f638012ed70 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63700b2040 con 0x7f638012ed70 2024-09-13T19:06:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6380093fc0 con 0x7f638012ed70 2024-09-13T19:06:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63700aa9f0 con 0x7f638012ed70 2024-09-13T19:06:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63801c6270 con 0x7f638012ed70 2024-09-13T19:06:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6380095760 con 0x7f638012ed70 2024-09-13T19:06:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.732+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f63700bf030 con 0x7f638012ed70 2024-09-13T19:06:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.736+0000 7f6367fff640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 0x7f636c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.736+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f63700bd070 con 0x7f638012ed70 2024-09-13T19:06:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.736+0000 7f637effd640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 0x7f636c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.736+0000 7f637effd640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 0x7f636c038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6374007fd0 tx=0x7f6374007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.740+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63700c6060 con 0x7f638012ed70 2024-09-13T19:06:11.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.904+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6380093b20 con 0x7f638012ed70 2024-09-13T19:06:11.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6367fff640 1 -- 172.21.15.12:0/4075888171 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9911 (secure 0 0 0) 0x7f6370015ff0 con 0x7f638012ed70 2024-09-13T19:06:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:11.916 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:06:11.208686+0000","last_up_change":"2024-09-13T19:06:03.013143+0000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:06:04.971530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:06:08.067884+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6801","nonce":3844244554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6803","nonce":3844244554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6807","nonce":3844244554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6805","nonce":3844244554}]},"public_addr":"172.21.15.12:6801/3844244554","cluster_addr":"172.21.15.12:6803/3844244554","heartbeat_back_addr":"172.21.15.12:6807/3844244554","heartbeat_front_addr":"172.21.15.12:6805/3844244554","state":["exists","up"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6817","nonce":4016279334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6819","nonce":4016279334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6823","nonce":4016279334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6821","nonce":4016279334}]},"public_addr":"172.21.15.151:6817/4016279334","cluster_addr":"172.21.15.151:6819/4016279334","heartbeat_back_addr":"172.21.15.151:6823/4016279334","heartbeat_front_addr":"172.21.15.151:6821/4016279334","state":["exists","up"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6809","nonce":3546065622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6811","nonce":3546065622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6815","nonce":3546065622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6813","nonce":3546065622}]},"public_addr":"172.21.15.151:6809/3546065622","cluster_addr":"172.21.15.151:6811/3546065622","heartbeat_back_addr":"172.21.15.151:6815/3546065622","heartbeat_front_addr":"172.21.15.151:6813/3546065622","state":["exists","up"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6801","nonce":3085220080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6803","nonce":3085220080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6807","nonce":3085220080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6805","nonce":3085220080}]},"public_addr":"172.21.15.151:6801/3085220080","cluster_addr":"172.21.15.151:6803/3085220080","heartbeat_back_addr":"172.21.15.151:6807/3085220080","heartbeat_front_addr":"172.21.15.151:6805/3085220080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.627416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.890789+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.751149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.612481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 msgr2=0x7f636c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 0x7f636c038270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6374007fd0 tx=0x7f6374007980 comp rx=0 tx=0).stop 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 msgr2=0x7f63801c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f63700af040 tx=0x7f637001ac40 comp rx=0 tx=0).stop 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 shutdown_connections 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f636c035db0 0x7f636c038270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 --2- 172.21.15.12:0/4075888171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f638012ed70 0x7f63801c5d30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 >> 172.21.15.12:0/4075888171 conn(0x7f638009cd30 msgr2=0x7f6380099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 shutdown_connections 2024-09-13T19:06:11.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:11.908+0000 7f6385c18640 1 -- 172.21.15.12:0/4075888171 wait complete. 2024-09-13T19:06:11.935 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T19:06:11.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:06:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7f017f0640 1 Processor -- start 2024-09-13T19:06:12.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7f017f0640 1 -- start start 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7f017f0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7efc06d0e0 0x7f7efc06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7f017f0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7efc071c10 con 0x7f7efc06da00 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7f017f0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7efc072230 con 0x7f7efc06d0e0 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efaffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7efc06d0e0 0x7f7efc06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efa7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7efc06da00 0x7f7efc12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34178/0 (socket says 172.21.15.12:34178) 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efa7fc640 1 -- 172.21.15.12:0/994667873 learned_addr learned my addr 172.21.15.12:0/994667873 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efaffd640 1 -- 172.21.15.12:0/994667873 >> v1:172.21.15.12:6789/0 conn(0x7f7efc06da00 legacy=0x7f7efc12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efaffd640 1 -- 172.21.15.12:0/994667873 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc0709e0 con 0x7f7efc06d0e0 2024-09-13T19:06:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7efaffd640 1 --2- 172.21.15.12:0/994667873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc06d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009740 tx=0x7f7eec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d7b8788bc5ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7ef9ffb640 1 -- 172.21.15.12:0/994667873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0b0070 con 0x7f7efc06d0e0 2024-09-13T19:06:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7ef9ffb640 1 -- 172.21.15.12:0/994667873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec0ab530 con 0x7f7efc06d0e0 2024-09-13T19:06:12.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.044+0000 7f7ef9ffb640 1 -- 172.21.15.12:0/994667873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0ab830 con 0x7f7efc06d0e0 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/994667873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 msgr2=0x7f7efc06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 --2- 172.21.15.12:0/994667873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc06d4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7eec009740 tx=0x7f7eec01c370 comp rx=0 tx=0).stop 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/994667873 shutdown_connections 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 --2- 172.21.15.12:0/994667873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc06d4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/994667873 >> 172.21.15.12:0/994667873 conn(0x7f7efc099a50 msgr2=0x7f7efc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/994667873 shutdown_connections 2024-09-13T19:06:12.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/994667873 wait complete. 2024-09-13T19:06:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 Processor -- start 2024-09-13T19:06:12.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- start start 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc134e80 con 0x7f7efc06d0e0 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7efaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42808/0 (socket says 172.21.15.12:42808) 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7efaffd640 1 -- 172.21.15.12:0/309243545 learned_addr learned my addr 172.21.15.12:0/309243545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7efaffd640 1 -- 172.21.15.12:0/309243545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc12bfc0 con 0x7f7efc06d0e0 2024-09-13T19:06:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7efaffd640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0ae040 tx=0x7f7eec01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0b0050 con 0x7f7efc06d0e0 2024-09-13T19:06:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc06f660 con 0x7f7efc06d0e0 2024-09-13T19:06:12.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eec0b1040 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0b5780 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.048+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1c68a0 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7eec0be030 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7ee37fe640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 0x7f7ee8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc06d4c0 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f7eec0bc070 con 0x7f7efc06d0e0 2024-09-13T19:06:12.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7efa7fc640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 0x7f7ee8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.052+0000 7f7efa7fc640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 0x7f7ee8038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0001610 tx=0x7f7ef0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.056+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7eec0c5060 con 0x7f7efc06d0e0 2024-09-13T19:06:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.216+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7efc073790 con 0x7f7efc06d0e0 2024-09-13T19:06:12.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.216+0000 7f7ee37fe640 1 -- 172.21.15.12:0/309243545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9911 (secure 0 0 0) 0x7f7eec015ff0 con 0x7f7efc06d0e0 2024-09-13T19:06:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:12.225 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:06:11.208686+0000","last_up_change":"2024-09-13T19:06:03.013143+0000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:06:04.971530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:06:08.067884+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6801","nonce":3844244554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6803","nonce":3844244554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6807","nonce":3844244554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6805","nonce":3844244554}]},"public_addr":"172.21.15.12:6801/3844244554","cluster_addr":"172.21.15.12:6803/3844244554","heartbeat_back_addr":"172.21.15.12:6807/3844244554","heartbeat_front_addr":"172.21.15.12:6805/3844244554","state":["exists","up"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6817","nonce":4016279334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6819","nonce":4016279334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6823","nonce":4016279334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6821","nonce":4016279334}]},"public_addr":"172.21.15.151:6817/4016279334","cluster_addr":"172.21.15.151:6819/4016279334","heartbeat_back_addr":"172.21.15.151:6823/4016279334","heartbeat_front_addr":"172.21.15.151:6821/4016279334","state":["exists","up"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6809","nonce":3546065622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6811","nonce":3546065622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6815","nonce":3546065622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6813","nonce":3546065622}]},"public_addr":"172.21.15.151:6809/3546065622","cluster_addr":"172.21.15.151:6811/3546065622","heartbeat_back_addr":"172.21.15.151:6815/3546065622","heartbeat_front_addr":"172.21.15.151:6813/3546065622","state":["exists","up"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6801","nonce":3085220080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6803","nonce":3085220080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6807","nonce":3085220080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6805","nonce":3085220080}]},"public_addr":"172.21.15.151:6801/3085220080","cluster_addr":"172.21.15.151:6803/3085220080","heartbeat_back_addr":"172.21.15.151:6807/3085220080","heartbeat_front_addr":"172.21.15.151:6805/3085220080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.627416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.890789+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.751149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.612481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:06:12.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 msgr2=0x7f7ee8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 0x7f7ee8038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0001610 tx=0x7f7ef0007ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 msgr2=0x7f7efc1c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0ae040 tx=0x7f7eec01abb0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 shutdown_connections 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ee8035d60 0x7f7ee8038220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 --2- 172.21.15.12:0/309243545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7efc06d0e0 0x7f7efc1c6360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 >> 172.21.15.12:0/309243545 conn(0x7f7efc099a50 msgr2=0x7f7efc09b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 shutdown_connections 2024-09-13T19:06:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.220+0000 7f7f017f0640 1 -- 172.21.15.12:0/309243545 wait complete. 2024-09-13T19:06:12.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T19:06:12.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T19:06:12.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T19:06:12.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T19:06:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277b77e640 1 Processor -- start 2024-09-13T19:06:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f515802c640 1 Processor -- start 2024-09-13T19:06:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277b77e640 1 -- start start 2024-09-13T19:06:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f515802c640 1 -- start start 2024-09-13T19:06:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277b77e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f277412e760 0x7f277412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f515802c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5150096520 0x7f5150096900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f515802c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5150098420 con 0x7f5150096e40 2024-09-13T19:06:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277b77e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27740984f0 con 0x7f277412f1c0 2024-09-13T19:06:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277b77e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2774098dc0 con 0x7f277412e760 2024-09-13T19:06:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f515802c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f51500989e0 con 0x7f5150096520 2024-09-13T19:06:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f5155dc8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5150096520 0x7f5150096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f5155dc8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5150096520 0x7f5150096900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42820/0 (socket says 172.21.15.12:42820) 2024-09-13T19:06:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f5155dc8640 1 -- 172.21.15.12:0/164740066 learned_addr learned my addr 172.21.15.12:0/164740066 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f2778d19640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f277412f1c0 0x7f277412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34184/0 (socket says 172.21.15.12:34184) 2024-09-13T19:06:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f2778d19640 1 -- 172.21.15.12:0/3037587965 learned_addr learned my addr 172.21.15.12:0/3037587965 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.340+0000 7f277951a640 1 --2- 172.21.15.12:0/3037587965 >> v2:172.21.15.12:3300/0 conn(0x7f277412e760 0x7f277412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5155dc8640 1 -- 172.21.15.12:0/164740066 >> v1:172.21.15.12:6789/0 conn(0x7f5150096e40 legacy=0x7f515012c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T19:06:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5155dc8640 1 -- 172.21.15.12:0/164740066 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51500972a0 con 0x7f5150096520 2024-09-13T19:06:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277951a640 1 -- 172.21.15.12:0/3037587965 >> v1:172.21.15.12:6789/0 conn(0x7f277412f1c0 legacy=0x7f277412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277951a640 1 -- 172.21.15.12:0/3037587965 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277412f5a0 con 0x7f277412e760 2024-09-13T19:06:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277951a640 1 --2- 172.21.15.12:0/3037587965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277412ec80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2770009740 tx=0x7f277001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59d4236985a6272 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f276bfff640 1 -- 172.21.15.12:0/3037587965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700b0070 con 0x7f277412e760 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f276bfff640 1 -- 172.21.15.12:0/3037587965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27700ab530 con 0x7f277412e760 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f276bfff640 1 -- 172.21.15.12:0/3037587965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700ab830 con 0x7f277412e760 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 -- 172.21.15.12:0/3037587965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 msgr2=0x7f277412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 --2- 172.21.15.12:0/3037587965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277412ec80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2770009740 tx=0x7f277001c400 comp rx=0 tx=0).stop 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 -- 172.21.15.12:0/3037587965 shutdown_connections 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 --2- 172.21.15.12:0/3037587965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277412ec80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 -- 172.21.15.12:0/3037587965 >> 172.21.15.12:0/3037587965 conn(0x7f27740a10a0 msgr2=0x7f27740a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5155dc8640 1 --2- 172.21.15.12:0/164740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f5150096900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f514c0097f0 tx=0x7f514c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224140e34b11910d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 -- 172.21.15.12:0/3037587965 shutdown_connections 2024-09-13T19:06:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f277b77e640 1 -- 172.21.15.12:0/3037587965 wait complete. 2024-09-13T19:06:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5154dc6640 1 -- 172.21.15.12:0/164740066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f514c0b0070 con 0x7f5150096520 2024-09-13T19:06:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5154dc6640 1 -- 172.21.15.12:0/164740066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c0ab530 con 0x7f5150096520 2024-09-13T19:06:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.344+0000 7f5154dc6640 1 -- 172.21.15.12:0/164740066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f514c0ab830 con 0x7f5150096520 2024-09-13T19:06:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 Processor -- start 2024-09-13T19:06:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/164740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 msgr2=0x7f5150096900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 --2- 172.21.15.12:0/164740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f5150096900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f514c0097f0 tx=0x7f514c01c3f0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 -- start start 2024-09-13T19:06:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/164740066 shutdown_connections 2024-09-13T19:06:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 --2- 172.21.15.12:0/164740066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f5150096900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/164740066 >> 172.21.15.12:0/164740066 conn(0x7f515009f010 msgr2=0x7f515009f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/164740066 shutdown_connections 2024-09-13T19:06:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/164740066 wait complete. 2024-09-13T19:06:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4f78a640 1 Processor -- start 2024-09-13T19:06:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4f78a640 1 -- start start 2024-09-13T19:06:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2774136e30 con 0x7f277412e760 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277951a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277951a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42828/0 (socket says 172.21.15.12:42828) 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277951a640 1 -- 172.21.15.12:0/1455825928 learned_addr learned my addr 172.21.15.12:0/1455825928 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4f78a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e4812f390 0x7f6e48133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4f78a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e480984f0 con 0x7f6e4812e760 2024-09-13T19:06:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4f78a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6e48098dc0 con 0x7f6e4812f390 2024-09-13T19:06:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277951a640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2774130510 con 0x7f277412e760 2024-09-13T19:06:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 Processor -- start 2024-09-13T19:06:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4cd25640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e4812f390 0x7f6e48133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4cd25640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e4812f390 0x7f6e48133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42834/0 (socket says 172.21.15.12:42834) 2024-09-13T19:06:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- start start 2024-09-13T19:06:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277951a640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f277001a030 tx=0x7f277001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4cd25640 1 -- 172.21.15.12:0/3416675936 learned_addr learned my addr 172.21.15.12:0/3416675936 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700b0050 con 0x7f277412e760 2024-09-13T19:06:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2774130c10 con 0x7f277412e760 2024-09-13T19:06:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4cd25640 1 -- 172.21.15.12:0/3416675936 >> v1:172.21.15.12:6789/0 conn(0x7f6e4812e760 legacy=0x7f6e4812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f6e4cd25640 1 -- 172.21.15.12:0/3416675936 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e480981a0 con 0x7f6e4812f390 2024-09-13T19:06:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277409ce60 con 0x7f277412e760 2024-09-13T19:06:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51501352a0 con 0x7f5150096520 2024-09-13T19:06:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27700b1040 con 0x7f277412e760 2024-09-13T19:06:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700ab530 con 0x7f277412e760 2024-09-13T19:06:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f5155dc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f5155dc8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42840/0 (socket says 172.21.15.12:42840) 2024-09-13T19:06:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f5155dc8640 1 -- 172.21.15.12:0/1820879603 learned_addr learned my addr 172.21.15.12:0/1820879603 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f5155dc8640 1 -- 172.21.15.12:0/1820879603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515012f290 con 0x7f5150096520 2024-09-13T19:06:12.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2754000f90 con 0x7f277412e760 2024-09-13T19:06:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f5155dc8640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f514c01a020 tx=0x7f514c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f514c0ba020 con 0x7f5150096520 2024-09-13T19:06:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f514c0b6610 con 0x7f5150096520 2024-09-13T19:06:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5150132320 con 0x7f5150096520 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f514c0b0040 con 0x7f5150096520 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5150072820 con 0x7f5150096520 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27700be030 con 0x7f277412e760 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 0x7f27580383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.348+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f27700bc070 con 0x7f277412e760 2024-09-13T19:06:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2769ffb640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 0x7f275803db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27700bde80 con 0x7f275803b680 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f27700e9050 con 0x7f277412e760 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2779d1b640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 0x7f275803db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2778d19640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 0x7f27580383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f514c0bd020 con 0x7f5150096520 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51467fc640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 0x7f5134038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f514c0e2c10 con 0x7f5150096520 2024-09-13T19:06:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51555c7640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 0x7f5134038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2779d1b640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 0x7f275803db00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4cd25640 1 --2- 172.21.15.12:0/3416675936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812f390 0x7f6e48133a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e380097f0 tx=0x7f6e3801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df78f47d7e3b064 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2778d19640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 0x7f27580383c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2764005890 tx=0x7f2764007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 0x7f515012d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5150096900 con 0x7f5150096e40 2024-09-13T19:06:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e3ffff640 1 -- 172.21.15.12:0/3416675936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e380b1070 con 0x7f6e4812f390 2024-09-13T19:06:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e3ffff640 1 -- 172.21.15.12:0/3416675936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e380ac560 con 0x7f6e4812f390 2024-09-13T19:06:12.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e3ffff640 1 -- 172.21.15.12:0/3416675936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e380a8050 con 0x7f6e4812f390 2024-09-13T19:06:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51565c9640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 0x7f515012d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51555c7640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 0x7f5134038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f51400015c0 tx=0x7f5140007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27700bde80 con 0x7f275803b680 2024-09-13T19:06:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- 172.21.15.12:0/3416675936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812f390 msgr2=0x7f6e48133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/3416675936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812f390 0x7f6e48133a80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6e380097f0 tx=0x7f6e3801c4c0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f51565c9640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 0x7f515012d9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- 172.21.15.12:0/3416675936 shutdown_connections 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/3416675936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812f390 0x7f6e48133a80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- 172.21.15.12:0/3416675936 >> 172.21.15.12:0/3416675936 conn(0x7f6e480a10a0 msgr2=0x7f6e480a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- 172.21.15.12:0/3416675936 shutdown_connections 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- 172.21.15.12:0/3416675936 wait complete. 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 Processor -- start 2024-09-13T19:06:12.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- start start 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4f78a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6e48136b70 con 0x7f6e4812e760 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4d526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4d526640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42852/0 (socket says 172.21.15.12:42852) 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.352+0000 7f6e4d526640 1 -- 172.21.15.12:0/264606272 learned_addr learned my addr 172.21.15.12:0/264606272 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4d526640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e48131730 con 0x7f6e4812e760 2024-09-13T19:06:12.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5150096900 con 0x7f5150096e40 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4d526640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c480 tx=0x7f6e4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e44005150 con 0x7f6e4812e760 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e440052f0 con 0x7f6e4812e760 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e48128f50 con 0x7f6e4812e760 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e44007030 con 0x7f6e4812e760 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e48131da0 con 0x7f6e4812e760 2024-09-13T19:06:12.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6e4812ec80 con 0x7f6e4812e760 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e44019020 con 0x7f6e4812e760 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 0x7f6e2c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f6e44047a20 con 0x7f6e4812e760 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 0x7f6e2c03d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e2c03e080 con 0x7f6e2c03b530 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6e4404c2a0 con 0x7f6e4812e760 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4cd25640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 0x7f6e2c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4dd27640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 0x7f6e2c03d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4dd27640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 0x7f6e2c03d9b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.356+0000 7f6e4cd25640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 0x7f6e2c038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e380ae000 tx=0x7f6e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.360+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e2c03e080 con 0x7f6e2c03b530 2024-09-13T19:06:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.364+0000 7fbe6eb57640 1 Processor -- start 2024-09-13T19:06:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.364+0000 7fbe6eb57640 1 -- start start 2024-09-13T19:06:12.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.364+0000 7fbe6eb57640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe68096520 0x7fbe68096900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.364+0000 7fbe6eb57640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe68098420 con 0x7fbe68096e40 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.364+0000 7fbe6c8f3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe68096520 0x7fbe68096900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe67fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe68096e40 0x7fbe6812c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34218/0 (socket says 172.21.15.12:34218) 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe67fff640 1 -- 172.21.15.12:0/1517237241 learned_addr learned my addr 172.21.15.12:0/1517237241 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbe680989e0 con 0x7fbe68096520 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe677fe640 1 -- 172.21.15.12:0/1517237241 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828190277 0 0) 0x7fbe68098420 con 0x7fbe68096e40 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe677fe640 1 -- 172.21.15.12:0/1517237241 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe58003530 con 0x7fbe68096e40 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe6c8f3640 1 -- 172.21.15.12:0/1517237241 >> v1:172.21.15.12:6789/0 conn(0x7fbe68096e40 legacy=0x7fbe6812c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe6c8f3640 1 -- 172.21.15.12:0/1517237241 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe680972a0 con 0x7fbe68096520 2024-09-13T19:06:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2754002c80 con 0x7f275803b680 2024-09-13T19:06:12.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f2769ffb640 1 -- 172.21.15.12:0/1455825928 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2754002c80 con 0x7f275803b680 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 msgr2=0x7f275803db00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 0x7f275803db00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 msgr2=0x7f27580383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 0x7f27580383c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2764005890 tx=0x7f2764007a90 comp rx=0 tx=0).stop 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 msgr2=0x7f277409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f277001a030 tx=0x7f277001ac40 comp rx=0 tx=0).stop 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 shutdown_connections 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2758035f00 0x7f27580383c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f275803b680 0x7f275803db00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 --2- 172.21.15.12:0/1455825928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f277412e760 0x7f277409c920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 >> 172.21.15.12:0/1455825928 conn(0x7f27740a10a0 msgr2=0x7f2774095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 shutdown_connections 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f277b77e640 1 -- 172.21.15.12:0/1455825928 wait complete. 2024-09-13T19:06:12.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe6c8f3640 1 --2- 172.21.15.12:0/1517237241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68096900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009740 tx=0x7fbe5c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87979a4bc631b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5150126900 con 0x7f5150096e40 2024-09-13T19:06:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.368+0000 7fbe677fe640 1 -- 172.21.15.12:0/1517237241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b0070 con 0x7fbe68096520 2024-09-13T19:06:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe677fe640 1 -- 172.21.15.12:0/1517237241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0ab530 con 0x7fbe68096520 2024-09-13T19:06:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe677fe640 1 -- 172.21.15.12:0/1517237241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0ab830 con 0x7fbe68096520 2024-09-13T19:06:12.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f51467fc640 1 -- 172.21.15.12:0/1820879603 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5150126900 con 0x7f5150096e40 2024-09-13T19:06:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 msgr2=0x7fbe68096900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1517237241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68096900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009740 tx=0x7fbe5c01c370 comp rx=0 tx=0).stop 2024-09-13T19:06:12.386 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 shutdown_connections 2024-09-13T19:06:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1517237241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68096900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 >> 172.21.15.12:0/1517237241 conn(0x7fbe6809f010 msgr2=0x7fbe6809f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 shutdown_connections 2024-09-13T19:06:12.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1517237241 wait complete. 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 msgr2=0x7f515012d9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 0x7f515012d9f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 msgr2=0x7f5134038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 0x7f5134038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f51400015c0 tx=0x7f5140007a40 comp rx=0 tx=0).stop 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 msgr2=0x7f515012d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f514c01a020 tx=0x7f514c01ac30 comp rx=0 tx=0).stop 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 shutdown_connections 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f5150096e40 0x7f515012d9f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5134035db0 0x7f5134038270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 --2- 172.21.15.12:0/1820879603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5150096520 0x7f515012d4b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 >> 172.21.15.12:0/1820879603 conn(0x7f515009f010 msgr2=0x7f5150125ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 shutdown_connections 2024-09-13T19:06:12.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7f515802c640 1 -- 172.21.15.12:0/1820879603 wait complete. 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 Processor -- start 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- start start 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbe681352a0 con 0x7fbe68096520 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6c8f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6c8f3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42874/0 (socket says 172.21.15.12:42874) 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6c8f3640 1 -- 172.21.15.12:0/1189881320 learned_addr learned my addr 172.21.15.12:0/1189881320 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6c8f3640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe68131b50 con 0x7fbe68096520 2024-09-13T19:06:12.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6c8f3640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c019fa0 tx=0x7fbe5c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b0050 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0b1040 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6806df90 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe5c0b5740 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.372+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe68072990 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbe68096900 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbe5c0be030 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 0x7fbe4c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fbe5c0bc070 con 0x7fbe68096520 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 0x7fbe4c03d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe5c0c4e50 con 0x7fbe4c03b4e0 2024-09-13T19:06:12.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fbe5c0e8050 con 0x7fbe68096520 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe67fff640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 0x7fbe4c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe6d0f4640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 0x7fbe4c03d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe6d0f4640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 0x7fbe4c03d960 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7fbe67fff640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 0x7fbe4c038220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe54007fd0 tx=0x7fbe54007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6e4812de00 con 0x7f6e2c03b530 2024-09-13T19:06:12.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.376+0000 7f6e3dffb640 1 -- 172.21.15.12:0/264606272 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6e4812de00 con 0x7f6e2c03b530 2024-09-13T19:06:12.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbe5c0c4e50 con 0x7fbe4c03b4e0 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 msgr2=0x7f6e2c03d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 0x7f6e2c03d9b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 msgr2=0x7f6e2c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 0x7f6e2c038270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6e380ae000 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 msgr2=0x7f6e480963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c480 tx=0x7f6e4400c940 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 shutdown_connections 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e2c03b530 0x7f6e2c03d9b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6e2c035db0 0x7f6e2c038270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 --2- 172.21.15.12:0/264606272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4812e760 0x7f6e480963d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 >> 172.21.15.12:0/264606272 conn(0x7f6e480a10a0 msgr2=0x7f6e480972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 shutdown_connections 2024-09-13T19:06:12.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.380+0000 7f6e4f78a640 1 -- 172.21.15.12:0/264606272 wait complete. 2024-09-13T19:06:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:12.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:06:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.392+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbe6806e940 con 0x7fbe4c03b4e0 2024-09-13T19:06:12.403 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe657fa640 1 -- 172.21.15.12:0/1189881320 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbe6806e940 con 0x7fbe4c03b4e0 2024-09-13T19:06:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 msgr2=0x7fbe4c03d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 0x7fbe4c03d960 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.404 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 msgr2=0x7fbe4c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 0x7fbe4c038220 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbe54007fd0 tx=0x7fbe54007980 comp rx=0 tx=0).stop 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 msgr2=0x7fbe68072280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c019fa0 tx=0x7fbe5c01abb0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 shutdown_connections 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbe4c035d60 0x7fbe4c038220 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7fbe4c03b4e0 0x7fbe4c03d960 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 --2- 172.21.15.12:0/1189881320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe68096520 0x7fbe68072280 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 >> 172.21.15.12:0/1189881320 conn(0x7fbe6809f010 msgr2=0x7fbe68125ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 shutdown_connections 2024-09-13T19:06:12.405 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.396+0000 7fbe6eb57640 1 -- 172.21.15.12:0/1189881320 wait complete. 2024-09-13T19:06:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:12.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:06:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:38654705668 2024-09-13T19:06:12.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:06:12.419 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:12.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:06:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5c598c640 1 Processor -- start 2024-09-13T19:06:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5c598c640 1 -- start start 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5c598c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5c012e760 0x7fb5c012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5c598c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c00984f0 con 0x7fb5c012f1c0 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5c598c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c0098dc0 con 0x7fb5c012e760 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5be7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5c012f1c0 0x7fb5c012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34222/0 (socket says 172.21.15.12:34222) 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5be7fc640 1 -- 172.21.15.12:0/3987597621 learned_addr learned my addr 172.21.15.12:0/3987597621 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5beffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb5c012e760 0x7fb5c012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5beffd640 1 -- 172.21.15.12:0/3987597621 >> v1:172.21.15.12:6789/0 conn(0x7fb5c012f1c0 legacy=0x7fb5c012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.504+0000 7fb5beffd640 1 -- 172.21.15.12:0/3987597621 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c012f5a0 con 0x7fb5c012e760 2024-09-13T19:06:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5beffd640 1 --2- 172.21.15.12:0/3987597621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c012ec80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009740 tx=0x7fb5b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daecb062e6b116ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5bdffb640 1 -- 172.21.15.12:0/3987597621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b00b0070 con 0x7fb5c012e760 2024-09-13T19:06:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5bdffb640 1 -- 172.21.15.12:0/3987597621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b00ab530 con 0x7fb5c012e760 2024-09-13T19:06:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5bdffb640 1 -- 172.21.15.12:0/3987597621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b00ab830 con 0x7fb5c012e760 2024-09-13T19:06:12.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- 172.21.15.12:0/3987597621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 msgr2=0x7fb5c012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 --2- 172.21.15.12:0/3987597621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c012ec80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009740 tx=0x7fb5b001c400 comp rx=0 tx=0).stop 2024-09-13T19:06:12.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- 172.21.15.12:0/3987597621 shutdown_connections 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 --2- 172.21.15.12:0/3987597621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c012ec80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- 172.21.15.12:0/3987597621 >> 172.21.15.12:0/3987597621 conn(0x7fb5c00a10a0 msgr2=0x7fb5c00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- 172.21.15.12:0/3987597621 shutdown_connections 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- 172.21.15.12:0/3987597621 wait complete. 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 Processor -- start 2024-09-13T19:06:12.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- start start 2024-09-13T19:06:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5c598c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c0136e30 con 0x7fb5c012e760 2024-09-13T19:06:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5beffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42886/0 (socket says 172.21.15.12:42886) 2024-09-13T19:06:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5beffd640 1 -- 172.21.15.12:0/791198674 learned_addr learned my addr 172.21.15.12:0/791198674 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.508+0000 7fb5beffd640 1 -- 172.21.15.12:0/791198674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c0130510 con 0x7fb5c012e760 2024-09-13T19:06:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5beffd640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5b001a030 tx=0x7fb5b001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b00b0050 con 0x7fb5c012e760 2024-09-13T19:06:12.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b00b1040 con 0x7fb5c012e760 2024-09-13T19:06:12.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c0130c10 con 0x7fb5c012e760 2024-09-13T19:06:12.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b00b5740 con 0x7fb5c012e760 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c009ce60 con 0x7fb5c012e760 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5b00be030 con 0x7fb5c012e760 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c009e3a0 con 0x7fb5c012e760 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 0x7fb5ac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb5b00bc070 con 0x7fb5c012e760 2024-09-13T19:06:12.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5be7fc640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 0x7fb5ac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.512+0000 7fb5be7fc640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 0x7fb5ac038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4005890 tx=0x7fb5b4007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.520+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5b00c5020 con 0x7fb5c012e760 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0ab4c9c640 1 Processor -- start 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0ab4c9c640 1 -- start start 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0ab4c9c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ab0070870 0x7f0ab0131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0ab4c9c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ab009e860 con 0x7f0ab012cd50 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0ab4c9c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0ab012d840 con 0x7f0ab0070870 2024-09-13T19:06:12.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0aa7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ab0070870 0x7f0ab0131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0aa7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0ab0070870 0x7f0ab0131dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42896/0 (socket says 172.21.15.12:42896) 2024-09-13T19:06:12.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0aa7fff640 1 -- 172.21.15.12:0/3622712989 learned_addr learned my addr 172.21.15.12:0/3622712989 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0aa7fff640 1 -- 172.21.15.12:0/3622712989 >> v1:172.21.15.12:6789/0 conn(0x7f0ab012cd50 legacy=0x7f0ab012d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.564+0000 7f0aa7fff640 1 -- 172.21.15.12:0/3622712989 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab0071c60 con 0x7f0ab0070870 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0aa7fff640 1 --2- 172.21.15.12:0/3622712989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0131dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a980097f0 tx=0x7f0a9801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a860dc063cb30a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0aadd9b640 1 -- 172.21.15.12:0/3622712989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a980a6040 con 0x7f0ab0070870 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0aadd9b640 1 -- 172.21.15.12:0/3622712989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a980af070 con 0x7f0ab0070870 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0aadd9b640 1 -- 172.21.15.12:0/3622712989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a980aa6c0 con 0x7f0ab0070870 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f2870e0f640 1 Processor -- start 2024-09-13T19:06:12.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f2870e0f640 1 -- start start 2024-09-13T19:06:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/3622712989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 msgr2=0x7f0ab0131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/3622712989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0131dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a980097f0 tx=0x7f0a9801c4c0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f2870e0f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f286c12b3e0 0x7f286c12b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f2870e0f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c12bd00 con 0x7f286c096990 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f2870e0f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0972a0 con 0x7f286c12b3e0 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f286a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f286c12b3e0 0x7f286c12b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/3622712989 shutdown_connections 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/3622712989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0131dc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/3622712989 >> 172.21.15.12:0/3622712989 conn(0x7f0ab009cd30 msgr2=0x7f0ab009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f286a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f286c12b3e0 0x7f286c12b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42902/0 (socket says 172.21.15.12:42902) 2024-09-13T19:06:12.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f286a59c640 1 -- 172.21.15.12:0/1913951683 learned_addr learned my addr 172.21.15.12:0/1913951683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/3622712989 shutdown_connections 2024-09-13T19:06:12.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f286a59c640 1 -- 172.21.15.12:0/1913951683 >> v1:172.21.15.12:6789/0 conn(0x7f286c096990 legacy=0x7f286c0953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/3622712989 wait complete. 2024-09-13T19:06:12.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.568+0000 7f286a59c640 1 -- 172.21.15.12:0/1913951683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c12bed0 con 0x7f286c12b3e0 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 Processor -- start 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 -- start start 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0ab0134d30 con 0x7f0ab0070870 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aae59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42912/0 (socket says 172.21.15.12:42912) 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aae59c640 1 -- 172.21.15.12:0/14304181 learned_addr learned my addr 172.21.15.12:0/14304181 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aae59c640 1 -- 172.21.15.12:0/14304181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ab0072cd0 con 0x7f0ab0070870 2024-09-13T19:06:12.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aae59c640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c480 tx=0x7f0aa000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f286a59c640 1 --2- 172.21.15.12:0/1913951683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c12b3e0 0x7f286c12b7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097f0 tx=0x7f285c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a914454e3f55ad2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa0005150 con 0x7f0ab0070870 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ab012b560 con 0x7f0ab0070870 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aa00052f0 con 0x7f0ab0070870 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0aa0007030 con 0x7f0ab0070870 2024-09-13T19:06:12.583 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ab0129ff0 con 0x7f0ab0070870 2024-09-13T19:06:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2869d9b640 1 -- 172.21.15.12:0/1913951683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0b0070 con 0x7f286c12b3e0 2024-09-13T19:06:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2869d9b640 1 -- 172.21.15.12:0/1913951683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c0ab530 con 0x7f286c12b3e0 2024-09-13T19:06:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2869d9b640 1 -- 172.21.15.12:0/1913951683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0ab830 con 0x7f286c12b3e0 2024-09-13T19:06:12.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 -- 172.21.15.12:0/1913951683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c12b3e0 msgr2=0x7f286c12b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 --2- 172.21.15.12:0/1913951683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c12b3e0 0x7f286c12b7c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f285c0097f0 tx=0x7f285c01c430 comp rx=0 tx=0).stop 2024-09-13T19:06:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 -- 172.21.15.12:0/1913951683 shutdown_connections 2024-09-13T19:06:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 --2- 172.21.15.12:0/1913951683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c12b3e0 0x7f286c12b7c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ab00008e0 con 0x7f0ab0070870 2024-09-13T19:06:12.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 -- 172.21.15.12:0/1913951683 >> 172.21.15.12:0/1913951683 conn(0x7f286c09b450 msgr2=0x7f286c09b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 -- 172.21.15.12:0/1913951683 shutdown_connections 2024-09-13T19:06:12.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f2870e0f640 1 -- 172.21.15.12:0/1913951683 wait complete. 2024-09-13T19:06:12.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0aa0019020 con 0x7f0ab0070870 2024-09-13T19:06:12.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.572+0000 7f0aa6ffd640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 0x7f0a9003c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0aa004b120 con 0x7f0ab0070870 2024-09-13T19:06:12.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f0aa7fff640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 0x7f0a9003c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f2870e0f640 1 Processor -- start 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f2870e0f640 1 -- start start 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f2870e0f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f2870e0f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0966e0 con 0x7f286c096990 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f286a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f286a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42916/0 (socket says 172.21.15.12:42916) 2024-09-13T19:06:12.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f0aa7fff640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 0x7f0a9003c630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ae000 tx=0x7f0a98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f286a59c640 1 -- 172.21.15.12:0/201820806 learned_addr learned my addr 172.21.15.12:0/201820806 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f286a59c640 1 -- 172.21.15.12:0/201820806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c08f8b0 con 0x7f286c096990 2024-09-13T19:06:12.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.576+0000 7f286a59c640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f285c01a060 tx=0x7f285c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0b0040 con 0x7f286c096990 2024-09-13T19:06:12.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c0aa780 con 0x7f286c096990 2024-09-13T19:06:12.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285c0aaaa0 con 0x7f286c096990 2024-09-13T19:06:12.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c091280 con 0x7f286c096990 2024-09-13T19:06:12.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c090190 con 0x7f286c096990 2024-09-13T19:06:12.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0aa001a560 con 0x7f0ab0070870 2024-09-13T19:06:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c0732e0 con 0x7f286c096990 2024-09-13T19:06:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f285c0bb020 con 0x7f286c096990 2024-09-13T19:06:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 0x7f284c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f285c0b9020 con 0x7f286c096990 2024-09-13T19:06:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2863fff640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 0x7f284c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.584+0000 7f2863fff640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 0x7f284c038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2854000f70 tx=0x7f2854007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.592+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f285c0c2020 con 0x7f286c096990 2024-09-13T19:06:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee30b8640 1 Processor -- start 2024-09-13T19:06:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee30b8640 1 -- start start 2024-09-13T19:06:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee30b8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3edc12f390 0x7f3edc133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee30b8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3edc0984f0 con 0x7f3edc12e760 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee30b8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3edc098dc0 con 0x7f3edc12f390 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3edc12f390 0x7f3edc133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee0e54640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3edc12e760 0x7f3edc12ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34266/0 (socket says 172.21.15.12:34266) 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3ee0e54640 1 -- 172.21.15.12:0/548451703 learned_addr learned my addr 172.21.15.12:0/548451703 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edbfff640 1 -- 172.21.15.12:0/548451703 >> v1:172.21.15.12:6789/0 conn(0x7f3edc12e760 legacy=0x7f3edc12ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edbfff640 1 -- 172.21.15.12:0/548451703 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc0981a0 con 0x7f3edc12f390 2024-09-13T19:06:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edbfff640 1 --2- 172.21.15.12:0/548451703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12f390 0x7f3edc133a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009740 tx=0x7f3ec801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc9eee711a309d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edb7fe640 1 -- 172.21.15.12:0/548451703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec80b0070 con 0x7f3edc12f390 2024-09-13T19:06:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edb7fe640 1 -- 172.21.15.12:0/548451703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ec80ab530 con 0x7f3edc12f390 2024-09-13T19:06:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.612+0000 7f3edb7fe640 1 -- 172.21.15.12:0/548451703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ec80ab830 con 0x7f3edc12f390 2024-09-13T19:06:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/548451703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12f390 msgr2=0x7f3edc133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/548451703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12f390 0x7f3edc133a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009740 tx=0x7f3ec801c420 comp rx=0 tx=0).stop 2024-09-13T19:06:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/548451703 shutdown_connections 2024-09-13T19:06:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/548451703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12f390 0x7f3edc133a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/548451703 >> 172.21.15.12:0/548451703 conn(0x7f3edc0a10a0 msgr2=0x7f3edc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/548451703 shutdown_connections 2024-09-13T19:06:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/548451703 wait complete. 2024-09-13T19:06:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 Processor -- start 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- start start 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3edc136b70 con 0x7f3edc12e760 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee0e54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee0e54640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42924/0 (socket says 172.21.15.12:42924) 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee0e54640 1 -- 172.21.15.12:0/2571990596 learned_addr learned my addr 172.21.15.12:0/2571990596 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee0e54640 1 -- 172.21.15.12:0/2571990596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3edc131cd0 con 0x7f3edc12e760 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee0e54640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c480 tx=0x7f3ed000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0017070 con 0x7f3edc12e760 2024-09-13T19:06:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed0005c20 con 0x7f3edc12e760 2024-09-13T19:06:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3edc12b5c0 con 0x7f3edc12e760 2024-09-13T19:06:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ed0007070 con 0x7f3edc12e760 2024-09-13T19:06:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3edc131640 con 0x7f3edc12e760 2024-09-13T19:06:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3ed001a070 con 0x7f3edc12e760 2024-09-13T19:06:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 0x7f3ec0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f3ed00479a0 con 0x7f3edc12e760 2024-09-13T19:06:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.616+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3edc12ec80 con 0x7f3edc12e760 2024-09-13T19:06:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.620+0000 7f3edbfff640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 0x7f3ec0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.620+0000 7f3edbfff640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 0x7f3ec0038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80ad000 tx=0x7f3ec8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.624+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3edc131cd0 con 0x7f3edc12e760 2024-09-13T19:06:12.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.728+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb5c012ec80 con 0x7fb5c012e760 2024-09-13T19:06:12.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.728+0000 7fb5a7fff640 1 -- 172.21.15.12:0/791198674 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5b0015ff0 con 0x7fb5c012e760 2024-09-13T19:06:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:38654705668 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 msgr2=0x7fb5ac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 0x7fb5ac038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4005890 tx=0x7fb5b4007a90 comp rx=0 tx=0).stop 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 msgr2=0x7fb5c009c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5b001a030 tx=0x7fb5b001ac40 comp rx=0 tx=0).stop 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 shutdown_connections 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb5ac035db0 0x7fb5ac038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.742 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 --2- 172.21.15.12:0/791198674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5c012e760 0x7fb5c009c920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 >> 172.21.15.12:0/791198674 conn(0x7fb5c00a10a0 msgr2=0x7fb5c0095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 shutdown_connections 2024-09-13T19:06:12.743 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.732+0000 7fb5c598c640 1 -- 172.21.15.12:0/791198674 wait complete. 2024-09-13T19:06:12.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.744+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0ab0074a40 con 0x7f0ab0070870 2024-09-13T19:06:12.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0aa6ffd640 1 -- 172.21.15.12:0/14304181 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0aa0046980 con 0x7f0ab0070870 2024-09-13T19:06:12.755 INFO:teuthology.orchestra.run.smithi012.stdout:38654705668 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 msgr2=0x7f0a9003c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 0x7f0a9003c630 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0a980ae000 tx=0x7f0a98008040 comp rx=0 tx=0).stop 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 msgr2=0x7f0ab0129ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000c480 tx=0x7f0aa000c940 comp rx=0 tx=0).stop 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 shutdown_connections 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0a9003a170 0x7f0a9003c630 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 --2- 172.21.15.12:0/14304181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab0070870 0x7f0ab0129ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 >> 172.21.15.12:0/14304181 conn(0x7f0ab009cd30 msgr2=0x7f0ab0130af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 shutdown_connections 2024-09-13T19:06:12.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-13T19:06:12.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.748+0000 7f0ab4c9c640 1 -- 172.21.15.12:0/14304181 wait complete. 2024-09-13T19:06:12.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-09-13T19:06:12.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3edc06e930 con 0x7f3edc12e760 2024-09-13T19:06:12.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ed97fa640 1 -- 172.21.15.12:0/2571990596 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ed0007210 con 0x7f3edc12e760 2024-09-13T19:06:12.791 INFO:teuthology.orchestra.run.smithi012.stdout:38654705668 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 msgr2=0x7f3ec0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 0x7f3ec0038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ec80ad000 tx=0x7f3ec8008040 comp rx=0 tx=0).stop 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 msgr2=0x7f3edc096080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000c480 tx=0x7f3ed000c940 comp rx=0 tx=0).stop 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 shutdown_connections 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3ec0035db0 0x7f3ec0038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 --2- 172.21.15.12:0/2571990596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3edc12e760 0x7f3edc096080 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 >> 172.21.15.12:0/2571990596 conn(0x7f3edc0a10a0 msgr2=0x7f3edc0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f286c09cc00 con 0x7f286c096990 2024-09-13T19:06:12.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 shutdown_connections 2024-09-13T19:06:12.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f3ee30b8640 1 -- 172.21.15.12:0/2571990596 wait complete. 2024-09-13T19:06:12.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.784+0000 7f2862ffd640 1 -- 172.21.15.12:0/201820806 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f285c0160b0 con 0x7f286c096990 2024-09-13T19:06:12.795 INFO:teuthology.orchestra.run.smithi012.stdout:38654705667 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 msgr2=0x7f284c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 0x7f284c038270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2854000f70 tx=0x7f2854007a40 comp rx=0 tx=0).stop 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 msgr2=0x7f286c1c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f285c01a060 tx=0x7f285c0191d0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 shutdown_connections 2024-09-13T19:06:12.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f284c035db0 0x7f284c038270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 --2- 172.21.15.12:0/201820806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f286c096990 0x7f286c1c69b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:12.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 >> 172.21.15.12:0/201820806 conn(0x7f286c09b450 msgr2=0x7f286c097a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:12.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 shutdown_connections 2024-09-13T19:06:12.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:12.788+0000 7f2870e0f640 1 -- 172.21.15.12:0/201820806 wait complete. 2024-09-13T19:06:12.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-09-13T19:06:12.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-09-13T19:06:13.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T19:06:13.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T19:06:13.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T19:06:13.812 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T19:06:13.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4f5f35640 1 Processor -- start 2024-09-13T19:06:13.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4f5f35640 1 -- start start 2024-09-13T19:06:13.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4f5f35640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4f0096180 0x7fe4f0096560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4f5f35640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f0098040 con 0x7fe4f0096aa0 2024-09-13T19:06:13.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4f5f35640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f006ca70 con 0x7fe4f0096180 2024-09-13T19:06:13.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4ef7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4f0096180 0x7fe4f0096560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4eeffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe4f0096aa0 0x7fe4f0130df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34278/0 (socket says 172.21.15.12:34278) 2024-09-13T19:06:13.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4eeffd640 1 -- 172.21.15.12:0/348652439 learned_addr learned my addr 172.21.15.12:0/348652439 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:13.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4ef7fe640 1 -- 172.21.15.12:0/348652439 >> v1:172.21.15.12:6789/0 conn(0x7fe4f0096aa0 legacy=0x7fe4f0130df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.880+0000 7fe4ef7fe640 1 -- 172.21.15.12:0/348652439 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f0097c10 con 0x7fe4f0096180 2024-09-13T19:06:13.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4ef7fe640 1 --2- 172.21.15.12:0/348652439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f0096560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009740 tx=0x7fe4e001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363ad7fd4989e2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4ee7fc640 1 -- 172.21.15.12:0/348652439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00ab550 con 0x7fe4f0096180 2024-09-13T19:06:13.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4ee7fc640 1 -- 172.21.15.12:0/348652439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e00b0070 con 0x7fe4f0096180 2024-09-13T19:06:13.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4ee7fc640 1 -- 172.21.15.12:0/348652439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00ab840 con 0x7fe4f0096180 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 -- 172.21.15.12:0/348652439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 msgr2=0x7fe4f0096560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/348652439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f0096560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009740 tx=0x7fe4e001c400 comp rx=0 tx=0).stop 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 -- 172.21.15.12:0/348652439 shutdown_connections 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/348652439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f0096560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 -- 172.21.15.12:0/348652439 >> 172.21.15.12:0/348652439 conn(0x7fe4f009a940 msgr2=0x7fe4f009ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 -- 172.21.15.12:0/348652439 shutdown_connections 2024-09-13T19:06:13.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.884+0000 7fe4f5f35640 1 -- 172.21.15.12:0/348652439 wait complete. 2024-09-13T19:06:13.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 Processor -- start 2024-09-13T19:06:13.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 -- start start 2024-09-13T19:06:13.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f0134f40 con 0x7fe4f0096180 2024-09-13T19:06:13.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42946/0 (socket says 172.21.15.12:42946) 2024-09-13T19:06:13.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4ef7fe640 1 -- 172.21.15.12:0/3176837613 learned_addr learned my addr 172.21.15.12:0/3176837613 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4ef7fe640 1 -- 172.21.15.12:0/3176837613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f01230b0 con 0x7fe4f0096180 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4ef7fe640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4e001a030 tx=0x7fe4e001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00abd50 con 0x7fe4f0096180 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e00bf410 con 0x7fe4f0096180 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f0094b60 con 0x7fe4f0096180 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e00bf710 con 0x7fe4f0096180 2024-09-13T19:06:13.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f00939a0 con 0x7fe4f0096180 2024-09-13T19:06:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4e00bd020 con 0x7fe4f0096180 2024-09-13T19:06:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f0096560 con 0x7fe4f0096180 2024-09-13T19:06:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 0x7fe4dc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe4e00e2b50 con 0x7fe4f0096180 2024-09-13T19:06:13.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.888+0000 7fe4eeffd640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 0x7fe4dc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.892+0000 7fe4eeffd640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 0x7fe4dc038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005890 tx=0x7fe4e4007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.896+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4e0015ff0 con 0x7fe4f0096180 2024-09-13T19:06:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.920+0000 7f57d70ec640 1 Processor -- start 2024-09-13T19:06:13.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.920+0000 7f57d70ec640 1 -- start start 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.920+0000 7f57d70ec640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57d012f490 0x7f57d0133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.920+0000 7f57d70ec640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57d0097c50 con 0x7f57d006bc50 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.920+0000 7f57d70ec640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f57d00500e0 con 0x7f57d012f490 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57d012f490 0x7f57d0133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57d012f490 0x7f57d0133fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42950/0 (socket says 172.21.15.12:42950) 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57d4e88640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f57d006bc50 0x7f57d012ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34294/0 (socket says 172.21.15.12:34294) 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 -- 172.21.15.12:0/2125353760 learned_addr learned my addr 172.21.15.12:0/2125353760 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 -- 172.21.15.12:0/2125353760 >> v1:172.21.15.12:6789/0 conn(0x7f57d006bc50 legacy=0x7f57d012ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 -- 172.21.15.12:0/2125353760 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d006c440 con 0x7f57d012f490 2024-09-13T19:06:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cf7fe640 1 -- 172.21.15.12:0/2125353760 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842878309 0 0) 0x7f57d0097c50 con 0x7f57d006bc50 2024-09-13T19:06:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cffff640 1 --2- 172.21.15.12:0/2125353760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d012f490 0x7f57d0133fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0097f0 tx=0x7f57bc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94837ad835e0aff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cf7fe640 1 -- 172.21.15.12:0/2125353760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc0b1070 con 0x7f57d012f490 2024-09-13T19:06:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cf7fe640 1 -- 172.21.15.12:0/2125353760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc0ac560 con 0x7f57d012f490 2024-09-13T19:06:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.924+0000 7f57cf7fe640 1 -- 172.21.15.12:0/2125353760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57bc0a8050 con 0x7f57d012f490 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- 172.21.15.12:0/2125353760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d012f490 msgr2=0x7f57d0133fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 --2- 172.21.15.12:0/2125353760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d012f490 0x7f57d0133fc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0097f0 tx=0x7f57bc01c4c0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- 172.21.15.12:0/2125353760 shutdown_connections 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 --2- 172.21.15.12:0/2125353760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d012f490 0x7f57d0133fc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- 172.21.15.12:0/2125353760 >> 172.21.15.12:0/2125353760 conn(0x7f57d009ab00 msgr2=0x7f57d009af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- 172.21.15.12:0/2125353760 shutdown_connections 2024-09-13T19:06:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- 172.21.15.12:0/2125353760 wait complete. 2024-09-13T19:06:13.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 Processor -- start 2024-09-13T19:06:13.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- start start 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d70ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f57d0136f30 con 0x7f57d006bc50 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d4e88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d4e88640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42954/0 (socket says 172.21.15.12:42954) 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d4e88640 1 -- 172.21.15.12:0/101301329 learned_addr learned my addr 172.21.15.12:0/101301329 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d4e88640 1 -- 172.21.15.12:0/101301329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d006fe00 con 0x7f57d006bc50 2024-09-13T19:06:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.928+0000 7f57d4e88640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c390 tx=0x7f57c400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c4007410 con 0x7f57d006bc50 2024-09-13T19:06:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c40075d0 con 0x7f57d006bc50 2024-09-13T19:06:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d006f960 con 0x7f57d006bc50 2024-09-13T19:06:13.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57c4004960 con 0x7f57d006bc50 2024-09-13T19:06:13.940 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d006e580 con 0x7f57d006bc50 2024-09-13T19:06:13.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d006f1d0 con 0x7f57d006bc50 2024-09-13T19:06:13.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f57c4011070 con 0x7f57d006bc50 2024-09-13T19:06:13.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 0x7f57b4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f57c40482d0 con 0x7f57d006bc50 2024-09-13T19:06:13.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cffff640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 0x7f57b4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.932+0000 7f57cffff640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 0x7f57b4038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0ae000 tx=0x7f57bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.936+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f57c4004d90 con 0x7f57d006bc50 2024-09-13T19:06:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb53a9e9640 1 Processor -- start 2024-09-13T19:06:13.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb53a9e9640 1 -- start start 2024-09-13T19:06:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb53a9e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb53412e760 0x7fb53412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb53a9e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5340984f0 con 0x7fb53412f1c0 2024-09-13T19:06:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb53a9e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb534098dc0 con 0x7fb53412e760 2024-09-13T19:06:13.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb533fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb53412e760 0x7fb53412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb533fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb53412e760 0x7fb53412ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42970/0 (socket says 172.21.15.12:42970) 2024-09-13T19:06:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb5337fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb53412f1c0 0x7fb53412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34298/0 (socket says 172.21.15.12:34298) 2024-09-13T19:06:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb533fff640 1 -- 172.21.15.12:0/3733463941 learned_addr learned my addr 172.21.15.12:0/3733463941 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb533fff640 1 -- 172.21.15.12:0/3733463941 >> v1:172.21.15.12:6789/0 conn(0x7fb53412f1c0 legacy=0x7fb53412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.956+0000 7fb533fff640 1 -- 172.21.15.12:0/3733463941 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53412f5a0 con 0x7fb53412e760 2024-09-13T19:06:13.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f8422a6e640 1 Processor -- start 2024-09-13T19:06:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f8422a6e640 1 -- start start 2024-09-13T19:06:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f8422a6e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f841c098e10 0x7f841c096450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.968 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f8422a6e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c097f50 con 0x7f841c096990 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f8422a6e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f841c097af0 con 0x7f841c098e10 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f842080a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f841c098e10 0x7f841c096450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f841bfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f841c096990 0x7f841c132e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34310/0 (socket says 172.21.15.12:34310) 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f841bfff640 1 -- 172.21.15.12:0/2579140795 learned_addr learned my addr 172.21.15.12:0/2579140795 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f841b7fe640 1 -- 172.21.15.12:0/2579140795 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751223939 0 0) 0x7f841c097f50 con 0x7f841c096990 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f841b7fe640 1 -- 172.21.15.12:0/2579140795 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f840c003530 con 0x7f841c096990 2024-09-13T19:06:13.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb533fff640 1 --2- 172.21.15.12:0/3733463941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb53412ec80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097f0 tx=0x7fb52401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6df4c22a08578d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f842080a640 1 -- 172.21.15.12:0/2579140795 >> v1:172.21.15.12:6789/0 conn(0x7f841c096990 legacy=0x7f841c132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7f842080a640 1 -- 172.21.15.12:0/2579140795 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c096da0 con 0x7f841c098e10 2024-09-13T19:06:13.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb532ffd640 1 -- 172.21.15.12:0/3733463941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5240b0070 con 0x7fb53412e760 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb532ffd640 1 -- 172.21.15.12:0/3733463941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5240ab530 con 0x7fb53412e760 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb532ffd640 1 -- 172.21.15.12:0/3733463941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5240ab830 con 0x7fb53412e760 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 -- 172.21.15.12:0/3733463941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 msgr2=0x7fb53412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/3733463941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb53412ec80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb5240097f0 tx=0x7fb52401c4c0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 -- 172.21.15.12:0/3733463941 shutdown_connections 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/3733463941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb53412ec80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 -- 172.21.15.12:0/3733463941 >> 172.21.15.12:0/3733463941 conn(0x7fb5340a10a0 msgr2=0x7fb5340a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 -- 172.21.15.12:0/3733463941 shutdown_connections 2024-09-13T19:06:13.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.960+0000 7fb53a9e9640 1 -- 172.21.15.12:0/3733463941 wait complete. 2024-09-13T19:06:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 --2- 172.21.15.12:0/2579140795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c098e10 0x7f841c096450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8410009740 tx=0x7f841001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4481c04332e5293c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f841b7fe640 1 -- 172.21.15.12:0/2579140795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84100b0070 con 0x7f841c098e10 2024-09-13T19:06:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f841b7fe640 1 -- 172.21.15.12:0/2579140795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100ab530 con 0x7f841c098e10 2024-09-13T19:06:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 Processor -- start 2024-09-13T19:06:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f841b7fe640 1 -- 172.21.15.12:0/2579140795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84100ab830 con 0x7f841c098e10 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 -- start start 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/2579140795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c098e10 msgr2=0x7f841c096450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 --2- 172.21.15.12:0/2579140795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c098e10 0x7f841c096450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8410009740 tx=0x7f841001c420 comp rx=0 tx=0).stop 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/2579140795 shutdown_connections 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 --2- 172.21.15.12:0/2579140795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c098e10 0x7f841c096450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/2579140795 >> 172.21.15.12:0/2579140795 conn(0x7f841c09cd50 msgr2=0x7f841c09d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb534136e30 con 0x7fb53412e760 2024-09-13T19:06:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/2579140795 shutdown_connections 2024-09-13T19:06:13.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/2579140795 wait complete. 2024-09-13T19:06:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb533fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb533fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42992/0 (socket says 172.21.15.12:42992) 2024-09-13T19:06:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb533fff640 1 -- 172.21.15.12:0/2046892011 learned_addr learned my addr 172.21.15.12:0/2046892011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb533fff640 1 -- 172.21.15.12:0/2046892011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53409ded0 con 0x7fb53412e760 2024-09-13T19:06:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb533fff640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ae040 tx=0x7fb52401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5240ba020 con 0x7fb53412e760 2024-09-13T19:06:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 Processor -- start 2024-09-13T19:06:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5240b6420 con 0x7fb53412e760 2024-09-13T19:06:13.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5240b0040 con 0x7fb53412e760 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- start start 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f841c098730 con 0x7f841c096990 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42994/0 (socket says 172.21.15.12:42994) 2024-09-13T19:06:13.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 -- 172.21.15.12:0/125089450 learned_addr learned my addr 172.21.15.12:0/125089450 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53412f8d0 con 0x7fb53412e760 2024-09-13T19:06:13.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb534131a90 con 0x7fb53412e760 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 -- 172.21.15.12:0/125089450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c092f70 con 0x7f841c096990 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f842080a640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8410019030 tx=0x7f841001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84100b0050 con 0x7f841c096990 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84100bc070 con 0x7f841c096990 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c0933b0 con 0x7f841c096990 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.964+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84100aa8e0 con 0x7f841c096990 2024-09-13T19:06:13.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c093dd0 con 0x7f841c096990 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb5240bd020 con 0x7fb53412e760 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb530ff9640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 0x7fb520038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb5240e2a40 con 0x7fb53412e760 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53412ec80 con 0x7fb53412e760 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb5337fe640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 0x7fb520038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7fb5337fe640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 0x7fb520038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5280015d0 tx=0x7fb528007a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.968+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c096450 con 0x7f841c096990 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f84100aaa80 con 0x7f841c096990 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7f84197fa640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 0x7f8400038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7f841bfff640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 0x7f8400038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7f841bfff640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 0x7f8400038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8408007fd0 tx=0x7f8408007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:13.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb5240c4030 con 0x7fb53412e760 2024-09-13T19:06:13.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.972+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f84100e8060 con 0x7f841c096990 2024-09-13T19:06:13.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:13.976+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8410016010 con 0x7f841c096990 2024-09-13T19:06:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.060+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe4f006c0d0 con 0x7fe4f0096180 2024-09-13T19:06:14.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.060+0000 7fe4d7fff640 1 -- 172.21.15.12:0/3176837613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe4e00b5d50 con 0x7fe4f0096180 2024-09-13T19:06:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 msgr2=0x7fe4dc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 0x7fe4dc038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4005890 tx=0x7fe4e4007a90 comp rx=0 tx=0).stop 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 msgr2=0x7fe4f012fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4e001a030 tx=0x7fe4e001ac40 comp rx=0 tx=0).stop 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 shutdown_connections 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4dc035db0 0x7fe4dc038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 --2- 172.21.15.12:0/3176837613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f0096180 0x7fe4f012fc80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 >> 172.21.15.12:0/3176837613 conn(0x7fe4f009a940 msgr2=0x7fe4f0099500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 shutdown_connections 2024-09-13T19:06:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.064+0000 7fe4f5f35640 1 -- 172.21.15.12:0/3176837613 wait complete. 2024-09-13T19:06:14.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-13T19:06:14.094 DEBUG:teuthology.parallel:result is None 2024-09-13T19:06:14.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.112+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f57d012ed80 con 0x7f57d006bc50 2024-09-13T19:06:14.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57cd7fa640 1 -- 172.21.15.12:0/101301329 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57c40138e0 con 0x7f57d006bc50 2024-09-13T19:06:14.123 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:14.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 msgr2=0x7f57b4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 0x7f57b4038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0ae000 tx=0x7f57bc008040 comp rx=0 tx=0).stop 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 msgr2=0x7f57d006e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c390 tx=0x7f57c400c850 comp rx=0 tx=0).stop 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 shutdown_connections 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f57b4035db0 0x7f57b4038270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 --2- 172.21.15.12:0/101301329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57d006bc50 0x7f57d006e040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 >> 172.21.15.12:0/101301329 conn(0x7f57d009ab00 msgr2=0x7f57d0132af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 shutdown_connections 2024-09-13T19:06:14.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.116+0000 7f57d70ec640 1 -- 172.21.15.12:0/101301329 wait complete. 2024-09-13T19:06:14.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-09-13T19:06:14.140 DEBUG:teuthology.parallel:result is None 2024-09-13T19:06:14.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.132+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb53406e930 con 0x7fb53412e760 2024-09-13T19:06:14.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.132+0000 7fb530ff9640 1 -- 172.21.15.12:0/2046892011 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5240160b0 con 0x7fb53412e760 2024-09-13T19:06:14.142 INFO:teuthology.orchestra.run.smithi012.stdout:38654705669 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 msgr2=0x7fb520038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 0x7fb520038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5280015d0 tx=0x7fb528007a30 comp rx=0 tx=0).stop 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 msgr2=0x7fb5340953c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5240ae040 tx=0x7fb52401ad00 comp rx=0 tx=0).stop 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 shutdown_connections 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb520035db0 0x7fb520038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 --2- 172.21.15.12:0/2046892011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb53412e760 0x7fb5340953c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 >> 172.21.15.12:0/2046892011 conn(0x7fb5340a10a0 msgr2=0x7fb53412c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 shutdown_connections 2024-09-13T19:06:14.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.136+0000 7fb53a9e9640 1 -- 172.21.15.12:0/2046892011 wait complete. 2024-09-13T19:06:14.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.140+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f841c075bf0 con 0x7f841c096990 2024-09-13T19:06:14.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.140+0000 7f84197fa640 1 -- 172.21.15.12:0/125089450 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84100b4e20 con 0x7f841c096990 2024-09-13T19:06:14.149 INFO:teuthology.orchestra.run.smithi012.stdout:38654705668 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 msgr2=0x7f8400038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 0x7f8400038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8408007fd0 tx=0x7f8408007980 comp rx=0 tx=0).stop 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 msgr2=0x7f841c130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8410019030 tx=0x7f841001ac60 comp rx=0 tx=0).stop 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 shutdown_connections 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8400035db0 0x7f8400038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 --2- 172.21.15.12:0/125089450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f841c096990 0x7f841c130060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 >> 172.21.15.12:0/125089450 conn(0x7f841c09cd50 msgr2=0x7f841c099cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 shutdown_connections 2024-09-13T19:06:14.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.144+0000 7f8422a6e640 1 -- 172.21.15.12:0/125089450 wait complete. 2024-09-13T19:06:14.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-09-13T19:06:14.161 DEBUG:teuthology.parallel:result is None 2024-09-13T19:06:14.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2024-09-13T19:06:14.167 DEBUG:teuthology.parallel:result is None 2024-09-13T19:06:14.167 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:06:14.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:06:14.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f3141d70640 1 Processor -- start 2024-09-13T19:06:14.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f3141d70640 1 -- start start 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f3141d70640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f313c06d0e0 0x7f313c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f3141d70640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313c071c10 con 0x7f313c06da00 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f3141d70640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f313c072230 con 0x7f313c06d0e0 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f313c06d0e0 0x7f313c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f313c06d0e0 0x7f313c06d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42998/0 (socket says 172.21.15.12:42998) 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313affd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f313c06da00 0x7f313c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34324/0 (socket says 172.21.15.12:34324) 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313b7fe640 1 -- 172.21.15.12:0/3108764840 learned_addr learned my addr 172.21.15.12:0/3108764840 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313b7fe640 1 -- 172.21.15.12:0/3108764840 >> v1:172.21.15.12:6789/0 conn(0x7f313c06da00 legacy=0x7f313c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313b7fe640 1 -- 172.21.15.12:0/3108764840 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c0709e0 con 0x7f313c06d0e0 2024-09-13T19:06:14.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.312+0000 7f313a7fc640 1 -- 172.21.15.12:0/3108764840 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208447108 0 0) 0x7f313c071c10 con 0x7f313c06da00 2024-09-13T19:06:14.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f313b7fe640 1 --2- 172.21.15.12:0/3108764840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06d4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31300097f0 tx=0x7f313001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b57d526798dd32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f313a7fc640 1 -- 172.21.15.12:0/3108764840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31300b0070 con 0x7f313c06d0e0 2024-09-13T19:06:14.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f313a7fc640 1 -- 172.21.15.12:0/3108764840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31300ab530 con 0x7f313c06d0e0 2024-09-13T19:06:14.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f313a7fc640 1 -- 172.21.15.12:0/3108764840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31300ab830 con 0x7f313c06d0e0 2024-09-13T19:06:14.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- 172.21.15.12:0/3108764840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 msgr2=0x7f313c06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 --2- 172.21.15.12:0/3108764840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06d4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31300097f0 tx=0x7f313001c430 comp rx=0 tx=0).stop 2024-09-13T19:06:14.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- 172.21.15.12:0/3108764840 shutdown_connections 2024-09-13T19:06:14.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 --2- 172.21.15.12:0/3108764840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06d4c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- 172.21.15.12:0/3108764840 >> 172.21.15.12:0/3108764840 conn(0x7f313c099a50 msgr2=0x7f313c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- 172.21.15.12:0/3108764840 shutdown_connections 2024-09-13T19:06:14.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- 172.21.15.12:0/3108764840 wait complete. 2024-09-13T19:06:14.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 Processor -- start 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.316+0000 7f3141d70640 1 -- start start 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3141d70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3141d70640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f313c134e80 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43014/0 (socket says 172.21.15.12:43014) 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313b7fe640 1 -- 172.21.15.12:0/240825134 learned_addr learned my addr 172.21.15.12:0/240825134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313b7fe640 1 -- 172.21.15.12:0/240825134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c12bd70 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313b7fe640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3130019040 tx=0x7f313001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31300b0040 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130004020 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c06fa10 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31300abe60 con 0x7f313c06d0e0 2024-09-13T19:06:14.328 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c06fed0 con 0x7f313c06d0e0 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31300b3070 con 0x7f313c06d0e0 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c070100 con 0x7f313c06d0e0 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 0x7f3128038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f31300e2b20 con 0x7f313c06d0e0 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313affd640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 0x7f3128038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.320+0000 7f313affd640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 0x7f3128038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f312c007fd0 tx=0x7f312c007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.333 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.324+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f31300c3030 con 0x7f313c06d0e0 2024-09-13T19:06:14.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.484+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f313c06d4c0 con 0x7f3128035db0 2024-09-13T19:06:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3123fff640 1 -- 172.21.15.12:0/240825134 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32236 (secure 0 0 0) 0x7f313c06d4c0 con 0x7f3128035db0 2024-09-13T19:06:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:06:14.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 msgr2=0x7f3128038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 0x7f3128038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f312c007fd0 tx=0x7f312c007940 comp rx=0 tx=0).stop 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 msgr2=0x7f313c06e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3130019040 tx=0x7f313001ac70 comp rx=0 tx=0).stop 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 shutdown_connections 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3128035db0 0x7f3128038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 --2- 172.21.15.12:0/240825134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f313c06d0e0 0x7f313c06e1f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.488+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 >> 172.21.15.12:0/240825134 conn(0x7f313c099a50 msgr2=0x7f313c09b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.492+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 shutdown_connections 2024-09-13T19:06:14.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.492+0000 7f3141d70640 1 -- 172.21.15.12:0/240825134 wait complete. 2024-09-13T19:06:14.514 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-13T19:06:12.900754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114024,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373336,"statfs":{"total":386547056640,"available":386430296064,"internally_reserved":0,"allocated":1785856,"data_stored":1373114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.687504"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.228117+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:11.228117+0000","last_peered":"2024-09-13T19:06:11.228117+0000","last_clean":"2024-09-13T19:06:11.228117+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:11.228117+0000","last_undegraded":"2024-09-13T19:06:11.228117+0000","last_fullsized":"2024-09-13T19:06:11.228117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.225661+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:11.225661+0000","last_peered":"2024-09-13T19:06:11.225661+0000","last_clean":"2024-09-13T19:06:11.225661+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:11.225661+0000","last_undegraded":"2024-09-13T19:06:11.225661+0000","last_fullsized":"2024-09-13T19:06:11.225661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.227657+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:11.227657+0000","last_peered":"2024-09-13T19:06:11.227657+0000","last_clean":"2024-09-13T19:06:11.227657+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:11.227657+0000","last_undegraded":"2024-09-13T19:06:11.227657+0000","last_fullsized":"2024-09-13T19:06:11.227657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.225423+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:11.225423+0000","last_peered":"2024-09-13T19:06:11.225423+0000","last_clean":"2024-09-13T19:06:11.225423+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:11.225423+0000","last_undegraded":"2024-09-13T19:06:11.225423+0000","last_fullsized":"2024-09-13T19:06:11.225423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.227983+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:11.227983+0000","last_peered":"2024-09-13T19:06:11.227983+0000","last_clean":"2024-09-13T19:06:11.227983+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:11.227983+0000","last_undegraded":"2024-09-13T19:06:11.227983+0000","last_fullsized":"2024-09-13T19:06:11.227983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.422606+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:11.422606+0000","last_peered":"2024-09-13T19:06:11.422606+0000","last_clean":"2024-09-13T19:06:11.422606+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:11.422606+0000","last_undegraded":"2024-09-13T19:06:11.422606+0000","last_fullsized":"2024-09-13T19:06:11.422606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.226200+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:11.226200+0000","last_peered":"2024-09-13T19:06:11.226200+0000","last_clean":"2024-09-13T19:06:11.226200+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:11.226200+0000","last_undegraded":"2024-09-13T19:06:11.226200+0000","last_fullsized":"2024-09-13T19:06:11.226200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.228296+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:11.228296+0000","last_peered":"2024-09-13T19:06:11.228296+0000","last_clean":"2024-09-13T19:06:11.228296+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:11.228296+0000","last_undegraded":"2024-09-13T19:06:11.228296+0000","last_fullsized":"2024-09-13T19:06:11.228296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.221178+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:11.221178+0000","last_peered":"2024-09-13T19:06:11.221178+0000","last_clean":"2024-09-13T19:06:11.221178+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:11.221178+0000","last_undegraded":"2024-09-13T19:06:11.221178+0000","last_fullsized":"2024-09-13T19:06:11.221178+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":48104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":638453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":638453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":48104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:06:14.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:06:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd127477640 1 Processor -- start 2024-09-13T19:06:14.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd127477640 1 -- start start 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd127477640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd120072760 0x7fd120072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd127477640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd12006fa30 con 0x7fd12006f190 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd127477640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd12006e800 con 0x7fd120072760 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd125213640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd120072760 0x7fd120072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd124a12640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd12006f190 0x7fd12006d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34332/0 (socket says 172.21.15.12:34332) 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd124a12640 1 -- 172.21.15.12:0/701941977 learned_addr learned my addr 172.21.15.12:0/701941977 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd117fff640 1 -- 172.21.15.12:0/701941977 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111882518 0 0) 0x7fd12006fa30 con 0x7fd12006f190 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd117fff640 1 -- 172.21.15.12:0/701941977 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd10c003530 con 0x7fd12006f190 2024-09-13T19:06:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd125213640 1 -- 172.21.15.12:0/701941977 >> v1:172.21.15.12:6789/0 conn(0x7fd12006f190 legacy=0x7fd12006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.616+0000 7fd125213640 1 -- 172.21.15.12:0/701941977 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd12006fd40 con 0x7fd120072760 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd125213640 1 --2- 172.21.15.12:0/701941977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd120072760 0x7fd120072b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009740 tx=0x7fd11c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10659bf0bc604b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd117fff640 1 -- 172.21.15.12:0/701941977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd11c0b0070 con 0x7fd120072760 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd117fff640 1 -- 172.21.15.12:0/701941977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c0ab530 con 0x7fd120072760 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd117fff640 1 -- 172.21.15.12:0/701941977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd11c0ab830 con 0x7fd120072760 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- 172.21.15.12:0/701941977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd120072760 msgr2=0x7fd120072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 --2- 172.21.15.12:0/701941977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd120072760 0x7fd120072b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009740 tx=0x7fd11c01c370 comp rx=0 tx=0).stop 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- 172.21.15.12:0/701941977 shutdown_connections 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 --2- 172.21.15.12:0/701941977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd120072760 0x7fd120072b40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- 172.21.15.12:0/701941977 >> 172.21.15.12:0/701941977 conn(0x7fd120099a50 msgr2=0x7fd1200972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- 172.21.15.12:0/701941977 shutdown_connections 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- 172.21.15.12:0/701941977 wait complete. 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 Processor -- start 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- start start 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd127477640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd120137620 con 0x7fd12006f190 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd125213640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd125213640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43044/0 (socket says 172.21.15.12:43044) 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.620+0000 7fd125213640 1 -- 172.21.15.12:0/1869243681 learned_addr learned my addr 172.21.15.12:0/1869243681 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd125213640 1 -- 172.21.15.12:0/1869243681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1201252f0 con 0x7fd12006f190 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd125213640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0ae040 tx=0x7fd11c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd11c0b0050 con 0x7fd12006f190 2024-09-13T19:06:14.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c0b1040 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd120132ca0 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd11c0b5610 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd120122670 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120072b40 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd11c0be030 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 0x7fd104038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd11c0bc070 con 0x7fd12006f190 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd124a12640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 0x7fd104038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.624+0000 7fd124a12640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 0x7fd104038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd110007fd0 tx=0x7fd110007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.628+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd11c0c5060 con 0x7fd12006f190 2024-09-13T19:06:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.780+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd120124e70 con 0x7fd104035db0 2024-09-13T19:06:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd115ffb640 1 -- 172.21.15.12:0/1869243681 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32236 (secure 0 0 0) 0x7fd120124e70 con 0x7fd104035db0 2024-09-13T19:06:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:06:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 msgr2=0x7fd104038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 0x7fd104038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd110007fd0 tx=0x7fd110007980 comp rx=0 tx=0).stop 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 msgr2=0x7fd120122130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0ae040 tx=0x7fd11c01abb0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 shutdown_connections 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd104035db0 0x7fd104038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 --2- 172.21.15.12:0/1869243681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd12006f190 0x7fd120122130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 >> 172.21.15.12:0/1869243681 conn(0x7fd120099a50 msgr2=0x7fd120070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 shutdown_connections 2024-09-13T19:06:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.784+0000 7fd127477640 1 -- 172.21.15.12:0/1869243681 wait complete. 2024-09-13T19:06:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-13T19:06:12.900754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114024,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373336,"statfs":{"total":386547056640,"available":386430296064,"internally_reserved":0,"allocated":1785856,"data_stored":1373114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.687504"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.228117+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:11.228117+0000","last_peered":"2024-09-13T19:06:11.228117+0000","last_clean":"2024-09-13T19:06:11.228117+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:11.228117+0000","last_undegraded":"2024-09-13T19:06:11.228117+0000","last_fullsized":"2024-09-13T19:06:11.228117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.225661+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:11.225661+0000","last_peered":"2024-09-13T19:06:11.225661+0000","last_clean":"2024-09-13T19:06:11.225661+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:11.225661+0000","last_undegraded":"2024-09-13T19:06:11.225661+0000","last_fullsized":"2024-09-13T19:06:11.225661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.227657+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:11.227657+0000","last_peered":"2024-09-13T19:06:11.227657+0000","last_clean":"2024-09-13T19:06:11.227657+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:11.227657+0000","last_undegraded":"2024-09-13T19:06:11.227657+0000","last_fullsized":"2024-09-13T19:06:11.227657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.225423+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:11.225423+0000","last_peered":"2024-09-13T19:06:11.225423+0000","last_clean":"2024-09-13T19:06:11.225423+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:11.225423+0000","last_undegraded":"2024-09-13T19:06:11.225423+0000","last_fullsized":"2024-09-13T19:06:11.225423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.227983+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:11.227983+0000","last_peered":"2024-09-13T19:06:11.227983+0000","last_clean":"2024-09-13T19:06:11.227983+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:11.227983+0000","last_undegraded":"2024-09-13T19:06:11.227983+0000","last_fullsized":"2024-09-13T19:06:11.227983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.422606+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:11.422606+0000","last_peered":"2024-09-13T19:06:11.422606+0000","last_clean":"2024-09-13T19:06:11.422606+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:11.422606+0000","last_undegraded":"2024-09-13T19:06:11.422606+0000","last_fullsized":"2024-09-13T19:06:11.422606+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.226200+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:11.226200+0000","last_peered":"2024-09-13T19:06:11.226200+0000","last_clean":"2024-09-13T19:06:11.226200+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:11.226200+0000","last_undegraded":"2024-09-13T19:06:11.226200+0000","last_fullsized":"2024-09-13T19:06:11.226200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.228296+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:11.228296+0000","last_peered":"2024-09-13T19:06:11.228296+0000","last_clean":"2024-09-13T19:06:11.228296+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:11.228296+0000","last_undegraded":"2024-09-13T19:06:11.228296+0000","last_fullsized":"2024-09-13T19:06:11.228296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'117","reported_seq":170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T19:06:11.221178+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:11.221178+0000","last_peered":"2024-09-13T19:06:11.221178+0000","last_clean":"2024-09-13T19:06:11.221178+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:11.221178+0000","last_undegraded":"2024-09-13T19:06:11.221178+0000","last_fullsized":"2024-09-13T19:06:11.221178+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":151552,"data_stored":48104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":638453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":741376,"data_stored":638453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":48104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:06:14.810 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:06:14.810 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T19:06:14.810 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T19:06:14.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T19:06:14.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e5daf2640 1 Processor -- start 2024-09-13T19:06:14.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e5daf2640 1 -- start start 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e5daf2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e5806d0e0 0x7f4e5806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e5daf2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e58071c10 con 0x7f4e5806da00 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e5daf2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4e58072230 con 0x7f4e5806d0e0 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e577fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e5806d0e0 0x7f4e5806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e4effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4e5806da00 0x7f4e5812ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34342/0 (socket says 172.21.15.12:34342) 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.908+0000 7f4e4effd640 1 -- 172.21.15.12:0/3593539445 learned_addr learned my addr 172.21.15.12:0/3593539445 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e577fe640 1 -- 172.21.15.12:0/3593539445 >> v1:172.21.15.12:6789/0 conn(0x7f4e5806da00 legacy=0x7f4e5812ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e577fe640 1 -- 172.21.15.12:0/3593539445 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e580709e0 con 0x7f4e5806d0e0 2024-09-13T19:06:14.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e577fe640 1 --2- 172.21.15.12:0/3593539445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e5806d4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009740 tx=0x7f4e4801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c79b6286366b640 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e56ffd640 1 -- 172.21.15.12:0/3593539445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e480b0070 con 0x7f4e5806d0e0 2024-09-13T19:06:14.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e56ffd640 1 -- 172.21.15.12:0/3593539445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e480ab530 con 0x7f4e5806d0e0 2024-09-13T19:06:14.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e56ffd640 1 -- 172.21.15.12:0/3593539445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e480ab830 con 0x7f4e5806d0e0 2024-09-13T19:06:14.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 -- 172.21.15.12:0/3593539445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 msgr2=0x7f4e5806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:14.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/3593539445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e5806d4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e48009740 tx=0x7f4e4801c370 comp rx=0 tx=0).stop 2024-09-13T19:06:14.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 -- 172.21.15.12:0/3593539445 shutdown_connections 2024-09-13T19:06:14.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/3593539445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e5806d4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:14.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 -- 172.21.15.12:0/3593539445 >> 172.21.15.12:0/3593539445 conn(0x7f4e58099a50 msgr2=0x7f4e580972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:14.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 -- 172.21.15.12:0/3593539445 shutdown_connections 2024-09-13T19:06:14.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.912+0000 7f4e5daf2640 1 -- 172.21.15.12:0/3593539445 wait complete. 2024-09-13T19:06:14.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 Processor -- start 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 -- start start 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58134e80 con 0x7f4e5806d0e0 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e577fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43068/0 (socket says 172.21.15.12:43068) 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e577fe640 1 -- 172.21.15.12:0/4065121959 learned_addr learned my addr 172.21.15.12:0/4065121959 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e577fe640 1 -- 172.21.15.12:0/4065121959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5812bfc0 con 0x7f4e5806d0e0 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e577fe640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e480ae040 tx=0x7f4e4801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e480b0050 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e480b1040 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5806f660 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e480b5780 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e581c68a0 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5806d4c0 con 0x7f4e5806d0e0 2024-09-13T19:06:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4e480be030 con 0x7f4e5806d0e0 2024-09-13T19:06:14.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 0x7f4e38038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:14.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f4e480bc070 con 0x7f4e5806d0e0 2024-09-13T19:06:14.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e4effd640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 0x7f4e38038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:14.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.916+0000 7f4e4effd640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 0x7f4e38038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e40001610 tx=0x7f4e40007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:14.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:14.920+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4e480c5060 con 0x7f4e5806d0e0 2024-09-13T19:06:15.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.112+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e58073790 con 0x7f4e5806d0e0 2024-09-13T19:06:15.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.112+0000 7f4e54ff9640 1 -- 172.21.15.12:0/4065121959 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4e48015ff0 con 0x7f4e5806d0e0 2024-09-13T19:06:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:06:15.121 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 msgr2=0x7f4e38038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 0x7f4e38038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e40001610 tx=0x7f4e40007ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 msgr2=0x7f4e581c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4e480ae040 tx=0x7f4e4801abb0 comp rx=0 tx=0).stop 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 shutdown_connections 2024-09-13T19:06:15.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e38035db0 0x7f4e38038270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 --2- 172.21.15.12:0/4065121959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e5806d0e0 0x7f4e581c6360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 >> 172.21.15.12:0/4065121959 conn(0x7f4e58099a50 msgr2=0x7f4e5809b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 shutdown_connections 2024-09-13T19:06:15.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:06:15.116+0000 7f4e5daf2640 1 -- 172.21.15.12:0/4065121959 wait complete. 2024-09-13T19:06:15.139 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T19:06:15.139 INFO:teuthology.run_tasks:Running task rgw... 2024-09-13T19:06:15.158 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-13T19:06:15.158 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-13T19:06:15.159 INFO:tasks.rgw:Creating data pools 2024-09-13T19:06:15.159 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-13T19:06:15.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-13T19:06:15.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb6a01e1640 1 Processor -- start 2024-09-13T19:06:15.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb6a01e1640 1 -- start start 2024-09-13T19:06:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb6a01e1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb69810f880 0x7fb69811b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb6a01e1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69811b660 con 0x7fb69810ed90 2024-09-13T19:06:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb6a01e1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb69811c840 con 0x7fb69810f880 2024-09-13T19:06:15.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69d77c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb69810f880 0x7fb69811b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69df7d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb69810ed90 0x7fb69810f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:47560/0 (socket says 172.21.15.151:47560) 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69df7d640 1 -- 172.21.15.151:0/3085463601 learned_addr learned my addr 172.21.15.151:0/3085463601 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69cf7b640 1 -- 172.21.15.151:0/3085463601 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890641133 0 0) 0x7fb69811b660 con 0x7fb69810ed90 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69cf7b640 1 -- 172.21.15.151:0/3085463601 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb684003530 con 0x7fb69810ed90 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69d77c640 1 -- 172.21.15.151:0/3085463601 >> v1:172.21.15.12:6789/0 conn(0x7fb69810ed90 legacy=0x7fb69810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:15.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.291+0000 7fb69d77c640 1 -- 172.21.15.151:0/3085463601 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69811c9c0 con 0x7fb69810f880 2024-09-13T19:06:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb69d77c640 1 --2- 172.21.15.151:0/3085463601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810f880 0x7fb69811b120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb694009740 tx=0x7fb69401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fb256308bccd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb69cf7b640 1 -- 172.21.15.151:0/3085463601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6940b1070 con 0x7fb69810f880 2024-09-13T19:06:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb69cf7b640 1 -- 172.21.15.151:0/3085463601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6940ac520 con 0x7fb69810f880 2024-09-13T19:06:15.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb69cf7b640 1 -- 172.21.15.151:0/3085463601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6940ac820 con 0x7fb69810f880 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- 172.21.15.151:0/3085463601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810f880 msgr2=0x7fb69811b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/3085463601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810f880 0x7fb69811b120 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb694009740 tx=0x7fb69401c370 comp rx=0 tx=0).stop 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- 172.21.15.151:0/3085463601 shutdown_connections 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/3085463601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810f880 0x7fb69811b120 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- 172.21.15.151:0/3085463601 >> 172.21.15.151:0/3085463601 conn(0x7fb69806f370 msgr2=0x7fb698071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:15.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- 172.21.15.151:0/3085463601 shutdown_connections 2024-09-13T19:06:15.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- 172.21.15.151:0/3085463601 wait complete. 2024-09-13T19:06:15.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 Processor -- start 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.295+0000 7fb6a01e1640 1 -- start start 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb6a01e1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb6a01e1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb69811c470 con 0x7fb69810ed90 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69df7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69df7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50106/0 (socket says 172.21.15.151:50106) 2024-09-13T19:06:15.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69df7d640 1 -- 172.21.15.151:0/92328706 learned_addr learned my addr 172.21.15.151:0/92328706 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69df7d640 1 -- 172.21.15.151:0/92328706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6981ad0f0 con 0x7fb69810ed90 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69df7d640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c450 tx=0x7fb68800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb688017070 con 0x7fb69810ed90 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6981ad380 con 0x7fb69810ed90 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688005c20 con 0x7fb69810ed90 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb688007070 con 0x7fb69810ed90 2024-09-13T19:06:15.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6981a6d90 con 0x7fb69810ed90 2024-09-13T19:06:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69810f170 con 0x7fb69810ed90 2024-09-13T19:06:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb68801a070 con 0x7fb69810ed90 2024-09-13T19:06:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 0x7fb67c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb6880482d0 con 0x7fb69810ed90 2024-09-13T19:06:15.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69d77c640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 0x7fb67c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:15.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.299+0000 7fb69d77c640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 0x7fb67c038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb694009740 tx=0x7fb694008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:15.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.311+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb688007210 con 0x7fb69810ed90 2024-09-13T19:06:15.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:15.479+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fb6981ad5b0 con 0x7fb69810ed90 2024-09-13T19:06:16.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.227+0000 7fb68e7fc640 1 -- 172.21.15.151:0/92328706 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7fb6880461b0 con 0x7fb69810ed90 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 msgr2=0x7fb67c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 0x7fb67c038220 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb694009740 tx=0x7fb694008040 comp rx=0 tx=0).stop 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 msgr2=0x7fb6981acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c450 tx=0x7fb68800c910 comp rx=0 tx=0).stop 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 shutdown_connections 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb67c035d60 0x7fb67c038220 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 --2- 172.21.15.151:0/92328706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb69810ed90 0x7fb6981acb20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:16.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 >> 172.21.15.151:0/92328706 conn(0x7fb69806f370 msgr2=0x7fb698117560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:16.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 shutdown_connections 2024-09-13T19:06:16.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.231+0000 7fb6a01e1640 1 -- 172.21.15.151:0/92328706 wait complete. 2024-09-13T19:06:16.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9147455640 1 Processor -- start 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9147455640 1 -- start start 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9147455640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f914010ed90 0x7f914010f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9147455640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914010fb60 con 0x7f914010f6b0 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9147455640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f914011c840 con 0x7f914010ed90 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f91449f0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f914010f6b0 0x7f914011a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:47570/0 (socket says 172.21.15.151:47570) 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f91449f0640 1 -- 172.21.15.151:0/2270857785 learned_addr learned my addr 172.21.15.151:0/2270857785 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:16.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f91451f1640 1 --2- 172.21.15.151:0/2270857785 >> v2:172.21.15.12:3300/0 conn(0x7f914010ed90 0x7f914010f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:16.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9137fff640 1 -- 172.21.15.151:0/2270857785 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064503836 0 0) 0x7f914010fb60 con 0x7f914010f6b0 2024-09-13T19:06:16.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f9137fff640 1 -- 172.21.15.151:0/2270857785 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f912c003530 con 0x7f914010f6b0 2024-09-13T19:06:16.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f91451f1640 1 -- 172.21.15.151:0/2270857785 >> v1:172.21.15.12:6789/0 conn(0x7f914010f6b0 legacy=0x7f914011a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:16.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.383+0000 7f91451f1640 1 -- 172.21.15.151:0/2270857785 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914011c9c0 con 0x7f914010ed90 2024-09-13T19:06:16.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f91451f1640 1 --2- 172.21.15.151:0/2270857785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010f170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f913c009740 tx=0x7f913c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b712928b6c7f9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:16.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9137fff640 1 -- 172.21.15.151:0/2270857785 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f913c0b1070 con 0x7f914010ed90 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9137fff640 1 -- 172.21.15.151:0/2270857785 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c0ac520 con 0x7f914010ed90 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9137fff640 1 -- 172.21.15.151:0/2270857785 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f913c0ac800 con 0x7f914010ed90 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- 172.21.15.151:0/2270857785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 msgr2=0x7f914010f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 --2- 172.21.15.151:0/2270857785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010f170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f913c009740 tx=0x7f913c01c370 comp rx=0 tx=0).stop 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- 172.21.15.151:0/2270857785 shutdown_connections 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 --2- 172.21.15.151:0/2270857785 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010f170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- 172.21.15.151:0/2270857785 >> 172.21.15.151:0/2270857785 conn(0x7f914006f370 msgr2=0x7f9140071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- 172.21.15.151:0/2270857785 shutdown_connections 2024-09-13T19:06:16.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- 172.21.15.151:0/2270857785 wait complete. 2024-09-13T19:06:16.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 Processor -- start 2024-09-13T19:06:16.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- start start 2024-09-13T19:06:16.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:16.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f9147455640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f914011c410 con 0x7f914010ed90 2024-09-13T19:06:16.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.387+0000 7f91451f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:16.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91451f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50126/0 (socket says 172.21.15.151:50126) 2024-09-13T19:06:16.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91451f1640 1 -- 172.21.15.151:0/3780414244 learned_addr learned my addr 172.21.15.151:0/3780414244 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:16.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91451f1640 1 -- 172.21.15.151:0/3780414244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91401104b0 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91451f1640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f913c0af040 tx=0x7f913c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f913c0ba020 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c0acc10 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91401106e0 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f913c0b1040 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9140110ba0 con 0x7f914010ed90 2024-09-13T19:06:16.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914010f170 con 0x7f914010ed90 2024-09-13T19:06:16.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f913c0bd020 con 0x7f914010ed90 2024-09-13T19:06:16.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 0x7f9124038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:16.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3825+0+0 (secure 0 0 0) 0x7f913c0e3060 con 0x7f914010ed90 2024-09-13T19:06:16.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91449f0640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 0x7f9124038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:16.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.391+0000 7f91449f0640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 0x7f9124038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9130007fd0 tx=0x7f9130007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:16.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.403+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f913c0c4030 con 0x7f914010ed90 2024-09-13T19:06:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:16.559+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f914010f6b0 con 0x7f914010ed90 2024-09-13T19:06:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.219+0000 7f9135ffb640 1 -- 172.21.15.151:0/3780414244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7f913c0a9070 con 0x7f914010ed90 2024-09-13T19:06:18.222 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.data' created 2024-09-13T19:06:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 msgr2=0x7f9124038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:18.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 0x7f9124038270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9130007fd0 tx=0x7f9130007980 comp rx=0 tx=0).stop 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 msgr2=0x7f914010ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f913c0af040 tx=0x7f913c019110 comp rx=0 tx=0).stop 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 shutdown_connections 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9124035db0 0x7f9124038270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 --2- 172.21.15.151:0/3780414244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f914010ed90 0x7f914010ff70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 >> 172.21.15.151:0/3780414244 conn(0x7f914006f370 msgr2=0x7f914011a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 shutdown_connections 2024-09-13T19:06:18.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.223+0000 7f9147455640 1 -- 172.21.15.151:0/3780414244 wait complete. 2024-09-13T19:06:18.254 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-13T19:06:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.371+0000 7fa10a3ab640 1 Processor -- start 2024-09-13T19:06:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.371+0000 7fa10a3ab640 1 -- start start 2024-09-13T19:06:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa10a3ab640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa10410ed90 0x7fa10410f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa10a3ab640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa10410fb60 con 0x7fa10410f6b0 2024-09-13T19:06:18.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa10a3ab640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa10411c840 con 0x7fa10410ed90 2024-09-13T19:06:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa10410ed90 0x7fa10410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa10410ed90 0x7fa10410f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33378/0 (socket says 172.21.15.151:33378) 2024-09-13T19:06:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 -- 172.21.15.151:0/1878439626 learned_addr learned my addr 172.21.15.151:0/1878439626 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 -- 172.21.15.151:0/1878439626 >> v1:172.21.15.12:6789/0 conn(0x7fa10410f6b0 legacy=0x7fa10411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:18.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 -- 172.21.15.151:0/1878439626 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10411c9c0 con 0x7fa10410ed90 2024-09-13T19:06:18.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.375+0000 7fa103fff640 1 --2- 172.21.15.151:0/1878439626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa10410f170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009e50 tx=0x7fa0fc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970f156762528ce9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:18.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa102ffd640 1 -- 172.21.15.151:0/1878439626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc009200 con 0x7fa10410ed90 2024-09-13T19:06:18.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa102ffd640 1 -- 172.21.15.151:0/1878439626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0a57e0 con 0x7fa10410ed90 2024-09-13T19:06:18.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa102ffd640 1 -- 172.21.15.151:0/1878439626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc0a5ae0 con 0x7fa10410ed90 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/1878439626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 msgr2=0x7fa10410f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/1878439626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa10410f170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009e50 tx=0x7fa0fc01c980 comp rx=0 tx=0).stop 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/1878439626 shutdown_connections 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/1878439626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa10410f170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/1878439626 >> 172.21.15.151:0/1878439626 conn(0x7fa10406f390 msgr2=0x7fa1040717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/1878439626 shutdown_connections 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/1878439626 wait complete. 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 Processor -- start 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- start start 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:18.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa10411c3d0 con 0x7fa10410ed90 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa103fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa103fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33380/0 (socket says 172.21.15.151:33380) 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa103fff640 1 -- 172.21.15.151:0/2682579029 learned_addr learned my addr 172.21.15.151:0/2682579029 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa103fff640 1 -- 172.21.15.151:0/2682579029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1041af540 con 0x7fa10410ed90 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa103fff640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc019590 tx=0x7fa0fc019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc0bc020 con 0x7fa10410ed90 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0fc0079e0 con 0x7fa10410ed90 2024-09-13T19:06:18.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1041af770 con 0x7fa10410ed90 2024-09-13T19:06:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0fc007ce0 con 0x7fa10410ed90 2024-09-13T19:06:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.379+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1041a9010 con 0x7fa10410ed90 2024-09-13T19:06:18.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10410f170 con 0x7fa10410ed90 2024-09-13T19:06:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa0fc0bf020 con 0x7fa10410ed90 2024-09-13T19:06:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa100ff9640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 0x7fa0e4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4272+0+0 (secure 0 0 0) 0x7fa0fc0e4460 con 0x7fa10410ed90 2024-09-13T19:06:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa1037fe640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 0x7fa0e4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:18.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.383+0000 7fa1037fe640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 0x7fa0e4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000f70 tx=0x7fa0f4007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:18.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.395+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0fc0c6030 con 0x7fa10410ed90 2024-09-13T19:06:18.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:18.559+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fa10410f6b0 con 0x7fa10410ed90 2024-09-13T19:06:19.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.223+0000 7fa100ff9640 1 -- 172.21.15.151:0/2682579029 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7fa0fc016600 con 0x7fa10410ed90 2024-09-13T19:06:19.225 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-13T19:06:19.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 msgr2=0x7fa0e4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:19.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 0x7fa0e4038220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4000f70 tx=0x7fa0f4007a60 comp rx=0 tx=0).stop 2024-09-13T19:06:19.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 msgr2=0x7fa1041aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:19.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc019590 tx=0x7fa0fc019720 comp rx=0 tx=0).stop 2024-09-13T19:06:19.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 shutdown_connections 2024-09-13T19:06:19.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0e4035d60 0x7fa0e4038220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:19.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 --2- 172.21.15.151:0/2682579029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa10410ed90 0x7fa1041aef70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:19.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 >> 172.21.15.151:0/2682579029 conn(0x7fa10406f390 msgr2=0x7fa104110140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:19.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.227+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 shutdown_connections 2024-09-13T19:06:19.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.231+0000 7fa10a3ab640 1 -- 172.21.15.151:0/2682579029 wait complete. 2024-09-13T19:06:19.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-13T19:06:19.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.399+0000 7fe43c972640 1 Processor -- start 2024-09-13T19:06:19.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.399+0000 7fe43c972640 1 -- start start 2024-09-13T19:06:19.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43c972640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe438113b70 0x7fe438113f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:19.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43c972640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4381145e0 con 0x7fe4380732a0 2024-09-13T19:06:19.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43c972640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe438073e40 con 0x7fe438113b70 2024-09-13T19:06:19.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe438113b70 0x7fe438113f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:19.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe435d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe4380732a0 0x7fe438073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:54066/0 (socket says 172.21.15.151:54066) 2024-09-13T19:06:19.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe438113b70 0x7fe438113f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33382/0 (socket says 172.21.15.151:33382) 2024-09-13T19:06:19.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe435d9b640 1 -- 172.21.15.151:0/2319087568 learned_addr learned my addr 172.21.15.151:0/2319087568 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:19.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43559a640 1 -- 172.21.15.151:0/2319087568 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346400170 0 0) 0x7fe4381145e0 con 0x7fe4380732a0 2024-09-13T19:06:19.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43559a640 1 -- 172.21.15.151:0/2319087568 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe420003530 con 0x7fe4380732a0 2024-09-13T19:06:19.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43659c640 1 -- 172.21.15.151:0/2319087568 >> v1:172.21.15.12:6789/0 conn(0x7fe4380732a0 legacy=0x7fe438073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:19.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43659c640 1 -- 172.21.15.151:0/2319087568 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe438073ff0 con 0x7fe438113b70 2024-09-13T19:06:19.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.403+0000 7fe43659c640 1 --2- 172.21.15.151:0/2319087568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe438113b70 0x7fe438113f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe430009740 tx=0x7fe43001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c2e88e075d9db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43559a640 1 -- 172.21.15.151:0/2319087568 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4300b1070 con 0x7fe438113b70 2024-09-13T19:06:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43559a640 1 -- 172.21.15.151:0/2319087568 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4300ac520 con 0x7fe438113b70 2024-09-13T19:06:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43559a640 1 -- 172.21.15.151:0/2319087568 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4300ac800 con 0x7fe438113b70 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/2319087568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe438113b70 msgr2=0x7fe438113f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 --2- 172.21.15.151:0/2319087568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe438113b70 0x7fe438113f50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe430009740 tx=0x7fe43001c370 comp rx=0 tx=0).stop 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/2319087568 shutdown_connections 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 --2- 172.21.15.151:0/2319087568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe438113b70 0x7fe438113f50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/2319087568 >> 172.21.15.151:0/2319087568 conn(0x7fe43806f390 msgr2=0x7fe4380717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/2319087568 shutdown_connections 2024-09-13T19:06:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/2319087568 wait complete. 2024-09-13T19:06:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 Processor -- start 2024-09-13T19:06:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- start start 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe43811d640 con 0x7fe4380732a0 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33398/0 (socket says 172.21.15.151:33398) 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43659c640 1 -- 172.21.15.151:0/1515001372 learned_addr learned my addr 172.21.15.151:0/1515001372 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43659c640 1 -- 172.21.15.151:0/1515001372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4381ad0e0 con 0x7fe4380732a0 2024-09-13T19:06:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43659c640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe43001aa20 tx=0x7fe430019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4300ba020 con 0x7fe4380732a0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4300acc10 con 0x7fe4380732a0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4381ad310 con 0x7fe4380732a0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4300b1040 con 0x7fe4380732a0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.407+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4381a6bb0 con 0x7fe4380732a0 2024-09-13T19:06:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe438113b70 con 0x7fe4380732a0 2024-09-13T19:06:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4300bd020 con 0x7fe4380732a0 2024-09-13T19:06:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe426ffd640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 0x7fe418038250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7fe4300e3190 con 0x7fe4380732a0 2024-09-13T19:06:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe435d9b640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 0x7fe418038250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.411+0000 7fe435d9b640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 0x7fe418038250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4280012f0 tx=0x7fe428001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:19.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.423+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4300c4030 con 0x7fe4380732a0 2024-09-13T19:06:19.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:19.575+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fe438113db0 con 0x7fe4380732a0 2024-09-13T19:06:20.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.223+0000 7fe426ffd640 1 -- 172.21.15.151:0/1515001372 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7fe4300a9070 con 0x7fe4380732a0 2024-09-13T19:06:20.227 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'default.rgw.buckets.index' created 2024-09-13T19:06:20.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 msgr2=0x7fe418038250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:20.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 0x7fe418038250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4280012f0 tx=0x7fe428001430 comp rx=0 tx=0).stop 2024-09-13T19:06:20.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 msgr2=0x7fe4381acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:20.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe43001aa20 tx=0x7fe430019110 comp rx=0 tx=0).stop 2024-09-13T19:06:20.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 shutdown_connections 2024-09-13T19:06:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe418035d90 0x7fe418038250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 --2- 172.21.15.151:0/1515001372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4380732a0 0x7fe4381acb10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:20.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 >> 172.21.15.151:0/1515001372 conn(0x7fe43806f390 msgr2=0x7fe43810ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 shutdown_connections 2024-09-13T19:06:20.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.227+0000 7fe43c972640 1 -- 172.21.15.151:0/1515001372 wait complete. 2024-09-13T19:06:20.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-13T19:06:20.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80d2534640 1 Processor -- start 2024-09-13T19:06:20.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80d2534640 1 -- start start 2024-09-13T19:06:20.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80d2534640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80cc10f880 0x7f80cc11b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:20.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80d2534640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80cc11b660 con 0x7f80cc10ed90 2024-09-13T19:06:20.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80d2534640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f80cc11c840 con 0x7f80cc10f880 2024-09-13T19:06:20.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80cc10f880 0x7f80cc11b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:20.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80cc10f880 0x7f80cc11b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33404/0 (socket says 172.21.15.151:33404) 2024-09-13T19:06:20.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cb7fe640 1 -- 172.21.15.151:0/469281844 learned_addr learned my addr 172.21.15.151:0/469281844 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:20.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cbfff640 1 --1- 172.21.15.151:0/469281844 >> v1:172.21.15.12:6789/0 conn(0x7f80cc10ed90 0x7f80cc10f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:54074/0 (socket says 172.21.15.151:54074) 2024-09-13T19:06:20.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cb7fe640 1 -- 172.21.15.151:0/469281844 >> v1:172.21.15.12:6789/0 conn(0x7f80cc10ed90 legacy=0x7f80cc10f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:20.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.383+0000 7f80cb7fe640 1 -- 172.21.15.151:0/469281844 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc11c9c0 con 0x7f80cc10f880 2024-09-13T19:06:20.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80cb7fe640 1 --2- 172.21.15.151:0/469281844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10f880 0x7f80cc11b120 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80c00097f0 tx=0x7f80c001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4187e7507ca85896 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:20.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80caffd640 1 -- 172.21.15.151:0/469281844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c00ab580 con 0x7f80cc10f880 2024-09-13T19:06:20.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80caffd640 1 -- 172.21.15.151:0/469281844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80c00b0070 con 0x7f80cc10f880 2024-09-13T19:06:20.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80caffd640 1 -- 172.21.15.151:0/469281844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80c00ab870 con 0x7f80cc10f880 2024-09-13T19:06:20.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- 172.21.15.151:0/469281844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10f880 msgr2=0x7f80cc11b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:20.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 --2- 172.21.15.151:0/469281844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10f880 0x7f80cc11b120 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f80c00097f0 tx=0x7f80c001c430 comp rx=0 tx=0).stop 2024-09-13T19:06:20.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- 172.21.15.151:0/469281844 shutdown_connections 2024-09-13T19:06:20.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 --2- 172.21.15.151:0/469281844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10f880 0x7f80cc11b120 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:20.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- 172.21.15.151:0/469281844 >> 172.21.15.151:0/469281844 conn(0x7f80cc06f390 msgr2=0x7f80cc0717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:20.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- 172.21.15.151:0/469281844 shutdown_connections 2024-09-13T19:06:20.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- 172.21.15.151:0/469281844 wait complete. 2024-09-13T19:06:20.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 Processor -- start 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.387+0000 7f80d2534640 1 -- start start 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80d2534640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80d2534640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc11c490 con 0x7f80cc10ed90 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33416/0 (socket says 172.21.15.151:33416) 2024-09-13T19:06:20.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cbfff640 1 -- 172.21.15.151:0/329246006 learned_addr learned my addr 172.21.15.151:0/329246006 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cbfff640 1 -- 172.21.15.151:0/329246006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80cc1104b0 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cbfff640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c3a0 tx=0x7f80bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80bc007410 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc0075b0 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80bc004920 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80cc110740 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80cc110c00 con 0x7f80cc10ed90 2024-09-13T19:06:20.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80cc10f170 con 0x7f80cc10ed90 2024-09-13T19:06:20.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80bc01a020 con 0x7f80cc10ed90 2024-09-13T19:06:20.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 0x7f80b8038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:20.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7f80bc048b70 con 0x7f80cc10ed90 2024-09-13T19:06:20.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.391+0000 7f80cb7fe640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 0x7f80b8038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:20.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.395+0000 7f80cb7fe640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 0x7f80b8038220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80c00af000 tx=0x7f80c00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:20.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.407+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f80bc021070 con 0x7f80cc10ed90 2024-09-13T19:06:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:20.567+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f80cc115a80 con 0x7f80cc10ed90 2024-09-13T19:06:21.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.227+0000 7f80c8ff9640 1 -- 172.21.15.151:0/329246006 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7f80bc019da0 con 0x7f80cc10ed90 2024-09-13T19:06:21.229 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-13T19:06:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 msgr2=0x7f80b8038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 0x7f80b8038220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80c00af000 tx=0x7f80c00a7000 comp rx=0 tx=0).stop 2024-09-13T19:06:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 msgr2=0x7f80cc10ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:21.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00c3a0 tx=0x7f80bc00c860 comp rx=0 tx=0).stop 2024-09-13T19:06:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 shutdown_connections 2024-09-13T19:06:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f80b8035d60 0x7f80b8038220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 --2- 172.21.15.151:0/329246006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc10ed90 0x7f80cc10ff70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:21.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.231+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 >> 172.21.15.151:0/329246006 conn(0x7f80cc06f390 msgr2=0x7f80cc11a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:21.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.235+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 shutdown_connections 2024-09-13T19:06:21.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:21.235+0000 7f80d2534640 1 -- 172.21.15.151:0/329246006 wait complete. 2024-09-13T19:06:21.281 DEBUG:tasks.rgw:Pools created 2024-09-13T19:06:21.281 INFO:tasks.rgw:Starting rgw... 2024-09-13T19:06:21.281 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-13T19:06:21.281 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-13T19:06:21.282 DEBUG:teuthology.orchestra.run.smithi151:> sudo echo -n http://smithi151.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-13T19:06:21.295 INFO:teuthology.orchestra.run.smithi151.stdout:http://smithi151.front.sepia.ceph.com:80 2024-09-13T19:06:21.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-13T19:06:21.345 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-13T19:06:21.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-13T19:06:21.389 INFO:tasks.rgw.client.0:Started 2024-09-13T19:06:21.389 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:21.389 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:21.412 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:06:21.412 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:06:21.414 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:06:21.414 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:06:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:06:22.415 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:22.428 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:06:22.428 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:06:22.428 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:06:22.428 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:06:22.428 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:06:24.430 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:24.441 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:06:24.441 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:06:24.441 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:06:24.441 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:06:24.442 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:06:28.443 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:28.455 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:06:28.455 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:06:28.455 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-13T19:06:28.455 INFO:teuthology.orchestra.run.smithi151.stderr:curl: (7) Failed to connect to smithi151.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-13T19:06:28.456 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-13T19:06:30.438 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-13T19:06:30.435+0000 7f2a5c39fa40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-13T19:06:36.457 DEBUG:teuthology.orchestra.run.smithi151:> curl http://smithi151.front.sepia.ceph.com:80/ 2024-09-13T19:06:36.469 INFO:teuthology.orchestra.run.smithi151.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-13T19:06:36.469 INFO:teuthology.orchestra.run.smithi151.stderr: Dload Upload Total Spent Left Speed 2024-09-13T19:06:36.472 INFO:teuthology.orchestra.run.smithi151.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52439 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-13T19:06:36.473 INFO:teuthology.orchestra.run.smithi151.stdout:anonymous 2024-09-13T19:06:36.474 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-13T19:06:38.312 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-13T19:06:38.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:06:38.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:06:38.312 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:06:38.348 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:38.349 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:38.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6e8ab980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a86b89d8d0 0x55a86b89dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6e8ab980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a86b723ae0 con 0x55a86b89e220 2024-09-13T19:06:38.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6e8ab980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55a86b747e30 con 0x55a86b89d8d0 2024-09-13T19:06:38.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6c3bb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a86b89d8d0 0x55a86b89dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6bbba640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55a86b89e220 0x55a86b8a2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33308/0 (socket says 172.21.15.151:33308) 2024-09-13T19:06:38.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6bbba640 1 -- 172.21.15.151:0/369473838 learned_addr learned my addr 172.21.15.151:0/369473838 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:38.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/369473838 >> v1:172.21.15.12:6789/0 conn(0x55a86b89e220 legacy=0x55a86b8a2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/369473838 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b8a54a0 con 0x55a86b89d8d0 2024-09-13T19:06:38.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.347+0000 7f9a6b3b9640 1 -- 172.21.15.151:0/369473838 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340259851 0 0) 0x55a86b723ae0 con 0x55a86b89e220 2024-09-13T19:06:38.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/369473838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b89dcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00a420 tx=0x7f9a5c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f3e0c6b284dfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6b3b9640 1 -- 172.21.15.151:0/369473838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0af070 con 0x55a86b89d8d0 2024-09-13T19:06:38.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6b3b9640 1 -- 172.21.15.151:0/369473838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0aa530 con 0x55a86b89d8d0 2024-09-13T19:06:38.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6b3b9640 1 -- 172.21.15.151:0/369473838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0aa810 con 0x55a86b89d8d0 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/369473838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 msgr2=0x55a86b89dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/369473838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b89dcb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00a420 tx=0x7f9a5c01afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/369473838 shutdown_connections 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/369473838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b89dcb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/369473838 >> 172.21.15.151:0/369473838 conn(0x55a86b811220 msgr2=0x55a86b811630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/369473838 shutdown_connections 2024-09-13T19:06:38.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.351+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/369473838 wait complete. 2024-09-13T19:06:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.367+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.367+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a86b749200 con 0x55a86b89d8d0 2024-09-13T19:06:38.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55466/0 (socket says 172.21.15.151:55466) 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/1936594045 learned_addr learned my addr 172.21.15.151:0/1936594045 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/1936594045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b988fc0 con 0x55a86b89d8d0 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/1936594045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ad040 tx=0x7f9a5c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b851530665011da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f995a60c640 1 -- 172.21.15.151:0/1936594045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0af050 con 0x55a86b89d8d0 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f995a60c640 1 -- 172.21.15.151:0/1936594045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0b0040 con 0x55a86b89d8d0 2024-09-13T19:06:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f995a60c640 1 -- 172.21.15.151:0/1936594045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0aaca0 con 0x55a86b89d8d0 2024-09-13T19:06:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/1936594045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 msgr2=0x55a86b9889f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/1936594045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ad040 tx=0x7f9a5c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/1936594045 shutdown_connections 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/1936594045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b9889f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/1936594045 >> 172.21.15.151:0/1936594045 conn(0x55a86b811220 msgr2=0x55a86b984620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/1936594045 shutdown_connections 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/1936594045 wait complete. 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b98fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6e8ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a86b8a4ee0 con 0x55a86b89d8d0 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b98fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b98fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55468/0 (socket says 172.21.15.151:55468) 2024-09-13T19:06:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.371+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2290058772 learned_addr learned my addr 172.21.15.151:0/2290058772 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b9902a0 con 0x55a86b89d8d0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b98fd60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c01b010 tx=0x7f9a5c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 -- 172.21.15.151:0/2290058772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0c5070 con 0x55a86b89d8d0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 -- 172.21.15.151:0/2290058772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0b6d40 con 0x55a86b89d8d0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86b990530 con 0x55a86b89d8d0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 -- 172.21.15.151:0/2290058772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0c15d0 con 0x55a86b89d8d0 2024-09-13T19:06:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86b993210 con 0x55a86b89d8d0 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 -- 172.21.15.151:0/2290058772 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0c1800 con 0x55a86b89d8d0 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9954034650 0x7f9954036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9958e09640 1 -- 172.21.15.151:0/2290058772 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a5c0bb070 con 0x55a86b89d8d0 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9954034650 0x7f9954036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b89e220 0x55a86b996cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9972c0 con 0x55a86b89e220 2024-09-13T19:06:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b89e220 0x55a86b996cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9954034650 0x7f9954036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a54000c10 tx=0x7f9a540013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b89e220 0x55a86b996cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2290058772 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b89e220 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.375+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b994410 con 0x55a86b89e220 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2290058772 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b89e220 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b999600 0x55a86b99b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b99c0c0 con 0x55a86b999600 2024-09-13T19:06:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b999600 0x55a86b99b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b999600 0x55a86b99b9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2290058772 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a5c0d0070 con 0x55a86b999600 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9984a0 con 0x55a86b89e220 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2290058772 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b89e220 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a86b99d520 0x55a86b99f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9a0010 con 0x55a86b99d520 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a86b99d520 0x55a86b99f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a86b99d520 0x55a86b99f910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2290058772 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a5400f680 con 0x55a86b99d520 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6e8ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a86b7a2800 con 0x55a86b9adae0 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55484/0 (socket says 172.21.15.151:55484) 2024-09-13T19:06:38.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.379+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/3616679498 learned_addr learned my addr 172.21.15.151:0/3616679498 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/3616679498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b9ae440 con 0x55a86b9adae0 2024-09-13T19:06:38.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e38d0 tx=0x7f9a5c0d1580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 -- 172.21.15.151:0/3616679498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0e2200 con 0x55a86b9adae0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 -- 172.21.15.151:0/3616679498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0d16d0 con 0x55a86b9adae0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 -- 172.21.15.151:0/3616679498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0d19b0 con 0x55a86b9adae0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86b9ae670 con 0x55a86b9adae0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86b9b12f0 con 0x55a86b9adae0 2024-09-13T19:06:38.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 -- 172.21.15.151:0/3616679498 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0e3940 con 0x55a86b9adae0 2024-09-13T19:06:38.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 0x7f9944036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9951ffb640 1 -- 172.21.15.151:0/3616679498 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a5c0dd070 con 0x55a86b9adae0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 0x7f9944036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6e8ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a86b989280 con 0x55a86b9ba3f0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 0x7f9944036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55a86b997bb0 tx=0x7f9a54006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55490/0 (socket says 172.21.15.151:55490) 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/633931088 learned_addr learned my addr 172.21.15.151:0/633931088 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.383+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/633931088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b9bada0 con 0x55a86b9ba3f0 2024-09-13T19:06:38.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/633931088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b6040 tx=0x7f9a5c0ace30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9049dcf3016c96ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f99437fe640 1 -- 172.21.15.151:0/633931088 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0d3450 con 0x55a86b9ba3f0 2024-09-13T19:06:38.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f99437fe640 1 -- 172.21.15.151:0/633931088 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0db130 con 0x55a86b9ba3f0 2024-09-13T19:06:38.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f99437fe640 1 -- 172.21.15.151:0/633931088 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0d35f0 con 0x55a86b9ba3f0 2024-09-13T19:06:38.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/633931088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 msgr2=0x55a86b9ba7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/633931088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b6040 tx=0x7f9a5c0ace30 comp rx=0 tx=0).stop 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/633931088 shutdown_connections 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/633931088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9ba7d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/633931088 >> 172.21.15.151:0/633931088 conn(0x55a86b9b67d0 msgr2=0x55a86b9b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/633931088 shutdown_connections 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/633931088 wait complete. 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 Processor -- start 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- start start 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a86b9bb240 con 0x55a86b9ba3f0 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55498/0 (socket says 172.21.15.151:55498) 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 learned_addr learned my addr 172.21.15.151:0/2720533905 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a86b9c1b90 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9c1650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e23e0 tx=0x7f9a5c0b3fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9941ffb640 1 -- 172.21.15.151:0/2720533905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0ec030 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9941ffb640 1 -- 172.21.15.151:0/2720533905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0a9ad0 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a86b9c1b90 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9941ffb640 1 -- 172.21.15.151:0/2720533905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0d6d10 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.387+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a86b9c1b90 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9941ffb640 1 -- 172.21.15.151:0/2720533905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0d37b0 con 0x55a86b9ba3f0 2024-09-13T19:06:38.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9941ffb640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9934034650 0x7f9934036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9941ffb640 1 -- 172.21.15.151:0/2720533905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9a5c0ff040 con 0x55a86b9ba3f0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9934034650 0x7f9934036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b9cc6b0 0x55a86b9ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9cf2c0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b9cc6b0 0x55a86b9ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9934034650 0x7f9934036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400ffd0 tx=0x7f9a54023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b9cc6b0 0x55a86b9ceb70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 realm 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9cf6d0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9cff70 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b9d1070 0x55a86b9d3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d39a0 con 0x55a86b9d1070 2024-09-13T19:06:38.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b9d1070 0x55a86b9d3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b9d1070 0x55a86b9d3460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 20 searching for the correct realm 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d5240 con 0x55a86b9d1070 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.391+0000 7f9a6c3bb640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9a5c103070 0x7f9a5c113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d5240 con 0x7f9a5c103070 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9a5c103070 0x7f9a5c113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9a5c103070 0x7f9a5c113ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6bbba640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9a5401f940 0x7f9a5403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d5240 con 0x7f9a5401f940 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9a5401f940 0x7f9a5403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9a5401f940 0x7f9a5403a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.395+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5c103070 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5c103070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.399+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5c103070 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.403+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5c103070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9d1070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5401f940 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x55a86b9cc6b0 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d0310 con 0x7f9a5c103070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:38.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.407+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d45e0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d45e0 con 0x7f9a5c103070 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 zone default found 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 4 Realm: () 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:38.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 zonegroup default 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d5710 con 0x7f9a5401f940 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d70f0 con 0x55a86b9d1070 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d7490 con 0x55a86b9d1070 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 started sync module instance, tier type = 2024-09-13T19:06:38.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:38.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d6590 con 0x7f9a5c103070 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94181848345008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d7d70 con 0x7f9a5c103070 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.411+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d85c0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.415+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94181848345008] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.415+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.415+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94181848348864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d85c0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.415+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d90c0 con 0x55a86b9d1070 2024-09-13T19:06:38.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94181848348864] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94181848350992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d8530 con 0x55a86b9d1070 2024-09-13T19:06:38.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d9e10 con 0x7f9a5c103070 2024-09-13T19:06:38.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94181848359424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5c103070 2024-09-13T19:06:38.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9db490 con 0x55a86b9cc6b0 2024-09-13T19:06:38.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94181848359424] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.419+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94181848350992] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94181848360480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9db490 con 0x55a86b9cc6b0 2024-09-13T19:06:38.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dbd30 con 0x7f9a5401f940 2024-09-13T19:06:38.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94181848360480] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94181848363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dbaa0 con 0x7f9a5401f940 2024-09-13T19:06:38.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.423+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dc5c0 con 0x7f9a5401f940 2024-09-13T19:06:38.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.427+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94181848363248] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.427+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.427+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94181848367248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dc580 con 0x7f9a5401f940 2024-09-13T19:06:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.427+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dcf80 con 0x7f9a5401f940 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94181848369808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dd3a0 con 0x7f9a5401f940 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=0 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=1 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=2 2024-09-13T19:06:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=3 2024-09-13T19:06:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=4 2024-09-13T19:06:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=5 2024-09-13T19:06:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94181848367248] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=6 2024-09-13T19:06:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94181848369808] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 20 add_watcher() i=7 2024-09-13T19:06:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9db510 con 0x55a86b9cc6b0 2024-09-13T19:06:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.431+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94181848364304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9dd8e0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94181848364304] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f99227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 5 note: GC not initialized 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f99217e2640 20 reqs_thread_entry: start 2024-09-13T19:06:38.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 20 Filter name: none 2024-09-13T19:06:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9892ffd640 20 reqs_thread_entry: start 2024-09-13T19:06:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86ba03120 con 0x55a86b9d1070 2024-09-13T19:06:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d8530 con 0x55a86b9d1070 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d8530 con 0x55a86b9cc6b0 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41f0 con 0x7f9a5c103070 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9d1070 2024-09-13T19:06:38.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9d1070 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.435+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5c103070 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9d1070 2024-09-13T19:06:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5401f940 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5401f940 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9d1070 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5401f940 2024-09-13T19:06:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.439+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5401f940 2024-09-13T19:06:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5401f940 2024-09-13T19:06:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9d1070 2024-09-13T19:06:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5c103070 2024-09-13T19:06:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9cc6b0 2024-09-13T19:06:38.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9cc6b0 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9d1070 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5c103070 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5401f940 2024-09-13T19:06:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9cc6b0 2024-09-13T19:06:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.443+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5401f940 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9d1070 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5c103070 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5401f940 2024-09-13T19:06:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9cc6b0 2024-09-13T19:06:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x55a86b9d1070 2024-09-13T19:06:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f9a64040040 con 0x7f9a5c103070 2024-09-13T19:06:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f99227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.447+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94181848364304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d8530 con 0x55a86b9cc6b0 2024-09-13T19:06:38.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94181848364304] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94181848345008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x7f9a5c103070 2024-09-13T19:06:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94181848345008] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6e8ab980 20 remove_watcher() i=0 2024-09-13T19:06:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6e8ab980 2 removed watcher, disabling cache 2024-09-13T19:06:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.451+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94181848348864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94181848348864] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6e8ab980 20 remove_watcher() i=1 2024-09-13T19:06:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94181848350992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9daad0 con 0x55a86b9d1070 2024-09-13T19:06:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6c3bb640 1 -- 172.21.15.151:0/2720533905 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94181848350992] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c10b020 con 0x55a86b9d1070 2024-09-13T19:06:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6e8ab980 20 remove_watcher() i=2 2024-09-13T19:06:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.455+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94181848359424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41b0 con 0x7f9a5c103070 2024-09-13T19:06:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6bbba640 1 -- 172.21.15.151:0/2720533905 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94181848359424] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a54037040 con 0x7f9a5c103070 2024-09-13T19:06:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6e8ab980 20 remove_watcher() i=3 2024-09-13T19:06:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94181848360480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41b0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94181848360480] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x55a86b9cc6b0 2024-09-13T19:06:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6e8ab980 20 remove_watcher() i=4 2024-09-13T19:06:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.459+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94181848363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41b0 con 0x7f9a5401f940 2024-09-13T19:06:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94181848363248] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6e8ab980 20 remove_watcher() i=5 2024-09-13T19:06:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94181848367248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41b0 con 0x7f9a5401f940 2024-09-13T19:06:38.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94181848367248] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6e8ab980 20 remove_watcher() i=6 2024-09-13T19:06:38.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.463+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94181848369808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a86b9d41b0 con 0x7f9a5401f940 2024-09-13T19:06:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94181848369808] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a640083f0 con 0x7f9a5401f940 2024-09-13T19:06:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 20 remove_watcher() i=7 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9a5401f940 msgr2=0x7f9a5403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9a5401f940 0x7f9a5403a3c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b9cc6b0 msgr2=0x55a86b9ceb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b9cc6b0 0x55a86b9ceb70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9a5c103070 msgr2=0x7f9a5c113ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9a5c103070 0x7f9a5c113ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b9d1070 msgr2=0x55a86b9d3460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b9d1070 0x55a86b9d3460 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9934034650 msgr2=0x7f9934036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9934034650 0x7f9934036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400ffd0 tx=0x7f9a54023040 comp rx=0 tx=0).stop 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 msgr2=0x55a86b9c1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2720533905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9ba3f0 0x55a86b9c1650 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e23e0 tx=0x7f9a5c0b3fa0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2720533905 reap_dead start 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 shutdown_connections 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 >> 172.21.15.151:0/2720533905 conn(0x55a86b9b67d0 msgr2=0x55a86b9b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 shutdown_connections 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2720533905 wait complete. 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 msgr2=0x7f9944036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 0x7f9944036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55a86b997bb0 tx=0x7f9a54006000 comp rx=0 tx=0).stop 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 msgr2=0x55a86b9adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e38d0 tx=0x7f9a5c0d1580 comp rx=0 tx=0).stop 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 shutdown_connections 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9944034650 0x7f9944036b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/3616679498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b9adae0 0x55a86b9adf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 >> 172.21.15.151:0/3616679498 conn(0x55a86b9a2c30 msgr2=0x55a86b9a56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 shutdown_connections 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/3616679498 wait complete. 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b89e220 msgr2=0x55a86b996cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a86b89e220 0x55a86b996cf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a86b99d520 msgr2=0x55a86b99f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a86b99d520 0x55a86b99f910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b999600 msgr2=0x55a86b99b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a86b999600 0x55a86b99b9f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9954034650 msgr2=0x7f9954036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9954034650 0x7f9954036b10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9a54000c10 tx=0x7f9a540013c0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 msgr2=0x55a86b98fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 --2- 172.21.15.151:0/2290058772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a86b89d8d0 0x55a86b98fd60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c01b010 tx=0x7f9a5c019810 comp rx=0 tx=0).stop 2024-09-13T19:06:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6cbbc640 1 -- 172.21.15.151:0/2290058772 reap_dead start 2024-09-13T19:06:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 shutdown_connections 2024-09-13T19:06:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 >> 172.21.15.151:0/2290058772 conn(0x55a86b811220 msgr2=0x55a86b9831a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 shutdown_connections 2024-09-13T19:06:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.467+0000 7f9a6e8ab980 1 -- 172.21.15.151:0/2290058772 wait complete. 2024-09-13T19:06:38.481 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-13T19:06:38.482 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:06:38.482 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-13T19:06:38.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-13T19:06:38.482 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-13T19:06:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:38.560 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa5f98980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f7ac8b5a50 0x55f7ac8b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa5f98980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f7ac739ae0 con 0x55f7ac825b00 2024-09-13T19:06:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa5f98980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55f7ac75de30 con 0x55f7ac8b5a50 2024-09-13T19:06:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa32a7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f7ac8b5a50 0x55f7ac8b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa3aa8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55f7ac825b00 0x55f7ac8b4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33310/0 (socket says 172.21.15.151:33310) 2024-09-13T19:06:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/589347696 learned_addr learned my addr 172.21.15.151:0/589347696 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa32a7640 1 -- 172.21.15.151:0/589347696 >> v1:172.21.15.12:6789/0 conn(0x55f7ac825b00 legacy=0x55f7ac8b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.559+0000 7f4fa32a7640 1 -- 172.21.15.151:0/589347696 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac8b9390 con 0x55f7ac8b5a50 2024-09-13T19:06:38.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/589347696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac8b7e40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800a480 tx=0x7f4f9801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beac2c5c387af903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa2aa6640 1 -- 172.21.15.151:0/589347696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980b0070 con 0x55f7ac8b5a50 2024-09-13T19:06:38.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa2aa6640 1 -- 172.21.15.151:0/589347696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f980ab540 con 0x55f7ac8b5a50 2024-09-13T19:06:38.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa2aa6640 1 -- 172.21.15.151:0/589347696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f980ab840 con 0x55f7ac8b5a50 2024-09-13T19:06:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 -- 172.21.15.151:0/589347696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 msgr2=0x55f7ac8b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/589347696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac8b7e40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800a480 tx=0x7f4f9801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:38.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 -- 172.21.15.151:0/589347696 shutdown_connections 2024-09-13T19:06:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/589347696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac8b7e40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 -- 172.21.15.151:0/589347696 >> 172.21.15.151:0/589347696 conn(0x55f7ac8ac060 msgr2=0x55f7ac8ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 -- 172.21.15.151:0/589347696 shutdown_connections 2024-09-13T19:06:38.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.563+0000 7f4fa5f98980 1 -- 172.21.15.151:0/589347696 wait complete. 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa5f98980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa5f98980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac75f200 con 0x55f7ac825b00 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55508/0 (socket says 172.21.15.151:55508) 2024-09-13T19:06:38.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2453512929 learned_addr learned my addr 172.21.15.151:0/2453512929 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.579+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2453512929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac99d070 con 0x55f7ac825b00 2024-09-13T19:06:38.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2453512929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001e20 tx=0x7f4f9400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b070d5f9be1f48cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e91e0b640 1 -- 172.21.15.151:0/2453512929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94012020 con 0x55f7ac825b00 2024-09-13T19:06:38.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e91e0b640 1 -- 172.21.15.151:0/2453512929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f9400e7c0 con 0x55f7ac825b00 2024-09-13T19:06:38.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e91e0b640 1 -- 172.21.15.151:0/2453512929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f9400eb00 con 0x55f7ac825b00 2024-09-13T19:06:38.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2453512929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 msgr2=0x55f7ac99caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2453512929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001e20 tx=0x7f4f9400b790 comp rx=0 tx=0).stop 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2453512929 shutdown_connections 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2453512929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac825b00 0x55f7ac99caa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2453512929 >> 172.21.15.151:0/2453512929 conn(0x55f7ac8ac060 msgr2=0x55f7ac9986d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2453512929 shutdown_connections 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2453512929 wait complete. 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac9a4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac8b8e30 con 0x55f7ac8b5a50 2024-09-13T19:06:38.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac9a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac9a4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55524/0 (socket says 172.21.15.151:55524) 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2744333937 learned_addr learned my addr 172.21.15.151:0/2744333937 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac9a45d0 con 0x55f7ac8b5a50 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac9a4090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001e20 tx=0x7f4f94000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e8bfff640 1 -- 172.21.15.151:0/2744333937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94012030 con 0x55f7ac8b5a50 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e8bfff640 1 -- 172.21.15.151:0/2744333937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f94001480 con 0x55f7ac8b5a50 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4e8bfff640 1 -- 172.21.15.151:0/2744333937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f9401a8a0 con 0x55f7ac8b5a50 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac9a4860 con 0x55f7ac8b5a50 2024-09-13T19:06:38.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.583+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac9a7540 con 0x55f7ac8b5a50 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4e8bfff640 1 -- 172.21.15.151:0/2744333937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f94015020 con 0x55f7ac8b5a50 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4e8bfff640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e8c0346a0 0x7f4e8c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4e8bfff640 1 -- 172.21.15.151:0/2744333937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f94020030 con 0x55f7ac8b5a50 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e8c0346a0 0x7f4e8c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9a9010 0x55f7ac9ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ab9d0 con 0x55f7ac9a9010 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9a9010 0x55f7ac9ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e8c0346a0 0x7f4e8c036b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ad000 tx=0x7f4f980a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9a9010 0x55f7ac9ab400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2744333937 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9a9010 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9a8760 con 0x55f7ac9a9010 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2744333937 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9a9010 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9adce0 0x55f7ac9b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9b07c0 con 0x55f7ac9adce0 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9adce0 0x55f7ac9b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9adce0 0x55f7ac9b00d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2744333937 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f94008030 con 0x55f7ac9adce0 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9acb80 con 0x55f7ac9a9010 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2744333937 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9a9010 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f7ac9b1c20 0x55f7ac9b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.587+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9b4750 con 0x55f7ac9b1c20 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f7ac9b1c20 0x55f7ac9b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f7ac9b1c20 0x55f7ac9b4010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2744333937 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f980b3040 con 0x55f7ac9b1c20 2024-09-13T19:06:38.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac7b8800 con 0x55f7ac9c2220 2024-09-13T19:06:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55532/0 (socket says 172.21.15.151:55532) 2024-09-13T19:06:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/882257270 learned_addr learned my addr 172.21.15.151:0/882257270 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/882257270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac9c2b80 con 0x55f7ac9c2220 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c010 tx=0x7f4f9402dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4e897fa640 1 -- 172.21.15.151:0/882257270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94017c50 con 0x55f7ac9c2220 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4e897fa640 1 -- 172.21.15.151:0/882257270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f94017df0 con 0x55f7ac9c2220 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4e897fa640 1 -- 172.21.15.151:0/882257270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94016880 con 0x55f7ac9c2220 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac9c2e10 con 0x55f7ac9c2220 2024-09-13T19:06:38.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.591+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac9c5a90 con 0x55f7ac9c2220 2024-09-13T19:06:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e897fa640 1 -- 172.21.15.151:0/882257270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f94009070 con 0x55f7ac9c2220 2024-09-13T19:06:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e897fa640 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 0x7f4e7c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e897fa640 1 -- 172.21.15.151:0/882257270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f94005050 con 0x55f7ac9c2220 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 0x7f4e7c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac99d3f0 con 0x55f7ac9ce970 2024-09-13T19:06:38.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 0x7f4e7c036b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55f7ac9abe60 tx=0x7f4f98005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55534/0 (socket says 172.21.15.151:55534) 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/1591838292 learned_addr learned my addr 172.21.15.151:0/1591838292 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/1591838292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac9cf320 con 0x55f7ac9ce970 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/1591838292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f94045e80 tx=0x7f4f9403a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3a40b915f66647 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e82ffd640 1 -- 172.21.15.151:0/1591838292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94025cc0 con 0x55f7ac9ce970 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e82ffd640 1 -- 172.21.15.151:0/1591838292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f94061070 con 0x55f7ac9ce970 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4e82ffd640 1 -- 172.21.15.151:0/1591838292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f940260c0 con 0x55f7ac9ce970 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- 172.21.15.151:0/1591838292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 msgr2=0x55f7ac9ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/1591838292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4f94045e80 tx=0x7f4f9403a4f0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- 172.21.15.151:0/1591838292 shutdown_connections 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/1591838292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9ced50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- 172.21.15.151:0/1591838292 >> 172.21.15.151:0/1591838292 conn(0x55f7ac9cad50 msgr2=0x55f7ac9c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- 172.21.15.151:0/1591838292 shutdown_connections 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 -- 172.21.15.151:0/1591838292 wait complete. 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.595+0000 7f4fa5f98980 1 Processor -- start 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 -- start start 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f7ac9cf7c0 con 0x55f7ac9ce970 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa3aa8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55536/0 (socket says 172.21.15.151:55536) 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 learned_addr learned my addr 172.21.15.151:0/2619530894 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ac9d6030 con 0x55f7ac9ce970 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f94025a40 tx=0x7f4f9401de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 -- 172.21.15.151:0/2619530894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f94041560 con 0x55f7ac9ce970 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ac9d6030 con 0x55f7ac9ce970 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 -- 172.21.15.151:0/2619530894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f94041700 con 0x55f7ac9ce970 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 -- 172.21.15.151:0/2619530894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f9402d520 con 0x55f7ac9ce970 2024-09-13T19:06:38.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ac9d6030 con 0x55f7ac9ce970 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 -- 172.21.15.151:0/2619530894 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f9402d6c0 con 0x55f7ac9ce970 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e6c034650 0x7f4e6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4e817fa640 1 -- 172.21.15.151:0/2619530894 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f94072ca0 con 0x55f7ac9ce970 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e6c034650 0x7f4e6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9e0bd0 0x55f7ac9e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.599+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e37e0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9e0bd0 0x55f7ac9e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e6c034650 0x7f4e6c036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f98000c10 tx=0x7f4f980b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9e0bd0 0x55f7ac9e3090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 realm 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e3bf0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e44c0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9e55c0 0x55f7ac9e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e7fc0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9e55c0 0x55f7ac9e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9e55c0 0x55f7ac9e79b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 20 searching for the correct realm 2024-09-13T19:06:38.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e9890 con 0x55f7ac9e55c0 2024-09-13T19:06:38.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f94017050 0x7f4f9407a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e9890 con 0x7f4f94017050 2024-09-13T19:06:38.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f94017050 0x7f4f9407a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f94017050 0x7f4f9407a8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f980dc040 0x7f4f980dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.603+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e9890 con 0x7f4f980dc040 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f980dc040 0x7f4f980dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f980dc040 0x7f4f980dd430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f94017050 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.607+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f94017050 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.611+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f94017050 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.615+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f94017050 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e55c0 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f980dc040 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e4860 con 0x7f4f94017050 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e8910 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e91b0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e8d00 con 0x7f4f94017050 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 zone default found 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 4 Realm: () 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:38.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 zonegroup default 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9e91a0 con 0x7f4f980dc040 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.619+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9eb720 con 0x55f7ac9e55c0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ebb70 con 0x55f7ac9e55c0 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 20 started sync module instance, tier type = 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:38.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9eabc0 con 0x7f4f94017050 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94522241363888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ea820 con 0x7f4f94017050 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ecaa0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.623+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94522241363888] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94522241369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ecec0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ed710 con 0x55f7ac9e55c0 2024-09-13T19:06:38.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94522241369584] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94522241372112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9edb00 con 0x55f7ac9e55c0 2024-09-13T19:06:38.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.627+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ee4c0 con 0x7f4f94017050 2024-09-13T19:06:38.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94522241378400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ef130 con 0x7f4f94017050 2024-09-13T19:06:38.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9efaf0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94522241372112] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94522241378400] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94522241379456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ef0a0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.631+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9effa0 con 0x7f4f980dc040 2024-09-13T19:06:38.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94522241379456] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94522241381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9eff10 con 0x7f4f980dc040 2024-09-13T19:06:38.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f08d0 con 0x7f4f980dc040 2024-09-13T19:06:38.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94522241381952] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94522241383280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f08d0 con 0x7f4f980dc040 2024-09-13T19:06:38.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.635+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f1290 con 0x7f4f980dc040 2024-09-13T19:06:38.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94522241383280] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94522241385776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f1290 con 0x7f4f980dc040 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=0 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=1 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=2 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=3 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=4 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=5 2024-09-13T19:06:38.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.639+0000 7f4fa5f98980 20 add_watcher() i=6 2024-09-13T19:06:38.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94522241385776] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 20 add_watcher() i=7 2024-09-13T19:06:38.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:38.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f4600 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94522241400816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f1400 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94522241400816] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4e59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:38.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:38.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.643+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f3880 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.647+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.647+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fd6c0 con 0x7f4f980dc040 2024-09-13T19:06:38.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.647+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.647+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fd6c0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fdb70 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fdd40 con 0x7f4f94017050 2024-09-13T19:06:38.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.651+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fe2b0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.655+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.655+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fe2b0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.655+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.655+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fe340 con 0x7f4f980dc040 2024-09-13T19:06:38.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.659+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.659+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fe340 con 0x7f4f94017050 2024-09-13T19:06:38.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.659+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.659+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fea50 con 0x55f7ac9e55c0 2024-09-13T19:06:38.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.663+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.663+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fea50 con 0x7f4f94017050 2024-09-13T19:06:38.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.663+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.663+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ff060 con 0x7f4f980dc040 2024-09-13T19:06:38.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.667+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.667+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ff060 con 0x7f4f94017050 2024-09-13T19:06:38.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.667+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.667+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x7f4f980dc040 2024-09-13T19:06:38.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.671+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.671+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.671+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.671+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x55f7ac9e55c0 2024-09-13T19:06:38.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.675+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.675+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x7f4f94017050 2024-09-13T19:06:38.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.675+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.675+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x55f7ac9e55c0 2024-09-13T19:06:38.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.679+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.679+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.679+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.679+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fef40 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.683+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.683+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.683+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.683+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x7f4f94017050 2024-09-13T19:06:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.687+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.691+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.691+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.691+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.691+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x7f4f980dc040 2024-09-13T19:06:38.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.695+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.695+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.695+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.695+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x7f4f980dc040 2024-09-13T19:06:38.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.699+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.699+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.703+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.703+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x7f4f980dc040 2024-09-13T19:06:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.707+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.707+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fefd0 con 0x7f4f94017050 2024-09-13T19:06:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.707+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.707+0000 7f4e58fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 20 Filter name: none 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4dd27fc640 20 reqs_thread_entry: start 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fc2a0 con 0x7f4f94017050 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-13T19:06:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:06:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:06:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4e59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94522241400816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9fa080 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94522241400816] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.711+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94522241363888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f3ff0 con 0x7f4f94017050 2024-09-13T19:06:38.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94522241363888] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa5f98980 20 remove_watcher() i=0 2024-09-13T19:06:38.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa5f98980 2 removed watcher, disabling cache 2024-09-13T19:06:38.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94522241369584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9f3ff0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94522241369584] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa5f98980 20 remove_watcher() i=1 2024-09-13T19:06:38.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.715+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94522241372112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ec5f0 con 0x55f7ac9e55c0 2024-09-13T19:06:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa3aa8640 1 -- 172.21.15.151:0/2619530894 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94522241372112] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f94077020 con 0x55f7ac9e55c0 2024-09-13T19:06:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa5f98980 20 remove_watcher() i=2 2024-09-13T19:06:38.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94522241378400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ec5f0 con 0x7f4f94017050 2024-09-13T19:06:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa32a7640 1 -- 172.21.15.151:0/2619530894 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94522241378400] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f980c9030 con 0x7f4f94017050 2024-09-13T19:06:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa5f98980 20 remove_watcher() i=3 2024-09-13T19:06:38.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.719+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94522241379456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ee860 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.723+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94522241379456] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x55f7ac9e0bd0 2024-09-13T19:06:38.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.723+0000 7f4fa5f98980 20 remove_watcher() i=4 2024-09-13T19:06:38.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.723+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94522241381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ec5f0 con 0x7f4f980dc040 2024-09-13T19:06:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94522241381952] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa5f98980 20 remove_watcher() i=5 2024-09-13T19:06:38.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94522241383280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ef640 con 0x7f4f980dc040 2024-09-13T19:06:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94522241383280] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa5f98980 20 remove_watcher() i=6 2024-09-13T19:06:38.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.727+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94522241385776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f7ac9ec5f0 con 0x7f4f980dc040 2024-09-13T19:06:38.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94522241385776] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f9c00a4d0 con 0x7f4f980dc040 2024-09-13T19:06:38.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 20 remove_watcher() i=7 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f980dc040 msgr2=0x7f4f980dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f980dc040 0x7f4f980dd430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9e0bd0 msgr2=0x55f7ac9e3090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9e0bd0 0x55f7ac9e3090 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f94017050 msgr2=0x7f4f9407a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f94017050 0x7f4f9407a8a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9e55c0 msgr2=0x55f7ac9e79b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9e55c0 0x55f7ac9e79b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e6c034650 msgr2=0x7f4e6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e6c034650 0x7f4e6c036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4f98000c10 tx=0x7f4f980b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 msgr2=0x55f7ac9d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4f94025a40 tx=0x7f4f9401de90 comp rx=0 tx=0).stop 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2619530894 reap_dead start 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 shutdown_connections 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2619530894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9ce970 0x55f7ac9d5af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 >> 172.21.15.151:0/2619530894 conn(0x55f7ac9cad50 msgr2=0x55f7ac9c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 shutdown_connections 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2619530894 wait complete. 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 msgr2=0x7f4e7c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 0x7f4e7c036b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55f7ac9abe60 tx=0x7f4f98005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 msgr2=0x55f7ac9c2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400c010 tx=0x7f4f9402dd60 comp rx=0 tx=0).stop 2024-09-13T19:06:38.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 shutdown_connections 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e7c0346a0 0x7f4e7c036b60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/882257270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac9c2220 0x55f7ac9c2640 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 >> 172.21.15.151:0/882257270 conn(0x55f7ac9b7370 msgr2=0x55f7ac9b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 shutdown_connections 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/882257270 wait complete. 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9a9010 msgr2=0x55f7ac9ab400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f7ac9a9010 0x55f7ac9ab400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f7ac9b1c20 msgr2=0x55f7ac9b4010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f7ac9b1c20 0x55f7ac9b4010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9adce0 msgr2=0x55f7ac9b00d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f7ac9adce0 0x55f7ac9b00d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e8c0346a0 msgr2=0x7f4e8c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e8c0346a0 0x7f4e8c036b60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4f980ad000 tx=0x7f4f980a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 msgr2=0x55f7ac9a4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 --2- 172.21.15.151:0/2744333937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f7ac8b5a50 0x55f7ac9a4090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001e20 tx=0x7f4f94000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa42a9640 1 -- 172.21.15.151:0/2744333937 reap_dead start 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 shutdown_connections 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 >> 172.21.15.151:0/2744333937 conn(0x55f7ac8ac060 msgr2=0x55f7ac997250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 shutdown_connections 2024-09-13T19:06:38.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.731+0000 7f4fa5f98980 1 -- 172.21.15.151:0/2744333937 wait complete. 2024-09-13T19:06:38.746 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:06:38.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-13T19:06:38.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-13T19:06:38.747 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-13T19:06:38.826 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:38.826 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:38.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.823+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.823+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.823+0000 7f845f918980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560c3c7cfa50 0x560c3c7d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.823+0000 7f845f918980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560c3c653ae0 con 0x560c3c73fb00 2024-09-13T19:06:38.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.823+0000 7f845f918980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x560c3c677e30 con 0x560c3c7cfa50 2024-09-13T19:06:38.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560c3c7cfa50 0x560c3c7d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560c3c7cfa50 0x560c3c7d1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55548/0 (socket says 172.21.15.151:55548) 2024-09-13T19:06:38.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 -- 172.21.15.151:0/3375172555 learned_addr learned my addr 172.21.15.151:0/3375172555 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 -- 172.21.15.151:0/3375172555 >> v1:172.21.15.12:6789/0 conn(0x560c3c73fb00 legacy=0x560c3c7ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 -- 172.21.15.151:0/3375172555 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c7d3390 con 0x560c3c7cfa50 2024-09-13T19:06:38.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845cc27640 1 --2- 172.21.15.151:0/3375172555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c7cfa50 0x560c3c7d1e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845400a5c0 tx=0x7f845401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bdf1941d86e5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f844ffff640 1 -- 172.21.15.151:0/3375172555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84540a6070 con 0x560c3c7cfa50 2024-09-13T19:06:38.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f844ffff640 1 -- 172.21.15.151:0/3375172555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84540af070 con 0x560c3c7cfa50 2024-09-13T19:06:38.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f844ffff640 1 -- 172.21.15.151:0/3375172555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84540aa5c0 con 0x560c3c7cfa50 2024-09-13T19:06:38.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845f918980 1 -- 172.21.15.151:0/3375172555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c7cfa50 msgr2=0x560c3c7d1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.827+0000 7f845f918980 1 --2- 172.21.15.151:0/3375172555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c7cfa50 0x560c3c7d1e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f845400a5c0 tx=0x7f845401b340 comp rx=0 tx=0).stop 2024-09-13T19:06:38.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.831+0000 7f845f918980 1 -- 172.21.15.151:0/3375172555 shutdown_connections 2024-09-13T19:06:38.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.831+0000 7f845f918980 1 --2- 172.21.15.151:0/3375172555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c7cfa50 0x560c3c7d1e40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.831+0000 7f845f918980 1 -- 172.21.15.151:0/3375172555 >> 172.21.15.151:0/3375172555 conn(0x560c3c7c6060 msgr2=0x560c3c7c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.831+0000 7f845f918980 1 -- 172.21.15.151:0/3375172555 shutdown_connections 2024-09-13T19:06:38.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.831+0000 7f845f918980 1 -- 172.21.15.151:0/3375172555 wait complete. 2024-09-13T19:06:38.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.843+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.843+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.843+0000 7f845f918980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.843+0000 7f845f918980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c3c679200 con 0x560c3c73fb00 2024-09-13T19:06:38.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55560/0 (socket says 172.21.15.151:55560) 2024-09-13T19:06:38.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 -- 172.21.15.151:0/1326699381 learned_addr learned my addr 172.21.15.151:0/1326699381 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 -- 172.21.15.151:0/1326699381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c7cc060 con 0x560c3c73fb00 2024-09-13T19:06:38.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 --2- 172.21.15.151:0/1326699381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84580016c0 tx=0x7f8458001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cea21328aabc597 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f834b606640 1 -- 172.21.15.151:0/1326699381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458016070 con 0x560c3c73fb00 2024-09-13T19:06:38.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f834b606640 1 -- 172.21.15.151:0/1326699381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845800f640 con 0x560c3c73fb00 2024-09-13T19:06:38.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f834b606640 1 -- 172.21.15.151:0/1326699381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845800f9a0 con 0x560c3c73fb00 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- 172.21.15.151:0/1326699381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 msgr2=0x560c3c7cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 --2- 172.21.15.151:0/1326699381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f84580016c0 tx=0x7f8458001b80 comp rx=0 tx=0).stop 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- 172.21.15.151:0/1326699381 shutdown_connections 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 --2- 172.21.15.151:0/1326699381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c7cba90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- 172.21.15.151:0/1326699381 >> 172.21.15.151:0/1326699381 conn(0x560c3c7c6060 msgr2=0x560c3c8b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- 172.21.15.151:0/1326699381 shutdown_connections 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- 172.21.15.151:0/1326699381 wait complete. 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c8c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845f918980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c3c7d2e30 con 0x560c3c73fb00 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c8c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c8c0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55570/0 (socket says 172.21.15.151:55570) 2024-09-13T19:06:38.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 -- 172.21.15.151:0/1922430633 learned_addr learned my addr 172.21.15.151:0/1922430633 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.847+0000 7f845d428640 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c8c0580 con 0x560c3c73fb00 2024-09-13T19:06:38.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845d428640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c8c0040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f845800f610 tx=0x7f8458001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 -- 172.21.15.151:0/1922430633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458021020 con 0x560c3c73fb00 2024-09-13T19:06:38.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c3c8c0810 con 0x560c3c73fb00 2024-09-13T19:06:38.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 -- 172.21.15.151:0/1922430633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8458011770 con 0x560c3c73fb00 2024-09-13T19:06:38.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 -- 172.21.15.151:0/1922430633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458016040 con 0x560c3c73fb00 2024-09-13T19:06:38.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3c8c34f0 con 0x560c3c73fb00 2024-09-13T19:06:38.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 -- 172.21.15.151:0/1922430633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8458024020 con 0x560c3c73fb00 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8344034650 0x7f8344036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f8349e03640 1 -- 172.21.15.151:0/1922430633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f84580496e0 con 0x560c3c73fb00 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845cc27640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8344034650 0x7f8344036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c7cfa50 0x560c3c8c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8c7640 con 0x560c3c7cfa50 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845dc29640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c7cfa50 0x560c3c8c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845cc27640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8344034650 0x7f8344036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84540ae000 tx=0x7f84540a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845dc29640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c7cfa50 0x560c3c8c6fd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845dc29640 1 -- 172.21.15.151:0/1922430633 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c7cfa50 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8c46f0 con 0x560c3c7cfa50 2024-09-13T19:06:38.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845dc29640 1 -- 172.21.15.151:0/1922430633 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c7cfa50 2024-09-13T19:06:38.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c8c9970 0x560c3c8cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8cc430 con 0x560c3c8c9970 2024-09-13T19:06:38.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.851+0000 7f845d428640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c8c9970 0x560c3c8cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c8c9970 0x560c3c8cbd60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 -- 172.21.15.151:0/1922430633 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f845800f070 con 0x560c3c8c9970 2024-09-13T19:06:38.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8c8810 con 0x560c3c7cfa50 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845dc29640 1 -- 172.21.15.151:0/1922430633 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c7cfa50 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560c3c8cd890 0x560c3c8cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8d0380 con 0x560c3c8cd890 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845cc27640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560c3c8cd890 0x560c3c8cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845cc27640 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560c3c8cd890 0x560c3c8cfc80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845cc27640 1 -- 172.21.15.151:0/1922430633 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f84540aaad0 con 0x560c3c8cd890 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845f918980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c3c6d2800 con 0x560c3c8dde50 2024-09-13T19:06:38.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55578/0 (socket says 172.21.15.151:55578) 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 -- 172.21.15.151:0/3390341336 learned_addr learned my addr 172.21.15.151:0/3390341336 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 -- 172.21.15.151:0/3390341336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c8de7b0 con 0x560c3c8dde50 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f845d428640 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8458047b30 tx=0x7f8458011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.855+0000 7f8342ffd640 1 -- 172.21.15.151:0/3390341336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458010de0 con 0x560c3c8dde50 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8342ffd640 1 -- 172.21.15.151:0/3390341336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845802d300 con 0x560c3c8dde50 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c3c8dea40 con 0x560c3c8dde50 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8342ffd640 1 -- 172.21.15.151:0/3390341336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845802d5e0 con 0x560c3c8dde50 2024-09-13T19:06:38.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3c8e16c0 con 0x560c3c8dde50 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8342ffd640 1 -- 172.21.15.151:0/3390341336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8458049ac0 con 0x560c3c8dde50 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8342ffd640 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 0x7f8334036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8342ffd640 1 -- 172.21.15.151:0/3390341336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8458037070 con 0x560c3c8dde50 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845cc27640 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 0x7f8334036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845cc27640 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 0x7f8334036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560c3c8c7f20 tx=0x7f8454005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845f918980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c3c7ca280 con 0x560c3c8ea7d0 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55586/0 (socket says 172.21.15.151:55586) 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845d428640 1 -- 172.21.15.151:0/3865577289 learned_addr learned my addr 172.21.15.151:0/3865577289 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845d428640 1 -- 172.21.15.151:0/3865577289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c8eb1a0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f845d428640 1 --2- 172.21.15.151:0/3865577289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f845802da90 tx=0x7f845801cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e7f48c7b31e678 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8340ff9640 1 -- 172.21.15.151:0/3865577289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458059070 con 0x560c3c8ea7d0 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8340ff9640 1 -- 172.21.15.151:0/3865577289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845802f7e0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.859+0000 7f8340ff9640 1 -- 172.21.15.151:0/3865577289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845802dd00 con 0x560c3c8ea7d0 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/3865577289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 msgr2=0x560c3c8eabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 --2- 172.21.15.151:0/3865577289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f845802da90 tx=0x7f845801cac0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/3865577289 shutdown_connections 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 --2- 172.21.15.151:0/3865577289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8eabd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/3865577289 >> 172.21.15.151:0/3865577289 conn(0x560c3c8e6bb0 msgr2=0x560c3c8e4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/3865577289 shutdown_connections 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/3865577289 wait complete. 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 Processor -- start 2024-09-13T19:06:38.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- start start 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560c3c8eb620 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845d428640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55600/0 (socket says 172.21.15.151:55600) 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 learned_addr learned my addr 172.21.15.151:0/1793069212 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c3c8f1ea0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845d428640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84580469a0 tx=0x7f8458010a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f8332ffd640 1 -- 172.21.15.151:0/1793069212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f845806e070 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560c3c8f1ea0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f8332ffd640 1 -- 172.21.15.151:0/1793069212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8458041ad0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c3c8f1ea0 con 0x560c3c8ea7d0 2024-09-13T19:06:38.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f8332ffd640 1 -- 172.21.15.151:0/1793069212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8458026400 con 0x560c3c8ea7d0 2024-09-13T19:06:38.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.863+0000 7f8332ffd640 1 -- 172.21.15.151:0/1793069212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8458071070 con 0x560c3c8ea7d0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f8332ffd640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8328034650 0x7f8328036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f8332ffd640 1 -- 172.21.15.151:0/1793069212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8458066070 con 0x560c3c8ea7d0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845cc27640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8328034650 0x7f8328036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c8fca10 0x560c3c8feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8ff620 con 0x560c3c8fca10 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c8fca10 0x560c3c8feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845cc27640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8328034650 0x7f8328036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8454000c10 tx=0x7f84540c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c8fca10 0x560c3c8feed0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 realm 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c8ffa30 con 0x560c3c8fca10 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c900300 con 0x560c3c8fca10 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c901400 0x560c3c9037f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c903e00 con 0x560c3c901400 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c901400 0x560c3c9037f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c901400 0x560c3c9037f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 20 searching for the correct realm 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9056d0 con 0x560c3c901400 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8458073060 0x7f8458046340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9056d0 con 0x7f8458073060 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.867+0000 7f845cc27640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8458073060 0x7f8458046340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845cc27640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8458073060 0x7f8458046340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845cc27640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f84540e0040 0x7f84540e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9056d0 con 0x7f84540e0040 2024-09-13T19:06:38.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f84540e0040 0x7f84540e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f84540e0040 0x7f84540e0420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.871+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f8458073060 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f8458073060 2024-09-13T19:06:38.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.875+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f8458073060 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.879+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f8458073060 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c901400 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f84540e0040 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x560c3c8fca10 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9006a0 con 0x7f8458073060 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:38.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9047c0 con 0x560c3c8fca10 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c904400 con 0x560c3c8fca10 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9050e0 con 0x7f8458073060 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 zone default found 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 4 Realm: () 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 zonegroup default 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.883+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c905b00 con 0x7f84540e0040 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9074e0 con 0x560c3c901400 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9078b0 con 0x560c3c901400 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 started sync module instance, tier type = 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:38.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c906980 con 0x7f8458073060 2024-09-13T19:06:38.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94610555694448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9065e0 con 0x7f8458073060 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9087c0 con 0x560c3c8fca10 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.887+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94610555694448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94610555699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c908730 con 0x560c3c8fca10 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c909550 con 0x560c3c901400 2024-09-13T19:06:38.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94610555699984] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94610555702192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c909940 con 0x560c3c901400 2024-09-13T19:06:38.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.891+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90a300 con 0x7f8458073060 2024-09-13T19:06:38.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94610555709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90af70 con 0x7f8458073060 2024-09-13T19:06:38.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90b930 con 0x560c3c8fca10 2024-09-13T19:06:38.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94610555702192] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94610555709088] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94610555712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90af70 con 0x560c3c8fca10 2024-09-13T19:06:38.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.895+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90b8a0 con 0x7f84540e0040 2024-09-13T19:06:38.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94610555712640] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94610555710416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90bd50 con 0x7f84540e0040 2024-09-13T19:06:38.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90c710 con 0x7f84540e0040 2024-09-13T19:06:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94610555716192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90cb30 con 0x7f84540e0040 2024-09-13T19:06:38.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.899+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90d610 con 0x7f84540e0040 2024-09-13T19:06:38.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94610555710416] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94610555719968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90d610 con 0x7f84540e0040 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=0 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=1 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=2 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=3 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=4 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=5 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94610555716192] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=6 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94610555719968] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 20 add_watcher() i=7 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.903+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c910640 con 0x560c3c8fca10 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94610555713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90dac0 con 0x560c3c8fca10 2024-09-13T19:06:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94610555713696] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f83137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845f918980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845f918980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:38.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c918e00 con 0x560c3c8fca10 2024-09-13T19:06:38.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.907+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.911+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9194d0 con 0x7f84540e0040 2024-09-13T19:06:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.911+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.911+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c9198f0 con 0x560c3c901400 2024-09-13T19:06:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.911+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.911+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c919890 con 0x560c3c8fca10 2024-09-13T19:06:38.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c919e20 con 0x7f8458073060 2024-09-13T19:06:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a2d0 con 0x560c3c901400 2024-09-13T19:06:38.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.915+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a2d0 con 0x560c3c8fca10 2024-09-13T19:06:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.919+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.919+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a2d0 con 0x7f84540e0040 2024-09-13T19:06:38.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a2d0 con 0x7f8458073060 2024-09-13T19:06:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a840 con 0x560c3c901400 2024-09-13T19:06:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.923+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91a840 con 0x7f8458073060 2024-09-13T19:06:38.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.927+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.927+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91add0 con 0x7f84540e0040 2024-09-13T19:06:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.927+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.927+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91add0 con 0x7f8458073060 2024-09-13T19:06:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.931+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.931+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f84540e0040 2024-09-13T19:06:38.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.931+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.931+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c8fca10 2024-09-13T19:06:38.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.935+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.935+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.935+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.935+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f8458073060 2024-09-13T19:06:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.935+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.939+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.939+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.939+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c8fca10 2024-09-13T19:06:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.939+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.939+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c8fca10 2024-09-13T19:06:38.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f8458073060 2024-09-13T19:06:38.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.943+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.947+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.951+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.951+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f84540e0040 2024-09-13T19:06:38.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.955+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.955+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.955+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.955+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f84540e0040 2024-09-13T19:06:38.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.959+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.959+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x560c3c901400 2024-09-13T19:06:38.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.959+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.959+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f84540e0040 2024-09-13T19:06:38.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.963+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.963+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c91b210 con 0x7f8458073060 2024-09-13T19:06:38.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f83127e4640 20 reqs_thread_entry: start 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 20 Filter name: none 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f8283fff640 20 reqs_thread_entry: start 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 20 rados->read ofs=0 len=0 2024-09-13T19:06:38.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560c3c936280 con 0x7f84540e0040 2024-09-13T19:06:38.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:38.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:06:38.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.967+0000 7f845f918980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:06:38.971 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:06:38.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.971+0000 7f83137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:38.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.971+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94610555713696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c917050 con 0x560c3c8fca10 2024-09-13T19:06:38.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.971+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94610555713696] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.971+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94610555694448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90b8a0 con 0x7f8458073060 2024-09-13T19:06:38.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94610555694448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845f918980 20 remove_watcher() i=0 2024-09-13T19:06:38.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845f918980 2 removed watcher, disabling cache 2024-09-13T19:06:38.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94610555699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90b8a0 con 0x560c3c8fca10 2024-09-13T19:06:38.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94610555699984] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845f918980 20 remove_watcher() i=1 2024-09-13T19:06:38.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.975+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94610555702192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c908310 con 0x560c3c901400 2024-09-13T19:06:38.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845d428640 1 -- 172.21.15.151:0/1793069212 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94610555702192] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8458070030 con 0x560c3c901400 2024-09-13T19:06:38.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845f918980 20 remove_watcher() i=2 2024-09-13T19:06:38.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94610555709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90b8a0 con 0x7f8458073060 2024-09-13T19:06:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845cc27640 1 -- 172.21.15.151:0/1793069212 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94610555709088] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84540aaad0 con 0x7f8458073060 2024-09-13T19:06:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845f918980 20 remove_watcher() i=3 2024-09-13T19:06:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.979+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94610555712640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c908bb0 con 0x560c3c8fca10 2024-09-13T19:06:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.983+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94610555712640] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x560c3c8fca10 2024-09-13T19:06:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.983+0000 7f845f918980 20 remove_watcher() i=4 2024-09-13T19:06:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.983+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94610555710416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c908310 con 0x7f84540e0040 2024-09-13T19:06:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94610555710416] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845f918980 20 remove_watcher() i=5 2024-09-13T19:06:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94610555716192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c90a6a0 con 0x7f84540e0040 2024-09-13T19:06:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94610555716192] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845f918980 20 remove_watcher() i=6 2024-09-13T19:06:38.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.987+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94610555719968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560c3c908bb0 con 0x7f84540e0040 2024-09-13T19:06:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94610555719968] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f84500083f0 con 0x7f84540e0040 2024-09-13T19:06:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 20 remove_watcher() i=7 2024-09-13T19:06:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f84540e0040 msgr2=0x7f84540e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f84540e0040 0x7f84540e0420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c8fca10 msgr2=0x560c3c8feed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c8fca10 0x560c3c8feed0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8458073060 msgr2=0x7f8458046340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8458073060 0x7f8458046340 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c901400 msgr2=0x560c3c9037f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c901400 0x560c3c9037f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8328034650 msgr2=0x7f8328036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8328034650 0x7f8328036b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8454000c10 tx=0x7f84540c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845dc29640 1 -- 172.21.15.151:0/1793069212 reap_dead start 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 msgr2=0x560c3c8f1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f84580469a0 tx=0x7f8458010a20 comp rx=0 tx=0).stop 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 shutdown_connections 2024-09-13T19:06:38.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1793069212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8ea7d0 0x560c3c8f1960 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 >> 172.21.15.151:0/1793069212 conn(0x560c3c8e6bb0 msgr2=0x560c3c8e4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 shutdown_connections 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1793069212 wait complete. 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 msgr2=0x7f8334036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 0x7f8334036b60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560c3c8c7f20 tx=0x7f8454005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 msgr2=0x560c3c8de270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8458047b30 tx=0x7f8458011f40 comp rx=0 tx=0).stop 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 shutdown_connections 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f83340346a0 0x7f8334036b60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/3390341336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c8dde50 0x560c3c8de270 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 >> 172.21.15.151:0/3390341336 conn(0x560c3c8d2fa0 msgr2=0x560c3c8d5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 shutdown_connections 2024-09-13T19:06:38.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/3390341336 wait complete. 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c7cfa50 msgr2=0x560c3c8c6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560c3c7cfa50 0x560c3c8c6fd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560c3c8cd890 msgr2=0x560c3c8cfc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560c3c8cd890 0x560c3c8cfc80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c8c9970 msgr2=0x560c3c8cbd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560c3c8c9970 0x560c3c8cbd60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8344034650 msgr2=0x7f8344036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8344034650 0x7f8344036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84540ae000 tx=0x7f84540a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 msgr2=0x560c3c8c0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 --2- 172.21.15.151:0/1922430633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560c3c73fb00 0x560c3c8c0040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f845800f610 tx=0x7f8458001260 comp rx=0 tx=0).stop 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845dc29640 1 -- 172.21.15.151:0/1922430633 reap_dead start 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 shutdown_connections 2024-09-13T19:06:38.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 >> 172.21.15.151:0/1922430633 conn(0x560c3c7c6060 msgr2=0x560c3c8b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:38.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 shutdown_connections 2024-09-13T19:06:38.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:38.991+0000 7f845f918980 1 -- 172.21.15.151:0/1922430633 wait complete. 2024-09-13T19:06:39.007 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:06:39.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:39.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:39.007 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:06:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:39.085 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa771caa980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e2a8bd5ac0 0x55e2a8c64370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa771caa980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2a8ae9ae0 con 0x55e2a8c648b0 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa771caa980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55e2a8b0de30 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76f7ba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e2a8bd5ac0 0x55e2a8c64370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76efb9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55e2a8c648b0 0x55e2a8c66ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33324/0 (socket says 172.21.15.151:33324) 2024-09-13T19:06:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76f7ba640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e2a8bd5ac0 0x55e2a8c64370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55602/0 (socket says 172.21.15.151:55602) 2024-09-13T19:06:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76efb9640 1 -- 172.21.15.151:0/3508597393 learned_addr learned my addr 172.21.15.151:0/3508597393 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3508597393 >> v1:172.21.15.12:6789/0 conn(0x55e2a8c648b0 legacy=0x55e2a8c66ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.083+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3508597393 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8c693d0 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3508597393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c64370 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa76000a480 tx=0x7fa76001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe63bbf2920b6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa76e7b8640 1 -- 172.21.15.151:0/3508597393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600b0070 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa76e7b8640 1 -- 172.21.15.151:0/3508597393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600ab540 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa76e7b8640 1 -- 172.21.15.151:0/3508597393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600ab840 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa771caa980 1 -- 172.21.15.151:0/3508597393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 msgr2=0x55e2a8c64370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.087+0000 7fa771caa980 1 --2- 172.21.15.151:0/3508597393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c64370 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa76000a480 tx=0x7fa76001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.091+0000 7fa771caa980 1 -- 172.21.15.151:0/3508597393 shutdown_connections 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.091+0000 7fa771caa980 1 --2- 172.21.15.151:0/3508597393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c64370 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.091+0000 7fa771caa980 1 -- 172.21.15.151:0/3508597393 >> 172.21.15.151:0/3508597393 conn(0x55e2a8c5c060 msgr2=0x55e2a8c5e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.091+0000 7fa771caa980 1 -- 172.21.15.151:0/3508597393 shutdown_connections 2024-09-13T19:06:39.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.091+0000 7fa771caa980 1 -- 172.21.15.151:0/3508597393 wait complete. 2024-09-13T19:06:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2a8b0f200 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55608/0 (socket says 172.21.15.151:55608) 2024-09-13T19:06:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3222800574 learned_addr learned my addr 172.21.15.151:0/3222800574 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3222800574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8c620a0 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3222800574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ae040 tx=0x7fa760003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f464dfde468f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa65d60a640 1 -- 172.21.15.151:0/3222800574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600b0040 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa65d60a640 1 -- 172.21.15.151:0/3222800574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600ab9b0 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa65d60a640 1 -- 172.21.15.151:0/3222800574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600abc90 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- 172.21.15.151:0/3222800574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 msgr2=0x55e2a8c61ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 --2- 172.21.15.151:0/3222800574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ae040 tx=0x7fa760003030 comp rx=0 tx=0).stop 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- 172.21.15.151:0/3222800574 shutdown_connections 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 --2- 172.21.15.151:0/3222800574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8c61ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- 172.21.15.151:0/3222800574 >> 172.21.15.151:0/3222800574 conn(0x55e2a8c5c060 msgr2=0x55e2a8d48680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- 172.21.15.151:0/3222800574 shutdown_connections 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- 172.21.15.151:0/3222800574 wait complete. 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8d55e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.107+0000 7fa771caa980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2a8c68e10 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8d55e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8d55e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55622/0 (socket says 172.21.15.151:55622) 2024-09-13T19:06:39.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3910121181 learned_addr learned my addr 172.21.15.151:0/3910121181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8d563a0 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8d55e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7600030b0 tx=0x7fa760018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 -- 172.21.15.151:0/3910121181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600c5070 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a8d56630 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 -- 172.21.15.151:0/3910121181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600b6970 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a8d59310 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 -- 172.21.15.151:0/3910121181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600b0050 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 -- 172.21.15.151:0/3910121181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7600c8070 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6540346a0 0x7fa654036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa65be07640 1 -- 172.21.15.151:0/3910121181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa7600bc070 con 0x55e2a8bd5ac0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6540346a0 0x7fa654036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8c648b0 0x55e2a8d5ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d5d480 con 0x55e2a8c648b0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8c648b0 0x55e2a8d5ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6540346a0 0x7fa654036b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f70 tx=0x7fa7580012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8c648b0 0x55e2a8d5ce10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.111+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3910121181 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8c648b0 2024-09-13T19:06:39.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d5a510 con 0x55e2a8c648b0 2024-09-13T19:06:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3910121181 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8c648b0 2024-09-13T19:06:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d5f7b0 0x55e2a8d61ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d62270 con 0x55e2a8d5f7b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d5f7b0 0x55e2a8d61ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d5f7b0 0x55e2a8d61ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3910121181 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7600c7030 con 0x55e2a8d5f7b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d5e650 con 0x55e2a8c648b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3910121181 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8c648b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2a8d636b0 0x55e2a8d65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d66230 con 0x55e2a8d636b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2a8d636b0 0x55e2a8d65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2a8d636b0 0x55e2a8d65aa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76efb9640 1 -- 172.21.15.151:0/3910121181 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa75800e620 con 0x55e2a8d636b0 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa771caa980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2a8b68800 con 0x55e2a8d73cc0 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55630/0 (socket says 172.21.15.151:55630) 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 -- 172.21.15.151:0/2480282728 learned_addr learned my addr 172.21.15.151:0/2480282728 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.115+0000 7fa76f7ba640 1 -- 172.21.15.151:0/2480282728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8d74620 con 0x55e2a8d73cc0 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa7600e2000 tx=0x7fa7600aafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 -- 172.21.15.151:0/2480282728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600ad400 con 0x55e2a8d73cc0 2024-09-13T19:06:39.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a8d748b0 con 0x55e2a8d73cc0 2024-09-13T19:06:39.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 -- 172.21.15.151:0/2480282728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600c93b0 con 0x55e2a8d73cc0 2024-09-13T19:06:39.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 -- 172.21.15.151:0/2480282728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600c9690 con 0x55e2a8d73cc0 2024-09-13T19:06:39.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a8d77530 con 0x55e2a8d73cc0 2024-09-13T19:06:39.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 -- 172.21.15.151:0/2480282728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7600aa3b0 con 0x55e2a8d73cc0 2024-09-13T19:06:39.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 0x7fa648036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa659602640 1 -- 172.21.15.151:0/2480282728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa7600df030 con 0x55e2a8d73cc0 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76efb9640 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 0x7fa648036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76efb9640 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 0x7fa648036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa75800bf60 tx=0x7fa75800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa771caa980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2a8c60200 con 0x55e2a8d80680 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55632/0 (socket says 172.21.15.151:55632) 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 -- 172.21.15.151:0/674321292 learned_addr learned my addr 172.21.15.151:0/674321292 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 -- 172.21.15.151:0/674321292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8d81050 con 0x55e2a8d80680 2024-09-13T19:06:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.119+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/674321292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c0fd0 tx=0x7fa7600ec500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3881a57c2d2948c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa652ffd640 1 -- 172.21.15.151:0/674321292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600c0070 con 0x55e2a8d80680 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa652ffd640 1 -- 172.21.15.151:0/674321292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600c0210 con 0x55e2a8d80680 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa652ffd640 1 -- 172.21.15.151:0/674321292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600c04f0 con 0x55e2a8d80680 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/674321292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 msgr2=0x55e2a8d80a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 --2- 172.21.15.151:0/674321292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa7600c0fd0 tx=0x7fa7600ec500 comp rx=0 tx=0).stop 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/674321292 shutdown_connections 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 --2- 172.21.15.151:0/674321292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d80a80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/674321292 >> 172.21.15.151:0/674321292 conn(0x55e2a8d7ca10 msgr2=0x55e2a8d7ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/674321292 shutdown_connections 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/674321292 wait complete. 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 Processor -- start 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- start start 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d87810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2a8d815a0 con 0x55e2a8d80680 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d87810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa76f7ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d87810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55642/0 (socket says 172.21.15.151:55642) 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 learned_addr learned my addr 172.21.15.151:0/3325545642 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2a8d87d50 con 0x55e2a8d80680 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d87810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7600adfd0 tx=0x7fa7600f0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa6517fa640 1 -- 172.21.15.151:0/3325545642 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa76010f070 con 0x55e2a8d80680 2024-09-13T19:06:39.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2a8d87d50 con 0x55e2a8d80680 2024-09-13T19:06:39.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa6517fa640 1 -- 172.21.15.151:0/3325545642 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600c0c10 con 0x55e2a8d80680 2024-09-13T19:06:39.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa6517fa640 1 -- 172.21.15.151:0/3325545642 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7600ec630 con 0x55e2a8d80680 2024-09-13T19:06:39.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.123+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2a8d87d50 con 0x55e2a8d80680 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa6517fa640 1 -- 172.21.15.151:0/3325545642 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa760112070 con 0x55e2a8d80680 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa6517fa640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa638034650 0x7fa638036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa6517fa640 1 -- 172.21.15.151:0/3325545642 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa760107070 con 0x55e2a8d80680 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa638034650 0x7fa638036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8d92780 0x55e2a8d94c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d95390 con 0x55e2a8d92780 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8d92780 0x55e2a8d94c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa638034650 0x7fa638036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e2a8d66630 tx=0x7fa758010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8d92780 0x55e2a8d94c40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 realm 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d957a0 con 0x55e2a8d92780 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96070 con 0x55e2a8d92780 2024-09-13T19:06:39.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d97170 0x55e2a8d99560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d99b30 con 0x55e2a8d97170 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d97170 0x55e2a8d99560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d97170 0x55e2a8d99560 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 20 searching for the correct realm 2024-09-13T19:06:39.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9b400 con 0x55e2a8d97170 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa760114060 0x7fa7600a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9b400 con 0x7fa760114060 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.127+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa760114060 0x7fa7600a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa760114060 0x7fa7600a5170 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76efb9640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa758037040 0x7fa758036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9b400 con 0x7fa758037040 2024-09-13T19:06:39.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa758037040 0x7fa758036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa758037040 0x7fa758036410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.131+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa760114060 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa760114060 2024-09-13T19:06:39.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.135+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa760114060 2024-09-13T19:06:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.139+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa760114060 2024-09-13T19:06:39.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d97170 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa758037040 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x55e2a8d92780 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d96410 con 0x7fa760114060 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:39.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9a520 con 0x55e2a8d92780 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9adc0 con 0x55e2a8d92780 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9a910 con 0x7fa760114060 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 zone default found 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 4 Realm: () 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 zonegroup default 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9b830 con 0x7fa758037040 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.143+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9d2a0 con 0x55e2a8d97170 2024-09-13T19:06:39.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9d750 con 0x55e2a8d97170 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 20 started sync module instance, tier type = 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:39.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9c6b0 con 0x7fa760114060 2024-09-13T19:06:39.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94431983815328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9c310 con 0x7fa760114060 2024-09-13T19:06:39.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9e680 con 0x55e2a8d92780 2024-09-13T19:06:39.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.147+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94431983815328] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94431983821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9eaa0 con 0x55e2a8d92780 2024-09-13T19:06:39.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9f330 con 0x55e2a8d97170 2024-09-13T19:06:39.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94431983823520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9eec0 con 0x55e2a8d97170 2024-09-13T19:06:39.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.151+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da0230 con 0x7fa760114060 2024-09-13T19:06:39.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.155+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.155+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94431983828288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da0b00 con 0x7fa760114060 2024-09-13T19:06:39.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.155+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da14c0 con 0x55e2a8d92780 2024-09-13T19:06:39.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.155+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94431983828288] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.155+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94431983821264] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.159+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94431983823520] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.159+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.159+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94431983822320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9f830 con 0x55e2a8d92780 2024-09-13T19:06:39.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.159+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da0b00 con 0x7fa758037040 2024-09-13T19:06:39.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.163+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94431983822320] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.167+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.167+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94431983833552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da0b00 con 0x7fa758037040 2024-09-13T19:06:39.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.167+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da1d10 con 0x7fa758037040 2024-09-13T19:06:39.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.171+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94431983833552] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.171+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.171+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94431983831088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da1d10 con 0x7fa758037040 2024-09-13T19:06:39.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.171+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da2710 con 0x7fa758037040 2024-09-13T19:06:39.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.171+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94431983831088] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94431983837728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da28f0 con 0x7fa758037040 2024-09-13T19:06:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=0 2024-09-13T19:06:39.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=1 2024-09-13T19:06:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=2 2024-09-13T19:06:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=3 2024-09-13T19:06:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=4 2024-09-13T19:06:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=5 2024-09-13T19:06:39.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa771caa980 20 add_watcher() i=6 2024-09-13T19:06:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.175+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94431983837728] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 20 add_watcher() i=7 2024-09-13T19:06:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da5cc0 con 0x55e2a8d92780 2024-09-13T19:06:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94431983839200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da30b0 con 0x55e2a8d92780 2024-09-13T19:06:39.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94431983839200] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa625fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:39.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:39.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.179+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8dae480 con 0x55e2a8d92780 2024-09-13T19:06:39.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.183+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.183+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daeb50 con 0x7fa758037040 2024-09-13T19:06:39.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.183+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.183+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daef70 con 0x55e2a8d97170 2024-09-13T19:06:39.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.187+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.187+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daeeb0 con 0x55e2a8d92780 2024-09-13T19:06:39.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.187+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.187+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daf4a0 con 0x7fa760114060 2024-09-13T19:06:39.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.191+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.191+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daf950 con 0x55e2a8d97170 2024-09-13T19:06:39.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.191+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.191+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daf950 con 0x55e2a8d92780 2024-09-13T19:06:39.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.195+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.195+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daf950 con 0x7fa758037040 2024-09-13T19:06:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.195+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.195+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8daf950 con 0x7fa760114060 2024-09-13T19:06:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.199+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.199+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8dafec0 con 0x55e2a8d97170 2024-09-13T19:06:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.199+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.199+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8dafec0 con 0x7fa760114060 2024-09-13T19:06:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.203+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.203+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db0430 con 0x7fa758037040 2024-09-13T19:06:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.203+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.203+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db04c0 con 0x7fa760114060 2024-09-13T19:06:39.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.207+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.207+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa758037040 2024-09-13T19:06:39.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.207+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.207+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d92780 2024-09-13T19:06:39.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.211+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.211+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.211+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.211+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa760114060 2024-09-13T19:06:39.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.215+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.215+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.215+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.215+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d92780 2024-09-13T19:06:39.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.219+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.219+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d92780 2024-09-13T19:06:39.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.219+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.219+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.223+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.223+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa760114060 2024-09-13T19:06:39.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.223+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.223+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.227+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.227+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.227+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.227+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.231+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.231+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.231+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.231+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa758037040 2024-09-13T19:06:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.235+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.235+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.235+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.235+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa758037040 2024-09-13T19:06:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.239+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.239+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x55e2a8d97170 2024-09-13T19:06:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.243+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.243+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa758037040 2024-09-13T19:06:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.243+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.243+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8db08a0 con 0x7fa760114060 2024-09-13T19:06:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa624fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:39.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:39.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 20 Filter name: none 2024-09-13T19:06:39.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa59e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:39.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:39.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8dac7c0 con 0x7fa758037040 2024-09-13T19:06:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:06:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.247+0000 7fa771caa980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:39.251 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:06:39.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.251+0000 7fa625fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.251+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94431983839200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da7c70 con 0x55e2a8d92780 2024-09-13T19:06:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.251+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94431983839200] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.251+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94431983815328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da27e0 con 0x7fa760114060 2024-09-13T19:06:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94431983815328] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa771caa980 20 remove_watcher() i=0 2024-09-13T19:06:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa771caa980 2 removed watcher, disabling cache 2024-09-13T19:06:39.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94431983821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da27e0 con 0x55e2a8d92780 2024-09-13T19:06:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94431983821264] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa771caa980 20 remove_watcher() i=1 2024-09-13T19:06:39.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.255+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94431983823520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9e1d0 con 0x55e2a8d97170 2024-09-13T19:06:39.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa76f7ba640 1 -- 172.21.15.151:0/3325545642 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94431983823520] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa760111030 con 0x55e2a8d97170 2024-09-13T19:06:39.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa771caa980 20 remove_watcher() i=2 2024-09-13T19:06:39.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94431983828288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da27e0 con 0x7fa760114060 2024-09-13T19:06:39.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa76efb9640 1 -- 172.21.15.151:0/3325545642 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94431983828288] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa75800e620 con 0x7fa760114060 2024-09-13T19:06:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa771caa980 20 remove_watcher() i=3 2024-09-13T19:06:39.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.259+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94431983822320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8d9eaa0 con 0x55e2a8d92780 2024-09-13T19:06:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94431983822320] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x55e2a8d92780 2024-09-13T19:06:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa771caa980 20 remove_watcher() i=4 2024-09-13T19:06:39.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94431983833552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da27e0 con 0x7fa758037040 2024-09-13T19:06:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94431983833552] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa771caa980 20 remove_watcher() i=5 2024-09-13T19:06:39.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.263+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94431983831088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da11d0 con 0x7fa758037040 2024-09-13T19:06:39.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94431983831088] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 20 remove_watcher() i=6 2024-09-13T19:06:39.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94431983837728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2a8da27e0 con 0x7fa758037040 2024-09-13T19:06:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94431983837728] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa76800a4d0 con 0x7fa758037040 2024-09-13T19:06:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 20 remove_watcher() i=7 2024-09-13T19:06:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa758037040 msgr2=0x7fa758036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa758037040 0x7fa758036410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8d92780 msgr2=0x55e2a8d94c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8d92780 0x55e2a8d94c40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa760114060 msgr2=0x7fa7600a5170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.267+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa760114060 0x7fa7600a5170 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d97170 msgr2=0x55e2a8d99560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d97170 0x55e2a8d99560 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa638034650 msgr2=0x7fa638036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa638034650 0x7fa638036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55e2a8d66630 tx=0x7fa758010000 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 msgr2=0x55e2a8d87810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3325545642 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d80680 0x55e2a8d87810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7600adfd0 tx=0x7fa7600f0f90 comp rx=0 tx=0).stop 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 reap_dead start 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3325545642 reap_dead start 2024-09-13T19:06:39.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 shutdown_connections 2024-09-13T19:06:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 >> 172.21.15.151:0/3325545642 conn(0x55e2a8d7ca10 msgr2=0x55e2a8d7aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 shutdown_connections 2024-09-13T19:06:39.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3325545642 wait complete. 2024-09-13T19:06:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 msgr2=0x7fa648036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 0x7fa648036b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa75800bf60 tx=0x7fa75800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 msgr2=0x55e2a8d740e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa7600e2000 tx=0x7fa7600aafa0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 shutdown_connections 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa648034650 0x7fa648036b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/2480282728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8d73cc0 0x55e2a8d740e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 >> 172.21.15.151:0/2480282728 conn(0x55e2a8d68e10 msgr2=0x55e2a8d6b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 shutdown_connections 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/2480282728 wait complete. 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8c648b0 msgr2=0x55e2a8d5ce10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2a8c648b0 0x55e2a8d5ce10 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2a8d636b0 msgr2=0x55e2a8d65aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2a8d636b0 0x55e2a8d65aa0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d5f7b0 msgr2=0x55e2a8d61ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2a8d5f7b0 0x55e2a8d61ba0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6540346a0 msgr2=0x7fa654036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6540346a0 0x7fa654036b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa758000f70 tx=0x7fa7580012c0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 msgr2=0x55e2a8d55e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 --2- 172.21.15.151:0/3910121181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2a8bd5ac0 0x55e2a8d55e60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7600030b0 tx=0x7fa760018020 comp rx=0 tx=0).stop 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa76ffbb640 1 -- 172.21.15.151:0/3910121181 reap_dead start 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 shutdown_connections 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 >> 172.21.15.151:0/3910121181 conn(0x55e2a8c5c060 msgr2=0x55e2a8c60720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 shutdown_connections 2024-09-13T19:06:39.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.271+0000 7fa771caa980 1 -- 172.21.15.151:0/3910121181 wait complete. 2024-09-13T19:06:39.285 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:06:39.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:06:39.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:06:39.286 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:06:39.368 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:39.368 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:39.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2836ef980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561ec6fe8a10 0x561ec6feae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2836ef980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561ec6e6cae0 con 0x561ec6fe4690 2024-09-13T19:06:39.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2836ef980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x561ec6e90e30 con 0x561ec6fe8a10 2024-09-13T19:06:39.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2809fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561ec6fe8a10 0x561ec6feae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2809fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561ec6fe8a10 0x561ec6feae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55656/0 (socket says 172.21.15.151:55656) 2024-09-13T19:06:39.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2809fe640 1 -- 172.21.15.151:0/1004798439 learned_addr learned my addr 172.21.15.151:0/1004798439 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2809fe640 1 -- 172.21.15.151:0/1004798439 >> v1:172.21.15.12:6789/0 conn(0x561ec6fe4690 legacy=0x561ec6fe4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.367+0000 7fa2809fe640 1 -- 172.21.15.151:0/1004798439 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec6fec350 con 0x561ec6fe8a10 2024-09-13T19:06:39.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2809fe640 1 --2- 172.21.15.151:0/1004798439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe8a10 0x561ec6feae00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa27800a5c0 tx=0x7fa27801b1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7b5934385015cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa273fff640 1 -- 172.21.15.151:0/1004798439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2780af070 con 0x561ec6fe8a10 2024-09-13T19:06:39.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa273fff640 1 -- 172.21.15.151:0/1004798439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2780aa530 con 0x561ec6fe8a10 2024-09-13T19:06:39.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa273fff640 1 -- 172.21.15.151:0/1004798439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2780aa830 con 0x561ec6fe8a10 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 -- 172.21.15.151:0/1004798439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe8a10 msgr2=0x561ec6feae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 --2- 172.21.15.151:0/1004798439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe8a10 0x561ec6feae00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa27800a5c0 tx=0x7fa27801b1d0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 -- 172.21.15.151:0/1004798439 shutdown_connections 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 --2- 172.21.15.151:0/1004798439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe8a10 0x561ec6feae00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 -- 172.21.15.151:0/1004798439 >> 172.21.15.151:0/1004798439 conn(0x561ec6fe01b0 msgr2=0x561ec6fe25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 -- 172.21.15.151:0/1004798439 shutdown_connections 2024-09-13T19:06:39.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.371+0000 7fa2836ef980 1 -- 172.21.15.151:0/1004798439 wait complete. 2024-09-13T19:06:39.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2836ef980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2836ef980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ec6e92200 con 0x561ec6fe4690 2024-09-13T19:06:39.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55660/0 (socket says 172.21.15.151:55660) 2024-09-13T19:06:39.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2811ff640 1 -- 172.21.15.151:0/93090652 learned_addr learned my addr 172.21.15.151:0/93090652 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2811ff640 1 -- 172.21.15.151:0/93090652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec70cfff0 con 0x561ec6fe4690 2024-09-13T19:06:39.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.387+0000 7fa2811ff640 1 --2- 172.21.15.151:0/93090652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001860 tx=0x7fa27c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd318e068c0478e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16f606640 1 -- 172.21.15.151:0/93090652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c016070 con 0x561ec6fe4690 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16f606640 1 -- 172.21.15.151:0/93090652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c00b6f0 con 0x561ec6fe4690 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16f606640 1 -- 172.21.15.151:0/93090652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c00b9f0 con 0x561ec6fe4690 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/93090652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 msgr2=0x561ec70cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 --2- 172.21.15.151:0/93090652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa27c001860 tx=0x7fa27c006f90 comp rx=0 tx=0).stop 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/93090652 shutdown_connections 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 --2- 172.21.15.151:0/93090652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70cfa20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/93090652 >> 172.21.15.151:0/93090652 conn(0x561ec6fe01b0 msgr2=0x561ec70cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/93090652 shutdown_connections 2024-09-13T19:06:39.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/93090652 wait complete. 2024-09-13T19:06:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70d9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ec6febe50 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70d9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55672/0 (socket says 172.21.15.151:55672) 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2811ff640 1 -- 172.21.15.151:0/638571046 learned_addr learned my addr 172.21.15.151:0/638571046 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2811ff640 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec70d9580 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2811ff640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70d9040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561ec70d0c00 tx=0x7fa27c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16de03640 1 -- 172.21.15.151:0/638571046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c022070 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16de03640 1 -- 172.21.15.151:0/638571046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c006160 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ec70d9810 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa16de03640 1 -- 172.21.15.151:0/638571046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c016070 con 0x561ec6fe4690 2024-09-13T19:06:39.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.391+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec70dc4f0 con 0x561ec6fe4690 2024-09-13T19:06:39.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa16de03640 1 -- 172.21.15.151:0/638571046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa27c025070 con 0x561ec6fe4690 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa16de03640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa168034650 0x7fa168036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa16de03640 1 -- 172.21.15.151:0/638571046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa27c0491e0 con 0x561ec6fe4690 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2809fe640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa168034650 0x7fa168036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec6fe8a10 0x561ec70e0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec70e0680 con 0x561ec6fe8a10 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa281a00640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec6fe8a10 0x561ec70e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2809fe640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa168034650 0x7fa168036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ac000 tx=0x7fa2780a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa281a00640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec6fe8a10 0x561ec70e0010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa281a00640 1 -- 172.21.15.151:0/638571046 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec6fe8a10 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec70dd710 con 0x561ec6fe8a10 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa281a00640 1 -- 172.21.15.151:0/638571046 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec6fe8a10 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec70e29d0 0x561ec70e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec70e54b0 con 0x561ec70e29d0 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2811ff640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec70e29d0 0x561ec70e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2811ff640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec70e29d0 0x561ec70e4dc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2811ff640 1 -- 172.21.15.151:0/638571046 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa27c024030 con 0x561ec70e29d0 2024-09-13T19:06:39.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.395+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec70e1870 con 0x561ec6fe8a10 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa281a00640 1 -- 172.21.15.151:0/638571046 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec6fe8a10 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561ec70e6910 0x561ec70e8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec70e9440 con 0x561ec70e6910 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2809fe640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561ec70e6910 0x561ec70e8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2809fe640 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561ec70e6910 0x561ec70e8d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2809fe640 1 -- 172.21.15.151:0/638571046 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2780b2040 con 0x561ec70e6910 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ec6eeb800 con 0x561ec70f6f10 2024-09-13T19:06:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55682/0 (socket says 172.21.15.151:55682) 2024-09-13T19:06:39.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2811ff640 1 -- 172.21.15.151:0/3105344560 learned_addr learned my addr 172.21.15.151:0/3105344560 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2811ff640 1 -- 172.21.15.151:0/3105344560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec70f7870 con 0x561ec70f6f10 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2811ff640 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa27c047570 tx=0x7fa27c026c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa166ffd640 1 -- 172.21.15.151:0/3105344560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c047920 con 0x561ec70f6f10 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa166ffd640 1 -- 172.21.15.151:0/3105344560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c047ac0 con 0x561ec70f6f10 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ec70f7b00 con 0x561ec70f6f10 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa166ffd640 1 -- 172.21.15.151:0/3105344560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c047da0 con 0x561ec70f6f10 2024-09-13T19:06:39.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.399+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec70fa780 con 0x561ec70f6f10 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa166ffd640 1 -- 172.21.15.151:0/3105344560 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa27c02e070 con 0x561ec70f6f10 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa166ffd640 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 0x7fa158036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa166ffd640 1 -- 172.21.15.151:0/3105344560 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa27c04ad80 con 0x561ec70f6f10 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2809fe640 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 0x7fa158036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2809fe640 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 0x7fa158036b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x561ec70e0b50 tx=0x7fa278005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ec70d0370 con 0x561ec7103a30 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55686/0 (socket says 172.21.15.151:55686) 2024-09-13T19:06:39.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2811ff640 1 -- 172.21.15.151:0/2591839210 learned_addr learned my addr 172.21.15.151:0/2591839210 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2811ff640 1 -- 172.21.15.151:0/2591839210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec71043e0 con 0x561ec7103a30 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2811ff640 1 --2- 172.21.15.151:0/2591839210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa27c01db50 tx=0x7fa27c01d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9c95955bd084c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa164ff9640 1 -- 172.21.15.151:0/2591839210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c027440 con 0x561ec7103a30 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa164ff9640 1 -- 172.21.15.151:0/2591839210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c0275e0 con 0x561ec7103a30 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa164ff9640 1 -- 172.21.15.151:0/2591839210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0408a0 con 0x561ec7103a30 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- 172.21.15.151:0/2591839210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 msgr2=0x561ec7103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2591839210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa27c01db50 tx=0x7fa27c01d6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- 172.21.15.151:0/2591839210 shutdown_connections 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2591839210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec7103e10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- 172.21.15.151:0/2591839210 >> 172.21.15.151:0/2591839210 conn(0x561ec70ffe10 msgr2=0x561ec70fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- 172.21.15.151:0/2591839210 shutdown_connections 2024-09-13T19:06:39.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.403+0000 7fa2836ef980 1 -- 172.21.15.151:0/2591839210 wait complete. 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 Processor -- start 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 -- start start 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec710abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561ec7104880 con 0x561ec7103a30 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec710abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2811ff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec710abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55700/0 (socket says 172.21.15.151:55700) 2024-09-13T19:06:39.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 learned_addr learned my addr 172.21.15.151:0/2277477565 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ec710b130 con 0x561ec7103a30 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2811ff640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec710abf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa27c017dc0 tx=0x7fa27c02ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 -- 172.21.15.151:0/2277477565 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c010a20 con 0x561ec7103a30 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561ec710b130 con 0x561ec7103a30 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 -- 172.21.15.151:0/2277477565 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c00f530 con 0x561ec7103a30 2024-09-13T19:06:39.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 -- 172.21.15.151:0/2277477565 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c00f810 con 0x561ec7103a30 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ec710b130 con 0x561ec7103a30 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 -- 172.21.15.151:0/2277477565 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa27c050070 con 0x561ec7103a30 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa14c034650 0x7fa14c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa156ffd640 1 -- 172.21.15.151:0/2277477565 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa27c06ec60 con 0x561ec7103a30 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2809fe640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa14c034650 0x7fa14c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec7115c80 0x561ec7118140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.407+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7118890 con 0x561ec7115c80 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec7115c80 0x561ec7118140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa14c034650 0x7fa14c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ad040 tx=0x7fa2780b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec7115c80 0x561ec7118140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 realm 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7118ca0 con 0x561ec7115c80 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119570 con 0x561ec7115c80 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec711a670 0x561ec711ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec711d030 con 0x561ec711a670 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec711a670 0x561ec711ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec711a670 0x561ec711ca60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 20 searching for the correct realm 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec711e900 con 0x561ec711a670 2024-09-13T19:06:39.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa27c06d020 0x7fa27c06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec711e900 con 0x7fa27c06d020 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa27c06d020 0x7fa27c06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa27c06d020 0x7fa27c06e3f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa2780cc040 0x7fa2780d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.411+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec711e900 con 0x7fa2780cc040 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa2780cc040 0x7fa2780d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa2780cc040 0x7fa2780d9410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa27c06d020 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.415+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa27c06d020 2024-09-13T19:06:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c074070 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.419+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa27c06d020 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa27c06d020 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec711a670 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.423+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa2780cc040 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x561ec7115c80 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561ec7119910 con 0x7fa27c06d020 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec711da20 con 0x561ec7115c80 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec711e2c0 con 0x561ec7115c80 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec711de10 con 0x7fa27c06d020 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 zone default found 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 4 Realm: () 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:39.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 zonegroup default 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec711ed30 con 0x7fa2780cc040 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7120710 con 0x561ec711a670 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7120bc0 con 0x561ec711a670 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 started sync module instance, tier type = 2024-09-13T19:06:39.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.427+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec711fbb0 con 0x7fa27c06d020 2024-09-13T19:06:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94690188853072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7120370 con 0x7fa27c06d020 2024-09-13T19:06:39.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7121af0 con 0x561ec7115c80 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94690188853072] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94690188858944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7121f10 con 0x561ec7115c80 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.431+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71228d0 con 0x561ec711a670 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94690188862496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7123120 con 0x561ec711a670 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7123ae0 con 0x7fa27c06d020 2024-09-13T19:06:39.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94690188858944] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94690188867120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7123ed0 con 0x7fa27c06d020 2024-09-13T19:06:39.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71248d0 con 0x561ec7115c80 2024-09-13T19:06:39.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.435+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94690188862496] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94690188867120] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94690188860000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71243e0 con 0x561ec7115c80 2024-09-13T19:06:39.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7125170 con 0x7fa2780cc040 2024-09-13T19:06:39.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94690188860000] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94690188864624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7124e50 con 0x7fa2780cc040 2024-09-13T19:06:39.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.439+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71256a0 con 0x7fa2780cc040 2024-09-13T19:06:39.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94690188864624] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94690188872368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7125500 con 0x7fa2780cc040 2024-09-13T19:06:39.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7125fc0 con 0x7fa2780cc040 2024-09-13T19:06:39.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94690188876432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7126430 con 0x7fa2780cc040 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=0 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=1 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=2 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=3 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=4 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.443+0000 7fa2836ef980 20 add_watcher() i=5 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94690188872368] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 20 add_watcher() i=6 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94690188876432] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 20 add_watcher() i=7 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7124f50 con 0x561ec7115c80 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94690188873552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7126940 con 0x561ec7115c80 2024-09-13T19:06:39.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94690188873552] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa1377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:39.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.447+0000 7fa2836ef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:39.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.451+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7131d70 con 0x561ec7115c80 2024-09-13T19:06:39.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.451+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.451+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7132440 con 0x7fa2780cc040 2024-09-13T19:06:39.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.455+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.455+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7132860 con 0x561ec711a670 2024-09-13T19:06:39.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.455+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.455+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71327a0 con 0x561ec7115c80 2024-09-13T19:06:39.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.459+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.459+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7132d90 con 0x7fa27c06d020 2024-09-13T19:06:39.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.459+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.463+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133240 con 0x561ec711a670 2024-09-13T19:06:39.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.463+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.463+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133240 con 0x561ec7115c80 2024-09-13T19:06:39.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.467+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.467+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133240 con 0x7fa2780cc040 2024-09-13T19:06:39.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.467+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.467+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133240 con 0x7fa27c06d020 2024-09-13T19:06:39.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.471+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.471+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71337b0 con 0x561ec711a670 2024-09-13T19:06:39.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.471+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.471+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec71337b0 con 0x7fa27c06d020 2024-09-13T19:06:39.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.475+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.475+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a90 con 0x7fa2780cc040 2024-09-13T19:06:39.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.475+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.475+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x7fa27c06d020 2024-09-13T19:06:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.479+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.479+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x7fa2780cc040 2024-09-13T19:06:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.479+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.479+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec7115c80 2024-09-13T19:06:39.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.483+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.483+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec711a670 2024-09-13T19:06:39.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.483+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.483+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133af0 con 0x7fa27c06d020 2024-09-13T19:06:39.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.487+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.487+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133be0 con 0x561ec711a670 2024-09-13T19:06:39.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.487+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.487+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133be0 con 0x561ec7115c80 2024-09-13T19:06:39.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.491+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.491+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133b80 con 0x561ec7115c80 2024-09-13T19:06:39.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.491+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.491+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133af0 con 0x561ec711a670 2024-09-13T19:06:39.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.495+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.495+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133b20 con 0x7fa27c06d020 2024-09-13T19:06:39.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.495+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.495+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133b20 con 0x561ec711a670 2024-09-13T19:06:39.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.499+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.499+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133af0 con 0x561ec711a670 2024-09-13T19:06:39.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.499+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.499+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec711a670 2024-09-13T19:06:39.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.503+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.503+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec711a670 2024-09-13T19:06:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.503+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.503+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x7fa2780cc040 2024-09-13T19:06:39.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.507+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.507+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec711a670 2024-09-13T19:06:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.507+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.507+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x7fa2780cc040 2024-09-13T19:06:39.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.511+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.511+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x561ec711a670 2024-09-13T19:06:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.515+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.515+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a60 con 0x7fa2780cc040 2024-09-13T19:06:39.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.515+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.515+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7133a80 con 0x7fa27c06d020 2024-09-13T19:06:39.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa1367e4640 20 reqs_thread_entry: start 2024-09-13T19:06:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:39.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 20 Filter name: none 2024-09-13T19:06:39.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa0a7fff640 20 reqs_thread_entry: start 2024-09-13T19:06:39.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:39.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561ec7130080 con 0x561ec7115c80 2024-09-13T19:06:39.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.519+0000 7fa2836ef980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, user does not exist 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa1377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94690188873552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec712e010 con 0x561ec7115c80 2024-09-13T19:06:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94690188873552] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94690188853072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7124f50 con 0x7fa27c06d020 2024-09-13T19:06:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94690188853072] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2836ef980 20 remove_watcher() i=0 2024-09-13T19:06:39.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2836ef980 2 removed watcher, disabling cache 2024-09-13T19:06:39.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.523+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94690188858944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec711ff50 con 0x561ec7115c80 2024-09-13T19:06:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.527+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94690188858944] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.527+0000 7fa2836ef980 20 remove_watcher() i=1 2024-09-13T19:06:39.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.527+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94690188862496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec711ff50 con 0x561ec711a670 2024-09-13T19:06:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2811ff640 1 -- 172.21.15.151:0/2277477565 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94690188862496] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa27c08a040 con 0x561ec711a670 2024-09-13T19:06:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 20 remove_watcher() i=2 2024-09-13T19:06:39.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94690188867120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7122420 con 0x7fa27c06d020 2024-09-13T19:06:39.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2809fe640 1 -- 172.21.15.151:0/2277477565 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94690188867120] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2780d7070 con 0x7fa27c06d020 2024-09-13T19:06:39.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 20 remove_watcher() i=3 2024-09-13T19:06:39.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94690188860000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec711ff50 con 0x561ec7115c80 2024-09-13T19:06:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94690188860000] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x561ec7115c80 2024-09-13T19:06:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 20 remove_watcher() i=4 2024-09-13T19:06:39.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.531+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94690188864624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7123630 con 0x7fa2780cc040 2024-09-13T19:06:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.535+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94690188864624] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.535+0000 7fa2836ef980 20 remove_watcher() i=5 2024-09-13T19:06:39.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.535+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94690188872368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec711ff50 con 0x7fa2780cc040 2024-09-13T19:06:39.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94690188872368] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 20 remove_watcher() i=6 2024-09-13T19:06:39.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94690188876432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561ec7123630 con 0x7fa2780cc040 2024-09-13T19:06:39.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94690188876432] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2740083f0 con 0x7fa2780cc040 2024-09-13T19:06:39.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 20 remove_watcher() i=7 2024-09-13T19:06:39.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa2780cc040 msgr2=0x7fa2780d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa2780cc040 0x7fa2780d9410 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec7115c80 msgr2=0x561ec7118140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec7115c80 0x561ec7118140 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa27c06d020 msgr2=0x7fa27c06e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa27c06d020 0x7fa27c06e3f0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec711a670 msgr2=0x561ec711ca60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec711a670 0x561ec711ca60 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa14c034650 msgr2=0x7fa14c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa14c034650 0x7fa14c036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ad040 tx=0x7fa2780b8040 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 msgr2=0x561ec710abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/2277477565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec7103a30 0x561ec710abf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa27c017dc0 tx=0x7fa27c02ced0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 reap_dead start 2024-09-13T19:06:39.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa281a00640 1 -- 172.21.15.151:0/2277477565 reap_dead start 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 shutdown_connections 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 >> 172.21.15.151:0/2277477565 conn(0x561ec70ffe10 msgr2=0x561ec70fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 shutdown_connections 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/2277477565 wait complete. 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 msgr2=0x7fa158036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 0x7fa158036b60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x561ec70e0b50 tx=0x7fa278005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 msgr2=0x561ec70f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa27c047570 tx=0x7fa27c026c90 comp rx=0 tx=0).stop 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 shutdown_connections 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa1580346a0 0x7fa158036b60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 --2- 172.21.15.151:0/3105344560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec70f6f10 0x561ec70f7330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 >> 172.21.15.151:0/3105344560 conn(0x561ec70ec060 msgr2=0x561ec70eeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 shutdown_connections 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.539+0000 7fa2836ef980 1 -- 172.21.15.151:0/3105344560 wait complete. 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec6fe8a10 msgr2=0x561ec70e0010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561ec6fe8a10 0x561ec70e0010 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561ec70e6910 msgr2=0x561ec70e8d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561ec70e6910 0x561ec70e8d00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec70e29d0 msgr2=0x561ec70e4dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561ec70e29d0 0x561ec70e4dc0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa168034650 msgr2=0x7fa168036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa168034650 0x7fa168036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa2780ac000 tx=0x7fa2780a5000 comp rx=0 tx=0).stop 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 msgr2=0x561ec70d9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 --2- 172.21.15.151:0/638571046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561ec6fe4690 0x561ec70d9040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x561ec70d0c00 tx=0x7fa27c001260 comp rx=0 tx=0).stop 2024-09-13T19:06:39.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa281a00640 1 -- 172.21.15.151:0/638571046 reap_dead start 2024-09-13T19:06:39.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 shutdown_connections 2024-09-13T19:06:39.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 >> 172.21.15.151:0/638571046 conn(0x561ec6fe01b0 msgr2=0x561ec70ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 shutdown_connections 2024-09-13T19:06:39.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.543+0000 7fa2836ef980 1 -- 172.21.15.151:0/638571046 wait complete. 2024-09-13T19:06:39.558 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-13T19:06:39.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:06:39.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:06:39.559 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:06:39.639 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:39.639 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:39.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.635+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb88146b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b91130e380 0x55b91139c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb88146b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b911221ae0 con 0x55b91139c8a0 2024-09-13T19:06:39.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb88146b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55b911245e30 con 0x55b91130e380 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b91130e380 0x55b91139c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b91130e380 0x55b91139c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55708/0 (socket says 172.21.15.151:55708) 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 -- 172.21.15.151:0/3277107916 learned_addr learned my addr 172.21.15.151:0/3277107916 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 -- 172.21.15.151:0/3277107916 >> v1:172.21.15.12:6789/0 conn(0x55b91139c8a0 legacy=0x55b91139ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 -- 172.21.15.151:0/3277107916 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b91130e910 con 0x55b91130e380 2024-09-13T19:06:39.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87df79640 1 -- 172.21.15.151:0/3277107916 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462060964 0 0) 0x55b911221ae0 con 0x55b91139c8a0 2024-09-13T19:06:39.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.639+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/3277107916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91139c360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a5c0 tx=0x7fb87001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0645c79b8579955 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb87df79640 1 -- 172.21.15.151:0/3277107916 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700a6070 con 0x55b91130e380 2024-09-13T19:06:39.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb87df79640 1 -- 172.21.15.151:0/3277107916 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700af070 con 0x55b91130e380 2024-09-13T19:06:39.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb87df79640 1 -- 172.21.15.151:0/3277107916 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aa5c0 con 0x55b91130e380 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 -- 172.21.15.151:0/3277107916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 msgr2=0x55b91139c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 --2- 172.21.15.151:0/3277107916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91139c360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a5c0 tx=0x7fb87001b340 comp rx=0 tx=0).stop 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 -- 172.21.15.151:0/3277107916 shutdown_connections 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 --2- 172.21.15.151:0/3277107916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91139c360 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 -- 172.21.15.151:0/3277107916 >> 172.21.15.151:0/3277107916 conn(0x55b911394050 msgr2=0x55b911396470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 -- 172.21.15.151:0/3277107916 shutdown_connections 2024-09-13T19:06:39.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.643+0000 7fb88146b980 1 -- 172.21.15.151:0/3277107916 wait complete. 2024-09-13T19:06:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b911247200 con 0x55b91130e380 2024-09-13T19:06:39.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55712/0 (socket says 172.21.15.151:55712) 2024-09-13T19:06:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb87ef7b640 1 -- 172.21.15.151:0/1009871199 learned_addr learned my addr 172.21.15.151:0/1009871199 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb87ef7b640 1 -- 172.21.15.151:0/1009871199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b91139a090 con 0x55b91130e380 2024-09-13T19:06:39.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/1009871199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb870017f50 tx=0x7fb870003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfa1c3b1cbf5d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb76ce09640 1 -- 172.21.15.151:0/1009871199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aa9c0 con 0x55b91130e380 2024-09-13T19:06:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb76ce09640 1 -- 172.21.15.151:0/1009871199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700aab60 con 0x55b91130e380 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb76ce09640 1 -- 172.21.15.151:0/1009871199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aae40 con 0x55b91130e380 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- 172.21.15.151:0/1009871199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 msgr2=0x55b911399ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 --2- 172.21.15.151:0/1009871199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb870017f50 tx=0x7fb870003030 comp rx=0 tx=0).stop 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- 172.21.15.151:0/1009871199 shutdown_connections 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 --2- 172.21.15.151:0/1009871199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b911399ac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- 172.21.15.151:0/1009871199 >> 172.21.15.151:0/1009871199 conn(0x55b911394050 msgr2=0x55b911480430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- 172.21.15.151:0/1009871199 shutdown_connections 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- 172.21.15.151:0/1009871199 wait complete. 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.659+0000 7fb88146b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b9113a0ec0 con 0x55b91130e380 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55716/0 (socket says 172.21.15.151:55716) 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 -- 172.21.15.151:0/2447758339 learned_addr learned my addr 172.21.15.151:0/2447758339 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b91148e220 con 0x55b91130e380 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb87001b170 tx=0x7fb8700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 -- 172.21.15.151:0/2447758339 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700ca020 con 0x55b91130e380 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b91148e4b0 con 0x55b91130e380 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 -- 172.21.15.151:0/2447758339 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700bd6a0 con 0x55b91130e380 2024-09-13T19:06:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 -- 172.21.15.151:0/2447758339 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700bd9c0 con 0x55b91130e380 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b911491190 con 0x55b91130e380 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb88146b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b9112a0800 con 0x55b91149aab0 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 -- 172.21.15.151:0/2447758339 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8700cd020 con 0x55b91130e380 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87f77c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87f77c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55720/0 (socket says 172.21.15.151:55720) 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87f77c640 1 -- 172.21.15.151:0/1803072690 learned_addr learned my addr 172.21.15.151:0/1803072690 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 0x7fb764036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb76b606640 1 -- 172.21.15.151:0/2447758339 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb8700e5100 con 0x55b91130e380 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 0x7fb764036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87f77c640 1 -- 172.21.15.151:0/1803072690 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b91149b3f0 con 0x55b91149aab0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 0x7fb764036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb870006500 tx=0x7fb8700c5f50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb87f77c640 1 --2- 172.21.15.151:0/1803072690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb87800a430 tx=0x7fb87800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1ce08bbd40fa58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb769602640 1 -- 172.21.15.151:0/1803072690 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87800f6e0 con 0x55b91149aab0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb769602640 1 -- 172.21.15.151:0/1803072690 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb878015070 con 0x55b91149aab0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.663+0000 7fb769602640 1 -- 172.21.15.151:0/1803072690 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87800fa10 con 0x55b91149aab0 2024-09-13T19:06:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/1803072690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 msgr2=0x55b91149aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 --2- 172.21.15.151:0/1803072690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb87800a430 tx=0x7fb87800a8f0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/1803072690 shutdown_connections 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 --2- 172.21.15.151:0/1803072690 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b91149aeb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/1803072690 >> 172.21.15.151:0/1803072690 conn(0x55b91139c8a0 msgr2=0x55b9114963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/1803072690 shutdown_connections 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/1803072690 wait complete. 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b91149bdd0 con 0x55b91149aab0 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb87f77c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb87f77c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55724/0 (socket says 172.21.15.151:55724) 2024-09-13T19:06:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb87f77c640 1 -- 172.21.15.151:0/98024209 learned_addr learned my addr 172.21.15.151:0/98024209 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb87f77c640 1 -- 172.21.15.151:0/98024209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9114a2410 con 0x55b91149aab0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb87f77c640 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55b91149b860 tx=0x7fb878003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb7637fe640 1 -- 172.21.15.151:0/98024209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb87800fe00 con 0x55b91149aab0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb7637fe640 1 -- 172.21.15.151:0/98024209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb878010a20 con 0x55b91149aab0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9114a26a0 con 0x55b91149aab0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb7637fe640 1 -- 172.21.15.151:0/98024209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb878010dc0 con 0x55b91149aab0 2024-09-13T19:06:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.667+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9114a5380 con 0x55b91149aab0 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb7637fe640 1 -- 172.21.15.151:0/98024209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb87801a480 con 0x55b91149aab0 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb7637fe640 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 0x7fb758036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87f77c640 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 0x7fb758036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb7637fe640 1 -- 172.21.15.151:0/98024209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb87804a510 con 0x55b91149aab0 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 Processor -- start 2024-09-13T19:06:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 -- start start 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87f77c640 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 0x7fb758036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb87802efd0 tx=0x7fb87802e4b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b9113981f0 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87ef7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55728/0 (socket says 172.21.15.151:55728) 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87ef7b640 1 -- 172.21.15.151:0/528993223 learned_addr learned my addr 172.21.15.151:0/528993223 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87ef7b640 1 -- 172.21.15.151:0/528993223 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9114bc0a0 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb8700a6fd0 tx=0x7fb8700c5770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb73effd640 1 -- 172.21.15.151:0/528993223 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700b3c10 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b9114bed20 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb73effd640 1 -- 172.21.15.151:0/528993223 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700b3db0 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb73effd640 1 -- 172.21.15.151:0/528993223 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700e3740 con 0x55b9114bb6b0 2024-09-13T19:06:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9114bf0d0 con 0x55b9114bb6b0 2024-09-13T19:06:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.671+0000 7fb73effd640 1 -- 172.21.15.151:0/528993223 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8700e38e0 con 0x55b9114bb6b0 2024-09-13T19:06:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb73effd640 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 0x7fb6b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb73effd640 1 -- 172.21.15.151:0/528993223 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb8700d22d0 con 0x55b9114bb6b0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87e77a640 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 0x7fb6b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb73cff9640 20 reqs_thread_entry: start 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 0x55b9114c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9114c3d50 con 0x55b9114c1290 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87e77a640 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 0x7fb6b8036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb874000f70 tx=0x7fb874001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87f77c640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 0x55b9114c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87f77c640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 0x55b9114c3680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87f77c640 1 -- 172.21.15.151:0/2447758339 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb878038040 con 0x55b9114c1290 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 0x55b9114c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:2 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b9114c85e0 con 0x55b9114c5b50 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 0x55b9114c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87ef7b640 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 0x55b9114c7f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb87ef7b640 1 -- 172.21.15.151:0/2447758339 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(2 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8700ce8d0 con 0x55b9114c5b50 2024-09-13T19:06:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.675+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b9114cd370 con 0x55b9114c5b50 2024-09-13T19:06:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb87ef7b640 1 -- 172.21.15.151:0/2447758339 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fb8700ce8d0 con 0x55b9114c5b50 2024-09-13T19:06:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 msgr2=0x7fb758036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 0x7fb758036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb87802efd0 tx=0x7fb87802e4b0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 msgr2=0x55b9114a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55b91149b860 tx=0x7fb878003380 comp rx=0 tx=0).stop 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 shutdown_connections 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb758034650 0x7fb758036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/98024209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91149aab0 0x55b9114a1ed0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 >> 172.21.15.151:0/98024209 conn(0x55b91139c8a0 msgr2=0x55b911495f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 shutdown_connections 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/98024209 wait complete. 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 msgr2=0x7fb6b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 0x7fb6b8036b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb874000f70 tx=0x7fb874001380 comp rx=0 tx=0).stop 2024-09-13T19:06:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 msgr2=0x55b9114bbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb8700a6fd0 tx=0x7fb8700c5770 comp rx=0 tx=0).stop 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 shutdown_connections 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6b8034650 0x7fb6b8036b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/528993223 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b9114bb6b0 0x55b9114bbad0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 >> 172.21.15.151:0/528993223 conn(0x55b9114b0720 msgr2=0x55b9114b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 shutdown_connections 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/528993223 wait complete. 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 msgr2=0x55b9114c3680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 0x55b9114c3680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 msgr2=0x55b9114c7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 0x55b9114c7f40 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 msgr2=0x7fb764036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 0x7fb764036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb870006500 tx=0x7fb8700c5f50 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 msgr2=0x55b91148dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb87001b170 tx=0x7fb8700180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 shutdown_connections 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b9114c5b50 0x55b9114c7f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb764034650 0x7fb764036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b9114c1290 0x55b9114c3680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 --2- 172.21.15.151:0/2447758339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b91130e380 0x55b91148dce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 >> 172.21.15.151:0/2447758339 conn(0x55b911394050 msgr2=0x55b911480070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 shutdown_connections 2024-09-13T19:06:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.679+0000 7fb88146b980 1 -- 172.21.15.151:0/2447758339 wait complete. 2024-09-13T19:06:39.695 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:06:39.695 DEBUG:tasks.util.rgw: json result: {'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:06:39.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:06:39.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:06:39.697 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:06:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:39.772 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:39.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1d9cf980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555695c32c50 0x555695c35040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1d9cf980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555695ab4ae0 con 0x555695c2e8d0 2024-09-13T19:06:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1d9cf980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x555695ad8e30 con 0x555695c32c50 2024-09-13T19:06:39.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1acde640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555695c32c50 0x555695c35040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1acde640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555695c32c50 0x555695c35040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55732/0 (socket says 172.21.15.151:55732) 2024-09-13T19:06:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1acde640 1 -- 172.21.15.151:0/602356660 learned_addr learned my addr 172.21.15.151:0/602356660 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1acde640 1 -- 172.21.15.151:0/602356660 >> v1:172.21.15.12:6789/0 conn(0x555695c2e8d0 legacy=0x555695c2ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.771+0000 7f2d1acde640 1 -- 172.21.15.151:0/602356660 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695c36590 con 0x555695c32c50 2024-09-13T19:06:39.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1acde640 1 --2- 172.21.15.151:0/602356660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c32c50 0x555695c35040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a4e0 tx=0x7f2d0c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f361fef1833788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1a4dd640 1 -- 172.21.15.151:0/602356660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c0aa540 con 0x555695c32c50 2024-09-13T19:06:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1a4dd640 1 -- 172.21.15.151:0/602356660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0aa6e0 con 0x555695c32c50 2024-09-13T19:06:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1a4dd640 1 -- 172.21.15.151:0/602356660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0c0aaa40 con 0x555695c32c50 2024-09-13T19:06:39.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/602356660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c32c50 msgr2=0x555695c35040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/602356660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c32c50 0x555695c35040 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a4e0 tx=0x7f2d0c01b090 comp rx=0 tx=0).stop 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/602356660 shutdown_connections 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/602356660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c32c50 0x555695c35040 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/602356660 >> 172.21.15.151:0/602356660 conn(0x555695ba2220 msgr2=0x555695ba2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/602356660 shutdown_connections 2024-09-13T19:06:39.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.775+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/602356660 wait complete. 2024-09-13T19:06:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1d9cf980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1d9cf980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555695ada200 con 0x555695c2e8d0 2024-09-13T19:06:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55746/0 (socket says 172.21.15.151:55746) 2024-09-13T19:06:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3386902923 learned_addr learned my addr 172.21.15.151:0/3386902923 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3386902923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695d1a1f0 con 0x555695c2e8d0 2024-09-13T19:06:39.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/3386902923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b1f0 tx=0x7f2d0400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fc629aa16c479c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2c0960a640 1 -- 172.21.15.151:0/3386902923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0400a040 con 0x555695c2e8d0 2024-09-13T19:06:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2c0960a640 1 -- 172.21.15.151:0/3386902923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0400f750 con 0x555695c2e8d0 2024-09-13T19:06:39.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.791+0000 7f2c0960a640 1 -- 172.21.15.151:0/3386902923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0400fa70 con 0x555695c2e8d0 2024-09-13T19:06:39.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3386902923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 msgr2=0x555695d19c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3386902923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b1f0 tx=0x7f2d0400b6b0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3386902923 shutdown_connections 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3386902923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d19c20 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3386902923 >> 172.21.15.151:0/3386902923 conn(0x555695ba2220 msgr2=0x555695d15850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3386902923 shutdown_connections 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3386902923 wait complete. 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d20fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555695c36090 con 0x555695c2e8d0 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d20fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d20fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55760/0 (socket says 172.21.15.151:55760) 2024-09-13T19:06:39.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2335340287 learned_addr learned my addr 172.21.15.151:0/2335340287 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695d214f0 con 0x555695c2e8d0 2024-09-13T19:06:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d20fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b6f0 tx=0x7f2d04000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2c07e07640 1 -- 172.21.15.151:0/2335340287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d04001300 con 0x555695c2e8d0 2024-09-13T19:06:39.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2c07e07640 1 -- 172.21.15.151:0/2335340287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0401c9c0 con 0x555695c2e8d0 2024-09-13T19:06:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555695d21780 con 0x555695c2e8d0 2024-09-13T19:06:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2c07e07640 1 -- 172.21.15.151:0/2335340287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0401cca0 con 0x555695c2e8d0 2024-09-13T19:06:39.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.795+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555695d24460 con 0x555695c2e8d0 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2c07e07640 1 -- 172.21.15.151:0/2335340287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2d04017050 con 0x555695c2e8d0 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2c07e07640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2c000346a0 0x7f2c00036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2c07e07640 1 -- 172.21.15.151:0/2335340287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d04015020 con 0x555695c2e8d0 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2c000346a0 0x7f2c00036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695c32c50 0x555695d280b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d285f0 con 0x555695c32c50 2024-09-13T19:06:39.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695c32c50 0x555695d280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2c000346a0 0x7f2c00036b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ab000 tx=0x7f2d0c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695c32c50 0x555695d280b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2335340287 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695c32c50 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d25680 con 0x555695c32c50 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2335340287 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d140083f0 con 0x555695c32c50 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d2a920 0x555695d2cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d2d400 con 0x555695d2a920 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d2a920 0x555695d2cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d2a920 0x555695d2cd10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2335340287 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d0402e070 con 0x555695d2a920 2024-09-13T19:06:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d297c0 con 0x555695c32c50 2024-09-13T19:06:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2335340287 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d140083f0 con 0x555695c32c50 2024-09-13T19:06:39.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555695d2e860 0x555695d30c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d31390 con 0x555695d2e860 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.799+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555695d2e860 0x555695d30c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555695d2e860 0x555695d30c50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1acde640 1 -- 172.21.15.151:0/2335340287 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d0c0bc040 con 0x555695d2e860 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555695b33800 con 0x555695d3ee60 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55768/0 (socket says 172.21.15.151:55768) 2024-09-13T19:06:39.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3563956432 learned_addr learned my addr 172.21.15.151:0/3563956432 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3563956432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695d3f7c0 con 0x555695d3ee60 2024-09-13T19:06:39.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d0401dfd0 tx=0x7f2d040453b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2c05602640 1 -- 172.21.15.151:0/3563956432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d04042280 con 0x555695d3ee60 2024-09-13T19:06:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555695d3fa50 con 0x555695d3ee60 2024-09-13T19:06:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2c05602640 1 -- 172.21.15.151:0/3563956432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0402f350 con 0x555695d3ee60 2024-09-13T19:06:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2c05602640 1 -- 172.21.15.151:0/3563956432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0402f670 con 0x555695d3ee60 2024-09-13T19:06:39.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555695d426d0 con 0x555695d3ee60 2024-09-13T19:06:39.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.803+0000 7f2c05602640 1 -- 172.21.15.151:0/3563956432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2d0402f810 con 0x555695d3ee60 2024-09-13T19:06:39.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2c05602640 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 0x7f2bf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2c05602640 1 -- 172.21.15.151:0/3563956432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d0403dca0 con 0x555695d3ee60 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1acde640 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 0x7f2bf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1acde640 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 0x7f2bf4036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555695d28aa0 tx=0x7f2d0c005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555695d1a570 con 0x555695d4b7e0 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55772/0 (socket says 172.21.15.151:55772) 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3771714003 learned_addr learned my addr 172.21.15.151:0/3771714003 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 -- 172.21.15.151:0/3771714003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695d4c1b0 con 0x555695d4b7e0 2024-09-13T19:06:39.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/3771714003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d04048a50 tx=0x7f2d04041a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7b49799240807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2bfeffd640 1 -- 172.21.15.151:0/3771714003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0404ada0 con 0x555695d4b7e0 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2bfeffd640 1 -- 172.21.15.151:0/3771714003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04059030 con 0x555695d4b7e0 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2bfeffd640 1 -- 172.21.15.151:0/3771714003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d0400e590 con 0x555695d4b7e0 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3771714003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 msgr2=0x555695d4bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3771714003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d04048a50 tx=0x7f2d04041a50 comp rx=0 tx=0).stop 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3771714003 shutdown_connections 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3771714003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d4bbe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3771714003 >> 172.21.15.151:0/3771714003 conn(0x555695d47b10 msgr2=0x555695d45c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3771714003 shutdown_connections 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3771714003 wait complete. 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 Processor -- start 2024-09-13T19:06:39.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- start start 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d52910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1d9cf980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555695d4c6a0 con 0x555695d4b7e0 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.807+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d52910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1b4df640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d52910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55774/0 (socket says 172.21.15.151:55774) 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 learned_addr learned my addr 172.21.15.151:0/2523500023 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555695d52e50 con 0x555695d4b7e0 2024-09-13T19:06:39.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d52910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d04019fb0 tx=0x7f2d04019f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 -- 172.21.15.151:0/2523500023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d04027430 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555695d52e50 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555695d52e50 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 -- 172.21.15.151:0/2523500023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d04041210 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 -- 172.21.15.151:0/2523500023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d040275d0 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 -- 172.21.15.151:0/2523500023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2d0400e590 con 0x555695d4b7e0 2024-09-13T19:06:39.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2be4034600 0x7f2be4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2bfd7fa640 1 -- 172.21.15.151:0/2523500023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2d04066070 con 0x555695d4b7e0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2be4034600 0x7f2be4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695d5d790 0x555695d5fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d60380 con 0x555695d5d790 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695d5d790 0x555695d5fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2be4034600 0x7f2be4036ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a190 tx=0x7f2d0c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695d5d790 0x555695d5fc30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.811+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 realm 2024-09-13T19:06:39.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d60790 con 0x555695d5d790 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d61030 con 0x555695d5d790 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d62130 0x555695d64520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d64a60 con 0x555695d62130 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d62130 0x555695d64520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d62130 0x555695d64520 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 20 searching for the correct realm 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d66300 con 0x555695d62130 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f2d04069030 0x7f2d0407c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d66300 con 0x7f2d04069030 2024-09-13T19:06:39.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f2d04069030 0x7f2d0407c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f2d04069030 0x7f2d0407c6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1acde640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2d0c0cd050 0x7f2d0c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d66300 con 0x7f2d0c0cd050 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.815+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2d0c0cd050 0x7f2d0c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2d0c0cd050 0x7f2d0c0cd430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d04069030 2024-09-13T19:06:39.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.819+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d04069030 2024-09-13T19:06:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.823+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d04069030 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d04069030 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d62130 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x555695d5d790 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.827+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555695d613d0 con 0x7f2d04069030 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d652b0 con 0x555695d5d790 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d656a0 con 0x555695d5d790 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d656a0 con 0x7f2d04069030 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 zone default found 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 4 Realm: () 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:39.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 zonegroup default 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d667d0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d681b0 con 0x555695d62130 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados->read ofs=0 len=0 2024-09-13T19:06:39.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d68550 con 0x555695d62130 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 started sync module instance, tier type = 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d67650 con 0x7f2d04069030 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.831+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93830369409648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d672b0 con 0x7f2d04069030 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.835+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d693c0 con 0x555695d5d790 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.835+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93830369409648] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.835+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.835+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93830369414928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d697e0 con 0x555695d5d790 2024-09-13T19:06:39.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.835+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6a090 con 0x555695d62130 2024-09-13T19:06:39.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93830369414928] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93830369416256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6a480 con 0x555695d62130 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6ae40 con 0x7f2d04069030 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93830369421712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6b690 con 0x7f2d04069030 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6c0b0 con 0x555695d5d790 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.839+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93830369416256] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93830369421712] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93830369423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d698a0 con 0x555695d5d790 2024-09-13T19:06:39.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6c950 con 0x7f2d0c0cd050 2024-09-13T19:06:39.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93830369423840] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93830369426336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6c880 con 0x7f2d0c0cd050 2024-09-13T19:06:39.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.843+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6d230 con 0x7f2d0c0cd050 2024-09-13T19:06:39.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.847+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.847+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93830369430848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6d650 con 0x7f2d0c0cd050 2024-09-13T19:06:39.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.847+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6e170 con 0x7f2d0c0cd050 2024-09-13T19:06:39.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.847+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93830369426336] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.847+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93830369430848] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93830369434688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6d160 con 0x7f2d0c0cd050 2024-09-13T19:06:39.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=0 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=1 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=2 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=3 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=4 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=5 2024-09-13T19:06:39.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.851+0000 7f2d1d9cf980 20 add_watcher() i=6 2024-09-13T19:06:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93830369434688] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 20 add_watcher() i=7 2024-09-13T19:06:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d71160 con 0x555695d5d790 2024-09-13T19:06:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93830369428432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d6e5e0 con 0x555695d5d790 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93830369428432] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 5 note: GC not initialized 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2bd0fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.855+0000 7f2d1d9cf980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 20 Filter name: none 2024-09-13T19:06:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2b4a7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c80 con 0x555695d5d790 2024-09-13T19:06:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c80 con 0x7f2d04069030 2024-09-13T19:06:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.859+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d04069030 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.863+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d04069030 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.867+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2bd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:39.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93830369428432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93830369428432] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93830369409648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d04069030 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93830369409648] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1d9cf980 20 remove_watcher() i=0 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1d9cf980 2 removed watcher, disabling cache 2024-09-13T19:06:39.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.871+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93830369414928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.875+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93830369414928] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.875+0000 7f2d1d9cf980 20 remove_watcher() i=1 2024-09-13T19:06:39.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.875+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93830369416256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d62130 2024-09-13T19:06:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1b4df640 1 -- 172.21.15.151:0/2523500023 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93830369416256] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0407b040 con 0x555695d62130 2024-09-13T19:06:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 20 remove_watcher() i=2 2024-09-13T19:06:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93830369421712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d04069030 2024-09-13T19:06:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1acde640 1 -- 172.21.15.151:0/2523500023 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93830369421712] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d0c0ca070 con 0x7f2d04069030 2024-09-13T19:06:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 20 remove_watcher() i=3 2024-09-13T19:06:39.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93830369423840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x555695d5d790 2024-09-13T19:06:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93830369423840] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x555695d5d790 2024-09-13T19:06:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 20 remove_watcher() i=4 2024-09-13T19:06:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.879+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93830369426336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.883+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93830369426336] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.883+0000 7f2d1d9cf980 20 remove_watcher() i=5 2024-09-13T19:06:39.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.883+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93830369430848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93830369430848] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 20 remove_watcher() i=6 2024-09-13T19:06:39.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93830369434688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555695d94c40 con 0x7f2d0c0cd050 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93830369434688] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d140083f0 con 0x7f2d0c0cd050 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 20 remove_watcher() i=7 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2d0c0cd050 msgr2=0x7f2d0c0cd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2d0c0cd050 0x7f2d0c0cd430 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695d5d790 msgr2=0x555695d5fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695d5d790 0x555695d5fc30 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f2d04069030 msgr2=0x7f2d0407c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f2d04069030 0x7f2d0407c6f0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d62130 msgr2=0x555695d64520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d62130 0x555695d64520 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2be4034600 msgr2=0x7f2be4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2be4034600 0x7f2be4036ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00a190 tx=0x7f2d0c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 msgr2=0x555695d52910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2523500023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d4b7e0 0x555695d52910 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2d04019fb0 tx=0x7f2d04019f40 comp rx=0 tx=0).stop 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 reap_dead start 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2523500023 reap_dead start 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 shutdown_connections 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 >> 172.21.15.151:0/2523500023 conn(0x555695d47b10 msgr2=0x555695d45be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 shutdown_connections 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2523500023 wait complete. 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 msgr2=0x7f2bf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 0x7f2bf4036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x555695d28aa0 tx=0x7f2d0c005e50 comp rx=0 tx=0).stop 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 msgr2=0x555695d3f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d0401dfd0 tx=0x7f2d040453b0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 shutdown_connections 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2bf4034650 0x7f2bf4036b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/3563956432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695d3ee60 0x555695d3f280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 >> 172.21.15.151:0/3563956432 conn(0x555695d33fb0 msgr2=0x555695d36a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 shutdown_connections 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.887+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/3563956432 wait complete. 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695c32c50 msgr2=0x555695d280b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555695c32c50 0x555695d280b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555695d2e860 msgr2=0x555695d30c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555695d2e860 0x555695d30c50 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d2a920 msgr2=0x555695d2cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555695d2a920 0x555695d2cd10 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2c000346a0 msgr2=0x7f2c00036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2c000346a0 0x7f2c00036b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0ab000 tx=0x7f2d0c0a5000 comp rx=0 tx=0).stop 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 msgr2=0x555695d20fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 --2- 172.21.15.151:0/2335340287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555695c2e8d0 0x555695d20fb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400b6f0 tx=0x7f2d04000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1bce0640 1 -- 172.21.15.151:0/2335340287 reap_dead start 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 shutdown_connections 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 >> 172.21.15.151:0/2335340287 conn(0x555695ba2220 msgr2=0x555695d143d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 shutdown_connections 2024-09-13T19:06:39.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.891+0000 7f2d1d9cf980 1 -- 172.21.15.151:0/2335340287 wait complete. 2024-09-13T19:06:39.904 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-13T19:06:39.904 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:06:39.904 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:39.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:39.904 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:39.984 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:39.984 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:39.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:39.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:39.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4106f03980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55fa47b6f570 0x55fa47b6f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4106f03980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa479f8ae0 con 0x55fa47b6fec0 2024-09-13T19:06:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4106f03980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55fa47a1ce30 con 0x55fa47b6f570 2024-09-13T19:06:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104a13640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55fa47b6f570 0x55fa47b6f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104a13640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55fa47b6f570 0x55fa47b6f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55776/0 (socket says 172.21.15.151:55776) 2024-09-13T19:06:39.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104212640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55fa47b6fec0 0x55fa47b748f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33350/0 (socket says 172.21.15.151:33350) 2024-09-13T19:06:39.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104a13640 1 -- 172.21.15.151:0/2661111427 learned_addr learned my addr 172.21.15.151:0/2661111427 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:39.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104a13640 1 -- 172.21.15.151:0/2661111427 >> v1:172.21.15.12:6789/0 conn(0x55fa47b6fec0 legacy=0x55fa47b748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.983+0000 7f4104a13640 1 -- 172.21.15.151:0/2661111427 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47b77140 con 0x55fa47b6f570 2024-09-13T19:06:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4104a13640 1 --2- 172.21.15.151:0/2661111427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47b6f950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a5c0 tx=0x7f40f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff04f385400f8cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:39.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4103a11640 1 -- 172.21.15.151:0/2661111427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40a6070 con 0x55fa47b6f570 2024-09-13T19:06:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4103a11640 1 -- 172.21.15.151:0/2661111427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40af070 con 0x55fa47b6f570 2024-09-13T19:06:39.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4103a11640 1 -- 172.21.15.151:0/2661111427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40aa5c0 con 0x55fa47b6f570 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 -- 172.21.15.151:0/2661111427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 msgr2=0x55fa47b6f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 --2- 172.21.15.151:0/2661111427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47b6f950 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a5c0 tx=0x7f40f401b340 comp rx=0 tx=0).stop 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 -- 172.21.15.151:0/2661111427 shutdown_connections 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 --2- 172.21.15.151:0/2661111427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47b6f950 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 -- 172.21.15.151:0/2661111427 >> 172.21.15.151:0/2661111427 conn(0x55fa47b6b090 msgr2=0x55fa47b6d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 -- 172.21.15.151:0/2661111427 shutdown_connections 2024-09-13T19:06:39.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:39.987+0000 7f4106f03980 1 -- 172.21.15.151:0/2661111427 wait complete. 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4106f03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4106f03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa47a1e200 con 0x55fa47b6f570 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55792/0 (socket says 172.21.15.151:55792) 2024-09-13T19:06:40.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4104a13640 1 -- 172.21.15.151:0/1468898146 learned_addr learned my addr 172.21.15.151:0/1468898146 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4104a13640 1 -- 172.21.15.151:0/1468898146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47c5e210 con 0x55fa47b6f570 2024-09-13T19:06:40.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.003+0000 7f4104a13640 1 --2- 172.21.15.151:0/1468898146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a5c0 tx=0x7f40f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945b5ff8a4884b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff2e0d640 1 -- 172.21.15.151:0/1468898146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40aa9b0 con 0x55fa47b6f570 2024-09-13T19:06:40.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff2e0d640 1 -- 172.21.15.151:0/1468898146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40aab50 con 0x55fa47b6f570 2024-09-13T19:06:40.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff2e0d640 1 -- 172.21.15.151:0/1468898146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40aae50 con 0x55fa47b6f570 2024-09-13T19:06:40.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/1468898146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 msgr2=0x55fa47c5dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 --2- 172.21.15.151:0/1468898146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f40f400a5c0 tx=0x7f40f4003030 comp rx=0 tx=0).stop 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/1468898146 shutdown_connections 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 --2- 172.21.15.151:0/1468898146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6f570 0x55fa47c5dc40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/1468898146 >> 172.21.15.151:0/1468898146 conn(0x55fa47b6b090 msgr2=0x55fa47c55460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/1468898146 shutdown_connections 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/1468898146 wait complete. 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 0x55fa47c64fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa47b76b80 con 0x55fa47b6fec0 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 0x55fa47c64fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 0x55fa47c64fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55802/0 (socket says 172.21.15.151:55802) 2024-09-13T19:06:40.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4104a13640 1 -- 172.21.15.151:0/743856181 learned_addr learned my addr 172.21.15.151:0/743856181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4104a13640 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47c65510 con 0x55fa47b6fec0 2024-09-13T19:06:40.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4104a13640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 0x55fa47c64fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40f401bbe0 tx=0x7f40f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff160a640 1 -- 172.21.15.151:0/743856181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40c6690 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa47c657a0 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff160a640 1 -- 172.21.15.151:0/743856181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40c6830 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa47c68480 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.007+0000 7f3ff160a640 1 -- 172.21.15.151:0/743856181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40c6b50 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f3ff160a640 1 -- 172.21.15.151:0/743856181 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40f40ce020 con 0x55fa47b6fec0 2024-09-13T19:06:40.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f3ff160a640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fec0346a0 0x7f3fec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f3ff160a640 1 -- 172.21.15.151:0/743856181 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40f40cc020 con 0x55fa47b6fec0 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4104212640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fec0346a0 0x7f3fec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47c69f50 0x55fa47c6c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47c6c990 con 0x55fa47c69f50 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4105214640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47c69f50 0x55fa47c6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4104212640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fec0346a0 0x7f3fec036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001e50 tx=0x7f40f80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4105214640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47c69f50 0x55fa47c6c340 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4105214640 1 -- 172.21.15.151:0/743856181 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47c69f50 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47c6d230 con 0x55fa47c69f50 2024-09-13T19:06:40.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4105214640 1 -- 172.21.15.151:0/743856181 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47c69f50 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47c6eb80 0x55fa47c71010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47c717a0 con 0x55fa47c6eb80 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4104a13640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47c6eb80 0x55fa47c71010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4104a13640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47c6eb80 0x55fa47c71010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4104a13640 1 -- 172.21.15.151:0/743856181 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47c6eb80 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47c6da80 con 0x55fa47c69f50 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4105214640 1 -- 172.21.15.151:0/743856181 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47c69f50 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47c72c00 0x55fa47c74ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.011+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47c75730 con 0x55fa47c72c00 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104212640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47c72c00 0x55fa47c74ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104212640 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47c72c00 0x55fa47c74ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104212640 1 -- 172.21.15.151:0/743856181 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40f800f700 con 0x55fa47c72c00 2024-09-13T19:06:40.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa47a77800 con 0x55fa47c831e0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55812/0 (socket says 172.21.15.151:55812) 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104a13640 1 -- 172.21.15.151:0/1145135662 learned_addr learned my addr 172.21.15.151:0/1145135662 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104a13640 1 -- 172.21.15.151:0/1145135662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47c83b40 con 0x55fa47c831e0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4104a13640 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40f40d4000 tx=0x7f40f40bcc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f3fea7fc640 1 -- 172.21.15.151:0/1145135662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f4006390 con 0x55fa47c831e0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa47c83dd0 con 0x55fa47c831e0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f3fea7fc640 1 -- 172.21.15.151:0/1145135662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40e32c0 con 0x55fa47c831e0 2024-09-13T19:06:40.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f3fea7fc640 1 -- 172.21.15.151:0/1145135662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40c53e0 con 0x55fa47c831e0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.015+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa47c83dd0 con 0x55fa47c831e0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fea7fc640 1 -- 172.21.15.151:0/1145135662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40f40c5580 con 0x55fa47c831e0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fea7fc640 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 0x7f3fdc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fea7fc640 1 -- 172.21.15.151:0/1145135662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40f40eccd0 con 0x55fa47c831e0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104212640 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 0x7f3fdc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104212640 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 0x7f3fdc036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55fa47c69800 tx=0x7f40f800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa47c5e4d0 con 0x55fa47c8f910 2024-09-13T19:06:40.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55828/0 (socket says 172.21.15.151:55828) 2024-09-13T19:06:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104a13640 1 -- 172.21.15.151:0/90376364 learned_addr learned my addr 172.21.15.151:0/90376364 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104a13640 1 -- 172.21.15.151:0/90376364 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47c902c0 con 0x55fa47c8f910 2024-09-13T19:06:40.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4104a13640 1 --2- 172.21.15.151:0/90376364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40f40bfff0 tx=0x7f40f40c3e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff50a9b414357f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fdbfff640 1 -- 172.21.15.151:0/90376364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40c3840 con 0x55fa47c8f910 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fdbfff640 1 -- 172.21.15.151:0/90376364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40fd030 con 0x55fa47c8f910 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f3fdbfff640 1 -- 172.21.15.151:0/90376364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40b3850 con 0x55fa47c8f910 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- 172.21.15.151:0/90376364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 msgr2=0x55fa47c8fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 --2- 172.21.15.151:0/90376364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40f40bfff0 tx=0x7f40f40c3e20 comp rx=0 tx=0).stop 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- 172.21.15.151:0/90376364 shutdown_connections 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 --2- 172.21.15.151:0/90376364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c8fcf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- 172.21.15.151:0/90376364 >> 172.21.15.151:0/90376364 conn(0x55fa47c8bcf0 msgr2=0x55fa47c89df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- 172.21.15.151:0/90376364 shutdown_connections 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- 172.21.15.151:0/90376364 wait complete. 2024-09-13T19:06:40.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 Processor -- start 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- start start 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.019+0000 7f4106f03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fa47c90760 con 0x55fa47c8f910 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104a13640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55834/0 (socket says 172.21.15.151:55834) 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 learned_addr learned my addr 172.21.15.151:0/3900187684 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa47c96ff0 con 0x55fa47c8f910 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104a13640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40f40c5aa0 tx=0x7f40f40fb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 -- 172.21.15.151:0/3900187684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40c7c40 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa47c96ff0 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 -- 172.21.15.151:0/3900187684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40f40a4100 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 -- 172.21.15.151:0/3900187684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f40b3b30 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa47c97460 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 -- 172.21.15.151:0/3900187684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40f410f020 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f3fda7fc640 1 -- 172.21.15.151:0/3900187684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40f4112c70 con 0x55fa47c8f910 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104212640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fd0034650 0x7f3fd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47ca1b80 0x55fa47ca4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca4770 con 0x55fa47ca1b80 2024-09-13T19:06:40.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4105214640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47ca1b80 0x55fa47ca4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4104212640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55fa47c75b10 tx=0x7f40f8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.023+0000 7f4105214640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47ca1b80 0x55fa47ca4020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 realm 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca4b80 con 0x55fa47ca1b80 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca5420 con 0x55fa47ca1b80 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47ca6520 0x55fa47ca8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca8e90 con 0x55fa47ca6520 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47ca6520 0x55fa47ca8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47ca6520 0x55fa47ca8910 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 20 searching for the correct realm 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caa730 con 0x55fa47ca6520 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47b6f570 0x7f40f4115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caa730 con 0x55fa47b6f570 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104212640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47b6f570 0x7f40f4115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104212640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47b6f570 0x7f40f4115a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104212640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40f801fc60 0x7f40f803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caa730 con 0x7f40f801fc60 2024-09-13T19:06:40.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.027+0000 7f4105214640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40f801fc60 0x7f40f803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40f801fc60 0x7f40f803a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47b6f570 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.031+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47b6f570 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.035+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47b6f570 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47b6f570 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.039+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca6520 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x7f40f801fc60 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca57c0 con 0x55fa47b6f570 2024-09-13T19:06:40.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca96e0 con 0x55fa47ca1b80 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca9ad0 con 0x55fa47ca1b80 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47ca9ad0 con 0x55fa47b6f570 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 zone default found 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 4 Realm: () 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 zonegroup default 2024-09-13T19:06:40.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caac00 con 0x7f40f801fc60 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cac5e0 con 0x55fa47ca6520 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.043+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cac980 con 0x55fa47ca6520 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 20 started sync module instance, tier type = 2024-09-13T19:06:40.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:40.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caba80 con 0x55fa47b6f570 2024-09-13T19:06:40.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94533434652112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cacd70 con 0x55fa47b6f570 2024-09-13T19:06:40.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cad5c0 con 0x55fa47ca1b80 2024-09-13T19:06:40.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94533434652112] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94533434659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cad9e0 con 0x55fa47ca1b80 2024-09-13T19:06:40.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.047+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cae230 con 0x55fa47ca6520 2024-09-13T19:06:40.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94533434659088] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94533434660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cae070 con 0x55fa47ca6520 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caeb90 con 0x55fa47b6f570 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94533434664544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47caf430 con 0x55fa47b6f570 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.051+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cafe50 con 0x55fa47ca1b80 2024-09-13T19:06:40.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.055+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94533434660416] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.055+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.055+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94533434669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb0240 con 0x55fa47ca1b80 2024-09-13T19:06:40.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.055+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb0c00 con 0x7f40f801fc60 2024-09-13T19:06:40.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.055+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94533434664544] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94533434666880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb0c00 con 0x7f40f801fc60 2024-09-13T19:06:40.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb14d0 con 0x7f40f801fc60 2024-09-13T19:06:40.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94533434669376] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94533434661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb16b0 con 0x7f40f801fc60 2024-09-13T19:06:40.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb1f00 con 0x7f40f801fc60 2024-09-13T19:06:40.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.059+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94533434666880] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94533434676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb1f80 con 0x7f40f801fc60 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=0 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=1 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=2 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=3 2024-09-13T19:06:40.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=4 2024-09-13T19:06:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=5 2024-09-13T19:06:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94533434661568] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=6 2024-09-13T19:06:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94533434676912] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 20 add_watcher() i=7 2024-09-13T19:06:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb4fb0 con 0x55fa47ca1b80 2024-09-13T19:06:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.063+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94533434677968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cb23a0 con 0x55fa47ca1b80 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94533434677968] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f3fbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 5 note: GC not initialized 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f3fb9fe3640 20 reqs_thread_entry: start 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 Filter name: none 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f3f2b7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7f20 con 0x55fa47ca1b80 2024-09-13T19:06:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-13T19:06:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f3fbafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.067+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94533434677968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47ca1b80 2024-09-13T19:06:40.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94533434677968] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94533434652112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47b6f570 2024-09-13T19:06:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94533434652112] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4106f03980 20 remove_watcher() i=0 2024-09-13T19:06:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4106f03980 2 removed watcher, disabling cache 2024-09-13T19:06:40.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.071+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94533434659088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47ca1b80 2024-09-13T19:06:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94533434659088] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 20 remove_watcher() i=1 2024-09-13T19:06:40.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94533434660416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47ca6520 2024-09-13T19:06:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4104a13640 1 -- 172.21.15.151:0/3900187684 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94533434660416] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f40b33f0 con 0x55fa47ca6520 2024-09-13T19:06:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 20 remove_watcher() i=2 2024-09-13T19:06:40.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94533434664544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47b6f570 2024-09-13T19:06:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4104212640 1 -- 172.21.15.151:0/3900187684 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94533434664544] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40f8037040 con 0x55fa47b6f570 2024-09-13T19:06:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 20 remove_watcher() i=3 2024-09-13T19:06:40.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.075+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94533434669376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x55fa47ca1b80 2024-09-13T19:06:40.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.079+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94533434669376] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x55fa47ca1b80 2024-09-13T19:06:40.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.079+0000 7f4106f03980 20 remove_watcher() i=4 2024-09-13T19:06:40.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.079+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94533434666880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x7f40f801fc60 2024-09-13T19:06:40.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94533434666880] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4106f03980 20 remove_watcher() i=5 2024-09-13T19:06:40.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94533434661568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x7f40f801fc60 2024-09-13T19:06:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94533434661568] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4106f03980 20 remove_watcher() i=6 2024-09-13T19:06:40.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.083+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94533434676912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa47cd7ee0 con 0x7f40f801fc60 2024-09-13T19:06:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94533434676912] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40fc00a4d0 con 0x7f40f801fc60 2024-09-13T19:06:40.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 20 remove_watcher() i=7 2024-09-13T19:06:40.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40f801fc60 msgr2=0x7f40f803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40f801fc60 0x7f40f803a3c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47ca1b80 msgr2=0x55fa47ca4020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47ca1b80 0x55fa47ca4020 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47b6f570 msgr2=0x7f40f4115a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47b6f570 0x7f40f4115a80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47ca6520 msgr2=0x55fa47ca8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47ca6520 0x55fa47ca8910 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fd0034650 msgr2=0x7f3fd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fd0034650 0x7f3fd0036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55fa47c75b10 tx=0x7f40f8010000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 msgr2=0x55fa47c96ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4105214640 1 -- 172.21.15.151:0/3900187684 reap_dead start 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f40f40c5aa0 tx=0x7f40f40fb070 comp rx=0 tx=0).stop 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 shutdown_connections 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/3900187684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c8f910 0x55fa47c96ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 >> 172.21.15.151:0/3900187684 conn(0x55fa47c8bcf0 msgr2=0x55fa47c89dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 shutdown_connections 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/3900187684 wait complete. 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 msgr2=0x7f3fdc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 0x7f3fdc036b10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55fa47c69800 tx=0x7f40f800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 msgr2=0x55fa47c83600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f40f40d4000 tx=0x7f40f40bcc70 comp rx=0 tx=0).stop 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 shutdown_connections 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fdc034650 0x7f3fdc036b10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/1145135662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47c831e0 0x55fa47c83600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 >> 172.21.15.151:0/1145135662 conn(0x55fa47c78330 msgr2=0x55fa47c7adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 shutdown_connections 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/1145135662 wait complete. 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47c69f50 msgr2=0x55fa47c6c340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fa47c69f50 0x55fa47c6c340 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47c72c00 msgr2=0x55fa47c74ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fa47c72c00 0x55fa47c74ff0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47c6eb80 msgr2=0x55fa47c71010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fa47c6eb80 0x55fa47c71010 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fec0346a0 msgr2=0x7f3fec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fec0346a0 0x7f3fec036b60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f40f8001e50 tx=0x7f40f80013b0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 msgr2=0x55fa47c64fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 --2- 172.21.15.151:0/743856181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa47b6fec0 0x55fa47c64fd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40f401bbe0 tx=0x7f40f40180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4105214640 1 -- 172.21.15.151:0/743856181 reap_dead start 2024-09-13T19:06:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 shutdown_connections 2024-09-13T19:06:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 >> 172.21.15.151:0/743856181 conn(0x55fa47b6b090 msgr2=0x55fa47c53fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 shutdown_connections 2024-09-13T19:06:40.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.087+0000 7f4106f03980 1 -- 172.21.15.151:0/743856181 wait complete. 2024-09-13T19:06:40.100 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:06:40.100 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:06:40.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-13T19:06:40.101 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-13T19:06:40.187 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:40.187 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:40.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0cca4980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7a9370890 0x55c7a9372c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0cca4980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7a91f5ae0 con 0x55c7a936c510 2024-09-13T19:06:40.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0cca4980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55c7a9219e30 con 0x55c7a9370890 2024-09-13T19:06:40.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d09fb3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7a9370890 0x55c7a9372c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0a7b4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55c7a936c510 0x55c7a936c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33360/0 (socket says 172.21.15.151:33360) 2024-09-13T19:06:40.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d09fb3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7a9370890 0x55c7a9372c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55844/0 (socket says 172.21.15.151:55844) 2024-09-13T19:06:40.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/1629797756 learned_addr learned my addr 172.21.15.151:0/1629797756 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:40.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d09fb3640 1 -- 172.21.15.151:0/1629797756 >> v1:172.21.15.12:6789/0 conn(0x55c7a936c510 legacy=0x55c7a936c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d09fb3640 1 -- 172.21.15.151:0/1629797756 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a93741d0 con 0x55c7a9370890 2024-09-13T19:06:40.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.187+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/1629797756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a9370890 0x55c7a9372c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400a480 tx=0x7f1cf401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6eb26d7b4dd91da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d097b2640 1 -- 172.21.15.151:0/1629797756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cf40b0070 con 0x55c7a9370890 2024-09-13T19:06:40.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d097b2640 1 -- 172.21.15.151:0/1629797756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf40ab540 con 0x55c7a9370890 2024-09-13T19:06:40.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d097b2640 1 -- 172.21.15.151:0/1629797756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cf40ab840 con 0x55c7a9370890 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1629797756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a9370890 msgr2=0x55c7a9372c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1629797756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a9370890 0x55c7a9372c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400a480 tx=0x7f1cf401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1629797756 shutdown_connections 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1629797756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a9370890 0x55c7a9372c80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1629797756 >> 172.21.15.151:0/1629797756 conn(0x55c7a9368030 msgr2=0x55c7a936a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1629797756 shutdown_connections 2024-09-13T19:06:40.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.191+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1629797756 wait complete. 2024-09-13T19:06:40.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7a921b200 con 0x55c7a936c510 2024-09-13T19:06:40.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55848/0 (socket says 172.21.15.151:55848) 2024-09-13T19:06:40.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/4201868812 learned_addr learned my addr 172.21.15.151:0/4201868812 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/4201868812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a92e2170 con 0x55c7a936c510 2024-09-13T19:06:40.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/4201868812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0015f0 tx=0x7f1cfc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbce544e1ee4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1bf8608640 1 -- 172.21.15.151:0/4201868812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc004530 con 0x55c7a936c510 2024-09-13T19:06:40.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1bf8608640 1 -- 172.21.15.151:0/4201868812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc0046f0 con 0x55c7a936c510 2024-09-13T19:06:40.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1bf8608640 1 -- 172.21.15.151:0/4201868812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc004a90 con 0x55c7a936c510 2024-09-13T19:06:40.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- 172.21.15.151:0/4201868812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 msgr2=0x55c7a92e1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/4201868812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0015f0 tx=0x7f1cfc001ab0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- 172.21.15.151:0/4201868812 shutdown_connections 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/4201868812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a92e1ba0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- 172.21.15.151:0/4201868812 >> 172.21.15.151:0/4201868812 conn(0x55c7a9368030 msgr2=0x55c7a94535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- 172.21.15.151:0/4201868812 shutdown_connections 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- 172.21.15.151:0/4201868812 wait complete. 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a945fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0cca4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7a9373cd0 con 0x55c7a936c510 2024-09-13T19:06:40.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a945fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a945fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55864/0 (socket says 172.21.15.151:55864) 2024-09-13T19:06:40.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.207+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/1004332840 learned_addr learned my addr 172.21.15.151:0/1004332840 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a94602e0 con 0x55c7a936c510 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a945fda0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c7a9459c70 tx=0x7f1cfc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 -- 172.21.15.151:0/1004332840 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc013760 con 0x55c7a936c510 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 -- 172.21.15.151:0/1004332840 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc013900 con 0x55c7a936c510 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 -- 172.21.15.151:0/1004332840 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc013be0 con 0x55c7a936c510 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7a9460570 con 0x55c7a936c510 2024-09-13T19:06:40.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7a9463250 con 0x55c7a936c510 2024-09-13T19:06:40.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 -- 172.21.15.151:0/1004332840 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1cfc010070 con 0x55c7a936c510 2024-09-13T19:06:40.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bf0034650 0x7f1bf0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1bf6e05640 1 -- 172.21.15.151:0/1004332840 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1cfc018070 con 0x55c7a936c510 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bf0034650 0x7f1bf0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a9370890 0x55c7a9466d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a9467400 con 0x55c7a9370890 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a9370890 0x55c7a9466d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bf0034650 0x7f1bf0036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40ad000 tx=0x7f1cf40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.211+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a9370890 0x55c7a9466d90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0afb5640 1 -- 172.21.15.151:0/1004332840 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a9370890 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a9464470 con 0x55c7a9370890 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0afb5640 1 -- 172.21.15.151:0/1004332840 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a9370890 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a9469730 0x55c7a946bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a946c210 con 0x55c7a9469730 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a9469730 0x55c7a946bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a9469730 0x55c7a946bb20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/1004332840 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1cfc01b030 con 0x55c7a9469730 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94685d0 con 0x55c7a9370890 2024-09-13T19:06:40.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0afb5640 1 -- 172.21.15.151:0/1004332840 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a9370890 2024-09-13T19:06:40.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c7a946d670 0x55c7a946fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94701a0 con 0x55c7a946d670 2024-09-13T19:06:40.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c7a946d670 0x55c7a946fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c7a946d670 0x55c7a946fa60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d09fb3640 1 -- 172.21.15.151:0/1004332840 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cf40b3040 con 0x55c7a946d670 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0cca4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7a9274800 con 0x55c7a947dc90 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55876/0 (socket says 172.21.15.151:55876) 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.215+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/818676915 learned_addr learned my addr 172.21.15.151:0/818676915 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/818676915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a947e610 con 0x55c7a947dc90 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0483b0 tx=0x7f1cfc029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 -- 172.21.15.151:0/818676915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc043040 con 0x55c7a947dc90 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 -- 172.21.15.151:0/818676915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc04b070 con 0x55c7a947dc90 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 -- 172.21.15.151:0/818676915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc010e40 con 0x55c7a947dc90 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7a9481240 con 0x55c7a947dc90 2024-09-13T19:06:40.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7a94815f0 con 0x55c7a947dc90 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 -- 172.21.15.151:0/818676915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1cfc041a10 con 0x55c7a947dc90 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 0x7f1be4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1beffff640 1 -- 172.21.15.151:0/818676915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1cfc03c030 con 0x55c7a947dc90 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 0x7f1be4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 0x7f1be4036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55c7a94678b0 tx=0x7f1cf4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0cca4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7a92e24f0 con 0x55c7a948a600 2024-09-13T19:06:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55878/0 (socket says 172.21.15.151:55878) 2024-09-13T19:06:40.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/2908088482 learned_addr learned my addr 172.21.15.151:0/2908088482 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.219+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/2908088482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a948afd0 con 0x55c7a948a600 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/2908088482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc053f00 tx=0x7f1cfc053f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c16cb5a68d1183 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bedffb640 1 -- 172.21.15.151:0/2908088482 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc05b040 con 0x55c7a948a600 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bedffb640 1 -- 172.21.15.151:0/2908088482 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc011c20 con 0x55c7a948a600 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bedffb640 1 -- 172.21.15.151:0/2908088482 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc028920 con 0x55c7a948a600 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/2908088482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 msgr2=0x55c7a948aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/2908088482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc053f00 tx=0x7f1cfc053f30 comp rx=0 tx=0).stop 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/2908088482 shutdown_connections 2024-09-13T19:06:40.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/2908088482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a948aa00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/2908088482 >> 172.21.15.151:0/2908088482 conn(0x55c7a94869e0 msgr2=0x55c7a9484ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/2908088482 shutdown_connections 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/2908088482 wait complete. 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 Processor -- start 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- start start 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7a948b450 con 0x55c7a948a600 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55884/0 (socket says 172.21.15.151:55884) 2024-09-13T19:06:40.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 learned_addr learned my addr 172.21.15.151:0/3968095164 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7a9457890 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55c7a94870c0 tx=0x7f1cfc017f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bdbfff640 1 -- 172.21.15.151:0/3968095164 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc048790 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7a9457890 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bdbfff640 1 -- 172.21.15.151:0/3968095164 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cfc06f030 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1bdbfff640 1 -- 172.21.15.151:0/3968095164 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cfc041500 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.223+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7a9457d00 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1bdbfff640 1 -- 172.21.15.151:0/3968095164 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1cfc0416a0 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1bdbfff640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bd4034650 0x7f1bd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1bdbfff640 1 -- 172.21.15.151:0/3968095164 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f1cfc075c80 con 0x55c7a948a600 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bd4034650 0x7f1bd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a949ead0 0x55c7a94a0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a16e0 con 0x55c7a949ead0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a949ead0 0x55c7a94a0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bd4034650 0x7f1bd4036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4018eb0 tx=0x7f1cf40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a949ead0 0x55c7a94a0f90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 realm 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a1af0 con 0x55c7a949ead0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2390 con 0x55c7a949ead0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a94a3490 0x55c7a94a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a5ed0 con 0x55c7a94a3490 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a94a3490 0x55c7a94a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a94a3490 0x55c7a94a5880 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 20 searching for the correct realm 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.227+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a7730 con 0x55c7a94a3490 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0a7b4640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1cfc06a050 0x7f1cfc050450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a7730 con 0x7f1cfc06a050 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1cfc06a050 0x7f1cfc050450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1cfc06a050 0x7f1cfc050450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d09fb3640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1cf40dc040 0x7f1cf40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a7730 con 0x7f1cf40dc040 2024-09-13T19:06:40.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1cf40dc040 0x7f1cf40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1cf40dc040 0x7f1cf40dd430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.231+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cfc06a050 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cfc06a050 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.235+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cfc06a050 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.239+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cfc06a050 2024-09-13T19:06:40.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a94a3490 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cf40dc040 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x55c7a949ead0 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a2730 con 0x7f1cfc06a050 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:40.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a6850 con 0x55c7a949ead0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a70a0 con 0x55c7a949ead0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a64b0 con 0x7f1cfc06a050 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 zone default found 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 4 Realm: () 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 zonegroup default 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a7b60 con 0x7f1cf40dc040 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a95a0 con 0x55c7a94a3490 2024-09-13T19:06:40.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.243+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a9a50 con 0x55c7a94a3490 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 20 started sync module instance, tier type = 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94a89e0 con 0x7f1cfc06a050 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94316027088336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94aa360 con 0x7f1cfc06a050 2024-09-13T19:06:40.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94aabb0 con 0x55c7a949ead0 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94316027088336] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94316027092656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94aabb0 con 0x55c7a949ead0 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.247+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ab630 con 0x55c7a94a3490 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94316027097376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ab5f0 con 0x55c7a94a3490 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ac560 con 0x7f1cfc06a050 2024-09-13T19:06:40.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94316027092656] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94316027094784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ac980 con 0x7f1cfc06a050 2024-09-13T19:06:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ad340 con 0x55c7a949ead0 2024-09-13T19:06:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.251+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94316027097376] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94316027094784] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94316027101296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ace90 con 0x55c7a949ead0 2024-09-13T19:06:40.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ad6e0 con 0x7f1cf40dc040 2024-09-13T19:06:40.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94316027101296] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.255+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94316027104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94adad0 con 0x7f1cf40dc040 2024-09-13T19:06:40.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.259+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ae320 con 0x7f1cf40dc040 2024-09-13T19:06:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.259+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94316027104912] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.259+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.259+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94316027106448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94adf80 con 0x7f1cf40dc040 2024-09-13T19:06:40.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.259+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94ae9f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94316027110592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94aee60 con 0x7f1cf40dc040 2024-09-13T19:06:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=0 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=1 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=2 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=3 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=4 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=5 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94316027106448] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=6 2024-09-13T19:06:40.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94316027110592] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 20 add_watcher() i=7 2024-09-13T19:06:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94adad0 con 0x55c7a949ead0 2024-09-13T19:06:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.263+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94316027108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94af370 con 0x55c7a949ead0 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94316027108048] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 5 note: GC not initialized 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1b3b7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 Filter name: none 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1b397fa640 20 reqs_thread_entry: start 2024-09-13T19:06:40.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d55a0 con 0x55c7a949ead0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d3d40 con 0x55c7a949ead0 2024-09-13T19:06:40.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d3d40 con 0x7f1cf40dc040 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-13T19:06:40.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.267+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d4760 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0cca4980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0cca4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94316027265408 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9050 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify (1) cookie 94316027101296 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55c7a94d4b00 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1bedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94316027101296 notifier 4288 bl.length()=567 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1bedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1bedffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 notify.4 [notify cookie 94316027265408 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1bedffb640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1bd0003eb0 con 0x55c7a949ead0 2024-09-13T19:06:40.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== watch-notify(notify_complete (2) cookie 94316027265408 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c7a94d51c0 con 0x55c7a949ead0 2024-09-13T19:06:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.271+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d6b20 con 0x55c7a949ead0 2024-09-13T19:06:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:06:40.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0cca4980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:06:40.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0cca4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:06:40.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94316027265264 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d8ff0 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== watch-notify(notify (1) cookie 94316027094784 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55c7a93741d0 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1bed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94316027094784 notifier 4288 bl.length()=169 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1bed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1bed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(69 notify.3 [notify cookie 94316027265264 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1bed7fa640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1b40003410 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== watch-notify(notify_complete (2) cookie 94316027265264 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1cf40b7620 con 0x7f1cfc06a050 2024-09-13T19:06:40.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.275+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d6fd0 con 0x7f1cf40dc040 2024-09-13T19:06:40.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94316027276064 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d8530 con 0x7f1cfc06a050 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== watch-notify(notify (1) cookie 94316027094784 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f1cf40b7620 con 0x7f1cfc06a050 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1bedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94316027094784 notifier 4288 bl.length()=177 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1bedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1bedffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(72 notify.3 [notify cookie 94316027276064 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1bedffb640 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1bd0003eb0 con 0x7f1cfc06a050 2024-09-13T19:06:40.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== watch-notify(notify_complete (2) cookie 94316027276064 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1cf40ddab0 con 0x7f1cfc06a050 2024-09-13T19:06:40.282 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94316027108048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x55c7a949ead0 2024-09-13T19:06:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94316027108048] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.279+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94316027088336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x7f1cfc06a050 2024-09-13T19:06:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94316027088336] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0cca4980 20 remove_watcher() i=0 2024-09-13T19:06:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0cca4980 2 removed watcher, disabling cache 2024-09-13T19:06:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94316027092656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x55c7a949ead0 2024-09-13T19:06:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94316027092656] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0cca4980 20 remove_watcher() i=1 2024-09-13T19:06:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.283+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94316027097376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x55c7a94a3490 2024-09-13T19:06:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d0a7b4640 1 -- 172.21.15.151:0/3968095164 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94316027097376] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cfc07b070 con 0x55c7a94a3490 2024-09-13T19:06:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d0cca4980 20 remove_watcher() i=2 2024-09-13T19:06:40.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94316027094784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x7f1cfc06a050 2024-09-13T19:06:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d09fb3640 1 -- 172.21.15.151:0/3968095164 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94316027094784] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cf40c9030 con 0x7f1cfc06a050 2024-09-13T19:06:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d0cca4980 20 remove_watcher() i=3 2024-09-13T19:06:40.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.287+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94316027101296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x55c7a949ead0 2024-09-13T19:06:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.291+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94316027101296] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x55c7a949ead0 2024-09-13T19:06:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.291+0000 7f1d0cca4980 20 remove_watcher() i=4 2024-09-13T19:06:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.291+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94316027104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x7f1cf40dc040 2024-09-13T19:06:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94316027104912] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0cca4980 20 remove_watcher() i=5 2024-09-13T19:06:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94316027106448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x7f1cf40dc040 2024-09-13T19:06:40.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94316027106448] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0cca4980 20 remove_watcher() i=6 2024-09-13T19:06:40.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.295+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94316027110592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c7a94d9070 con 0x7f1cf40dc040 2024-09-13T19:06:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94316027110592] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d040083f0 con 0x7f1cf40dc040 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 20 remove_watcher() i=7 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1cf40dc040 msgr2=0x7f1cf40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1cf40dc040 0x7f1cf40dd430 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a949ead0 msgr2=0x55c7a94a0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a949ead0 0x55c7a94a0f90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1cfc06a050 msgr2=0x7f1cfc050450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1cfc06a050 0x7f1cfc050450 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a94a3490 msgr2=0x55c7a94a5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a94a3490 0x55c7a94a5880 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bd4034650 msgr2=0x7f1bd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bd4034650 0x7f1bd4036b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4018eb0 tx=0x7f1cf40b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0afb5640 1 -- 172.21.15.151:0/3968095164 reap_dead start 2024-09-13T19:06:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 msgr2=0x55c7a9459170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55c7a94870c0 tx=0x7f1cfc017f20 comp rx=0 tx=0).stop 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 shutdown_connections 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/3968095164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a948a600 0x55c7a9459170 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 >> 172.21.15.151:0/3968095164 conn(0x55c7a94869e0 msgr2=0x55c7a9484ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 shutdown_connections 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/3968095164 wait complete. 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 msgr2=0x7f1be4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 0x7f1be4036b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55c7a94678b0 tx=0x7f1cf4005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 msgr2=0x55c7a947e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0483b0 tx=0x7f1cfc029840 comp rx=0 tx=0).stop 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 shutdown_connections 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1be4034650 0x7f1be4036b10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/818676915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a947dc90 0x55c7a947e0d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 >> 172.21.15.151:0/818676915 conn(0x55c7a9472de0 msgr2=0x55c7a9475860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 shutdown_connections 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.299+0000 7f1d0cca4980 1 -- 172.21.15.151:0/818676915 wait complete. 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a9370890 msgr2=0x55c7a9466d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7a9370890 0x55c7a9466d90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c7a946d670 msgr2=0x55c7a946fa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c7a946d670 0x55c7a946fa60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a9469730 msgr2=0x55c7a946bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7a9469730 0x55c7a946bb20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bf0034650 msgr2=0x7f1bf0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1bf0034650 0x7f1bf0036b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40ad000 tx=0x7f1cf40a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 msgr2=0x55c7a945fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 --2- 172.21.15.151:0/1004332840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7a936c510 0x55c7a945fda0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55c7a9459c70 tx=0x7f1cfc000f50 comp rx=0 tx=0).stop 2024-09-13T19:06:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0afb5640 1 -- 172.21.15.151:0/1004332840 reap_dead start 2024-09-13T19:06:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 shutdown_connections 2024-09-13T19:06:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 >> 172.21.15.151:0/1004332840 conn(0x55c7a9368030 msgr2=0x55c7a9452120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 shutdown_connections 2024-09-13T19:06:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.303+0000 7f1d0cca4980 1 -- 172.21.15.151:0/1004332840 wait complete. 2024-09-13T19:06:40.315 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:40.316 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:06:40.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-13T19:06:40.316 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-13T19:06:40.400 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:40.400 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:40.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70fad5d980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559b42798a60 0x559b4279ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70fad5d980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b4261cae0 con 0x559b42709230 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70fad5d980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559b42640e30 con 0x559b42798a60 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f806c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559b42798a60 0x559b4279ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f886d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x559b42709230 0x559b42797340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33370/0 (socket says 172.21.15.151:33370) 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f806c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559b42798a60 0x559b4279ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55898/0 (socket says 172.21.15.151:55898) 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f886d640 1 -- 172.21.15.151:0/3015046286 learned_addr learned my addr 172.21.15.151:0/3015046286 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f806c640 1 -- 172.21.15.151:0/3015046286 >> v1:172.21.15.12:6789/0 conn(0x559b42709230 legacy=0x559b42797340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.399+0000 7f70f806c640 1 -- 172.21.15.151:0/3015046286 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b427097c0 con 0x559b42798a60 2024-09-13T19:06:40.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70f806c640 1 --2- 172.21.15.151:0/3015046286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42798a60 0x559b4279ae50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70e000a480 tx=0x7f70e001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70068e6c3cc82a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70f786b640 1 -- 172.21.15.151:0/3015046286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e00b0070 con 0x559b42798a60 2024-09-13T19:06:40.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70f786b640 1 -- 172.21.15.151:0/3015046286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e00ab540 con 0x559b42798a60 2024-09-13T19:06:40.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70f786b640 1 -- 172.21.15.151:0/3015046286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e00ab840 con 0x559b42798a60 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 -- 172.21.15.151:0/3015046286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42798a60 msgr2=0x559b4279ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 --2- 172.21.15.151:0/3015046286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42798a60 0x559b4279ae50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f70e000a480 tx=0x7f70e001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 -- 172.21.15.151:0/3015046286 shutdown_connections 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 --2- 172.21.15.151:0/3015046286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42798a60 0x559b4279ae50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 -- 172.21.15.151:0/3015046286 >> 172.21.15.151:0/3015046286 conn(0x559b4278f030 msgr2=0x559b42791450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 -- 172.21.15.151:0/3015046286 shutdown_connections 2024-09-13T19:06:40.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.403+0000 7f70fad5d980 1 -- 172.21.15.151:0/3015046286 wait complete. 2024-09-13T19:06:40.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70fad5d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70fad5d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b42642200 con 0x559b42709230 2024-09-13T19:06:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55906/0 (socket says 172.21.15.151:55906) 2024-09-13T19:06:40.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70f886d640 1 -- 172.21.15.151:0/2885245244 learned_addr learned my addr 172.21.15.151:0/2885245244 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70f886d640 1 -- 172.21.15.151:0/2885245244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b42795070 con 0x559b42709230 2024-09-13T19:06:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f70f886d640 1 --2- 172.21.15.151:0/2885245244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70e80017b0 tx=0x7f70e8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e1545d8d8bdb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f6fe6e0d640 1 -- 172.21.15.151:0/2885245244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8016070 con 0x559b42709230 2024-09-13T19:06:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f6fe6e0d640 1 -- 172.21.15.151:0/2885245244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8004530 con 0x559b42709230 2024-09-13T19:06:40.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.419+0000 7f6fe6e0d640 1 -- 172.21.15.151:0/2885245244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8004870 con 0x559b42709230 2024-09-13T19:06:40.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/2885245244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 msgr2=0x559b42794aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 --2- 172.21.15.151:0/2885245244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f70e80017b0 tx=0x7f70e8001c70 comp rx=0 tx=0).stop 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/2885245244 shutdown_connections 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 --2- 172.21.15.151:0/2885245244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42794aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/2885245244 >> 172.21.15.151:0/2885245244 conn(0x559b4278f030 msgr2=0x559b4287b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/2885245244 shutdown_connections 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/2885245244 wait complete. 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42888fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b4279bea0 con 0x559b42709230 2024-09-13T19:06:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42888fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42888fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55918/0 (socket says 172.21.15.151:55918) 2024-09-13T19:06:40.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70f886d640 1 -- 172.21.15.151:0/1392114959 learned_addr learned my addr 172.21.15.151:0/1392114959 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70f886d640 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b42889510 con 0x559b42709230 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70f886d640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42888fd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000f90 tx=0x7f70e8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f6fe560a640 1 -- 172.21.15.151:0/1392114959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8020070 con 0x559b42709230 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f6fe560a640 1 -- 172.21.15.151:0/1392114959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8011400 con 0x559b42709230 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b428897a0 con 0x559b42709230 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f6fe560a640 1 -- 172.21.15.151:0/1392114959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8016040 con 0x559b42709230 2024-09-13T19:06:40.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b4288c480 con 0x559b42709230 2024-09-13T19:06:40.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f6fe560a640 1 -- 172.21.15.151:0/1392114959 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8023070 con 0x559b42709230 2024-09-13T19:06:40.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.423+0000 7f6fe560a640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fe0034650 0x7f6fe0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f6fe560a640 1 -- 172.21.15.151:0/1392114959 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70e8049170 con 0x559b42709230 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f806c640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fe0034650 0x7f6fe0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b42798a60 0x559b428900d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b42890610 con 0x559b42798a60 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f906e640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b42798a60 0x559b428900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f806c640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fe0034650 0x7f6fe0036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70e00ad000 tx=0x7f70e00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f906e640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b42798a60 0x559b428900d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f906e640 1 -- 172.21.15.151:0/1392114959 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b42798a60 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b4288d680 con 0x559b42798a60 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f906e640 1 -- 172.21.15.151:0/1392114959 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70f00083f0 con 0x559b42798a60 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428928b0 0x559b42894ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b42895390 con 0x559b428928b0 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f886d640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428928b0 0x559b42894ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f886d640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428928b0 0x559b42894ca0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f886d640 1 -- 172.21.15.151:0/1392114959 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f70e802c070 con 0x559b428928b0 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b42891720 con 0x559b42798a60 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f906e640 1 -- 172.21.15.151:0/1392114959 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70f00083f0 con 0x559b42798a60 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559b428967f0 0x559b42898be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428992e0 con 0x559b428967f0 2024-09-13T19:06:40.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f806c640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559b428967f0 0x559b42898be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f806c640 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559b428967f0 0x559b42898be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.427+0000 7f70f806c640 1 -- 172.21.15.151:0/1392114959 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f70e00b3040 con 0x559b428967f0 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b4269b800 con 0x559b428a6db0 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55928/0 (socket says 172.21.15.151:55928) 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f886d640 1 -- 172.21.15.151:0/1704330307 learned_addr learned my addr 172.21.15.151:0/1704330307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f886d640 1 -- 172.21.15.151:0/1704330307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b428a7710 con 0x559b428a6db0 2024-09-13T19:06:40.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f886d640 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f70e80475c0 tx=0x7f70e8023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 -- 172.21.15.151:0/1704330307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e802a040 con 0x559b428a6db0 2024-09-13T19:06:40.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b428a79a0 con 0x559b428a6db0 2024-09-13T19:06:40.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 -- 172.21.15.151:0/1704330307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e80116e0 con 0x559b428a6db0 2024-09-13T19:06:40.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 -- 172.21.15.151:0/1704330307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e802a420 con 0x559b428a6db0 2024-09-13T19:06:40.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b428aa620 con 0x559b428a6db0 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 -- 172.21.15.151:0/1704330307 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8011890 con 0x559b428a6db0 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 0x7f6fd0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f6fde7fc640 1 -- 172.21.15.151:0/1704330307 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70e8036070 con 0x559b428a6db0 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70f806c640 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 0x7f6fd0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.431+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f806c640 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 0x7f6fd0036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x559b42890a50 tx=0x7f70e0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b42793290 con 0x559b428b3620 2024-09-13T19:06:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55944/0 (socket says 172.21.15.151:55944) 2024-09-13T19:06:40.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 -- 172.21.15.151:0/658666947 learned_addr learned my addr 172.21.15.151:0/658666947 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 -- 172.21.15.151:0/658666947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b428b3fd0 con 0x559b428b3620 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- 172.21.15.151:0/658666947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70e8023c10 tx=0x7f70e8014e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1417b883f557ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f6fcffff640 1 -- 172.21.15.151:0/658666947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8011b80 con 0x559b428b3620 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f6fcffff640 1 -- 172.21.15.151:0/658666947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8026970 con 0x559b428b3620 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f6fcffff640 1 -- 172.21.15.151:0/658666947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e80486b0 con 0x559b428b3620 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- 172.21.15.151:0/658666947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 msgr2=0x559b428b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 --2- 172.21.15.151:0/658666947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70e8023c10 tx=0x7f70e8014e00 comp rx=0 tx=0).stop 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- 172.21.15.151:0/658666947 shutdown_connections 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 --2- 172.21.15.151:0/658666947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428b3a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- 172.21.15.151:0/658666947 >> 172.21.15.151:0/658666947 conn(0x559b428afa00 msgr2=0x559b428adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- 172.21.15.151:0/658666947 shutdown_connections 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- 172.21.15.151:0/658666947 wait complete. 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 Processor -- start 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- start start 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70fad5d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559b428b4470 con 0x559b428b3620 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55948/0 (socket says 172.21.15.151:55948) 2024-09-13T19:06:40.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 learned_addr learned my addr 172.21.15.151:0/276336831 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b428bace0 con 0x559b428b3620 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.435+0000 7f70f886d640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70e8023c10 tx=0x7f70e801df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 -- 172.21.15.151:0/276336831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e8011b80 con 0x559b428b3620 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b428bace0 con 0x559b428b3620 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 -- 172.21.15.151:0/276336831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8066070 con 0x559b428b3620 2024-09-13T19:06:40.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 -- 172.21.15.151:0/276336831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f70e802dd20 con 0x559b428b3620 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b428bace0 con 0x559b428b3620 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 -- 172.21.15.151:0/276336831 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f70e8048a40 con 0x559b428b3620 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fc4034650 0x7f6fc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f6fce7fc640 1 -- 172.21.15.151:0/276336831 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f70e80151c0 con 0x559b428b3620 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f806c640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fc4034650 0x7f6fc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b428c5880 0x559b428c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428c8490 con 0x559b428c5880 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b428c5880 0x559b428c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f806c640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fc4034650 0x7f6fc4036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c10 tx=0x7f70e00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b428c5880 0x559b428c7d40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 realm 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428c88a0 con 0x559b428c5880 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9170 con 0x559b428c5880 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428ca270 0x559b428cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428ccc70 con 0x559b428ca270 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.439+0000 7f70f886d640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428ca270 0x559b428cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f886d640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428ca270 0x559b428cc660 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70fad5d980 20 searching for the correct realm 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428ce540 con 0x559b428ca270 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f886d640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f70e8061050 0x7f70e80499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428ce540 con 0x7f70e8061050 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f806c640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f70e8061050 0x7f70e80499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f806c640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f70e8061050 0x7f70e80499d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f806c640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f70e00dc040 0x7f70e00dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428ce540 con 0x7f70e00dc040 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f70e00dc040 0x7f70e00dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f70e00dc040 0x7f70e00dd430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.443+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e8061050 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e8061050 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.447+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e8061050 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.451+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e8061050 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428ca270 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e00dc040 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x559b428c5880 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559b428c9510 con 0x7f70e8061050 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428cd5c0 con 0x559b428c5880 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428cde60 con 0x559b428c5880 2024-09-13T19:06:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.455+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428cd9b0 con 0x7f70e8061050 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 zone default found 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 4 Realm: () 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 zonegroup default 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428cde70 con 0x7f70e00dc040 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428d03d0 con 0x559b428ca270 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428d07f0 con 0x559b428ca270 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 started sync module instance, tier type = 2024-09-13T19:06:40.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428ce340 con 0x7f70e8061050 2024-09-13T19:06:40.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94125324826944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d0c50 con 0x7f70e8061050 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.459+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d16a0 con 0x559b428c5880 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.463+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94125324826944] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.463+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.463+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94125324833168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d1ac0 con 0x559b428c5880 2024-09-13T19:06:40.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.463+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d2480 con 0x559b428ca270 2024-09-13T19:06:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94125324836816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d2cd0 con 0x559b428ca270 2024-09-13T19:06:40.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d3690 con 0x7f70e8061050 2024-09-13T19:06:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94125324843696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d4380 con 0x7f70e8061050 2024-09-13T19:06:40.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d4d40 con 0x559b428c5880 2024-09-13T19:06:40.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.467+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94125324833168] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.471+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94125324843696] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.471+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94125324836816] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.475+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.475+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94125324828064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d2930 con 0x559b428c5880 2024-09-13T19:06:40.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.475+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d4380 con 0x7f70e00dc040 2024-09-13T19:06:40.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.475+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94125324828064] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.479+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.479+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94125324847616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d4380 con 0x7f70e00dc040 2024-09-13T19:06:40.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.479+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d5500 con 0x7f70e00dc040 2024-09-13T19:06:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94125324849232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d5920 con 0x7f70e00dc040 2024-09-13T19:06:40.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d6440 con 0x7f70e00dc040 2024-09-13T19:06:40.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94125324847616] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94125324849232] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94125324853008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d5470 con 0x7f70e00dc040 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=0 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=1 2024-09-13T19:06:40.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=2 2024-09-13T19:06:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=3 2024-09-13T19:06:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=4 2024-09-13T19:06:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=5 2024-09-13T19:06:40.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.483+0000 7f70fad5d980 20 add_watcher() i=6 2024-09-13T19:06:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94125324853008] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70fad5d980 20 add_watcher() i=7 2024-09-13T19:06:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70fad5d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428d9540 con 0x559b428c5880 2024-09-13T19:06:40.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94125324844752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d69c0 con 0x559b428c5880 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.487+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94125324844752] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f6faefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 5 note: GC not initialized 2024-09-13T19:06:40.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f6fadfe3640 20 reqs_thread_entry: start 2024-09-13T19:06:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 Filter name: none 2024-09-13T19:06:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f6f1f7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:40.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428fc970 con 0x7f70e00dc040 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:40.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428fb110 con 0x559b428c5880 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=7 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-13T19:06:40.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559b428fb500 con 0x559b428c5880 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 20 get_user_info_from_index found 0 xattrs 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f6faefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.491+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94125324844752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428db7d0 con 0x559b428c5880 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94125324844752] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94125324826944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428fa7a0 con 0x7f70e8061050 2024-09-13T19:06:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94125324826944] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70fad5d980 20 remove_watcher() i=0 2024-09-13T19:06:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70fad5d980 2 removed watcher, disabling cache 2024-09-13T19:06:40.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.495+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94125324833168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428cf940 con 0x559b428c5880 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94125324833168] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70fad5d980 20 remove_watcher() i=1 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94125324836816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428fa7a0 con 0x559b428ca270 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70f886d640 1 -- 172.21.15.151:0/276336831 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94125324836816] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e8054070 con 0x559b428ca270 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70fad5d980 20 remove_watcher() i=2 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.499+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94125324843696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d1190 con 0x7f70e8061050 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70f806c640 1 -- 172.21.15.151:0/276336831 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94125324843696] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70e00c9030 con 0x7f70e8061050 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70fad5d980 20 remove_watcher() i=3 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94125324828064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d1fd0 con 0x559b428c5880 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94125324828064] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x559b428c5880 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70fad5d980 20 remove_watcher() i=4 2024-09-13T19:06:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.503+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94125324847616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d1190 con 0x7f70e00dc040 2024-09-13T19:06:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.507+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94125324847616] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.507+0000 7f70fad5d980 20 remove_watcher() i=5 2024-09-13T19:06:40.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.507+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94125324849232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d1fd0 con 0x7f70e00dc040 2024-09-13T19:06:40.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94125324849232] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 20 remove_watcher() i=6 2024-09-13T19:06:40.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94125324853008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559b428d4a00 con 0x7f70e00dc040 2024-09-13T19:06:40.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94125324853008] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f70f00083f0 con 0x7f70e00dc040 2024-09-13T19:06:40.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 20 remove_watcher() i=7 2024-09-13T19:06:40.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f70e00dc040 msgr2=0x7f70e00dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f70e00dc040 0x7f70e00dd430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b428c5880 msgr2=0x559b428c7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b428c5880 0x559b428c7d40 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f70e8061050 msgr2=0x7f70e80499d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f70e8061050 0x7f70e80499d0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428ca270 msgr2=0x559b428cc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428ca270 0x559b428cc660 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fc4034650 msgr2=0x7f6fc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fc4034650 0x7f6fc4036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70e0000c10 tx=0x7f70e00b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:40.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70f906e640 1 -- 172.21.15.151:0/276336831 reap_dead start 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 msgr2=0x559b428ba7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f70e8023c10 tx=0x7f70e801df50 comp rx=0 tx=0).stop 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 shutdown_connections 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/276336831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428b3620 0x559b428ba7a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 >> 172.21.15.151:0/276336831 conn(0x559b428afa00 msgr2=0x559b428adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 shutdown_connections 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/276336831 wait complete. 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 msgr2=0x7f6fd0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 0x7f6fd0036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x559b42890a50 tx=0x7f70e0005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 msgr2=0x559b428a71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f70e80475c0 tx=0x7f70e8023ac0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 shutdown_connections 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fd0034650 0x7f6fd0036b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1704330307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b428a6db0 0x559b428a71d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.511+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 >> 172.21.15.151:0/1704330307 conn(0x559b4289bf00 msgr2=0x559b4289e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 shutdown_connections 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1704330307 wait complete. 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b42798a60 msgr2=0x559b428900d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559b42798a60 0x559b428900d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559b428967f0 msgr2=0x559b42898be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559b428967f0 0x559b42898be0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428928b0 msgr2=0x559b42894ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559b428928b0 0x559b42894ca0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fe0034650 msgr2=0x7f6fe0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6fe0034650 0x7f6fe0036b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70e00ad000 tx=0x7f70e00a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 msgr2=0x559b42888fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 --2- 172.21.15.151:0/1392114959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559b42709230 0x559b42888fd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000f90 tx=0x7f70e8001260 comp rx=0 tx=0).stop 2024-09-13T19:06:40.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70f906e640 1 -- 172.21.15.151:0/1392114959 reap_dead start 2024-09-13T19:06:40.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 shutdown_connections 2024-09-13T19:06:40.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 >> 172.21.15.151:0/1392114959 conn(0x559b4278f030 msgr2=0x559b4287b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 shutdown_connections 2024-09-13T19:06:40.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.515+0000 7f70fad5d980 1 -- 172.21.15.151:0/1392114959 wait complete. 2024-09-13T19:06:40.528 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-13T19:06:40.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:40.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:40.528 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:40.604 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a3f3c980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5568d63af600 0x5568d63b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a3f3c980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568d6236ae0 con 0x5568d63acb00 2024-09-13T19:06:40.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a3f3c980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5568d625ae30 con 0x5568d63af600 2024-09-13T19:06:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a124b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5568d63af600 0x5568d63b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a1a4c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5568d63acb00 0x5568d63aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33378/0 (socket says 172.21.15.151:33378) 2024-09-13T19:06:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a1a4c640 1 -- 172.21.15.151:0/2148226831 learned_addr learned my addr 172.21.15.151:0/2148226831 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a124b640 1 -- 172.21.15.151:0/2148226831 >> v1:172.21.15.12:6789/0 conn(0x5568d63acb00 legacy=0x5568d63aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.603+0000 7f45a124b640 1 -- 172.21.15.151:0/2148226831 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d63b8530 con 0x5568d63af600 2024-09-13T19:06:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a124b640 1 --2- 172.21.15.151:0/2148226831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63af600 0x5568d63b6fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f459800a480 tx=0x7f459801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757443447209c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a0a4a640 1 -- 172.21.15.151:0/2148226831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45980aa570 con 0x5568d63af600 2024-09-13T19:06:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a0a4a640 1 -- 172.21.15.151:0/2148226831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45980af070 con 0x5568d63af600 2024-09-13T19:06:40.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a0a4a640 1 -- 172.21.15.151:0/2148226831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45980aa860 con 0x5568d63af600 2024-09-13T19:06:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 -- 172.21.15.151:0/2148226831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63af600 msgr2=0x5568d63b6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/2148226831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63af600 0x5568d63b6fe0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f459800a480 tx=0x7f459801b310 comp rx=0 tx=0).stop 2024-09-13T19:06:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 -- 172.21.15.151:0/2148226831 shutdown_connections 2024-09-13T19:06:40.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/2148226831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63af600 0x5568d63b6fe0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 -- 172.21.15.151:0/2148226831 >> 172.21.15.151:0/2148226831 conn(0x5568d63a87a0 msgr2=0x5568d63aabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 -- 172.21.15.151:0/2148226831 shutdown_connections 2024-09-13T19:06:40.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.607+0000 7f45a3f3c980 1 -- 172.21.15.151:0/2148226831 wait complete. 2024-09-13T19:06:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a3f3c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a3f3c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568d625c200 con 0x5568d63acb00 2024-09-13T19:06:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55972/0 (socket says 172.21.15.151:55972) 2024-09-13T19:06:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a1a4c640 1 -- 172.21.15.151:0/767077432 learned_addr learned my addr 172.21.15.151:0/767077432 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a1a4c640 1 -- 172.21.15.151:0/767077432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d649c270 con 0x5568d63acb00 2024-09-13T19:06:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/767077432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4594001d90 tx=0x7f4594001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b29af3d0ebb38ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f448fe07640 1 -- 172.21.15.151:0/767077432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594013030 con 0x5568d63acb00 2024-09-13T19:06:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f448fe07640 1 -- 172.21.15.151:0/767077432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459400e690 con 0x5568d63acb00 2024-09-13T19:06:40.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.623+0000 7f448fe07640 1 -- 172.21.15.151:0/767077432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459400ea10 con 0x5568d63acb00 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/767077432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 msgr2=0x5568d649bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/767077432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4594001d90 tx=0x7f4594001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/767077432 shutdown_connections 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/767077432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d649bca0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/767077432 >> 172.21.15.151:0/767077432 conn(0x5568d63a87a0 msgr2=0x5568d64978d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/767077432 shutdown_connections 2024-09-13T19:06:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/767077432 wait complete. 2024-09-13T19:06:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d64a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568d63b8030 con 0x5568d63acb00 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d64a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d64a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55974/0 (socket says 172.21.15.151:55974) 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1382309559 learned_addr learned my addr 172.21.15.151:0/1382309559 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d64a3570 con 0x5568d63acb00 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d64a3030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5568d649ce80 tx=0x7f4594000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f448e604640 1 -- 172.21.15.151:0/1382309559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594027070 con 0x5568d63acb00 2024-09-13T19:06:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568d64a3800 con 0x5568d63acb00 2024-09-13T19:06:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f448e604640 1 -- 172.21.15.151:0/1382309559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4594019900 con 0x5568d63acb00 2024-09-13T19:06:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f448e604640 1 -- 172.21.15.151:0/1382309559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594019c20 con 0x5568d63acb00 2024-09-13T19:06:40.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.627+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d64a64e0 con 0x5568d63acb00 2024-09-13T19:06:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f448e604640 1 -- 172.21.15.151:0/1382309559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f459402a070 con 0x5568d63acb00 2024-09-13T19:06:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f448e604640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f44880346a0 0x7f4488036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f448e604640 1 -- 172.21.15.151:0/1382309559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f459401f070 con 0x5568d63acb00 2024-09-13T19:06:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a124b640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f44880346a0 0x7f4488036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d63af600 0x5568d64aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64aa670 con 0x5568d63af600 2024-09-13T19:06:40.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a224d640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d63af600 0x5568d64aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a124b640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f44880346a0 0x7f4488036b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45980ae000 tx=0x7f45980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a224d640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d63af600 0x5568d64aa000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a224d640 1 -- 172.21.15.151:0/1382309559 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d63af600 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64a76e0 con 0x5568d63af600 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a224d640 1 -- 172.21.15.151:0/1382309559 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d63af600 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64ac9a0 0x5568d64aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64af460 con 0x5568d64ac9a0 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64ac9a0 0x5568d64aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64ac9a0 0x5568d64aed90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1382309559 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4594029030 con 0x5568d64ac9a0 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ab840 con 0x5568d63af600 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a224d640 1 -- 172.21.15.151:0/1382309559 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d63af600 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5568d64b08c0 0x5568d64b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64b33b0 con 0x5568d64b08c0 2024-09-13T19:06:40.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a124b640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5568d64b08c0 0x5568d64b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.631+0000 7f45a124b640 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5568d64b08c0 0x5568d64b2cb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a124b640 1 -- 172.21.15.151:0/1382309559 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f45980a8070 con 0x5568d64b08c0 2024-09-13T19:06:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568d62b5800 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55978/0 (socket says 172.21.15.151:55978) 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a1a4c640 1 -- 172.21.15.151:0/4130561720 learned_addr learned my addr 172.21.15.151:0/4130561720 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a1a4c640 1 -- 172.21.15.151:0/4130561720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d64c17e0 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f459404a070 tx=0x7f459400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 -- 172.21.15.151:0/4130561720 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459402aa40 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568d64c1a70 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 -- 172.21.15.151:0/4130561720 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459402abe0 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 -- 172.21.15.151:0/4130561720 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459402b520 con 0x5568d64c0e80 2024-09-13T19:06:40.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d64c46f0 con 0x5568d64c0e80 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 -- 172.21.15.151:0/4130561720 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4594016070 con 0x5568d64c0e80 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 0x7f447c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.635+0000 7f44877fe640 1 -- 172.21.15.151:0/4130561720 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4594014070 con 0x5568d64c0e80 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a124b640 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 0x7f447c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568d649c5f0 con 0x5568d64cd810 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a124b640 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 0x7f447c036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5568d64aaf50 tx=0x7f4598005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55984/0 (socket says 172.21.15.151:55984) 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 -- 172.21.15.151:0/423882068 learned_addr learned my addr 172.21.15.151:0/423882068 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 -- 172.21.15.151:0/423882068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d64ce1c0 con 0x5568d64cd810 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/423882068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f459402ae30 tx=0x7f45940226b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9be8c2032cbee9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f44857fa640 1 -- 172.21.15.151:0/423882068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4594037560 con 0x5568d64cd810 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f44857fa640 1 -- 172.21.15.151:0/423882068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4594021a90 con 0x5568d64cd810 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f44857fa640 1 -- 172.21.15.151:0/423882068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459401cb60 con 0x5568d64cd810 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- 172.21.15.151:0/423882068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 msgr2=0x5568d64cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/423882068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f459402ae30 tx=0x7f45940226b0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- 172.21.15.151:0/423882068 shutdown_connections 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/423882068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64cdbf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- 172.21.15.151:0/423882068 >> 172.21.15.151:0/423882068 conn(0x5568d64c9bf0 msgr2=0x5568d64c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- 172.21.15.151:0/423882068 shutdown_connections 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- 172.21.15.151:0/423882068 wait complete. 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 Processor -- start 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- start start 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a3f3c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5568d64ce660 con 0x5568d64cd810 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64d4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55986/0 (socket says 172.21.15.151:55986) 2024-09-13T19:06:40.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.639+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 learned_addr learned my addr 172.21.15.151:0/1687514927 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568d64d4f50 con 0x5568d64cd810 2024-09-13T19:06:40.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64d4a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f459400c010 tx=0x7f4594029f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 -- 172.21.15.151:0/1687514927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459406a020 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 -- 172.21.15.151:0/1687514927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459402b8d0 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568d64d4f50 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 -- 172.21.15.151:0/1687514927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f459402bbd0 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568d64d53c0 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 -- 172.21.15.151:0/1687514927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f459406d020 con 0x5568d64cd810 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f446c034600 0x7f446c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f44737fe640 1 -- 172.21.15.151:0/1687514927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4594057040 con 0x5568d64cd810 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a124b640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f446c034600 0x7f446c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d64dfaa0 0x5568d64e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e26b0 con 0x5568d64dfaa0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a224d640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d64dfaa0 0x5568d64e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a124b640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f446c034600 0x7f446c036ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45980aa650 tx=0x7f45980a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a224d640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d64dfaa0 0x5568d64e1f60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 realm 2024-09-13T19:06:40.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e2ac0 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3360 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.643+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64e4460 0x5568d64e6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e6dd0 con 0x5568d64e4460 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64e4460 0x5568d64e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64e4460 0x5568d64e6850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 20 searching for the correct realm 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e8670 con 0x5568d64e4460 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f459407a040 0x7f459405e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e8670 con 0x7f459407a040 2024-09-13T19:06:40.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a124b640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f459407a040 0x7f459405e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a124b640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f459407a040 0x7f459405e1c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a124b640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4598009040 0x7f45980c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e8670 con 0x7f4598009040 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a224d640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4598009040 0x7f45980c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.647+0000 7f45a224d640 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4598009040 0x7f45980c1410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f459407a040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f459407a040 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.651+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f459407a040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.655+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f459407a040 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64e4460 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f4598009040 2024-09-13T19:06:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x5568d64dfaa0 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e3700 con 0x7f459407a040 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e7620 con 0x5568d64dfaa0 2024-09-13T19:06:40.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.659+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e7a10 con 0x5568d64dfaa0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e7a10 con 0x7f459407a040 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 zone default found 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 4 Realm: () 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:40.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 zonegroup default 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e8b40 con 0x7f4598009040 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ea520 con 0x5568d64e4460 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ea8c0 con 0x5568d64e4460 2024-09-13T19:06:40.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 started sync module instance, tier type = 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e99c0 con 0x7f459407a040 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908760436144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64e9620 con 0x7f459407a040 2024-09-13T19:06:40.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.663+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64eb730 con 0x5568d64dfaa0 2024-09-13T19:06:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.667+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908760436144] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.667+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.667+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908760441472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ebb50 con 0x5568d64dfaa0 2024-09-13T19:06:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.667+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ec3e0 con 0x5568d64e4460 2024-09-13T19:06:40.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908760444000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ecc80 con 0x5568d64e4460 2024-09-13T19:06:40.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ed680 con 0x7f459407a040 2024-09-13T19:06:40.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908760449424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ed5b0 con 0x7f459407a040 2024-09-13T19:06:40.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee580 con 0x5568d64dfaa0 2024-09-13T19:06:40.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908760449424] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.671+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908760441472] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.675+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908760444000] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.675+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.675+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908760442528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64eda70 con 0x5568d64dfaa0 2024-09-13T19:06:40.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.675+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee540 con 0x7f4598009040 2024-09-13T19:06:40.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908760453264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee4b0 con 0x7f4598009040 2024-09-13T19:06:40.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ef400 con 0x7f4598009040 2024-09-13T19:06:40.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908760442528] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908760446928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ef400 con 0x7f4598009040 2024-09-13T19:06:40.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.679+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64efe00 con 0x7f4598009040 2024-09-13T19:06:40.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.683+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908760453264] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908760446928] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908760459536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64eef50 con 0x7f4598009040 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=0 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=1 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=2 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=3 2024-09-13T19:06:40.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=4 2024-09-13T19:06:40.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=5 2024-09-13T19:06:40.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=6 2024-09-13T19:06:40.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908760459536] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 20 add_watcher() i=7 2024-09-13T19:06:40.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:40.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d64f2f00 con 0x5568d64dfaa0 2024-09-13T19:06:40.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.687+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908760455392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64f0380 con 0x5568d64dfaa0 2024-09-13T19:06:40.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908760455392] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f44537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 5 note: GC not initialized 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f44527fc640 20 reqs_thread_entry: start 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 Filter name: none 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f43c3fff640 20 reqs_thread_entry: start 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5568d6515e80 con 0x5568d64dfaa0 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:40.695 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:40.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f44537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.691+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908760455392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d6514dd0 con 0x5568d64dfaa0 2024-09-13T19:06:40.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93908760455392] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908760436144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee8e0 con 0x7f459407a040 2024-09-13T19:06:40.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93908760436144] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 20 remove_watcher() i=0 2024-09-13T19:06:40.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 2 removed watcher, disabling cache 2024-09-13T19:06:40.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908760441472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee8e0 con 0x5568d64dfaa0 2024-09-13T19:06:40.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93908760441472] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 20 remove_watcher() i=1 2024-09-13T19:06:40.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.695+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908760444000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64eb280 con 0x5568d64e4460 2024-09-13T19:06:40.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a1a4c640 1 -- 172.21.15.151:0/1687514927 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93908760444000] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4594029030 con 0x5568d64e4460 2024-09-13T19:06:40.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a3f3c980 20 remove_watcher() i=2 2024-09-13T19:06:40.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908760449424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee8e0 con 0x7f459407a040 2024-09-13T19:06:40.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a124b640 1 -- 172.21.15.151:0/1687514927 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93908760449424] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45980a8070 con 0x7f459407a040 2024-09-13T19:06:40.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a3f3c980 20 remove_watcher() i=3 2024-09-13T19:06:40.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.699+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908760442528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64eb280 con 0x5568d64dfaa0 2024-09-13T19:06:40.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93908760442528] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x5568d64dfaa0 2024-09-13T19:06:40.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a3f3c980 20 remove_watcher() i=4 2024-09-13T19:06:40.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908760453264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ed190 con 0x7f4598009040 2024-09-13T19:06:40.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93908760453264] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a3f3c980 20 remove_watcher() i=5 2024-09-13T19:06:40.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.703+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908760446928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee8e0 con 0x7f4598009040 2024-09-13T19:06:40.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.707+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93908760446928] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.707+0000 7f45a3f3c980 20 remove_watcher() i=6 2024-09-13T19:06:40.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.707+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908760459536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5568d64ee090 con 0x7f4598009040 2024-09-13T19:06:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93908760459536] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f459c00a4d0 con 0x7f4598009040 2024-09-13T19:06:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 20 remove_watcher() i=7 2024-09-13T19:06:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4598009040 msgr2=0x7f45980c1410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4598009040 0x7f45980c1410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d64dfaa0 msgr2=0x5568d64e1f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d64dfaa0 0x5568d64e1f60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f459407a040 msgr2=0x7f459405e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f459407a040 0x7f459405e1c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64e4460 msgr2=0x5568d64e6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64e4460 0x5568d64e6850 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f446c034600 msgr2=0x7f446c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f446c034600 0x7f446c036ac0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f45980aa650 tx=0x7f45980a8000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 msgr2=0x5568d64d4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1687514927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64cd810 0x5568d64d4a10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f459400c010 tx=0x7f4594029f30 comp rx=0 tx=0).stop 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a224d640 1 -- 172.21.15.151:0/1687514927 reap_dead start 2024-09-13T19:06:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 shutdown_connections 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 >> 172.21.15.151:0/1687514927 conn(0x5568d64c9bf0 msgr2=0x5568d64c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 shutdown_connections 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1687514927 wait complete. 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 msgr2=0x7f447c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 0x7f447c036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x5568d64aaf50 tx=0x7f4598005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 msgr2=0x5568d64c12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f459404a070 tx=0x7f459400c470 comp rx=0 tx=0).stop 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 shutdown_connections 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f447c034650 0x7f447c036b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/4130561720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d64c0e80 0x5568d64c12a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 >> 172.21.15.151:0/4130561720 conn(0x5568d64b5fd0 msgr2=0x5568d64b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 shutdown_connections 2024-09-13T19:06:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/4130561720 wait complete. 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d63af600 msgr2=0x5568d64aa000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5568d63af600 0x5568d64aa000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5568d64b08c0 msgr2=0x5568d64b2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5568d64b08c0 0x5568d64b2cb0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64ac9a0 msgr2=0x5568d64aed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5568d64ac9a0 0x5568d64aed90 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f44880346a0 msgr2=0x7f4488036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f44880346a0 0x7f4488036b60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45980ae000 tx=0x7f45980a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 msgr2=0x5568d64a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 --2- 172.21.15.151:0/1382309559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5568d63acb00 0x5568d64a3030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5568d649ce80 tx=0x7f4594000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a224d640 1 -- 172.21.15.151:0/1382309559 reap_dead start 2024-09-13T19:06:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 shutdown_connections 2024-09-13T19:06:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 >> 172.21.15.151:0/1382309559 conn(0x5568d63a87a0 msgr2=0x5568d6496450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 shutdown_connections 2024-09-13T19:06:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.711+0000 7f45a3f3c980 1 -- 172.21.15.151:0/1382309559 wait complete. 2024-09-13T19:06:40.725 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:40.726 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:06:40.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:06:40.726 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:06:40.805 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:40.806 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:40.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9c568980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564810a8bc60 0x564810a8e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9c568980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56481090dae0 con 0x564810a878e0 2024-09-13T19:06:40.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9c568980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x564810931e30 con 0x564810a8bc60 2024-09-13T19:06:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f99877640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564810a8bc60 0x564810a8e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9a078640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x564810a878e0 0x564810a87cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33384/0 (socket says 172.21.15.151:33384) 2024-09-13T19:06:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.803+0000 7f4f9a078640 1 -- 172.21.15.151:0/1147746375 learned_addr learned my addr 172.21.15.151:0/1147746375 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99877640 1 -- 172.21.15.151:0/1147746375 >> v1:172.21.15.12:6789/0 conn(0x564810a878e0 legacy=0x564810a87cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99877640 1 -- 172.21.15.151:0/1147746375 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810a8f5a0 con 0x564810a8bc60 2024-09-13T19:06:40.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99877640 1 --2- 172.21.15.151:0/1147746375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a8bc60 0x564810a8e050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a420 tx=0x7f4f8401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678b6e9e47ea8620 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99076640 1 -- 172.21.15.151:0/1147746375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f840af070 con 0x564810a8bc60 2024-09-13T19:06:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99076640 1 -- 172.21.15.151:0/1147746375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f840aa530 con 0x564810a8bc60 2024-09-13T19:06:40.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f99076640 1 -- 172.21.15.151:0/1147746375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f840aa850 con 0x564810a8bc60 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 -- 172.21.15.151:0/1147746375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a8bc60 msgr2=0x564810a8e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1147746375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a8bc60 0x564810a8e050 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400a420 tx=0x7f4f8401afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 -- 172.21.15.151:0/1147746375 shutdown_connections 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1147746375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a8bc60 0x564810a8e050 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 -- 172.21.15.151:0/1147746375 >> 172.21.15.151:0/1147746375 conn(0x5648109fb230 msgr2=0x5648109fb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 -- 172.21.15.151:0/1147746375 shutdown_connections 2024-09-13T19:06:40.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.807+0000 7f4f9c568980 1 -- 172.21.15.151:0/1147746375 wait complete. 2024-09-13T19:06:40.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.823+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.823+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.823+0000 7f4f9c568980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.823+0000 7f4f9c568980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564810933200 con 0x564810a878e0 2024-09-13T19:06:40.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55996/0 (socket says 172.21.15.151:55996) 2024-09-13T19:06:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 -- 172.21.15.151:0/2286679345 learned_addr learned my addr 172.21.15.151:0/2286679345 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 -- 172.21.15.151:0/2286679345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810b73210 con 0x564810a878e0 2024-09-13T19:06:40.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 --2- 172.21.15.151:0/2286679345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c001d90 tx=0x7f4f8c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96777692a069e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4e88608640 1 -- 172.21.15.151:0/2286679345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c013030 con 0x564810a878e0 2024-09-13T19:06:40.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4e88608640 1 -- 172.21.15.151:0/2286679345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00e690 con 0x564810a878e0 2024-09-13T19:06:40.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4e88608640 1 -- 172.21.15.151:0/2286679345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c00ea10 con 0x564810a878e0 2024-09-13T19:06:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- 172.21.15.151:0/2286679345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 msgr2=0x564810b72c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 --2- 172.21.15.151:0/2286679345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c001d90 tx=0x7f4f8c001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- 172.21.15.151:0/2286679345 shutdown_connections 2024-09-13T19:06:40.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 --2- 172.21.15.151:0/2286679345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b72c40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- 172.21.15.151:0/2286679345 >> 172.21.15.151:0/2286679345 conn(0x5648109fb230 msgr2=0x564810b6e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- 172.21.15.151:0/2286679345 shutdown_connections 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- 172.21.15.151:0/2286679345 wait complete. 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b79ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9c568980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564810a8f0a0 con 0x564810a878e0 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b79ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b79ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56006/0 (socket says 172.21.15.151:56006) 2024-09-13T19:06:40.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 -- 172.21.15.151:0/4227614860 learned_addr learned my addr 172.21.15.151:0/4227614860 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.827+0000 7f4f9a078640 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810b7a530 con 0x564810a878e0 2024-09-13T19:06:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a078640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b79ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564810b73e20 tx=0x7f4f8c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 -- 172.21.15.151:0/4227614860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c027070 con 0x564810a878e0 2024-09-13T19:06:40.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 -- 172.21.15.151:0/4227614860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c0198e0 con 0x564810a878e0 2024-09-13T19:06:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564810b7a7c0 con 0x564810a878e0 2024-09-13T19:06:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 -- 172.21.15.151:0/4227614860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c019c00 con 0x564810a878e0 2024-09-13T19:06:40.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564810b7d4a0 con 0x564810a878e0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 -- 172.21.15.151:0/4227614860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f8c02a070 con 0x564810a878e0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e80034650 0x7f4e80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4e86e05640 1 -- 172.21.15.151:0/4227614860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f8c01f070 con 0x564810a878e0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f99877640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e80034650 0x7f4e80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810a8bc60 0x564810b80fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810b81630 con 0x564810a8bc60 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a879640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810a8bc60 0x564810b80fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f99877640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e80034650 0x7f4e80036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f840ac000 tx=0x7f4f840a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a879640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810a8bc60 0x564810b80fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a879640 1 -- 172.21.15.151:0/4227614860 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810a8bc60 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810b7e6c0 con 0x564810a8bc60 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a879640 1 -- 172.21.15.151:0/4227614860 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f940083f0 con 0x564810a8bc60 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810b83960 0x564810b85d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810b86420 con 0x564810b83960 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.831+0000 7f4f9a078640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810b83960 0x564810b85d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810b83960 0x564810b85d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 -- 172.21.15.151:0/4227614860 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f8c029030 con 0x564810b83960 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810b827d0 con 0x564810a8bc60 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a879640 1 -- 172.21.15.151:0/4227614860 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f940083f0 con 0x564810a8bc60 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564810b87880 0x564810b89c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810b8a360 con 0x564810b87880 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f99877640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564810b87880 0x564810b89c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f99877640 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564810b87880 0x564810b89c70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f99877640 1 -- 172.21.15.151:0/4227614860 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f840b2040 con 0x564810b87880 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56481098c800 con 0x564810b97de0 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56014/0 (socket says 172.21.15.151:56014) 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 -- 172.21.15.151:0/252486174 learned_addr learned my addr 172.21.15.151:0/252486174 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 -- 172.21.15.151:0/252486174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810b98740 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9a078640 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c4e0 tx=0x7f4f8c00d7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4e7ffff640 1 -- 172.21.15.151:0/252486174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c0489c0 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564810b989d0 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.835+0000 7f4e7ffff640 1 -- 172.21.15.151:0/252486174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c048b60 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7ffff640 1 -- 172.21.15.151:0/252486174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c048e40 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564810b9b650 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7ffff640 1 -- 172.21.15.151:0/252486174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f8c016070 con 0x564810b97de0 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7ffff640 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 0x7f4e74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7ffff640 1 -- 172.21.15.151:0/252486174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f8c014070 con 0x564810b97de0 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f99877640 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 0x7f4e74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f99877640 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 0x7f4e74036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x564810b81f10 tx=0x7f4f84005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9c568980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9c568980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564810b73590 con 0x564810ba46b0 2024-09-13T19:06:40.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56016/0 (socket says 172.21.15.151:56016) 2024-09-13T19:06:40.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9a078640 1 -- 172.21.15.151:0/2837747789 learned_addr learned my addr 172.21.15.151:0/2837747789 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9a078640 1 -- 172.21.15.151:0/2837747789 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810ba5060 con 0x564810ba46b0 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4f9a078640 1 --2- 172.21.15.151:0/2837747789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c019620 tx=0x7f4f8c021370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e10e1d9547e37d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7dffb640 1 -- 172.21.15.151:0/2837747789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c041860 con 0x564810ba46b0 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7dffb640 1 -- 172.21.15.151:0/2837747789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c02a540 con 0x564810ba46b0 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.839+0000 7f4e7dffb640 1 -- 172.21.15.151:0/2837747789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c02a820 con 0x564810ba46b0 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/2837747789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 msgr2=0x564810ba4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 --2- 172.21.15.151:0/2837747789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c019620 tx=0x7f4f8c021370 comp rx=0 tx=0).stop 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/2837747789 shutdown_connections 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 --2- 172.21.15.151:0/2837747789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810ba4a90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/2837747789 >> 172.21.15.151:0/2837747789 conn(0x564810ba0a90 msgr2=0x564810b9eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/2837747789 shutdown_connections 2024-09-13T19:06:40.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/2837747789 wait complete. 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 Processor -- start 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- start start 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810bab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564810ba5500 con 0x564810ba46b0 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810bab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9a078640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810bab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56030/0 (socket says 172.21.15.151:56030) 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 learned_addr learned my addr 172.21.15.151:0/1942135956 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:40.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564810babd90 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9a078640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810bab850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c047300 tx=0x7f4f8c020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 -- 172.21.15.151:0/1942135956 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c0236b0 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564810babd90 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 -- 172.21.15.151:0/1942135956 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c023850 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 -- 172.21.15.151:0/1942135956 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f8c023b50 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564810babd90 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 -- 172.21.15.151:0/1942135956 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4f8c009070 con 0x564810ba46b0 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e64034650 0x7f4e64036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4e6bfff640 1 -- 172.21.15.151:0/1942135956 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4f8c005050 con 0x564810ba46b0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.843+0000 7f4f99877640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e64034650 0x7f4e64036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810bb6980 0x564810bb8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bb9590 con 0x564810bb6980 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810bb6980 0x564810bb8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e64034650 0x7f4e64036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f840abe40 tx=0x7f4f840a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810bb6980 0x564810bb8e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 realm 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bb99a0 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bba270 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810bbb370 0x564810bbd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bbddb0 con 0x564810bbb370 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810bbb370 0x564810bbd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810bbb370 0x564810bbd760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 20 searching for the correct realm 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bbf610 con 0x564810bbb370 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f8c065040 0x7f4f8c05a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bbf610 con 0x7f4f8c065040 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f8c065040 0x7f4f8c05a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f8c065040 0x7f4f8c05a860 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f840dc040 0x7f4f840ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.847+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bbf610 con 0x7f4f840dc040 2024-09-13T19:06:40.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f840dc040 0x7f4f840ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f840dc040 0x7f4f840ce430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f8c065040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.851+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f8c065040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.855+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f8c065040 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f8c065040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bbb370 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.859+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x564810bb6980 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564810bba610 con 0x7f4f8c065040 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bbe730 con 0x564810bb6980 2024-09-13T19:06:40.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bbef80 con 0x564810bb6980 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bbead0 con 0x7f4f8c065040 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 zone default found 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 4 Realm: () 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:40.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 zonegroup default 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bbfa40 con 0x7f4f840dc040 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bc1480 con 0x564810bbb370 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bc1970 con 0x564810bbb370 2024-09-13T19:06:40.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:40.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 started sync module instance, tier type = 2024-09-13T19:06:40.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.863+0000 7f4f9c568980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:40.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc08c0 con 0x7f4f8c065040 2024-09-13T19:06:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94867518393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc0520 con 0x7f4f8c065040 2024-09-13T19:06:40.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc28a0 con 0x564810bb6980 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94867518393520] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94867518399472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc2cc0 con 0x564810bb6980 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.867+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc3590 con 0x564810bbb370 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94867518402032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc3e30 con 0x564810bbb370 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc4850 con 0x7f4f8c065040 2024-09-13T19:06:40.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94867518399472] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94867518407488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc4c40 con 0x7f4f8c065040 2024-09-13T19:06:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.871+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc5600 con 0x564810bb6980 2024-09-13T19:06:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94867518407488] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94867518402032] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94867518404992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc5150 con 0x564810bb6980 2024-09-13T19:06:40.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc5ea0 con 0x7f4f840dc040 2024-09-13T19:06:40.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94867518404992] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94867518400528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc5b90 con 0x7f4f840dc040 2024-09-13T19:06:40.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.875+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc63e0 con 0x7f4f840dc040 2024-09-13T19:06:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.879+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.879+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94867518413984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc6750 con 0x7f4f840dc040 2024-09-13T19:06:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.879+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc7270 con 0x7f4f840dc040 2024-09-13T19:06:40.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.879+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94867518400528] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94867518413984] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94867518418240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc61a0 con 0x7f4f840dc040 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=0 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=1 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=2 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=3 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=4 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=5 2024-09-13T19:06:40.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=6 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94867518418240] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 20 add_watcher() i=7 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bca260 con 0x564810bb6980 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.883+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94867518412512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc76e0 con 0x564810bb6980 2024-09-13T19:06:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94867518412512] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:40.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 5 note: GC not initialized 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4dcb7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 Filter name: none 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4dc97fa640 20 reqs_thread_entry: start 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 rados->read ofs=0 len=0 2024-09-13T19:06:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bed7b0 con 0x564810bb6980 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bf0240 con 0x7f4f8c065040 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bf3a70 con 0x564810bb6980 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.887+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94867518600416 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564810bef230 con 0x564810bb6980 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94867518404992 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f4f9403b040 con 0x564810bb6980 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4e7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94867518404992 notifier 4309 bl.length()=567 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4e7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4e7dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify cookie 94867518600416 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4e7dffb640 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4e60003eb0 con 0x564810bb6980 2024-09-13T19:06:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify_complete (2) cookie 94867518600416 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4f94010040 con 0x564810bb6980 2024-09-13T19:06:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.894 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4e50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94867518412512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810beb5e0 con 0x564810bb6980 2024-09-13T19:06:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94867518412512] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.891+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94867518393520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810beb5e0 con 0x7f4f8c065040 2024-09-13T19:06:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94867518393520] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9c568980 20 remove_watcher() i=0 2024-09-13T19:06:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9c568980 2 removed watcher, disabling cache 2024-09-13T19:06:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94867518399472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc0cb0 con 0x564810bb6980 2024-09-13T19:06:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94867518399472] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9c568980 20 remove_watcher() i=1 2024-09-13T19:06:40.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.895+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94867518402032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810beb5e0 con 0x564810bbb370 2024-09-13T19:06:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9a078640 1 -- 172.21.15.151:0/1942135956 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94867518402032] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f8c074020 con 0x564810bbb370 2024-09-13T19:06:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 20 remove_watcher() i=2 2024-09-13T19:06:40.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94867518407488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc23f0 con 0x7f4f8c065040 2024-09-13T19:06:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f99877640 1 -- 172.21.15.151:0/1942135956 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94867518407488] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f840c9030 con 0x7f4f8c065040 2024-09-13T19:06:40.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 20 remove_watcher() i=3 2024-09-13T19:06:40.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94867518404992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc0cb0 con 0x564810bb6980 2024-09-13T19:06:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94867518404992] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x564810bb6980 2024-09-13T19:06:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 20 remove_watcher() i=4 2024-09-13T19:06:40.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.899+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94867518400528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810beb5e0 con 0x7f4f840dc040 2024-09-13T19:06:40.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94867518400528] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9c568980 20 remove_watcher() i=5 2024-09-13T19:06:40.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94867518413984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc4340 con 0x7f4f840dc040 2024-09-13T19:06:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94867518413984] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9c568980 20 remove_watcher() i=6 2024-09-13T19:06:40.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.903+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94867518418240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564810bc0cb0 con 0x7f4f840dc040 2024-09-13T19:06:40.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94867518418240] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f940083f0 con 0x7f4f840dc040 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 20 remove_watcher() i=7 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f840dc040 msgr2=0x7f4f840ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4f840dc040 0x7f4f840ce430 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810bb6980 msgr2=0x564810bb8e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810bb6980 0x564810bb8e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f8c065040 msgr2=0x7f4f8c05a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4f8c065040 0x7f4f8c05a860 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810bbb370 msgr2=0x564810bbd760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810bbb370 0x564810bbd760 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e64034650 msgr2=0x7f4e64036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e64034650 0x7f4e64036b10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4f840abe40 tx=0x7f4f840a7000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 msgr2=0x564810bab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/1942135956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810ba46b0 0x564810bab850 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c047300 tx=0x7f4f8c020f60 comp rx=0 tx=0).stop 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 reap_dead start 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9a879640 1 -- 172.21.15.151:0/1942135956 reap_dead start 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 shutdown_connections 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 >> 172.21.15.151:0/1942135956 conn(0x564810ba0a90 msgr2=0x564810b9eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 shutdown_connections 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/1942135956 wait complete. 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 msgr2=0x7f4e74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 0x7f4e74036b10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x564810b81f10 tx=0x7f4f84005d90 comp rx=0 tx=0).stop 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 msgr2=0x564810b98200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00c4e0 tx=0x7f4f8c00d7b0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 shutdown_connections 2024-09-13T19:06:40.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e74034650 0x7f4e74036b10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/252486174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810b97de0 0x564810b98200 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 >> 172.21.15.151:0/252486174 conn(0x564810b8cf60 msgr2=0x564810b8f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 shutdown_connections 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/252486174 wait complete. 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810a8bc60 msgr2=0x564810b80fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564810a8bc60 0x564810b80fc0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564810b87880 msgr2=0x564810b89c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564810b87880 0x564810b89c70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810b83960 msgr2=0x564810b85d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564810b83960 0x564810b85d50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e80034650 msgr2=0x7f4e80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4e80034650 0x7f4e80036b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f840ac000 tx=0x7f4f840a5000 comp rx=0 tx=0).stop 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 msgr2=0x564810b79ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:40.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9c568980 1 --2- 172.21.15.151:0/4227614860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564810a878e0 0x564810b79ff0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x564810b73e20 tx=0x7f4f8c000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.907+0000 7f4f9a879640 1 -- 172.21.15.151:0/4227614860 reap_dead start 2024-09-13T19:06:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.911+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 shutdown_connections 2024-09-13T19:06:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.911+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 >> 172.21.15.151:0/4227614860 conn(0x5648109fb230 msgr2=0x564810b6d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.911+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 shutdown_connections 2024-09-13T19:06:40.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.911+0000 7f4f9c568980 1 -- 172.21.15.151:0/4227614860 wait complete. 2024-09-13T19:06:40.923 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:40.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:40.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:40.924 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:41.000 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.000 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcdb03980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5572b7986a90 0x5572b7988e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcdb03980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5572b780aae0 con 0x5572b78f6ac0 2024-09-13T19:06:41.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcdb03980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5572b782ee30 con 0x5572b7986a90 2024-09-13T19:06:41.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcae12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5572b7986a90 0x5572b7988e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcae12640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5572b7986a90 0x5572b7988e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56034/0 (socket says 172.21.15.151:56034) 2024-09-13T19:06:41.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcae12640 1 -- 172.21.15.151:0/775962555 learned_addr learned my addr 172.21.15.151:0/775962555 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcae12640 1 -- 172.21.15.151:0/775962555 >> v1:172.21.15.12:6789/0 conn(0x5572b78f6ac0 legacy=0x5572b7985370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:40.999+0000 7f9fcae12640 1 -- 172.21.15.151:0/775962555 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b798a3d0 con 0x5572b7986a90 2024-09-13T19:06:41.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcae12640 1 --2- 172.21.15.151:0/775962555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7986a90 0x5572b7988e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000a5c0 tx=0x7f9fc001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc596332af9c9422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fca611640 1 -- 172.21.15.151:0/775962555 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00a6070 con 0x5572b7986a90 2024-09-13T19:06:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fca611640 1 -- 172.21.15.151:0/775962555 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fc00af070 con 0x5572b7986a90 2024-09-13T19:06:41.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fca611640 1 -- 172.21.15.151:0/775962555 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00aa5c0 con 0x5572b7986a90 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 -- 172.21.15.151:0/775962555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7986a90 msgr2=0x5572b7988e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/775962555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7986a90 0x5572b7988e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000a5c0 tx=0x7f9fc001b340 comp rx=0 tx=0).stop 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 -- 172.21.15.151:0/775962555 shutdown_connections 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/775962555 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7986a90 0x5572b7988e80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 -- 172.21.15.151:0/775962555 >> 172.21.15.151:0/775962555 conn(0x5572b797d060 msgr2=0x5572b797f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 -- 172.21.15.151:0/775962555 shutdown_connections 2024-09-13T19:06:41.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.003+0000 7f9fcdb03980 1 -- 172.21.15.151:0/775962555 wait complete. 2024-09-13T19:06:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcdb03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcdb03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572b7830200 con 0x5572b78f6ac0 2024-09-13T19:06:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56046/0 (socket says 172.21.15.151:56046) 2024-09-13T19:06:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcb613640 1 -- 172.21.15.151:0/199327148 learned_addr learned my addr 172.21.15.151:0/199327148 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcb613640 1 -- 172.21.15.151:0/199327148 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b7a6e030 con 0x5572b78f6ac0 2024-09-13T19:06:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9fcb613640 1 --2- 172.21.15.151:0/199327148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00b1f0 tx=0x7f9fbc00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a677d9aa7309e2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9eb960a640 1 -- 172.21.15.151:0/199327148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc00a040 con 0x5572b78f6ac0 2024-09-13T19:06:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9eb960a640 1 -- 172.21.15.151:0/199327148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc00f750 con 0x5572b78f6ac0 2024-09-13T19:06:41.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.019+0000 7f9eb960a640 1 -- 172.21.15.151:0/199327148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc00fa70 con 0x5572b78f6ac0 2024-09-13T19:06:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/199327148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 msgr2=0x5572b7a6da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/199327148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00b1f0 tx=0x7f9fbc00b6b0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/199327148 shutdown_connections 2024-09-13T19:06:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/199327148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a6da60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/199327148 >> 172.21.15.151:0/199327148 conn(0x5572b797d060 msgr2=0x5572b7a69690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/199327148 shutdown_connections 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/199327148 wait complete. 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a74e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572b7989e10 con 0x5572b78f6ac0 2024-09-13T19:06:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a74e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a74e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56054/0 (socket says 172.21.15.151:56054) 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcb613640 1 -- 172.21.15.151:0/281646241 learned_addr learned my addr 172.21.15.151:0/281646241 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcb613640 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b7a75350 con 0x5572b78f6ac0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcb613640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a74e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00b6f0 tx=0x7f9fbc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9eb7e07640 1 -- 172.21.15.151:0/281646241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc001300 con 0x5572b78f6ac0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b7a755e0 con 0x5572b78f6ac0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9eb7e07640 1 -- 172.21.15.151:0/281646241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc01c9c0 con 0x5572b78f6ac0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9eb7e07640 1 -- 172.21.15.151:0/281646241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc01cca0 con 0x5572b78f6ac0 2024-09-13T19:06:41.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.023+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b7a782c0 con 0x5572b78f6ac0 2024-09-13T19:06:41.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9eb7e07640 1 -- 172.21.15.151:0/281646241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fbc017050 con 0x5572b78f6ac0 2024-09-13T19:06:41.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9eb7e07640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9eb0034650 0x7f9eb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9eb7e07640 1 -- 172.21.15.151:0/281646241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9fbc015020 con 0x5572b78f6ac0 2024-09-13T19:06:41.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcae12640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9eb0034650 0x7f9eb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7986a90 0x5572b7a7bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7a7c450 con 0x5572b7986a90 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7986a90 0x5572b7a7bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcae12640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9eb0034650 0x7f9eb0036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ae000 tx=0x7f9fc00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7986a90 0x5572b7a7bf10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcbe14640 1 -- 172.21.15.151:0/281646241 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7986a90 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7a794e0 con 0x5572b7986a90 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcbe14640 1 -- 172.21.15.151:0/281646241 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7986a90 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7a7e7a0 0x5572b7a80b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7a81280 con 0x5572b7a7e7a0 2024-09-13T19:06:41.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcb613640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7a7e7a0 0x5572b7a80b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcb613640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7a7e7a0 0x5572b7a80b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcb613640 1 -- 172.21.15.151:0/281646241 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7a7e7a0 2024-09-13T19:06:41.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7a7d640 con 0x5572b7986a90 2024-09-13T19:06:41.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcbe14640 1 -- 172.21.15.151:0/281646241 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7986a90 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5572b7a826e0 0x5572b7a84ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7a85210 con 0x5572b7a826e0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcae12640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5572b7a826e0 0x5572b7a84ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.027+0000 7f9fcae12640 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5572b7a826e0 0x5572b7a84ad0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcae12640 1 -- 172.21.15.151:0/281646241 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9fc00aaad0 con 0x5572b7a826e0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572b7889800 con 0x5572b7a92ce0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56064/0 (socket says 172.21.15.151:56064) 2024-09-13T19:06:41.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcb613640 1 -- 172.21.15.151:0/4123640324 learned_addr learned my addr 172.21.15.151:0/4123640324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcb613640 1 -- 172.21.15.151:0/4123640324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b7a93640 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcb613640 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc01ced0 tx=0x7f9fbc02fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9eb5602640 1 -- 172.21.15.151:0/4123640324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc02f850 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b7a938d0 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b7a96550 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9eb5602640 1 -- 172.21.15.151:0/4123640324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc018980 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.031+0000 7f9eb5602640 1 -- 172.21.15.151:0/4123640324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc018c60 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eb5602640 1 -- 172.21.15.151:0/4123640324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fbc03a070 con 0x5572b7a92ce0 2024-09-13T19:06:41.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eb5602640 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 0x7f9ea4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eb5602640 1 -- 172.21.15.151:0/4123640324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9fbc0324f0 con 0x5572b7a92ce0 2024-09-13T19:06:41.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcae12640 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 0x7f9ea4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcae12640 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 0x7f9ea4036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5572b7a7c920 tx=0x7f9fc0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572b7a6e3b0 con 0x5572b7a9f620 2024-09-13T19:06:41.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56068/0 (socket says 172.21.15.151:56068) 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 -- 172.21.15.151:0/1165581230 learned_addr learned my addr 172.21.15.151:0/1165581230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 -- 172.21.15.151:0/1165581230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b7a9fff0 con 0x5572b7a9f620 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 --2- 172.21.15.151:0/1165581230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc042cf0 tx=0x7f9fbc04a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cd8bbba9ee08d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eaeffd640 1 -- 172.21.15.151:0/1165581230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc013e50 con 0x5572b7a9f620 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eaeffd640 1 -- 172.21.15.151:0/1165581230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc05a070 con 0x5572b7a9f620 2024-09-13T19:06:41.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9eaeffd640 1 -- 172.21.15.151:0/1165581230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc04bde0 con 0x5572b7a9f620 2024-09-13T19:06:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- 172.21.15.151:0/1165581230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 msgr2=0x5572b7a9fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/1165581230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc042cf0 tx=0x7f9fbc04a620 comp rx=0 tx=0).stop 2024-09-13T19:06:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- 172.21.15.151:0/1165581230 shutdown_connections 2024-09-13T19:06:41.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/1165581230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7a9fa20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- 172.21.15.151:0/1165581230 >> 172.21.15.151:0/1165581230 conn(0x5572b7a9ba00 msgr2=0x5572b7a99b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- 172.21.15.151:0/1165581230 shutdown_connections 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- 172.21.15.151:0/1165581230 wait complete. 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 Processor -- start 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- start start 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcdb03980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5572b7aa0470 con 0x5572b7a9f620 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56072/0 (socket says 172.21.15.151:56072) 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.035+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 learned_addr learned my addr 172.21.15.151:0/3327302311 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b7981390 con 0x5572b7a9f620 2024-09-13T19:06:41.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcb613640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0184b0 tx=0x7f9fbc032190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 -- 172.21.15.151:0/3327302311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc04acb0 con 0x5572b7a9f620 2024-09-13T19:06:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 -- 172.21.15.151:0/3327302311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc013130 con 0x5572b7a9f620 2024-09-13T19:06:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5572b7981390 con 0x5572b7a9f620 2024-09-13T19:06:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 -- 172.21.15.151:0/3327302311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9fbc01a7b0 con 0x5572b7a9f620 2024-09-13T19:06:41.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b7981390 con 0x5572b7a9f620 2024-09-13T19:06:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 -- 172.21.15.151:0/3327302311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9fbc06f020 con 0x5572b7a9f620 2024-09-13T19:06:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e94034650 0x7f9e94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9ead7fa640 1 -- 172.21.15.151:0/3327302311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9fbc06d020 con 0x5572b7a9f620 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcae12640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e94034650 0x7f9e94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7ab3a80 0x5572b7ab5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab6690 con 0x5572b7ab3a80 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7ab3a80 0x5572b7ab5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcae12640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e94034650 0x7f9e94036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c10 tx=0x7f9fc00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7ab3a80 0x5572b7ab5f40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 realm 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab6aa0 con 0x5572b7ab3a80 2024-09-13T19:06:41.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.039+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab7340 con 0x5572b7ab3a80 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7ab8440 0x5572b7aba830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abadb0 con 0x5572b7ab8440 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7ab8440 0x5572b7aba830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7ab8440 0x5572b7aba830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 20 searching for the correct realm 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abc650 con 0x5572b7ab8440 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9fbc019b20 0x7f9fbc00e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abc650 con 0x7f9fbc019b20 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcae12640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9fbc019b20 0x7f9fbc00e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcae12640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9fbc019b20 0x7f9fbc00e940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcae12640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9fc00e0040 0x7f9fc00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abc650 con 0x7f9fc00e0040 2024-09-13T19:06:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9fc00e0040 0x7f9fc00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.043+0000 7f9fcbe14640 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9fc00e0040 0x7f9fc00e0420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.047+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.051+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab8440 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.055+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ab76e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:41.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abb600 con 0x5572b7ab3a80 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abb9f0 con 0x5572b7ab3a80 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abb9f0 con 0x7f9fbc019b20 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:41.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 zone default found 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 4 Realm: () 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 zonegroup default 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abcb20 con 0x7f9fc00e0040 2024-09-13T19:06:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abe500 con 0x5572b7ab8440 2024-09-13T19:06:41.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abe8a0 con 0x5572b7ab8440 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 started sync module instance, tier type = 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abd9a0 con 0x7f9fbc019b20 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93951196126656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abd600 con 0x7f9fbc019b20 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.059+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abf370 con 0x5572b7ab3a80 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.063+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93951196126656] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.063+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.063+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93951196131008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abf790 con 0x5572b7ab3a80 2024-09-13T19:06:41.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.063+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0150 con 0x5572b7ab8440 2024-09-13T19:06:41.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93951196131008] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93951196132336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0150 con 0x5572b7ab8440 2024-09-13T19:06:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0b10 con 0x7f9fbc019b20 2024-09-13T19:06:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93951196137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac1360 con 0x7f9fbc019b20 2024-09-13T19:06:41.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac1d60 con 0x5572b7ab3a80 2024-09-13T19:06:41.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93951196132336] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.067+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93951196137056] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93951196134560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0eb0 con 0x5572b7ab3a80 2024-09-13T19:06:41.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac2600 con 0x7f9fc00e0040 2024-09-13T19:06:41.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93951196134560] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93951196143488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0eb0 con 0x7f9fc00e0040 2024-09-13T19:06:41.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.071+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac1890 con 0x7f9fc00e0040 2024-09-13T19:06:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93951196146336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0eb0 con 0x7f9fc00e0040 2024-09-13T19:06:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac3990 con 0x7f9fc00e0040 2024-09-13T19:06:41.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93951196143488] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93951196146336] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93951196147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=0 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=1 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=2 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=3 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=4 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=5 2024-09-13T19:06:41.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.075+0000 7f9fcdb03980 20 add_watcher() i=6 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93951196147392] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 20 add_watcher() i=7 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac69c0 con 0x5572b7ab3a80 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93951196148960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac3db0 con 0x5572b7ab3a80 2024-09-13T19:06:41.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93951196148960] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:41.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.079+0000 7f9fcdb03980 5 note: GC not initialized 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9e80fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 20 Filter name: none 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9dfa7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ae99c0 con 0x5572b7ab3a80 2024-09-13T19:06:41.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:41.086 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:41.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93951196148960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ae8910 con 0x5572b7ab3a80 2024-09-13T19:06:41.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93951196148960] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.083+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93951196126656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x7f9fbc019b20 2024-09-13T19:06:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93951196126656] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcdb03980 20 remove_watcher() i=0 2024-09-13T19:06:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcdb03980 2 removed watcher, disabling cache 2024-09-13T19:06:41.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93951196131008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93951196131008] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcdb03980 20 remove_watcher() i=1 2024-09-13T19:06:41.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.087+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93951196132336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x5572b7ab8440 2024-09-13T19:06:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcb613640 1 -- 172.21.15.151:0/3327302311 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93951196132336] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fbc02e070 con 0x5572b7ab8440 2024-09-13T19:06:41.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcdb03980 20 remove_watcher() i=2 2024-09-13T19:06:41.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93951196137056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abf3f0 con 0x7f9fbc019b20 2024-09-13T19:06:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcae12640 1 -- 172.21.15.151:0/3327302311 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93951196137056] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc00aaad0 con 0x7f9fbc019b20 2024-09-13T19:06:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcdb03980 20 remove_watcher() i=3 2024-09-13T19:06:41.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.091+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93951196134560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x5572b7ab3a80 2024-09-13T19:06:41.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93951196134560] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x5572b7ab3a80 2024-09-13T19:06:41.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcdb03980 20 remove_watcher() i=4 2024-09-13T19:06:41.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93951196143488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac0660 con 0x7f9fc00e0040 2024-09-13T19:06:41.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93951196143488] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcdb03980 20 remove_watcher() i=5 2024-09-13T19:06:41.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.095+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93951196146336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7abf3f0 con 0x7f9fc00e0040 2024-09-13T19:06:41.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.099+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93951196146336] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.099+0000 7f9fcdb03980 20 remove_watcher() i=6 2024-09-13T19:06:41.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.099+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93951196147392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5572b7ac34e0 con 0x7f9fc00e0040 2024-09-13T19:06:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93951196147392] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9fc400a4d0 con 0x7f9fc00e0040 2024-09-13T19:06:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 20 remove_watcher() i=7 2024-09-13T19:06:41.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9fc00e0040 msgr2=0x7f9fc00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9fc00e0040 0x7f9fc00e0420 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7ab3a80 msgr2=0x5572b7ab5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7ab3a80 0x5572b7ab5f40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9fbc019b20 msgr2=0x7f9fbc00e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9fbc019b20 0x7f9fbc00e940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7ab8440 msgr2=0x5572b7aba830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7ab8440 0x5572b7aba830 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e94034650 msgr2=0x7f9e94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e94034650 0x7f9e94036b10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c10 tx=0x7f9fc00c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 msgr2=0x5572b7982c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcbe14640 1 -- 172.21.15.151:0/3327302311 reap_dead start 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc0184b0 tx=0x7f9fbc032190 comp rx=0 tx=0).stop 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 shutdown_connections 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/3327302311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a9f620 0x5572b7982c70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 >> 172.21.15.151:0/3327302311 conn(0x5572b7a9ba00 msgr2=0x5572b7a99ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 shutdown_connections 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/3327302311 wait complete. 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 msgr2=0x7f9ea4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 0x7f9ea4036b10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x5572b7a7c920 tx=0x7f9fc0005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 msgr2=0x5572b7a93100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc01ced0 tx=0x7f9fbc02fe70 comp rx=0 tx=0).stop 2024-09-13T19:06:41.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 shutdown_connections 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ea4034650 0x7f9ea4036b10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/4123640324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b7a92ce0 0x5572b7a93100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 >> 172.21.15.151:0/4123640324 conn(0x5572b7a87e30 msgr2=0x5572b7a8a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 shutdown_connections 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/4123640324 wait complete. 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7986a90 msgr2=0x5572b7a7bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5572b7986a90 0x5572b7a7bf10 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5572b7a826e0 msgr2=0x5572b7a84ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5572b7a826e0 0x5572b7a84ad0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7a7e7a0 msgr2=0x5572b7a80b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5572b7a7e7a0 0x5572b7a80b90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9eb0034650 msgr2=0x7f9eb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9eb0034650 0x7f9eb0036b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ae000 tx=0x7f9fc00a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 msgr2=0x5572b7a74e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 --2- 172.21.15.151:0/281646241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5572b78f6ac0 0x5572b7a74e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00b6f0 tx=0x7f9fbc000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcbe14640 1 -- 172.21.15.151:0/281646241 reap_dead start 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 shutdown_connections 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 >> 172.21.15.151:0/281646241 conn(0x5572b797d060 msgr2=0x5572b7a68210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 shutdown_connections 2024-09-13T19:06:41.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.103+0000 7f9fcdb03980 1 -- 172.21.15.151:0/281646241 wait complete. 2024-09-13T19:06:41.118 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:41.118 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:06:41.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:06:41.118 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:06:41.199 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.199 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1715216980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5574aeb80c60 0x5574aeb83050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1715216980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5574aea02ae0 con 0x5574aeb7c8e0 2024-09-13T19:06:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1715216980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5574aea26e30 con 0x5574aeb80c60 2024-09-13T19:06:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5574aeb80c60 0x5574aeb83050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5574aeb80c60 0x5574aeb83050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56082/0 (socket says 172.21.15.151:56082) 2024-09-13T19:06:41.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 -- 172.21.15.151:0/454402347 learned_addr learned my addr 172.21.15.151:0/454402347 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 -- 172.21.15.151:0/454402347 >> v1:172.21.15.12:6789/0 conn(0x5574aeb7c8e0 legacy=0x5574aeb7ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 -- 172.21.15.151:0/454402347 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aeb845a0 con 0x5574aeb80c60 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.199+0000 7f1712525640 1 --2- 172.21.15.151:0/454402347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb80c60 0x5574aeb83050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f170800a5c0 tx=0x7f170801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec3d38cd9e02538 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1711d24640 1 -- 172.21.15.151:0/454402347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080a6070 con 0x5574aeb80c60 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1711d24640 1 -- 172.21.15.151:0/454402347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17080af070 con 0x5574aeb80c60 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1711d24640 1 -- 172.21.15.151:0/454402347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17080aa5c0 con 0x5574aeb80c60 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 -- 172.21.15.151:0/454402347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb80c60 msgr2=0x5574aeb83050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 --2- 172.21.15.151:0/454402347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb80c60 0x5574aeb83050 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f170800a5c0 tx=0x7f170801b340 comp rx=0 tx=0).stop 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 -- 172.21.15.151:0/454402347 shutdown_connections 2024-09-13T19:06:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 --2- 172.21.15.151:0/454402347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb80c60 0x5574aeb83050 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 -- 172.21.15.151:0/454402347 >> 172.21.15.151:0/454402347 conn(0x5574aeaf0230 msgr2=0x5574aeaf0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 -- 172.21.15.151:0/454402347 shutdown_connections 2024-09-13T19:06:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.203+0000 7f1715216980 1 -- 172.21.15.151:0/454402347 wait complete. 2024-09-13T19:06:41.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574aea28200 con 0x5574aeb7c8e0 2024-09-13T19:06:41.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56094/0 (socket says 172.21.15.151:56094) 2024-09-13T19:06:41.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1712d26640 1 -- 172.21.15.151:0/2266688251 learned_addr learned my addr 172.21.15.151:0/2266688251 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1712d26640 1 -- 172.21.15.151:0/2266688251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aec68370 con 0x5574aeb7c8e0 2024-09-13T19:06:41.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1712d26640 1 --2- 172.21.15.151:0/2266688251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f170c001ea0 tx=0x7f170c00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df6ae79e4973da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1600e09640 1 -- 172.21.15.151:0/2266688251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c00a040 con 0x5574aeb7c8e0 2024-09-13T19:06:41.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1600e09640 1 -- 172.21.15.151:0/2266688251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c00f620 con 0x5574aeb7c8e0 2024-09-13T19:06:41.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1600e09640 1 -- 172.21.15.151:0/2266688251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c00f890 con 0x5574aeb7c8e0 2024-09-13T19:06:41.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- 172.21.15.151:0/2266688251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 msgr2=0x5574aec67da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 --2- 172.21.15.151:0/2266688251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f170c001ea0 tx=0x7f170c00b680 comp rx=0 tx=0).stop 2024-09-13T19:06:41.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- 172.21.15.151:0/2266688251 shutdown_connections 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 --2- 172.21.15.151:0/2266688251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec67da0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- 172.21.15.151:0/2266688251 >> 172.21.15.151:0/2266688251 conn(0x5574aeaf0230 msgr2=0x5574aec63930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- 172.21.15.151:0/2266688251 shutdown_connections 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- 172.21.15.151:0/2266688251 wait complete. 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec6f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.219+0000 7f1715216980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574aeb840a0 con 0x5574aeb7c8e0 2024-09-13T19:06:41.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec6f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec6f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56104/0 (socket says 172.21.15.151:56104) 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712d26640 1 -- 172.21.15.151:0/2030951278 learned_addr learned my addr 172.21.15.151:0/2030951278 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712d26640 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aec6f670 con 0x5574aeb7c8e0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712d26640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec6f130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f170c001fd0 tx=0x7f170c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 -- 172.21.15.151:0/2030951278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c001520 con 0x5574aeb7c8e0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 -- 172.21.15.151:0/2030951278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c01c9c0 con 0x5574aeb7c8e0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574aec6f900 con 0x5574aeb7c8e0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 -- 172.21.15.151:0/2030951278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c01cd00 con 0x5574aeb7c8e0 2024-09-13T19:06:41.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574aec725e0 con 0x5574aeb7c8e0 2024-09-13T19:06:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 -- 172.21.15.151:0/2030951278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f170c017050 con 0x5574aeb7c8e0 2024-09-13T19:06:41.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15f8034650 0x7f15f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f15ff606640 1 -- 172.21.15.151:0/2030951278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f170c015020 con 0x5574aeb7c8e0 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712525640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15f8034650 0x7f15f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aec74220 0x5574aec76610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aec76b50 con 0x5574aec74220 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1713527640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aec74220 0x5574aec76610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1712525640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15f8034650 0x7f15f8036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17080ae000 tx=0x7f17080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.223+0000 7f1713527640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aec74220 0x5574aec76610 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1713527640 1 -- 172.21.15.151:0/2030951278 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aec74220 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aec73800 con 0x5574aec74220 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1713527640 1 -- 172.21.15.151:0/2030951278 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aec74220 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aec78ed0 0x5574aec7b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aec7b990 con 0x5574aec78ed0 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aec78ed0 0x5574aec7b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aec78ed0 0x5574aec7b2c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 -- 172.21.15.151:0/2030951278 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f170c02e070 con 0x5574aec78ed0 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aec77d70 con 0x5574aec74220 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1713527640 1 -- 172.21.15.151:0/2030951278 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aec74220 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5574aec7cdd0 0x5574aec7f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aec7f950 con 0x5574aec7cdd0 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712525640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5574aec7cdd0 0x5574aec7f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712525640 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5574aec7cdd0 0x5574aec7f1c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712525640 1 -- 172.21.15.151:0/2030951278 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f17080aaa90 con 0x5574aec7cdd0 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1715216980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574aea81800 con 0x5574aec8d3a0 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56106/0 (socket says 172.21.15.151:56106) 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.227+0000 7f1712d26640 1 -- 172.21.15.151:0/948167004 learned_addr learned my addr 172.21.15.151:0/948167004 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 -- 172.21.15.151:0/948167004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aec8dd00 con 0x5574aec8d3a0 2024-09-13T19:06:41.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f170c01dfd0 tx=0x7f170c018e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 -- 172.21.15.151:0/948167004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c02f690 con 0x5574aec8d3a0 2024-09-13T19:06:41.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 -- 172.21.15.151:0/948167004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c02f850 con 0x5574aec8d3a0 2024-09-13T19:06:41.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574aec8df90 con 0x5574aec8d3a0 2024-09-13T19:06:41.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 -- 172.21.15.151:0/948167004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c0132a0 con 0x5574aec8d3a0 2024-09-13T19:06:41.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574aec8df90 con 0x5574aec8d3a0 2024-09-13T19:06:41.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 -- 172.21.15.151:0/948167004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f170c04b070 con 0x5574aec8d3a0 2024-09-13T19:06:41.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 0x7f15ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f15fce01640 1 -- 172.21.15.151:0/948167004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f170c03fcc0 con 0x5574aec8d3a0 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712525640 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 0x7f15ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712525640 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 0x7f15ec036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1708018f70 tx=0x7f1708005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1715216980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574aec686f0 con 0x5574aec99b40 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56116/0 (socket says 172.21.15.151:56116) 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 -- 172.21.15.151:0/39701454 learned_addr learned my addr 172.21.15.151:0/39701454 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.231+0000 7f1712d26640 1 -- 172.21.15.151:0/39701454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aec9a4f0 con 0x5574aec99b40 2024-09-13T19:06:41.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 --2- 172.21.15.151:0/39701454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f170c041cd0 tx=0x7f170c03d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c004aec3e9fd2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f67fc640 1 -- 172.21.15.151:0/39701454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c048e00 con 0x5574aec99b40 2024-09-13T19:06:41.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f67fc640 1 -- 172.21.15.151:0/39701454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c05d020 con 0x5574aec99b40 2024-09-13T19:06:41.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f67fc640 1 -- 172.21.15.151:0/39701454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c0488e0 con 0x5574aec99b40 2024-09-13T19:06:41.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/39701454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 msgr2=0x5574aec99f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 --2- 172.21.15.151:0/39701454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f170c041cd0 tx=0x7f170c03d710 comp rx=0 tx=0).stop 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/39701454 shutdown_connections 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 --2- 172.21.15.151:0/39701454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aec99f20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/39701454 >> 172.21.15.151:0/39701454 conn(0x5574aec95e70 msgr2=0x5574aec93f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/39701454 shutdown_connections 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/39701454 wait complete. 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 Processor -- start 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- start start 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5574aec9a880 con 0x5574aec99b40 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56118/0 (socket says 172.21.15.151:56118) 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 learned_addr learned my addr 172.21.15.151:0/3524351259 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574aeca1130 con 0x5574aec99b40 2024-09-13T19:06:41.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1712d26640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f170c010fd0 tx=0x7f170c051f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f4ff9640 1 -- 172.21.15.151:0/3524351259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c048e00 con 0x5574aec99b40 2024-09-13T19:06:41.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5574aeca1130 con 0x5574aec99b40 2024-09-13T19:06:41.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f4ff9640 1 -- 172.21.15.151:0/3524351259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f170c0488e0 con 0x5574aec99b40 2024-09-13T19:06:41.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f15f4ff9640 1 -- 172.21.15.151:0/3524351259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f170c041790 con 0x5574aec99b40 2024-09-13T19:06:41.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.235+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574aeca15a0 con 0x5574aec99b40 2024-09-13T19:06:41.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f15f4ff9640 1 -- 172.21.15.151:0/3524351259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f170c043040 con 0x5574aec99b40 2024-09-13T19:06:41.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f15f4ff9640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15dc034650 0x7f15dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f15f4ff9640 1 -- 172.21.15.151:0/3524351259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f170c06b070 con 0x5574aec99b40 2024-09-13T19:06:41.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1712525640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15dc034650 0x7f15dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aecabce0 0x5574aecae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecae8f0 con 0x5574aecabce0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aecabce0 0x5574aecae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1712525640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15dc034650 0x7f15dc036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x5574aec7fd50 tx=0x7f17080c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aecabce0 0x5574aecae1a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 realm 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaed00 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf5d0 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aecb06d0 0x5574aecb2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb3090 con 0x5574aecb06d0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1712d26640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aecb06d0 0x5574aecb2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.239+0000 7f1712d26640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aecb06d0 0x5574aecb2ac0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1715216980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1715216980 20 searching for the correct realm 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb4960 con 0x5574aecb06d0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712d26640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f170c04d070 0x7f170c04d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb4960 con 0x7f170c04d070 2024-09-13T19:06:41.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712525640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f170c04d070 0x7f170c04d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712525640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f170c04d070 0x7f170c04d7e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712525640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f17080e0040 0x7f17080e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb4960 con 0x7f17080e0040 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f17080e0040 0x7f17080e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f17080e0040 0x7f17080e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.243+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f170c04d070 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f170c04d070 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.247+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f170c04d070 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.251+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f170c04d070 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecb06d0 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f17080e0040 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x5574aecabce0 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5574aecaf970 con 0x7f170c04d070 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:41.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb3a80 con 0x5574aecabce0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.255+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb4320 con 0x5574aecabce0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb3e70 con 0x7f170c04d070 2024-09-13T19:06:41.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 zone default found 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 4 Realm: () 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 zonegroup default 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb4d90 con 0x7f17080e0040 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb67a0 con 0x5574aecb06d0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb6ce0 con 0x5574aecb06d0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 started sync module instance, tier type = 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:41.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb5c10 con 0x7f170c04d070 2024-09-13T19:06:41.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93959637131264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb5870 con 0x7f170c04d070 2024-09-13T19:06:41.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.259+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb7c10 con 0x5574aecabce0 2024-09-13T19:06:41.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93959637131264] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93959637137248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb8030 con 0x5574aecabce0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb88c0 con 0x5574aecb06d0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93959637139776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb9160 con 0x5574aecb06d0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.263+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb9b60 con 0x7f170c04d070 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93959637137248] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93959637138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb9f50 con 0x7f170c04d070 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecba910 con 0x5574aecabce0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93959637139776] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93959637138304] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93959637145200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecba460 con 0x5574aecabce0 2024-09-13T19:06:41.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.267+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbb1b0 con 0x7f17080e0040 2024-09-13T19:06:41.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.271+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93959637145200] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.271+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.271+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93959637142704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbaea0 con 0x7f17080e0040 2024-09-13T19:06:41.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.271+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbb6f0 con 0x7f17080e0040 2024-09-13T19:06:41.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93959637142704] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93959637150464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbb570 con 0x7f17080e0040 2024-09-13T19:06:41.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbc060 con 0x7f17080e0040 2024-09-13T19:06:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93959637154608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbc4d0 con 0x7f17080e0040 2024-09-13T19:06:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=0 2024-09-13T19:06:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=1 2024-09-13T19:06:41.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=2 2024-09-13T19:06:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=3 2024-09-13T19:06:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=4 2024-09-13T19:06:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=5 2024-09-13T19:06:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93959637150464] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.275+0000 7f1715216980 20 add_watcher() i=6 2024-09-13T19:06:41.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93959637154608] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 20 add_watcher() i=7 2024-09-13T19:06:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbc4d0 con 0x5574aecabce0 2024-09-13T19:06:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93959637155872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecbc440 con 0x5574aecabce0 2024-09-13T19:06:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93959637155872] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f15c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:41.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 5 note: GC not initialized 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1543fff640 20 reqs_thread_entry: start 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.279+0000 7f1715216980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 20 Filter name: none 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1541ffb640 20 reqs_thread_entry: start 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aece2c70 con 0x5574aecabce0 2024-09-13T19:06:41.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aece2750 con 0x7f170c04d070 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece8ee0 con 0x5574aecabce0 2024-09-13T19:06:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93959637338992 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5574aece5c00 con 0x5574aecabce0 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 93959637145200 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f170402d040 con 0x5574aecabce0 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f15f67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93959637145200 notifier 4323 bl.length()=567 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f15f67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f15f67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f15f67fc640 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f15d8003eb0 con 0x5574aecabce0 2024-09-13T19:06:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify cookie 93959637338992 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.283+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 93959637338992 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f170401e040 con 0x5574aecabce0 2024-09-13T19:06:41.289 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:41.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f15c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93959637155872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece0aa0 con 0x5574aecabce0 2024-09-13T19:06:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93959637155872] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93959637131264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece0aa0 con 0x7f170c04d070 2024-09-13T19:06:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93959637131264] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1715216980 20 remove_watcher() i=0 2024-09-13T19:06:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1715216980 2 removed watcher, disabling cache 2024-09-13T19:06:41.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.287+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93959637137248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb6000 con 0x5574aecabce0 2024-09-13T19:06:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.291+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93959637137248] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.291+0000 7f1715216980 20 remove_watcher() i=1 2024-09-13T19:06:41.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.291+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93959637139776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece0aa0 con 0x5574aecb06d0 2024-09-13T19:06:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1712d26640 1 -- 172.21.15.151:0/3524351259 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93959637139776] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170c075020 con 0x5574aecb06d0 2024-09-13T19:06:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 20 remove_watcher() i=2 2024-09-13T19:06:41.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93959637138304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb7760 con 0x7f170c04d070 2024-09-13T19:06:41.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1712525640 1 -- 172.21.15.151:0/3524351259 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93959637138304] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f17080aaa90 con 0x7f170c04d070 2024-09-13T19:06:41.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 20 remove_watcher() i=3 2024-09-13T19:06:41.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93959637145200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb6000 con 0x5574aecabce0 2024-09-13T19:06:41.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93959637145200] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x5574aecabce0 2024-09-13T19:06:41.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 20 remove_watcher() i=4 2024-09-13T19:06:41.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.295+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93959637142704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece0aa0 con 0x7f17080e0040 2024-09-13T19:06:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.299+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93959637142704] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.299+0000 7f1715216980 20 remove_watcher() i=5 2024-09-13T19:06:41.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.299+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93959637150464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aecb6000 con 0x7f17080e0040 2024-09-13T19:06:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93959637150464] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 20 remove_watcher() i=6 2024-09-13T19:06:41.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93959637154608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5574aece0aa0 con 0x7f17080e0040 2024-09-13T19:06:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93959637154608] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170400a4d0 con 0x7f17080e0040 2024-09-13T19:06:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 20 remove_watcher() i=7 2024-09-13T19:06:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f17080e0040 msgr2=0x7f17080e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f17080e0040 0x7f17080e0420 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aecabce0 msgr2=0x5574aecae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aecabce0 0x5574aecae1a0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f170c04d070 msgr2=0x7f170c04d7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f170c04d070 0x7f170c04d7e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aecb06d0 msgr2=0x5574aecb2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aecb06d0 0x5574aecb2ac0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15dc034650 msgr2=0x7f15dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15dc034650 0x7f15dc036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x5574aec7fd50 tx=0x7f17080c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 msgr2=0x5574aeca0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1713527640 1 -- 172.21.15.151:0/3524351259 reap_dead start 2024-09-13T19:06:41.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f170c010fd0 tx=0x7f170c051f20 comp rx=0 tx=0).stop 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 shutdown_connections 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/3524351259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec99b40 0x5574aeca0bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 >> 172.21.15.151:0/3524351259 conn(0x5574aec95e70 msgr2=0x5574aec93f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 shutdown_connections 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/3524351259 wait complete. 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 msgr2=0x7f15ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 0x7f15ec036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1708018f70 tx=0x7f1708005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 msgr2=0x5574aec8d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f170c01dfd0 tx=0x7f170c018e10 comp rx=0 tx=0).stop 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 shutdown_connections 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15ec034650 0x7f15ec036b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 --2- 172.21.15.151:0/948167004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aec8d3a0 0x5574aec8d7c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.303+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 >> 172.21.15.151:0/948167004 conn(0x5574aec824f0 msgr2=0x5574aec84f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 shutdown_connections 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/948167004 wait complete. 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aec74220 msgr2=0x5574aec76610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5574aec74220 0x5574aec76610 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5574aec7cdd0 msgr2=0x5574aec7f1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5574aec7cdd0 0x5574aec7f1c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aec78ed0 msgr2=0x5574aec7b2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5574aec78ed0 0x5574aec7b2c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15f8034650 msgr2=0x7f15f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f15f8034650 0x7f15f8036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17080ae000 tx=0x7f17080a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 msgr2=0x5574aec6f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 --2- 172.21.15.151:0/2030951278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5574aeb7c8e0 0x5574aec6f130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f170c001fd0 tx=0x7f170c000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1713527640 1 -- 172.21.15.151:0/2030951278 reap_dead start 2024-09-13T19:06:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 shutdown_connections 2024-09-13T19:06:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 >> 172.21.15.151:0/2030951278 conn(0x5574aeaf0230 msgr2=0x5574aec624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 shutdown_connections 2024-09-13T19:06:41.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.307+0000 7f1715216980 1 -- 172.21.15.151:0/2030951278 wait complete. 2024-09-13T19:06:41.320 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:41.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:41.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:41.320 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.402 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21e1bea980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55671edfd570 0x55671edfd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21e1bea980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55671ec86ae0 con 0x55671edfdec0 2024-09-13T19:06:41.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21e1bea980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55671ecaae30 con 0x55671edfd570 2024-09-13T19:06:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21df6fa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55671edfd570 0x55671edfd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21df6fa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55671edfd570 0x55671edfd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56130/0 (socket says 172.21.15.151:56130) 2024-09-13T19:06:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21df6fa640 1 -- 172.21.15.151:0/1322047240 learned_addr learned my addr 172.21.15.151:0/1322047240 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.399+0000 7f21deef9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55671edfdec0 0x55671ee028f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33408/0 (socket says 172.21.15.151:33408) 2024-09-13T19:06:41.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21df6fa640 1 -- 172.21.15.151:0/1322047240 >> v1:172.21.15.12:6789/0 conn(0x55671edfdec0 legacy=0x55671ee028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21df6fa640 1 -- 172.21.15.151:0/1322047240 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671ee05140 con 0x55671edfd570 2024-09-13T19:06:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21df6fa640 1 --2- 172.21.15.151:0/1322047240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671edfd950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a5c0 tx=0x7f21d001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8540c0ff277c9af0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21de6f8640 1 -- 172.21.15.151:0/1322047240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a6070 con 0x55671edfd570 2024-09-13T19:06:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21de6f8640 1 -- 172.21.15.151:0/1322047240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00af070 con 0x55671edfd570 2024-09-13T19:06:41.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21de6f8640 1 -- 172.21.15.151:0/1322047240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00aa5c0 con 0x55671edfd570 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21e1bea980 1 -- 172.21.15.151:0/1322047240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 msgr2=0x55671edfd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21e1bea980 1 --2- 172.21.15.151:0/1322047240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671edfd950 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a5c0 tx=0x7f21d001b340 comp rx=0 tx=0).stop 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21e1bea980 1 -- 172.21.15.151:0/1322047240 shutdown_connections 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21e1bea980 1 --2- 172.21.15.151:0/1322047240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671edfd950 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.403+0000 7f21e1bea980 1 -- 172.21.15.151:0/1322047240 >> 172.21.15.151:0/1322047240 conn(0x55671edf9090 msgr2=0x55671edfb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.407+0000 7f21e1bea980 1 -- 172.21.15.151:0/1322047240 shutdown_connections 2024-09-13T19:06:41.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.407+0000 7f21e1bea980 1 -- 172.21.15.151:0/1322047240 wait complete. 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.419+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.419+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.419+0000 7f21e1bea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.419+0000 7f21e1bea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55671ecac200 con 0x55671edfd570 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56142/0 (socket says 172.21.15.151:56142) 2024-09-13T19:06:41.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 -- 172.21.15.151:0/2488460907 learned_addr learned my addr 172.21.15.151:0/2488460907 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 -- 172.21.15.151:0/2488460907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671ed731d0 con 0x55671edfd570 2024-09-13T19:06:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 --2- 172.21.15.151:0/2488460907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a5c0 tx=0x7f21d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f37f5474a3eee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f20cd60a640 1 -- 172.21.15.151:0/2488460907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00aa9b0 con 0x55671edfd570 2024-09-13T19:06:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f20cd60a640 1 -- 172.21.15.151:0/2488460907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00aab50 con 0x55671edfd570 2024-09-13T19:06:41.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f20cd60a640 1 -- 172.21.15.151:0/2488460907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00aae50 con 0x55671edfd570 2024-09-13T19:06:41.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- 172.21.15.151:0/2488460907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 msgr2=0x55671ed72c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2488460907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f21d000a5c0 tx=0x7f21d0003030 comp rx=0 tx=0).stop 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- 172.21.15.151:0/2488460907 shutdown_connections 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2488460907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671ed72c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- 172.21.15.151:0/2488460907 >> 172.21.15.151:0/2488460907 conn(0x55671edf9090 msgr2=0x55671eee4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- 172.21.15.151:0/2488460907 shutdown_connections 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- 172.21.15.151:0/2488460907 wait complete. 2024-09-13T19:06:41.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671eef0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21e1bea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55671ee04b80 con 0x55671edfd570 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671eef0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671eef0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56152/0 (socket says 172.21.15.151:56152) 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.423+0000 7f21df6fa640 1 -- 172.21.15.151:0/4063616682 learned_addr learned my addr 172.21.15.151:0/4063616682 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21df6fa640 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671eef1110 con 0x55671edfd570 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21df6fa640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671eef0bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21d001bbe0 tx=0x7f21d00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 -- 172.21.15.151:0/4063616682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00c6750 con 0x55671edfd570 2024-09-13T19:06:41.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55671eef13a0 con 0x55671edfd570 2024-09-13T19:06:41.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 -- 172.21.15.151:0/4063616682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00c68f0 con 0x55671edfd570 2024-09-13T19:06:41.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 -- 172.21.15.151:0/4063616682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00c6c10 con 0x55671edfd570 2024-09-13T19:06:41.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671eef4080 con 0x55671edfd570 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 -- 172.21.15.151:0/4063616682 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d00ce020 con 0x55671edfd570 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20c4034650 0x7f20c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f20cbe07640 1 -- 172.21.15.151:0/4063616682 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f21d00cc020 con 0x55671edfd570 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671edfdec0 0x55671eef7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21deef9640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20c4034650 0x7f20c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671eef8200 con 0x55671edfdec0 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21dfefb640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671edfdec0 0x55671eef7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21deef9640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20c4034650 0x7f20c4036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21d4001e50 tx=0x7f21d40013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21dfefb640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671edfdec0 0x55671eef7bc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21dfefb640 1 -- 172.21.15.151:0/4063616682 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671edfdec0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671eef5280 con 0x55671edfdec0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21dfefb640 1 -- 172.21.15.151:0/4063616682 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671edfdec0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671eefa530 0x55671eefc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671eefcff0 con 0x55671eefa530 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.427+0000 7f21df6fa640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671eefa530 0x55671eefc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671eefa530 0x55671eefc920 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 -- 172.21.15.151:0/4063616682 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f21d00e5050 con 0x55671eefa530 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671eef93d0 con 0x55671edfdec0 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21dfefb640 1 -- 172.21.15.151:0/4063616682 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671edfdec0 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55671eefe430 0x55671ef00820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef00fb0 con 0x55671eefe430 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21deef9640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55671eefe430 0x55671ef00820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21deef9640 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55671eefe430 0x55671ef00820 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21deef9640 1 -- 172.21.15.151:0/4063616682 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f21d400f700 con 0x55671eefe430 2024-09-13T19:06:41.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21e1bea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55671ed05800 con 0x55671ef0ea40 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56160/0 (socket says 172.21.15.151:56160) 2024-09-13T19:06:41.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 -- 172.21.15.151:0/4226383844 learned_addr learned my addr 172.21.15.151:0/4226383844 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 -- 172.21.15.151:0/4226383844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671ef0f3a0 con 0x55671ef0ea40 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.431+0000 7f21df6fa640 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cf900 tx=0x7f21d00bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 -- 172.21.15.151:0/4226383844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00d0e60 con 0x55671ef0ea40 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 -- 172.21.15.151:0/4226383844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00e33d0 con 0x55671ef0ea40 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55671ef0f630 con 0x55671ef0ea40 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 -- 172.21.15.151:0/4226383844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00d05f0 con 0x55671ef0ea40 2024-09-13T19:06:41.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671ef122b0 con 0x55671ef0ea40 2024-09-13T19:06:41.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 -- 172.21.15.151:0/4226383844 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d00d0790 con 0x55671ef0ea40 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 0x7f20b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c9602640 1 -- 172.21.15.151:0/4226383844 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f21d00eec50 con 0x55671ef0ea40 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21deef9640 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 0x7f20b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21deef9640 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 0x7f20b8036b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55671ef013b0 tx=0x7f21d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21e1bea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55671ed73490 con 0x55671ef1b310 2024-09-13T19:06:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56174/0 (socket says 172.21.15.151:56174) 2024-09-13T19:06:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21df6fa640 1 -- 172.21.15.151:0/1785467762 learned_addr learned my addr 172.21.15.151:0/1785467762 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21df6fa640 1 -- 172.21.15.151:0/1785467762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671ef1bce0 con 0x55671ef1b310 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f21df6fa640 1 --2- 172.21.15.151:0/1785467762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21d00c3f90 tx=0x7f21d00cf990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9437879b461810 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c2ffd640 1 -- 172.21.15.151:0/1785467762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00e56a0 con 0x55671ef1b310 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.435+0000 7f20c2ffd640 1 -- 172.21.15.151:0/1785467762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d00bc8c0 con 0x55671ef1b310 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f20c2ffd640 1 -- 172.21.15.151:0/1785467762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00c95b0 con 0x55671ef1b310 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/1785467762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 msgr2=0x55671ef1b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 --2- 172.21.15.151:0/1785467762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f21d00c3f90 tx=0x7f21d00cf990 comp rx=0 tx=0).stop 2024-09-13T19:06:41.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/1785467762 shutdown_connections 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 --2- 172.21.15.151:0/1785467762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef1b710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/1785467762 >> 172.21.15.151:0/1785467762 conn(0x55671ef176f0 msgr2=0x55671ef157f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/1785467762 shutdown_connections 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/1785467762 wait complete. 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 Processor -- start 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- start start 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55671ef1c160 con 0x55671ef1b310 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21df6fa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56178/0 (socket says 172.21.15.151:56178) 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 learned_addr learned my addr 172.21.15.151:0/2808992241 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671ef22af0 con 0x55671ef1b310 2024-09-13T19:06:41.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21df6fa640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cfae0 tx=0x7f21d00b3ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f20c17fa640 1 -- 172.21.15.151:0/2808992241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00a8c50 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55671ef22af0 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f20c17fa640 1 -- 172.21.15.151:0/2808992241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d010d030 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671ef22f60 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.439+0000 7f20c17fa640 1 -- 172.21.15.151:0/2808992241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21d00e54c0 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f20c17fa640 1 -- 172.21.15.151:0/2808992241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f21d0100030 con 0x55671ef1b310 2024-09-13T19:06:41.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f20c17fa640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20a8034650 0x7f20a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f20c17fa640 1 -- 172.21.15.151:0/2808992241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f21d00fe070 con 0x55671ef1b310 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21deef9640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20a8034650 0x7f20a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671ef2d410 0x55671ef2f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef2fff0 con 0x55671ef2d410 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671ef2d410 0x55671ef2f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21deef9640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20a8034650 0x7f20a8036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21d400baa0 tx=0x7f21d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671ef2d410 0x55671ef2f8a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 realm 2024-09-13T19:06:41.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef30400 con 0x55671ef2d410 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef30ca0 con 0x55671ef2d410 2024-09-13T19:06:41.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671ef31da0 0x55671ef34190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef34710 con 0x55671ef31da0 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671ef31da0 0x55671ef34190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671ef31da0 0x55671ef34190 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 20 searching for the correct realm 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35f70 con 0x55671ef31da0 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f21d0009040 0x7f21d00eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35f70 con 0x7f21d0009040 2024-09-13T19:06:41.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.443+0000 7f21deef9640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f21d0009040 0x7f21d00eb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21deef9640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f21d0009040 0x7f21d00eb300 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21deef9640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f21d403a3c0 0x7f21d403a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35f70 con 0x7f21d403a3c0 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f21d403a3c0 0x7f21d403a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f21d403a3c0 0x7f21d403a800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.447+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d0009040 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d0009040 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.451+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d0009040 2024-09-13T19:06:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.455+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d0009040 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef31da0 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d403a3c0 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x55671ef2d410 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55671ef31040 con 0x7f21d0009040 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:41.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35090 con 0x55671ef2d410 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35930 con 0x55671ef2d410 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef34cd0 con 0x7f21d0009040 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 zone default found 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 4 Realm: () 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 zonegroup default 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.459+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef35930 con 0x7f21d403a3c0 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef37e20 con 0x55671ef31da0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef381c0 con 0x55671ef31da0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 started sync module instance, tier type = 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef372c0 con 0x7f21d0009040 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93901389264560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef36f20 con 0x7f21d0009040 2024-09-13T19:06:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef390a0 con 0x55671ef2d410 2024-09-13T19:06:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.463+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93901389264560] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93901389270000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef39010 con 0x55671ef2d410 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef39e30 con 0x55671ef31da0 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93901389270000] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93901389273408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3a6d0 con 0x55671ef31da0 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.467+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef39490 con 0x7f21d0009040 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93901389278448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3b6c0 con 0x7f21d0009040 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3c1e0 con 0x55671ef2d410 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93901389273408] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93901389278448] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93901389282480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3b110 con 0x55671ef2d410 2024-09-13T19:06:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.471+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3ca80 con 0x7f21d403a3c0 2024-09-13T19:06:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.475+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93901389282480] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.475+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.475+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93901389275680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3ca30 con 0x7f21d403a3c0 2024-09-13T19:06:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.475+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3d280 con 0x7f21d403a3c0 2024-09-13T19:06:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.475+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93901389275680] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93901389285216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3d0f0 con 0x7f21d403a3c0 2024-09-13T19:06:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3dcc0 con 0x7f21d403a3c0 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93901389289488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3e0e0 con 0x7f21d403a3c0 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=0 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=1 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=2 2024-09-13T19:06:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=3 2024-09-13T19:06:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=4 2024-09-13T19:06:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=5 2024-09-13T19:06:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93901389285216] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.479+0000 7f21e1bea980 20 add_watcher() i=6 2024-09-13T19:06:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93901389289488] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 add_watcher() i=7 2024-09-13T19:06:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3cb80 con 0x55671ef2d410 2024-09-13T19:06:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93901389286272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3e630 con 0x55671ef2d410 2024-09-13T19:06:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93901389286272] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f2095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 5 note: GC not initialized 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f2094fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 Filter name: none 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f200e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55671ef64280 con 0x55671ef2d410 2024-09-13T19:06:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.483+0000 7f21e1bea980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:41.488 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f2095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93901389286272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef631d0 con 0x55671ef2d410 2024-09-13T19:06:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93901389286272] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93901389264560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3cb80 con 0x7f21d0009040 2024-09-13T19:06:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93901389264560] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21e1bea980 20 remove_watcher() i=0 2024-09-13T19:06:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21e1bea980 2 removed watcher, disabling cache 2024-09-13T19:06:41.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.487+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93901389270000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef376b0 con 0x55671ef2d410 2024-09-13T19:06:41.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93901389270000] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21e1bea980 20 remove_watcher() i=1 2024-09-13T19:06:41.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93901389273408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef376b0 con 0x55671ef31da0 2024-09-13T19:06:41.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21df6fa640 1 -- 172.21.15.151:0/2808992241 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93901389273408] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d0119070 con 0x55671ef31da0 2024-09-13T19:06:41.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21e1bea980 20 remove_watcher() i=2 2024-09-13T19:06:41.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.491+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93901389278448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef39940 con 0x7f21d0009040 2024-09-13T19:06:41.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21deef9640 1 -- 172.21.15.151:0/2808992241 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93901389278448] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d4037040 con 0x7f21d0009040 2024-09-13T19:06:41.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21e1bea980 20 remove_watcher() i=3 2024-09-13T19:06:41.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93901389282480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef376b0 con 0x55671ef2d410 2024-09-13T19:06:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93901389282480] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x55671ef2d410 2024-09-13T19:06:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21e1bea980 20 remove_watcher() i=4 2024-09-13T19:06:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.495+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93901389275680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3acf0 con 0x7f21d403a3c0 2024-09-13T19:06:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93901389275680] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21e1bea980 20 remove_watcher() i=5 2024-09-13T19:06:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93901389285216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef3bcb0 con 0x7f21d403a3c0 2024-09-13T19:06:41.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93901389285216] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21e1bea980 20 remove_watcher() i=6 2024-09-13T19:06:41.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.499+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93901389289488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55671ef376b0 con 0x7f21d403a3c0 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93901389289488] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f21d800a4d0 con 0x7f21d403a3c0 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 20 remove_watcher() i=7 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f21d403a3c0 msgr2=0x7f21d403a800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f21d403a3c0 0x7f21d403a800 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671ef2d410 msgr2=0x55671ef2f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671ef2d410 0x55671ef2f8a0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f21d0009040 msgr2=0x7f21d00eb300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f21d0009040 0x7f21d00eb300 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671ef31da0 msgr2=0x55671ef34190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671ef31da0 0x55671ef34190 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20a8034650 msgr2=0x7f20a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20a8034650 0x7f20a8036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f21d400baa0 tx=0x7f21d4010000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 msgr2=0x55671ef225b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cfae0 tx=0x7f21d00b3ef0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21dfefb640 1 -- 172.21.15.151:0/2808992241 reap_dead start 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 shutdown_connections 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/2808992241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef1b310 0x55671ef225b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 >> 172.21.15.151:0/2808992241 conn(0x55671ef176f0 msgr2=0x55671ef157c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 shutdown_connections 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/2808992241 wait complete. 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 msgr2=0x7f20b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 0x7f20b8036b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55671ef013b0 tx=0x7f21d400f000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 msgr2=0x55671ef0ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f21d00cf900 tx=0x7f21d00bcdc0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 shutdown_connections 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20b80346a0 0x7f20b8036b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4226383844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671ef0ea40 0x55671ef0ee60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 >> 172.21.15.151:0/4226383844 conn(0x55671ef03b90 msgr2=0x55671ef06610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 shutdown_connections 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4226383844 wait complete. 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671edfdec0 msgr2=0x55671eef7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55671edfdec0 0x55671eef7bc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55671eefe430 msgr2=0x55671ef00820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55671eefe430 0x55671ef00820 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671eefa530 msgr2=0x55671eefc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55671eefa530 0x55671eefc920 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20c4034650 msgr2=0x7f20c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f20c4034650 0x7f20c4036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f21d4001e50 tx=0x7f21d40013b0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 msgr2=0x55671eef0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 --2- 172.21.15.151:0/4063616682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55671edfd570 0x55671eef0bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21d001bbe0 tx=0x7f21d00180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21dfefb640 1 -- 172.21.15.151:0/4063616682 reap_dead start 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 shutdown_connections 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 >> 172.21.15.151:0/4063616682 conn(0x55671edf9090 msgr2=0x55671eee30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 shutdown_connections 2024-09-13T19:06:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.503+0000 7f21e1bea980 1 -- 172.21.15.151:0/4063616682 wait complete. 2024-09-13T19:06:41.519 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:41.519 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:06:41.519 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-13T19:06:41.519 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-13T19:06:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.595 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5524b00980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56517478de60 0x565174790250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5524b00980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56517460fae0 con 0x5651746fc230 2024-09-13T19:06:41.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5524b00980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x565174633e30 con 0x56517478de60 2024-09-13T19:06:41.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5521e0f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56517478de60 0x565174790250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5522610640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5651746fc230 0x56517478c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33416/0 (socket says 172.21.15.151:33416) 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5522610640 1 -- 172.21.15.151:0/4212280261 learned_addr learned my addr 172.21.15.151:0/4212280261 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f552160e640 1 -- 172.21.15.151:0/4212280261 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3575804988 0 0) 0x56517460fae0 con 0x5651746fc230 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f552160e640 1 -- 172.21.15.151:0/4212280261 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f550c001e20 con 0x5651746fc230 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5521e0f640 1 -- 172.21.15.151:0/4212280261 >> v1:172.21.15.12:6789/0 conn(0x5651746fc230 legacy=0x56517478c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5521e0f640 1 -- 172.21.15.151:0/4212280261 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651746fc610 con 0x56517478de60 2024-09-13T19:06:41.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.595+0000 7f5521e0f640 1 --2- 172.21.15.151:0/4212280261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56517478de60 0x565174790250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f551800a480 tx=0x7f551801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a81dfeabf3a4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f552160e640 1 -- 172.21.15.151:0/4212280261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55180b0070 con 0x56517478de60 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f552160e640 1 -- 172.21.15.151:0/4212280261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55180ab540 con 0x56517478de60 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f552160e640 1 -- 172.21.15.151:0/4212280261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55180ab820 con 0x56517478de60 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 -- 172.21.15.151:0/4212280261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56517478de60 msgr2=0x565174790250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 --2- 172.21.15.151:0/4212280261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56517478de60 0x565174790250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f551800a480 tx=0x7f551801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 -- 172.21.15.151:0/4212280261 shutdown_connections 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 --2- 172.21.15.151:0/4212280261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56517478de60 0x565174790250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 -- 172.21.15.151:0/4212280261 >> 172.21.15.151:0/4212280261 conn(0x565174782030 msgr2=0x565174784450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 -- 172.21.15.151:0/4212280261 shutdown_connections 2024-09-13T19:06:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.599+0000 7f5524b00980 1 -- 172.21.15.151:0/4212280261 wait complete. 2024-09-13T19:06:41.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.611+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.611+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.611+0000 7f5524b00980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.611+0000 7f5524b00980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x565174635200 con 0x5651746fc230 2024-09-13T19:06:41.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56196/0 (socket says 172.21.15.151:56196) 2024-09-13T19:06:41.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 -- 172.21.15.151:0/3744870201 learned_addr learned my addr 172.21.15.151:0/3744870201 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 -- 172.21.15.151:0/3744870201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651748750e0 con 0x5651746fc230 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 --2- 172.21.15.151:0/3744870201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f551c001740 tx=0x7f551c001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df868340722847d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5410608640 1 -- 172.21.15.151:0/3744870201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c016070 con 0x5651746fc230 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5410608640 1 -- 172.21.15.151:0/3744870201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c004530 con 0x5651746fc230 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5410608640 1 -- 172.21.15.151:0/3744870201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c004850 con 0x5651746fc230 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- 172.21.15.151:0/3744870201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 msgr2=0x565174874b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 --2- 172.21.15.151:0/3744870201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f551c001740 tx=0x7f551c001c00 comp rx=0 tx=0).stop 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- 172.21.15.151:0/3744870201 shutdown_connections 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 --2- 172.21.15.151:0/3744870201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x565174874b10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- 172.21.15.151:0/3744870201 >> 172.21.15.151:0/3744870201 conn(0x565174782030 msgr2=0x565174870740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- 172.21.15.151:0/3744870201 shutdown_connections 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- 172.21.15.151:0/3744870201 wait complete. 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x56517487bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5524b00980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5651747931c0 con 0x5651746fc230 2024-09-13T19:06:41.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x56517487bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x56517487bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56198/0 (socket says 172.21.15.151:56198) 2024-09-13T19:06:41.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 -- 172.21.15.151:0/1680969787 learned_addr learned my addr 172.21.15.151:0/1680969787 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.615+0000 7f5522610640 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517487c440 con 0x5651746fc230 2024-09-13T19:06:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522610640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x56517487bf00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f551c014040 tx=0x7f551c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 -- 172.21.15.151:0/1680969787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c016040 con 0x5651746fc230 2024-09-13T19:06:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56517487c6d0 con 0x5651746fc230 2024-09-13T19:06:41.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 -- 172.21.15.151:0/1680969787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c011400 con 0x5651746fc230 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 -- 172.21.15.151:0/1680969787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c011720 con 0x5651746fc230 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517487f3b0 con 0x5651746fc230 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 -- 172.21.15.151:0/1680969787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f551c0118c0 con 0x5651746fc230 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f54080346a0 0x7f5408036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f540ee05640 1 -- 172.21.15.151:0/1680969787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f551c049700 con 0x5651746fc230 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5521e0f640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f54080346a0 0x7f5408036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56517478de60 0x565174883000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565174883540 con 0x56517478de60 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522e11640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56517478de60 0x565174883000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5521e0f640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f54080346a0 0x7f5408036b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55180ad000 tx=0x7f55180a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522e11640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56517478de60 0x565174883000 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522e11640 1 -- 172.21.15.151:0/1680969787 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x56517478de60 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748805b0 con 0x56517478de60 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522e11640 1 -- 172.21.15.151:0/1680969787 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x56517478de60 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748857e0 0x565174887bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748882c0 con 0x5651748857e0 2024-09-13T19:06:41.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522610640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748857e0 0x565174887bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.619+0000 7f5522610640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748857e0 0x565174887bd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 -- 172.21.15.151:0/1680969787 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f551c02c070 con 0x5651748857e0 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565174884680 con 0x56517478de60 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522e11640 1 -- 172.21.15.151:0/1680969787 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x56517478de60 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x565174889720 0x56517488bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56517488c250 con 0x565174889720 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5521e0f640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x565174889720 0x56517488bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5521e0f640 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x565174889720 0x56517488bb10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5521e0f640 1 -- 172.21.15.151:0/1680969787 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55180abc20 con 0x565174889720 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56517468e800 con 0x565174899cc0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56214/0 (socket says 172.21.15.151:56214) 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 -- 172.21.15.151:0/2661667277 learned_addr learned my addr 172.21.15.151:0/2661667277 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 -- 172.21.15.151:0/2661667277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517489a620 con 0x565174899cc0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5522610640 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f551c049010 tx=0x7f551c01cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5407fff640 1 -- 172.21.15.151:0/2661667277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c0492c0 con 0x565174899cc0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5407fff640 1 -- 172.21.15.151:0/2661667277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c049460 con 0x565174899cc0 2024-09-13T19:06:41.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56517489a8b0 con 0x565174899cc0 2024-09-13T19:06:41.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5407fff640 1 -- 172.21.15.151:0/2661667277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c02d480 con 0x565174899cc0 2024-09-13T19:06:41.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.623+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517489d530 con 0x565174899cc0 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5407fff640 1 -- 172.21.15.151:0/2661667277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f551c02d620 con 0x565174899cc0 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5407fff640 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 0x7f53fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5407fff640 1 -- 172.21.15.151:0/2661667277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f551c039ce0 con 0x565174899cc0 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5521e0f640 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 0x7f53fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5521e0f640 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 0x7f53fc036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x565174884650 tx=0x7f5518005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x565174875460 con 0x5651748a6660 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56220/0 (socket says 172.21.15.151:56220) 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5522610640 1 -- 172.21.15.151:0/2462617838 learned_addr learned my addr 172.21.15.151:0/2462617838 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5522610640 1 -- 172.21.15.151:0/2462617838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651748a7010 con 0x5651748a6660 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5522610640 1 --2- 172.21.15.151:0/2462617838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f551c049670 tx=0x7f551c0411e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcb84d58dd107bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5405ffb640 1 -- 172.21.15.151:0/2462617838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c05a070 con 0x5651748a6660 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5405ffb640 1 -- 172.21.15.151:0/2462617838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c02e3e0 con 0x5651748a6660 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5405ffb640 1 -- 172.21.15.151:0/2462617838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c04f040 con 0x5651748a6660 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- 172.21.15.151:0/2462617838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 msgr2=0x5651748a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 --2- 172.21.15.151:0/2462617838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f551c049670 tx=0x7f551c0411e0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- 172.21.15.151:0/2462617838 shutdown_connections 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 --2- 172.21.15.151:0/2462617838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748a6a40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- 172.21.15.151:0/2462617838 >> 172.21.15.151:0/2462617838 conn(0x5651748a2a40 msgr2=0x5651748a0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- 172.21.15.151:0/2462617838 shutdown_connections 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.627+0000 7f5524b00980 1 -- 172.21.15.151:0/2462617838 wait complete. 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 Processor -- start 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 -- start start 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5651748a74b0 con 0x5651748a6660 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522610640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56232/0 (socket says 172.21.15.151:56232) 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 learned_addr learned my addr 172.21.15.151:0/3416960689 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651748adda0 con 0x5651748a6660 2024-09-13T19:06:41.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522610640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f551c049670 tx=0x7f551c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 -- 172.21.15.151:0/3416960689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c063070 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 -- 172.21.15.151:0/3416960689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551c02e760 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 -- 172.21.15.151:0/3416960689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551c05a040 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5651748adda0 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651748adda0 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 -- 172.21.15.151:0/3416960689 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f551c066070 con 0x5651748a6660 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53ec034650 0x7f53ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f53f3fff640 1 -- 172.21.15.151:0/3416960689 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f551c069cb0 con 0x5651748a6660 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5521e0f640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53ec034650 0x7f53ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5651748b87a0 0x5651748bac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748bb390 con 0x5651748b87a0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.631+0000 7f5522e11640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5651748b87a0 0x5651748bac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53ec034650 0x7f53ec036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f551801b2c0 tx=0x7f55180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5651748b87a0 0x5651748bac40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 realm 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748bb7a0 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc040 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748bd140 0x5651748bf530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748bfb80 con 0x5651748bd140 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748bd140 0x5651748bf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748bd140 0x5651748bf530 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 20 searching for the correct realm 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748c13e0 con 0x5651748bd140 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f551c068070 0x7f551c0499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748c13e0 con 0x7f551c068070 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f551c068070 0x7f551c0499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f551c068070 0x7f551c0499a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f55180de040 0x7f55180df940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748c13e0 con 0x7f55180de040 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.635+0000 7f5522e11640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f55180de040 0x7f55180df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f55180de040 0x7f55180df940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f551c068070 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.639+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f551c068070 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.643+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f551c068070 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f551c068070 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748bd140 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f55180de040 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.647+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x5651748b87a0 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5651748bc3e0 con 0x7f551c068070 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c04d0 con 0x5651748b87a0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c0d20 con 0x5651748b87a0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c0870 con 0x7f551c068070 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 zone default found 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 4 Realm: () 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 zonegroup default 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c1810 con 0x7f55180de040 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c31f0 con 0x5651748bd140 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c3630 con 0x5651748bd140 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 started sync module instance, tier type = 2024-09-13T19:06:41.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c2690 con 0x7f551c068070 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94907847682688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c22f0 con 0x7f551c068070 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.651+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c4560 con 0x5651748b87a0 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.655+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94907847682688] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.655+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.655+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94907847688368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c4980 con 0x5651748b87a0 2024-09-13T19:06:41.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.655+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c5230 con 0x5651748bd140 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94907847688368] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94907847689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c55d0 con 0x5651748bd140 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c5fd0 con 0x7f551c068070 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94907847695072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c6870 con 0x7f551c068070 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c7290 con 0x5651748b87a0 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94907847689424] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.659+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94907847695072] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94907847697344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c4ae0 con 0x5651748b87a0 2024-09-13T19:06:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c7b30 con 0x7f55180de040 2024-09-13T19:06:41.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94907847697344] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94907847699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c7a70 con 0x7f55180de040 2024-09-13T19:06:41.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.663+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c8430 con 0x7f55180de040 2024-09-13T19:06:41.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.667+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94907847699840] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.667+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.667+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94907847702144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c8430 con 0x7f55180de040 2024-09-13T19:06:41.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.667+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c8df0 con 0x7f55180de040 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94907847706944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c9210 con 0x7f55180de040 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=0 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=1 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=2 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=3 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=4 2024-09-13T19:06:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=5 2024-09-13T19:06:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94907847702144] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=6 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94907847706944] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 add_watcher() i=7 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748c7ff0 con 0x5651748b87a0 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94907847704512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748c96f0 con 0x5651748b87a0 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94907847704512] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f53d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 5 note: GC not initialized 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f53537fe640 20 reqs_thread_entry: start 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.671+0000 7f5524b00980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 20 Filter name: none 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f53517fa640 20 reqs_thread_entry: start 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:41.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748ef930 con 0x5651748b87a0 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:06:41.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748f03a0 con 0x7f55180de040 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:06:41.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f5d40 con 0x5651748b87a0 2024-09-13T19:06:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94907847890864 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748f1470 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94907847697344 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f551403b040 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5405ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94907847697344 notifier 4337 bl.length()=678 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5405ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5405ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify cookie 94907847890864 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5405ffb640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f53e8003eb0 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94907847890864 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5514010040 con 0x5651748b87a0 2024-09-13T19:06:41.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.675+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f57b0 con 0x7f55180de040 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5524b00980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5524b00980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5524b00980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94907847890864 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0fc0 con 0x5651748bd140 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 94907847689424 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56517489a8b0 con 0x5651748bd140 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5405ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94907847689424 notifier 4337 bl.length()=177 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5405ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5405ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [notify cookie 94907847890864 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5405ffb640 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f53e8003eb0 con 0x5651748bd140 2024-09-13T19:06:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== watch-notify(notify_complete (2) cookie 94907847890864 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56517489a620 con 0x5651748bd140 2024-09-13T19:06:41.684 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:06:41.678088Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:41.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f53d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.679+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94907847704512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0fc0 con 0x5651748b87a0 2024-09-13T19:06:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94907847704512] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94907847682688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x7f551c068070 2024-09-13T19:06:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94907847682688] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 20 remove_watcher() i=0 2024-09-13T19:06:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 2 removed watcher, disabling cache 2024-09-13T19:06:41.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94907847688368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x5651748b87a0 2024-09-13T19:06:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94907847688368] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 20 remove_watcher() i=1 2024-09-13T19:06:41.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.683+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94907847689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x5651748bd140 2024-09-13T19:06:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5522610640 1 -- 172.21.15.151:0/3416960689 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94907847689424] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f551c065030 con 0x5651748bd140 2024-09-13T19:06:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5524b00980 20 remove_watcher() i=2 2024-09-13T19:06:41.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94907847695072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x7f551c068070 2024-09-13T19:06:41.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5521e0f640 1 -- 172.21.15.151:0/3416960689 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94907847695072] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55180cb030 con 0x7f551c068070 2024-09-13T19:06:41.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5524b00980 20 remove_watcher() i=3 2024-09-13T19:06:41.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.687+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94907847697344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x5651748b87a0 2024-09-13T19:06:41.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94907847697344] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x5651748b87a0 2024-09-13T19:06:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5524b00980 20 remove_watcher() i=4 2024-09-13T19:06:41.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94907847699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x7f55180de040 2024-09-13T19:06:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94907847699840] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5524b00980 20 remove_watcher() i=5 2024-09-13T19:06:41.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.691+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94907847702144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x7f55180de040 2024-09-13T19:06:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.695+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94907847702144] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.695+0000 7f5524b00980 20 remove_watcher() i=6 2024-09-13T19:06:41.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.695+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94907847706944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5651748f0f90 con 0x7f55180de040 2024-09-13T19:06:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94907847706944] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55140083f0 con 0x7f55180de040 2024-09-13T19:06:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 20 remove_watcher() i=7 2024-09-13T19:06:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f55180de040 msgr2=0x7f55180df940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f55180de040 0x7f55180df940 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5651748b87a0 msgr2=0x5651748bac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5651748b87a0 0x5651748bac40 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f551c068070 msgr2=0x7f551c0499a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f551c068070 0x7f551c0499a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748bd140 msgr2=0x5651748bf530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748bd140 0x5651748bf530 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53ec034650 msgr2=0x7f53ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53ec034650 0x7f53ec036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f551801b2c0 tx=0x7f55180a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 msgr2=0x5651748ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5522e11640 1 -- 172.21.15.151:0/3416960689 reap_dead start 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f551c049670 tx=0x7f551c023000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 shutdown_connections 2024-09-13T19:06:41.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/3416960689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651748a6660 0x5651748ad860 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 >> 172.21.15.151:0/3416960689 conn(0x5651748a2a40 msgr2=0x5651748a0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 shutdown_connections 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/3416960689 wait complete. 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 msgr2=0x7f53fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 0x7f53fc036b10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x565174884650 tx=0x7f5518005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 msgr2=0x56517489a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f551c049010 tx=0x7f551c01cf80 comp rx=0 tx=0).stop 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 shutdown_connections 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f53fc034650 0x7f53fc036b10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/2661667277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x565174899cc0 0x56517489a0e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 >> 172.21.15.151:0/2661667277 conn(0x56517488ee10 msgr2=0x565174891890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 shutdown_connections 2024-09-13T19:06:41.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/2661667277 wait complete. 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56517478de60 msgr2=0x565174883000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56517478de60 0x565174883000 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x565174889720 msgr2=0x56517488bb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x565174889720 0x56517488bb10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748857e0 msgr2=0x565174887bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5651748857e0 0x565174887bd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f54080346a0 msgr2=0x7f5408036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f54080346a0 0x7f5408036b60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55180ad000 tx=0x7f55180a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 msgr2=0x56517487bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 --2- 172.21.15.151:0/1680969787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5651746fc230 0x56517487bf00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f551c014040 tx=0x7f551c001260 comp rx=0 tx=0).stop 2024-09-13T19:06:41.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5522e11640 1 -- 172.21.15.151:0/1680969787 reap_dead start 2024-09-13T19:06:41.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 shutdown_connections 2024-09-13T19:06:41.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 >> 172.21.15.151:0/1680969787 conn(0x565174782030 msgr2=0x56517486f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 shutdown_connections 2024-09-13T19:06:41.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.699+0000 7f5524b00980 1 -- 172.21.15.151:0/1680969787 wait complete. 2024-09-13T19:06:41.711 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:06:41.678088Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:41.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:41.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:41.712 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f6b8e980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5601236edc60 0x5601236f0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f6b8e980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56012356fae0 con 0x5601236e98e0 2024-09-13T19:06:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f6b8e980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x560123593e30 con 0x5601236edc60 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12ebfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5601236edc60 0x5601236f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f469e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5601236e98e0 0x5601236e9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33426/0 (socket says 172.21.15.151:33426) 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f469e640 1 -- 172.21.15.151:0/2950406152 learned_addr learned my addr 172.21.15.151:0/2950406152 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f3e9d640 1 -- 172.21.15.151:0/2950406152 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320354965 0 0) 0x56012356fae0 con 0x5601236e98e0 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.779+0000 7f12f3e9d640 1 -- 172.21.15.151:0/2950406152 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e0001e20 con 0x5601236e98e0 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12ebfff640 1 -- 172.21.15.151:0/2950406152 >> v1:172.21.15.12:6789/0 conn(0x5601236e98e0 legacy=0x5601236e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12ebfff640 1 -- 172.21.15.151:0/2950406152 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601236f15a0 con 0x5601236edc60 2024-09-13T19:06:41.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12ebfff640 1 --2- 172.21.15.151:0/2950406152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236edc60 0x5601236f0050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12e400a480 tx=0x7f12e401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55926f16ab2e4006 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f3e9d640 1 -- 172.21.15.151:0/2950406152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12e40b0070 con 0x5601236edc60 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f3e9d640 1 -- 172.21.15.151:0/2950406152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e40ab540 con 0x5601236edc60 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f3e9d640 1 -- 172.21.15.151:0/2950406152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12e40ab840 con 0x5601236edc60 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 -- 172.21.15.151:0/2950406152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236edc60 msgr2=0x5601236f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/2950406152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236edc60 0x5601236f0050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f12e400a480 tx=0x7f12e401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 -- 172.21.15.151:0/2950406152 shutdown_connections 2024-09-13T19:06:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/2950406152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236edc60 0x5601236f0050 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 -- 172.21.15.151:0/2950406152 >> 172.21.15.151:0/2950406152 conn(0x56012365d230 msgr2=0x56012365d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 -- 172.21.15.151:0/2950406152 shutdown_connections 2024-09-13T19:06:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.783+0000 7f12f6b8e980 1 -- 172.21.15.151:0/2950406152 wait complete. 2024-09-13T19:06:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.795+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.795+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.795+0000 7f12f6b8e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.795+0000 7f12f6b8e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560123595200 con 0x5601236e98e0 2024-09-13T19:06:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56248/0 (socket says 172.21.15.151:56248) 2024-09-13T19:06:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 -- 172.21.15.151:0/1763840450 learned_addr learned my addr 172.21.15.151:0/1763840450 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 -- 172.21.15.151:0/1763840450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601237d5010 con 0x5601236e98e0 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 --2- 172.21.15.151:0/1763840450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12dc001dc0 tx=0x7f12dc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2522d82f90eeb27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f11e260c640 1 -- 172.21.15.151:0/1763840450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc012020 con 0x5601236e98e0 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f11e260c640 1 -- 172.21.15.151:0/1763840450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc00e7c0 con 0x5601236e98e0 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f11e260c640 1 -- 172.21.15.151:0/1763840450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc00eb40 con 0x5601236e98e0 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1763840450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 msgr2=0x5601237d4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1763840450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f12dc001dc0 tx=0x7f12dc00b6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1763840450 shutdown_connections 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1763840450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237d4a40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1763840450 >> 172.21.15.151:0/1763840450 conn(0x56012365d230 msgr2=0x5601237d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1763840450 shutdown_connections 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1763840450 wait complete. 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237dbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f6b8e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5601236f10a0 con 0x5601236e98e0 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237dbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237dbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56254/0 (socket says 172.21.15.151:56254) 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.799+0000 7f12f469e640 1 -- 172.21.15.151:0/1551416272 learned_addr learned my addr 172.21.15.151:0/1551416272 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f469e640 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601237dc330 con 0x5601236e98e0 2024-09-13T19:06:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f469e640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237dbdf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12dc004180 tx=0x7f12dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 -- 172.21.15.151:0/1551416272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc012030 con 0x5601236e98e0 2024-09-13T19:06:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 -- 172.21.15.151:0/1551416272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc001440 con 0x5601236e98e0 2024-09-13T19:06:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 -- 172.21.15.151:0/1551416272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc01aaa0 con 0x5601236e98e0 2024-09-13T19:06:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601237dc5c0 con 0x5601236e98e0 2024-09-13T19:06:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601237df2a0 con 0x5601236e98e0 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 -- 172.21.15.151:0/1551416272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12dc015020 con 0x5601236e98e0 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11dc0346a0 0x7f11dc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f11e0e09640 1 -- 172.21.15.151:0/1551416272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f12dc020030 con 0x5601236e98e0 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11dc0346a0 0x7f11dc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601236edc60 0x5601237e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601237e33a0 con 0x5601236edc60 2024-09-13T19:06:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.803+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601236edc60 0x5601237e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11dc0346a0 0x7f11dc036b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ad000 tx=0x7f12e40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601236edc60 0x5601237e2d80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f4e9f640 1 -- 172.21.15.151:0/1551416272 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601236edc60 2024-09-13T19:06:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601237e04a0 con 0x5601236edc60 2024-09-13T19:06:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f4e9f640 1 -- 172.21.15.151:0/1551416272 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601236edc60 2024-09-13T19:06:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5601237e5720 0x5601237e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601237e8200 con 0x5601237e5720 2024-09-13T19:06:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5601237e5720 0x5601237e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5601237e5720 0x5601237e7b10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 -- 172.21.15.151:0/1551416272 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f12dc008030 con 0x5601237e5720 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601237e45c0 con 0x5601236edc60 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f4e9f640 1 -- 172.21.15.151:0/1551416272 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601236edc60 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5601237e9660 0x5601237eba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601237ec190 con 0x5601237e9660 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5601237e9660 0x5601237eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5601237e9660 0x5601237eba50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12ebfff640 1 -- 172.21.15.151:0/1551416272 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f12e40abd70 con 0x5601237e9660 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f6b8e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5601235ee800 con 0x5601237f9c20 2024-09-13T19:06:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56262/0 (socket says 172.21.15.151:56262) 2024-09-13T19:06:41.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.807+0000 7f12f469e640 1 -- 172.21.15.151:0/1662023617 learned_addr learned my addr 172.21.15.151:0/1662023617 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 -- 172.21.15.151:0/1662023617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601237fa580 con 0x5601237f9c20 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0487c0 tx=0x7f12dc00db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 -- 172.21.15.151:0/1662023617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc00d560 con 0x5601237f9c20 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601237fa810 con 0x5601237f9c20 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 -- 172.21.15.151:0/1662023617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc040070 con 0x5601237f9c20 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 -- 172.21.15.151:0/1662023617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc024550 con 0x5601237f9c20 2024-09-13T19:06:41.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601237fd490 con 0x5601237f9c20 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 -- 172.21.15.151:0/1662023617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12dc036070 con 0x5601237f9c20 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 0x7f11cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f11d9ffb640 1 -- 172.21.15.151:0/1662023617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f12dc005050 con 0x5601237f9c20 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 0x7f11cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12ebfff640 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 0x7f11cc036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5601237e38c0 tx=0x7f12e4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f6b8e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5601237d5390 con 0x5601238065a0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56278/0 (socket says 172.21.15.151:56278) 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 -- 172.21.15.151:0/1039661010 learned_addr learned my addr 172.21.15.151:0/1039661010 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 -- 172.21.15.151:0/1039661010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560123806f70 con 0x5601238065a0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.811+0000 7f12f469e640 1 --2- 172.21.15.151:0/1039661010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f12dc024990 tx=0x7f12dc041c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca12613bd12a365 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d37fe640 1 -- 172.21.15.151:0/1039661010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc03bcd0 con 0x5601238065a0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d37fe640 1 -- 172.21.15.151:0/1039661010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc00aa00 con 0x5601238065a0 2024-09-13T19:06:41.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d37fe640 1 -- 172.21.15.151:0/1039661010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc02da50 con 0x5601238065a0 2024-09-13T19:06:41.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1039661010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 msgr2=0x5601238069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1039661010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f12dc024990 tx=0x7f12dc041c60 comp rx=0 tx=0).stop 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1039661010 shutdown_connections 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1039661010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x5601238069a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1039661010 >> 172.21.15.151:0/1039661010 conn(0x560123802920 msgr2=0x560123800a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1039661010 shutdown_connections 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1039661010 wait complete. 2024-09-13T19:06:41.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 Processor -- start 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- start start 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x56012380d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560123807330 con 0x5601238065a0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x56012380d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f469e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x56012380d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56288/0 (socket says 172.21.15.151:56288) 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 learned_addr learned my addr 172.21.15.151:0/346969810 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012380dc00 con 0x5601238065a0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f469e640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x56012380d6c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12dc024990 tx=0x7f12dc017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d1ffb640 1 -- 172.21.15.151:0/346969810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc03bcd0 con 0x5601238065a0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d1ffb640 1 -- 172.21.15.151:0/346969810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12dc070070 con 0x5601238065a0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56012380dc00 con 0x5601238065a0 2024-09-13T19:06:41.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d1ffb640 1 -- 172.21.15.151:0/346969810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12dc00a820 con 0x5601238065a0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012380e070 con 0x5601238065a0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.815+0000 7f11d1ffb640 1 -- 172.21.15.151:0/346969810 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f12dc039040 con 0x5601238065a0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f11d1ffb640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11c4034600 0x7f11c4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f11d1ffb640 1 -- 172.21.15.151:0/346969810 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f12dc01f1d0 con 0x5601238065a0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11c4034600 0x7f11c4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601238187e0 0x56012381aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012381b3f0 con 0x5601238187e0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601238187e0 0x56012381aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11c4034600 0x7f11c4036ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12e4018eb0 tx=0x7f12e40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601238187e0 0x56012381aca0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 realm 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012381b800 con 0x5601238187e0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012381c0a0 con 0x5601238187e0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56012381d1a0 0x56012381f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012381fb10 con 0x56012381d1a0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56012381d1a0 0x56012381f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56012381d1a0 0x56012381f590 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 20 searching for the correct realm 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601238213e0 con 0x56012381d1a0 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f12dc017050 0x7f12dc0549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601238213e0 con 0x7f12dc017050 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f12dc017050 0x7f12dc0549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f12dc017050 0x7f12dc0549c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f12e40ce040 0x7f12e40db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601238213e0 con 0x7f12e40ce040 2024-09-13T19:06:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.819+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f12e40ce040 0x7f12e40db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f12e40ce040 0x7f12e40db920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12dc017050 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.823+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12dc017050 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.827+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12dc017050 2024-09-13T19:06:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12dc017050 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x56012381d1a0 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12e40ce040 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x5601238187e0 2024-09-13T19:06:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56012381c440 con 0x7f12dc017050 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:41.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.831+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123820530 con 0x5601238187e0 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123820dd0 con 0x5601238187e0 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123820170 con 0x7f12dc017050 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 zone default found 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 4 Realm: () 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 zonegroup default 2024-09-13T19:06:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123820dd0 con 0x7f12e40ce040 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123823290 con 0x56012381d1a0 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560123823630 con 0x56012381d1a0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 started sync module instance, tier type = 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123822730 con 0x7f12dc017050 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94562890689312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123822390 con 0x7f12dc017050 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123824510 con 0x5601238187e0 2024-09-13T19:06:41.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.835+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94562890689312] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94562890694752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123824480 con 0x5601238187e0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601238252e0 con 0x56012381d1a0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94562890698160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123825b80 con 0x56012381d1a0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.839+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123826580 con 0x7f12dc017050 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94562890694752] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94562890696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601238269a0 con 0x7f12dc017050 2024-09-13T19:06:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827360 con 0x5601238187e0 2024-09-13T19:06:41.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94562890696960] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94562890698160] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94562890702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827360 con 0x5601238187e0 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.843+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827bb0 con 0x7f12e40ce040 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.847+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94562890702992] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.847+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.847+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94562890706880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827910 con 0x7f12e40ce040 2024-09-13T19:06:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.847+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123828400 con 0x7f12e40ce040 2024-09-13T19:06:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.847+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94562890706880] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94562890710736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601238283c0 con 0x7f12e40ce040 2024-09-13T19:06:41.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123828de0 con 0x7f12e40ce040 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94562890713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123829250 con 0x7f12e40ce040 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=0 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=1 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=2 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=3 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=4 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.851+0000 7f12f6b8e980 20 add_watcher() i=5 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94562890710736] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f6b8e980 20 add_watcher() i=6 2024-09-13T19:06:41.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94562890713296] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f6b8e980 20 add_watcher() i=7 2024-09-13T19:06:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f6b8e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.855+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601238273e0 con 0x5601238187e0 2024-09-13T19:06:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94562890707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601238297d0 con 0x5601238187e0 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94562890707936] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f11aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 5 note: GC not initialized 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f11a97e2640 20 reqs_thread_entry: start 2024-09-13T19:06:41.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 Filter name: none 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f111affd640 20 reqs_thread_entry: start 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56012384f3d0 con 0x5601238187e0 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:06:41.873 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:06:41.678088Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f11aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.859+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94562890707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384df80 con 0x5601238187e0 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94562890707936] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94562890689312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x7f12dc017050 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94562890689312] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 20 remove_watcher() i=0 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 2 removed watcher, disabling cache 2024-09-13T19:06:41.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94562890694752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x5601238187e0 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94562890694752] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 20 remove_watcher() i=1 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.863+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94562890698160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x56012381d1a0 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12f469e640 1 -- 172.21.15.151:0/346969810 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94562890698160] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12dc008030 con 0x56012381d1a0 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12f6b8e980 20 remove_watcher() i=2 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94562890696960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x7f12dc017050 2024-09-13T19:06:41.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12ebfff640 1 -- 172.21.15.151:0/346969810 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94562890696960] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12e40d9070 con 0x7f12dc017050 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12f6b8e980 20 remove_watcher() i=3 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.867+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94562890702992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x5601238187e0 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.871+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94562890702992] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x5601238187e0 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.871+0000 7f12f6b8e980 20 remove_watcher() i=4 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.871+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94562890706880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56012384d290 con 0x7f12e40ce040 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94562890706880] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f6b8e980 20 remove_watcher() i=5 2024-09-13T19:06:41.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94562890710736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827470 con 0x7f12e40ce040 2024-09-13T19:06:41.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94562890710736] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f6b8e980 20 remove_watcher() i=6 2024-09-13T19:06:41.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.875+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94562890713296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560123827470 con 0x7f12e40ce040 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94562890713296] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f12ec00a4d0 con 0x7f12e40ce040 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 20 remove_watcher() i=7 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f12e40ce040 msgr2=0x7f12e40db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f12e40ce040 0x7f12e40db920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601238187e0 msgr2=0x56012381aca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601238187e0 0x56012381aca0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f12dc017050 msgr2=0x7f12dc0549c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f12dc017050 0x7f12dc0549c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56012381d1a0 msgr2=0x56012381f590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56012381d1a0 0x56012381f590 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11c4034600 msgr2=0x7f11c4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11c4034600 0x7f11c4036ac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f12e4018eb0 tx=0x7f12e40a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 msgr2=0x56012380d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/346969810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601238065a0 0x56012380d6c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f12dc024990 tx=0x7f12dc017f90 comp rx=0 tx=0).stop 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 reap_dead start 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f4e9f640 1 -- 172.21.15.151:0/346969810 reap_dead start 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 shutdown_connections 2024-09-13T19:06:41.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 >> 172.21.15.151:0/346969810 conn(0x560123802920 msgr2=0x5601238009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 shutdown_connections 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/346969810 wait complete. 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 msgr2=0x7f11cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 0x7f11cc036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x5601237e38c0 tx=0x7f12e4005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 msgr2=0x5601237fa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0487c0 tx=0x7f12dc00db30 comp rx=0 tx=0).stop 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 shutdown_connections 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11cc034650 0x7f11cc036b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1662023617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601237f9c20 0x5601237fa040 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 >> 172.21.15.151:0/1662023617 conn(0x5601237eed70 msgr2=0x5601237f17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 shutdown_connections 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1662023617 wait complete. 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601236edc60 msgr2=0x5601237e2d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5601236edc60 0x5601237e2d80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5601237e9660 msgr2=0x5601237eba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5601237e9660 0x5601237eba50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5601237e5720 msgr2=0x5601237e7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5601237e5720 0x5601237e7b10 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11dc0346a0 msgr2=0x7f11dc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f11dc0346a0 0x7f11dc036b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12e40ad000 tx=0x7f12e40a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 msgr2=0x5601237dbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 --2- 172.21.15.151:0/1551416272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5601236e98e0 0x5601237dbdf0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f12dc004180 tx=0x7f12dc000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f4e9f640 1 -- 172.21.15.151:0/1551416272 reap_dead start 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 shutdown_connections 2024-09-13T19:06:41.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 >> 172.21.15.151:0/1551416272 conn(0x56012365d230 msgr2=0x5601237cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 shutdown_connections 2024-09-13T19:06:41.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.879+0000 7f12f6b8e980 1 -- 172.21.15.151:0/1551416272 wait complete. 2024-09-13T19:06:41.892 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:06:41.678088Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:41.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:06:41.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-13T19:06:41.893 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-13T19:06:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:41.965 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c589c980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e2d29352a0 0x55e2d29c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c589c980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e2d2848ae0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c589c980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55e2d286ce30 con 0x55e2d29352a0 2024-09-13T19:06:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c33ac640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e2d29352a0 0x55e2d29c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c2bab640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55e2d29c5cf0 0x55e2d29c80e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33432/0 (socket says 172.21.15.151:33432) 2024-09-13T19:06:41.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c2bab640 1 -- 172.21.15.151:0/2563785445 learned_addr learned my addr 172.21.15.151:0/2563785445 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c23aa640 1 -- 172.21.15.151:0/2563785445 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370441000 0 0) 0x55e2d2848ae0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c23aa640 1 -- 172.21.15.151:0/2563785445 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44ac001e20 con 0x55e2d29c5cf0 2024-09-13T19:06:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c33ac640 1 -- 172.21.15.151:0/2563785445 >> v1:172.21.15.12:6789/0 conn(0x55e2d29c5cf0 legacy=0x55e2d29c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.963+0000 7f44c33ac640 1 -- 172.21.15.151:0/2563785445 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2935680 con 0x55e2d29352a0 2024-09-13T19:06:41.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c33ac640 1 --2- 172.21.15.151:0/2563785445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d29c57b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00a420 tx=0x7f44bc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6288daf4856a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c23aa640 1 -- 172.21.15.151:0/2563785445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0af070 con 0x55e2d29352a0 2024-09-13T19:06:41.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c23aa640 1 -- 172.21.15.151:0/2563785445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0aa530 con 0x55e2d29352a0 2024-09-13T19:06:41.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c23aa640 1 -- 172.21.15.151:0/2563785445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0aa850 con 0x55e2d29352a0 2024-09-13T19:06:41.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 -- 172.21.15.151:0/2563785445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 msgr2=0x55e2d29c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 --2- 172.21.15.151:0/2563785445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d29c57b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00a420 tx=0x7f44bc01afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 -- 172.21.15.151:0/2563785445 shutdown_connections 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 --2- 172.21.15.151:0/2563785445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d29c57b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 -- 172.21.15.151:0/2563785445 >> 172.21.15.151:0/2563785445 conn(0x55e2d29bb0a0 msgr2=0x55e2d29bd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 -- 172.21.15.151:0/2563785445 shutdown_connections 2024-09-13T19:06:41.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.967+0000 7f44c589c980 1 -- 172.21.15.151:0/2563785445 wait complete. 2024-09-13T19:06:41.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:41.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:41.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2d286e200 con 0x55e2d29352a0 2024-09-13T19:06:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56316/0 (socket says 172.21.15.151:56316) 2024-09-13T19:06:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 -- 172.21.15.151:0/3644174517 learned_addr learned my addr 172.21.15.151:0/3644174517 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 -- 172.21.15.151:0/3644174517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2aae0b0 con 0x55e2d29352a0 2024-09-13T19:06:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 --2- 172.21.15.151:0/3644174517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44bc017be0 tx=0x7f44bc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064de991b146bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f43b160a640 1 -- 172.21.15.151:0/3644174517 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0af040 con 0x55e2d29352a0 2024-09-13T19:06:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f43b160a640 1 -- 172.21.15.151:0/3644174517 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0aa9a0 con 0x55e2d29352a0 2024-09-13T19:06:41.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f43b160a640 1 -- 172.21.15.151:0/3644174517 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0aac80 con 0x55e2d29352a0 2024-09-13T19:06:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- 172.21.15.151:0/3644174517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 msgr2=0x55e2d2aadae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:41.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 --2- 172.21.15.151:0/3644174517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44bc017be0 tx=0x7f44bc0033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- 172.21.15.151:0/3644174517 shutdown_connections 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 --2- 172.21.15.151:0/3644174517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2aadae0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- 172.21.15.151:0/3644174517 >> 172.21.15.151:0/3644174517 conn(0x55e2d29bb0a0 msgr2=0x55e2d2aa9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- 172.21.15.151:0/3644174517 shutdown_connections 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- 172.21.15.151:0/3644174517 wait complete. 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2ab4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c589c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2d29cc230 con 0x55e2d29352a0 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2ab4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2ab4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56322/0 (socket says 172.21.15.151:56322) 2024-09-13T19:06:41.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.983+0000 7f44c33ac640 1 -- 172.21.15.151:0/1114721524 learned_addr learned my addr 172.21.15.151:0/1114721524 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c33ac640 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2ab5230 con 0x55e2d29352a0 2024-09-13T19:06:41.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c33ac640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2ab4cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0b8040 tx=0x7f44bc017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 -- 172.21.15.151:0/1114721524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0af040 con 0x55e2d29352a0 2024-09-13T19:06:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2d2ab54c0 con 0x55e2d29352a0 2024-09-13T19:06:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 -- 172.21.15.151:0/1114721524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0b5870 con 0x55e2d29352a0 2024-09-13T19:06:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 -- 172.21.15.151:0/1114721524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0b5b50 con 0x55e2d29352a0 2024-09-13T19:06:41.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2d2ab81a0 con 0x55e2d29352a0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 -- 172.21.15.151:0/1114721524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44bc0bd050 con 0x55e2d29352a0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f43a8034650 0x7f43a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f43afe07640 1 -- 172.21.15.151:0/1114721524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f44bc0bb020 con 0x55e2d29352a0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f43a8034650 0x7f43a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d29c5cf0 0x55e2d2abbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2abc370 con 0x55e2d29c5cf0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c3bad640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d29c5cf0 0x55e2d2abbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f43a8034650 0x7f43a8036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f70 tx=0x7f44b80010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c3bad640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d29c5cf0 0x55e2d2abbdf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c3bad640 1 -- 172.21.15.151:0/1114721524 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2ab93a0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.987+0000 7f44c3bad640 1 -- 172.21.15.151:0/1114721524 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2abe660 0x55e2d2ac0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2ac1120 con 0x55e2d2abe660 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2abe660 0x55e2d2ac0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2abe660 0x55e2d2ac0a50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 -- 172.21.15.151:0/1114721524 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f44bc0b2040 con 0x55e2d2abe660 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2abd4d0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c3bad640 1 -- 172.21.15.151:0/1114721524 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d29c5cf0 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2d2ac2580 0x55e2d2ac4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2ac5060 con 0x55e2d2ac2580 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2d2ac2580 0x55e2d2ac4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2d2ac2580 0x55e2d2ac4970 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c2bab640 1 -- 172.21.15.151:0/1114721524 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f44b800e6c0 con 0x55e2d2ac2580 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:41.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2d28c7800 con 0x55e2d2ad2b10 2024-09-13T19:06:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56324/0 (socket says 172.21.15.151:56324) 2024-09-13T19:06:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 -- 172.21.15.151:0/1645244208 learned_addr learned my addr 172.21.15.151:0/1645244208 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:41.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 -- 172.21.15.151:0/1645244208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2ad3470 con 0x55e2d2ad2b10 2024-09-13T19:06:41.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c33ac640 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0d43f0 tx=0x7f44bc0a9f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f43ad602640 1 -- 172.21.15.151:0/1645244208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0b3cf0 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2d2ad3700 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f43ad602640 1 -- 172.21.15.151:0/1645244208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0e1080 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f43ad602640 1 -- 172.21.15.151:0/1645244208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0069d0 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.991+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2d2ad6380 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43ad602640 1 -- 172.21.15.151:0/1645244208 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44bc006b70 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43ad602640 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43ad602640 1 -- 172.21.15.151:0/1645244208 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f44bc0e5d20 con 0x55e2d2ad2b10 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c2bab640 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 0x7f439c036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55e2d2abcc10 tx=0x7f44b800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:41.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2d2aae370 con 0x55e2d2adf280 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56336/0 (socket says 172.21.15.151:56336) 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c33ac640 1 -- 172.21.15.151:0/3659511230 learned_addr learned my addr 172.21.15.151:0/3659511230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c33ac640 1 -- 172.21.15.151:0/3659511230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2adfc30 con 0x55e2d2adf280 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c33ac640 1 --2- 172.21.15.151:0/3659511230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0b5fd0 tx=0x7f44bc0c1bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70abb86f71061a8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43a6ffd640 1 -- 172.21.15.151:0/3659511230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0df430 con 0x55e2d2adf280 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43a6ffd640 1 -- 172.21.15.151:0/3659511230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0b43d0 con 0x55e2d2adf280 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f43a6ffd640 1 -- 172.21.15.151:0/3659511230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0ca590 con 0x55e2d2adf280 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- 172.21.15.151:0/3659511230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 msgr2=0x55e2d2adf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 --2- 172.21.15.151:0/3659511230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0b5fd0 tx=0x7f44bc0c1bb0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- 172.21.15.151:0/3659511230 shutdown_connections 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 --2- 172.21.15.151:0/3659511230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2adf660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- 172.21.15.151:0/3659511230 >> 172.21.15.151:0/3659511230 conn(0x55e2d2adb660 msgr2=0x55e2d2ad9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- 172.21.15.151:0/3659511230 shutdown_connections 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.995+0000 7f44c589c980 1 -- 172.21.15.151:0/3659511230 wait complete. 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 Processor -- start 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 -- start start 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e2d2ae00d0 con 0x55e2d2adf280 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c33ac640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56344/0 (socket says 172.21.15.151:56344) 2024-09-13T19:06:42.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 learned_addr learned my addr 172.21.15.151:0/2095191927 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d2ae69a0 con 0x55e2d2adf280 2024-09-13T19:06:42.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c33ac640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0e8000 tx=0x7f44bc0cfeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 -- 172.21.15.151:0/2095191927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc105070 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 -- 172.21.15.151:0/2095191927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc006e60 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e2d2ae69a0 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 -- 172.21.15.151:0/2095191927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0df430 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2d2ae69a0 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 -- 172.21.15.151:0/2095191927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44bc110060 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f438c034600 0x7f438c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f43a57fa640 1 -- 172.21.15.151:0/2095191927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f44bc0fb020 con 0x55e2d2adf280 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c2bab640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f438c034600 0x7f438c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d2af1550 0x55e2d2af39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af4140 con 0x55e2d2af1550 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:41.999+0000 7f44c3bad640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d2af1550 0x55e2d2af39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f438c034600 0x7f438c036ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c010 tx=0x7f44b8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d2af1550 0x55e2d2af39f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 realm 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af4550 con 0x55e2d2af1550 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af4df0 con 0x55e2d2af1550 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2af5ef0 0x55e2d2af82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af8980 con 0x55e2d2af5ef0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2af5ef0 0x55e2d2af82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2af5ef0 0x55e2d2af82e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 20 searching for the correct realm 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afa1e0 con 0x55e2d2af5ef0 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f44bc109020 0x7f44bc0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afa1e0 con 0x7f44bc109020 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f44bc109020 0x7f44bc0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f44bc109020 0x7f44bc0b4ac0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f44b8037040 0x7f44b8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afa1e0 con 0x7f44b8037040 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f44b8037040 0x7f44b8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.003+0000 7f44c3bad640 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f44b8037040 0x7f44b8036410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44bc109020 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.007+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44bc109020 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44bc109020 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.011+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44bc109020 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af5ef0 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44b8037040 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x55e2d2af1550 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af5190 con 0x7f44bc109020 2024-09-13T19:06:42.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af9300 con 0x55e2d2af1550 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af9b50 con 0x55e2d2af1550 2024-09-13T19:06:42.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2af8f40 con 0x7f44bc109020 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 zone default found 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 4 Realm: () 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 zonegroup default 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.015+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afa610 con 0x7f44b8037040 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afc050 con 0x55e2d2af5ef0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afc4e0 con 0x55e2d2af5ef0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 started sync module instance, tier type = 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afb490 con 0x7f44bc109020 2024-09-13T19:06:42.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94432685701248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afbca0 con 0x7f44bc109020 2024-09-13T19:06:42.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afd450 con 0x55e2d2af1550 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.019+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94432685701248] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94432685705536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afd840 con 0x55e2d2af1550 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afe200 con 0x55e2d2af5ef0 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94432685710672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afea50 con 0x55e2d2af5ef0 2024-09-13T19:06:42.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.023+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2aff470 con 0x7f44bc109020 2024-09-13T19:06:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.027+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.027+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94432685715296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2affd10 con 0x7f44bc109020 2024-09-13T19:06:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.027+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b00750 con 0x55e2d2af1550 2024-09-13T19:06:42.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.027+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94432685715296] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.027+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94432685705536] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.031+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94432685710672] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.031+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.031+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94432685707104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afe5a0 con 0x55e2d2af1550 2024-09-13T19:06:42.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.031+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b00b40 con 0x7f44b8037040 2024-09-13T19:06:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.035+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94432685707104] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.035+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.035+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94432685717600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b00af0 con 0x7f44b8037040 2024-09-13T19:06:42.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.035+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b01340 con 0x7f44b8037040 2024-09-13T19:06:42.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.035+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94432685717600] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.039+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.039+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94432685722352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b013c0 con 0x7f44b8037040 2024-09-13T19:06:42.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.039+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b01d80 con 0x7f44b8037040 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94432685725904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b021a0 con 0x7f44b8037040 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=0 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=1 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=2 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=3 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=4 2024-09-13T19:06:42.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=5 2024-09-13T19:06:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94432685722352] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.043+0000 7f44c589c980 20 add_watcher() i=6 2024-09-13T19:06:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94432685725904] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 20 add_watcher() i=7 2024-09-13T19:06:42.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b021a0 con 0x55e2d2af1550 2024-09-13T19:06:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94432685726960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b02140 con 0x55e2d2af1550 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94432685726960] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f4379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.047+0000 7f44c589c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 5 note: GC not initialized 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f4378fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 20 Filter name: none 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f42f27fc640 20 reqs_thread_entry: start 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b287c0 con 0x55e2d2af1550 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 20 rados_obj.operate() r=0 bl.length=502 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:42.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2ee40 con 0x55e2d2af1550 2024-09-13T19:06:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94432685910192 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2a530 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94432685707104 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f44b403b280 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f43a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94432685707104 notifier 4351 bl.length()=567 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f43a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f43a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 94432685910192 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f43a6ffd640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4388003eb0 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94432685910192 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f44b4010040 con 0x55e2d2af1550 2024-09-13T19:06:42.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.051+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2e8b0 con 0x7f44b8037040 2024-09-13T19:06:42.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c589c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:42.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94432685910192 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2a080 con 0x55e2d2af5ef0 2024-09-13T19:06:42.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 94432685710672 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e2d2ad3470 con 0x55e2d2af5ef0 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f43a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94432685710672 notifier 4351 bl.length()=170 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 notify.2 [notify cookie 94432685910192 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f43a67fc640 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f42f80032d0 con 0x55e2d2af5ef0 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== watch-notify(notify_complete (2) cookie 94432685910192 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f44bc11c020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.058 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f4379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94432685726960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2a530 con 0x55e2d2af1550 2024-09-13T19:06:42.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94432685726960] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.055+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94432685701248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b2a530 con 0x7f44bc109020 2024-09-13T19:06:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94432685701248] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c589c980 20 remove_watcher() i=0 2024-09-13T19:06:42.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c589c980 2 removed watcher, disabling cache 2024-09-13T19:06:42.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94432685705536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b01cf0 con 0x55e2d2af1550 2024-09-13T19:06:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94432685705536] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c589c980 20 remove_watcher() i=1 2024-09-13T19:06:42.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.059+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94432685710672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afb880 con 0x55e2d2af5ef0 2024-09-13T19:06:42.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c33ac640 1 -- 172.21.15.151:0/2095191927 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94432685710672] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0ea020 con 0x55e2d2af5ef0 2024-09-13T19:06:42.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 20 remove_watcher() i=2 2024-09-13T19:06:42.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94432685715296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afc940 con 0x7f44bc109020 2024-09-13T19:06:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c2bab640 1 -- 172.21.15.151:0/2095191927 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94432685715296] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b800e6c0 con 0x7f44bc109020 2024-09-13T19:06:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 20 remove_watcher() i=3 2024-09-13T19:06:42.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94432685707104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b01cf0 con 0x55e2d2af1550 2024-09-13T19:06:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94432685707104] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x55e2d2af1550 2024-09-13T19:06:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 20 remove_watcher() i=4 2024-09-13T19:06:42.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.063+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94432685717600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afb880 con 0x7f44b8037040 2024-09-13T19:06:42.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.067+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94432685717600] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.067+0000 7f44c589c980 20 remove_watcher() i=5 2024-09-13T19:06:42.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.067+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94432685722352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2afc940 con 0x7f44b8037040 2024-09-13T19:06:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94432685722352] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 20 remove_watcher() i=6 2024-09-13T19:06:42.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94432685725904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e2d2b01cf0 con 0x7f44b8037040 2024-09-13T19:06:42.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94432685725904] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44b40083f0 con 0x7f44b8037040 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 20 remove_watcher() i=7 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f44b8037040 msgr2=0x7f44b8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f44b8037040 0x7f44b8036410 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d2af1550 msgr2=0x55e2d2af39f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d2af1550 0x55e2d2af39f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f44bc109020 msgr2=0x7f44bc0b4ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f44bc109020 0x7f44bc0b4ac0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2af5ef0 msgr2=0x55e2d2af82e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2af5ef0 0x55e2d2af82e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f438c034600 msgr2=0x7f438c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f438c034600 0x7f438c036ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f44b800c010 tx=0x7f44b8010000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c3bad640 1 -- 172.21.15.151:0/2095191927 reap_dead start 2024-09-13T19:06:42.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 msgr2=0x55e2d2ae6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0e8000 tx=0x7f44bc0cfeb0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 shutdown_connections 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/2095191927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2adf280 0x55e2d2ae6460 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 >> 172.21.15.151:0/2095191927 conn(0x55e2d2adb660 msgr2=0x55e2d2ad9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 shutdown_connections 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/2095191927 wait complete. 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 msgr2=0x7f439c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 0x7f439c036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55e2d2abcc10 tx=0x7f44b800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 msgr2=0x55e2d2ad2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0d43f0 tx=0x7f44bc0a9f00 comp rx=0 tx=0).stop 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 shutdown_connections 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f439c034650 0x7f439c036b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 --2- 172.21.15.151:0/1645244208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d2ad2b10 0x55e2d2ad2f30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.071+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 >> 172.21.15.151:0/1645244208 conn(0x55e2d2ac7c60 msgr2=0x55e2d2aca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 shutdown_connections 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1645244208 wait complete. 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d29c5cf0 msgr2=0x55e2d2abbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e2d29c5cf0 0x55e2d2abbdf0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2d2ac2580 msgr2=0x55e2d2ac4970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55e2d2ac2580 0x55e2d2ac4970 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2abe660 msgr2=0x55e2d2ac0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e2d2abe660 0x55e2d2ac0a50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f43a8034650 msgr2=0x7f43a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f43a8034650 0x7f43a8036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44b8000f70 tx=0x7f44b80010b0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 msgr2=0x55e2d2ab4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 --2- 172.21.15.151:0/1114721524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e2d29352a0 0x55e2d2ab4cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0b8040 tx=0x7f44bc017d70 comp rx=0 tx=0).stop 2024-09-13T19:06:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c3bad640 1 -- 172.21.15.151:0/1114721524 reap_dead start 2024-09-13T19:06:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 shutdown_connections 2024-09-13T19:06:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 >> 172.21.15.151:0/1114721524 conn(0x55e2d29bb0a0 msgr2=0x55e2d2aa8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 shutdown_connections 2024-09-13T19:06:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.075+0000 7f44c589c980 1 -- 172.21.15.151:0/1114721524 wait complete. 2024-09-13T19:06:42.085 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:06:42.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-13T19:06:42.086 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-13T19:06:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:42.164 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40cc48f980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56397adb8900 0x56397adbacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40cc48f980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56397ac3dae0 con 0x56397adb4580 2024-09-13T19:06:42.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40cc48f980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56397ac61e30 con 0x56397adb8900 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c9f9f640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x56397adb4580 0x56397adb4960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33436/0 (socket says 172.21.15.151:33436) 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c9f9f640 1 -- 172.21.15.151:0/3986116104 learned_addr learned my addr 172.21.15.151:0/3986116104 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c979e640 1 --2- 172.21.15.151:0/3986116104 >> v2:172.21.15.12:3300/0 conn(0x56397adb8900 0x56397adbacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c8f9d640 1 -- 172.21.15.151:0/3986116104 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994252598 0 0) 0x56397ac3dae0 con 0x56397adb4580 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c8f9d640 1 -- 172.21.15.151:0/3986116104 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40b4001e20 con 0x56397adb4580 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c979e640 1 -- 172.21.15.151:0/3986116104 >> v1:172.21.15.12:6789/0 conn(0x56397adb4580 legacy=0x56397adb4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.163+0000 7f40c979e640 1 -- 172.21.15.151:0/3986116104 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397adbc240 con 0x56397adb8900 2024-09-13T19:06:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40c979e640 1 --2- 172.21.15.151:0/3986116104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397adbacf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a480 tx=0x7f40c001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717c6bfd793bac6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40c8f9d640 1 -- 172.21.15.151:0/3986116104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c00b0070 con 0x56397adb8900 2024-09-13T19:06:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40c8f9d640 1 -- 172.21.15.151:0/3986116104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c00ab540 con 0x56397adb8900 2024-09-13T19:06:42.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40c8f9d640 1 -- 172.21.15.151:0/3986116104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c00ab840 con 0x56397adb8900 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 -- 172.21.15.151:0/3986116104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 msgr2=0x56397adbacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 --2- 172.21.15.151:0/3986116104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397adbacf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f40c000a480 tx=0x7f40c001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 -- 172.21.15.151:0/3986116104 shutdown_connections 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 --2- 172.21.15.151:0/3986116104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397adbacf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 -- 172.21.15.151:0/3986116104 >> 172.21.15.151:0/3986116104 conn(0x56397adb00a0 msgr2=0x56397adb24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 -- 172.21.15.151:0/3986116104 shutdown_connections 2024-09-13T19:06:42.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.167+0000 7f40cc48f980 1 -- 172.21.15.151:0/3986116104 wait complete. 2024-09-13T19:06:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40cc48f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40cc48f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56397ac63200 con 0x56397adb4580 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56358/0 (socket says 172.21.15.151:56358) 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.179+0000 7f40c9f9f640 1 -- 172.21.15.151:0/53446574 learned_addr learned my addr 172.21.15.151:0/53446574 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 -- 172.21.15.151:0/53446574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397ae9fd50 con 0x56397adb4580 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/53446574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001740 tx=0x7f40c4001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f377d7a2b40089fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb7e07640 1 -- 172.21.15.151:0/53446574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4016070 con 0x56397adb4580 2024-09-13T19:06:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb7e07640 1 -- 172.21.15.151:0/53446574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4004530 con 0x56397adb4580 2024-09-13T19:06:42.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb7e07640 1 -- 172.21.15.151:0/53446574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4004850 con 0x56397adb4580 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/53446574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 msgr2=0x56397ae9f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 --2- 172.21.15.151:0/53446574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001740 tx=0x7f40c4001c00 comp rx=0 tx=0).stop 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/53446574 shutdown_connections 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 --2- 172.21.15.151:0/53446574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb4580 0x56397ae9f780 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/53446574 >> 172.21.15.151:0/53446574 conn(0x56397adb00a0 msgr2=0x56397ae9b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/53446574 shutdown_connections 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/53446574 wait complete. 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397aea7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56397adbbd40 con 0x56397adb8900 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397aea7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397aea7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56362/0 (socket says 172.21.15.151:56362) 2024-09-13T19:06:42.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2124857935 learned_addr learned my addr 172.21.15.151:0/2124857935 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397aea8380 con 0x56397adb8900 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397aea7e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f40c4014040 tx=0x7f40c4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb6604640 1 -- 172.21.15.151:0/2124857935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4016030 con 0x56397adb8900 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56397aea8610 con 0x56397adb8900 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb6604640 1 -- 172.21.15.151:0/2124857935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c401d580 con 0x56397adb8900 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f3fb6604640 1 -- 172.21.15.151:0/2124857935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c401d8a0 con 0x56397adb8900 2024-09-13T19:06:42.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.183+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56397aeab2f0 con 0x56397adb8900 2024-09-13T19:06:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f3fb6604640 1 -- 172.21.15.151:0/2124857935 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40c401da40 con 0x56397adb8900 2024-09-13T19:06:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f3fb6604640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fb0034650 0x7f3fb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f3fb6604640 1 -- 172.21.15.151:0/2124857935 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40c4017070 con 0x56397adb8900 2024-09-13T19:06:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c979e640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fb0034650 0x7f3fb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aeacf30 0x56397aeaf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeaf860 con 0x56397aeacf30 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aeacf30 0x56397aeaf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c979e640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fb0034650 0x7f3fb0036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f40c00ad000 tx=0x7f40c00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aeacf30 0x56397aeaf320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2124857935 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aeacf30 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeac510 con 0x56397aeacf30 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2124857935 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aeacf30 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeb1be0 0x56397aeb3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeb46a0 con 0x56397aeb1be0 2024-09-13T19:06:42.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeb1be0 0x56397aeb3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeb1be0 0x56397aeb3fd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2124857935 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40c4023020 con 0x56397aeb1be0 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeb0a80 con 0x56397aeacf30 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2124857935 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aeacf30 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56397aeb5b00 0x56397aeb7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeb85e0 con 0x56397aeb5b00 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c979e640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56397aeb5b00 0x56397aeb7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.187+0000 7f40c979e640 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56397aeb5b00 0x56397aeb7ef0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c979e640 1 -- 172.21.15.151:0/2124857935 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40c00b3040 con 0x56397aeb5b00 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56397acbc800 con 0x56397aec6030 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56370/0 (socket says 172.21.15.151:56370) 2024-09-13T19:06:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2706405230 learned_addr learned my addr 172.21.15.151:0/2706405230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2706405230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397aec6990 con 0x56397aec6030 2024-09-13T19:06:42.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40c400f4c0 tx=0x7f40c4022ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 -- 172.21.15.151:0/2706405230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c403f070 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 -- 172.21.15.151:0/2706405230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4026800 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56397aec6c20 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 -- 172.21.15.151:0/2706405230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4041410 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56397aec6c20 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 -- 172.21.15.151:0/2706405230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40c40415b0 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 0x7f3fa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f3faf7fe640 1 -- 172.21.15.151:0/2706405230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40c403b570 con 0x56397aec6030 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40c979e640 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 0x7f3fa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.191+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56397aea00d0 con 0x56397ae9d8b0 2024-09-13T19:06:42.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c979e640 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 0x7f3fa4036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56397aeb0a50 tx=0x7f40c0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56372/0 (socket says 172.21.15.151:56372) 2024-09-13T19:06:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 -- 172.21.15.151:0/485328079 learned_addr learned my addr 172.21.15.151:0/485328079 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 -- 172.21.15.151:0/485328079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397ae9e260 con 0x56397ae9d8b0 2024-09-13T19:06:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/485328079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40c40419d0 tx=0x7f40c402f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a32fcaacc5437 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f3fad7fa640 1 -- 172.21.15.151:0/485328079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c4022260 con 0x56397ae9d8b0 2024-09-13T19:06:42.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f3fad7fa640 1 -- 172.21.15.151:0/485328079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c403b020 con 0x56397ae9d8b0 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f3fad7fa640 1 -- 172.21.15.151:0/485328079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c403a440 con 0x56397ae9d8b0 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- 172.21.15.151:0/485328079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 msgr2=0x56397ae9dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 --2- 172.21.15.151:0/485328079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40c40419d0 tx=0x7f40c402f3f0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- 172.21.15.151:0/485328079 shutdown_connections 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 --2- 172.21.15.151:0/485328079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397ae9dc90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- 172.21.15.151:0/485328079 >> 172.21.15.151:0/485328079 conn(0x56397aecec60 msgr2=0x56397aeccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- 172.21.15.151:0/485328079 shutdown_connections 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- 172.21.15.151:0/485328079 wait complete. 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 Processor -- start 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- start start 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40cc48f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56397ae9e260 con 0x56397ae9d8b0 2024-09-13T19:06:42.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56382/0 (socket says 172.21.15.151:56382) 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 learned_addr learned my addr 172.21.15.151:0/2081898653 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56397aedbfc0 con 0x56397ae9d8b0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40c40419d0 tx=0x7f40c403b210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.195+0000 7f3f9b7fe640 1 -- 172.21.15.151:0/2081898653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c406b020 con 0x56397ae9d8b0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f3f9b7fe640 1 -- 172.21.15.151:0/2081898653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c402f5d0 con 0x56397ae9d8b0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56397aedbfc0 con 0x56397ae9d8b0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f3f9b7fe640 1 -- 172.21.15.151:0/2081898653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c403a7c0 con 0x56397ae9d8b0 2024-09-13T19:06:42.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56397aedbfc0 con 0x56397ae9d8b0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f3f9b7fe640 1 -- 172.21.15.151:0/2081898653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f40c406e020 con 0x56397ae9d8b0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f3f9b7fe640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3f940346a0 0x7f3f94036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f3f9b7fe640 1 -- 172.21.15.151:0/2081898653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f40c4061050 con 0x56397ae9d8b0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40c979e640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3f940346a0 0x7f3f94036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aee6ac0 0x56397aee8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aee96d0 con 0x56397aee6ac0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aee6ac0 0x56397aee8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40c979e640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3f940346a0 0x7f3f94036b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c0017e90 tx=0x7f40c00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aee6ac0 0x56397aee8f80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 realm 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aee9ae0 con 0x56397aee6ac0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea380 con 0x56397aee6ac0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeeb480 0x56397aeed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeedec0 con 0x56397aeeb480 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeeb480 0x56397aeed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeeb480 0x56397aeed870 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 20 searching for the correct realm 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.199+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeef720 con 0x56397aeeb480 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c9f9f640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f40c4070020 0x7f40c4046130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeef720 con 0x7f40c4070020 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c979e640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f40c4070020 0x7f40c4046130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c979e640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f40c4070020 0x7f40c4046130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c979e640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40c00cd040 0x7f40c00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeef720 con 0x7f40c00cd040 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40c00cd040 0x7f40c00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40c00cd040 0x7f40c00b7930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.203+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c4070020 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c4070020 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.207+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c4070020 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c4070020 2024-09-13T19:06:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aeeb480 2024-09-13T19:06:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.211+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c00cd040 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x56397aee6ac0 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56397aeea720 con 0x7f40c4070020 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeee810 con 0x56397aee6ac0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeef060 con 0x56397aee6ac0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeeebb0 con 0x7f40c4070020 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 zone default found 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 4 Realm: () 2024-09-13T19:06:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 zonegroup default 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aeefb50 con 0x7f40c00cd040 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aef1560 con 0x56397aeeb480 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aef1a80 con 0x56397aeeb480 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 started sync module instance, tier type = 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef09d0 con 0x7f40c4070020 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.215+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804875611584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef2390 con 0x7f40c4070020 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.219+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef2be0 con 0x56397aee6ac0 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.219+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804875611584] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.219+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.219+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804875615968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef2be0 con 0x56397aee6ac0 2024-09-13T19:06:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.219+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef3600 con 0x56397aeeb480 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804875615968] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804875618096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef2b50 con 0x56397aeeb480 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef43e0 con 0x7f40c4070020 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804875626448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef50a0 con 0x7f40c4070020 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef5a60 con 0x56397aee6ac0 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804875626448] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804875618096] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804875630000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef50a0 con 0x56397aee6ac0 2024-09-13T19:06:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.223+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef59d0 con 0x7f40c00cd040 2024-09-13T19:06:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.227+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804875630000] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.227+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.227+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804875627776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef5e80 con 0x7f40c00cd040 2024-09-13T19:06:42.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.227+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef6840 con 0x7f40c00cd040 2024-09-13T19:06:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.231+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.231+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804875633552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef6c60 con 0x7f40c00cd040 2024-09-13T19:06:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.231+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef76b0 con 0x7f40c00cd040 2024-09-13T19:06:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.231+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804875627776] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.231+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804875633552] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804875631056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef6c60 con 0x7f40c00cd040 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=0 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=1 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=2 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=3 2024-09-13T19:06:42.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=4 2024-09-13T19:06:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=5 2024-09-13T19:06:42.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=6 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804875631056] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 20 add_watcher() i=7 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397aefa6a0 con 0x56397aee6ac0 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.235+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804875635072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef7b20 con 0x56397aee6ac0 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804875635072] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3f7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 5 note: GC not initialized 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3f7a7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 Filter name: none 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3eebfff640 20 reqs_thread_entry: start 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397af1dbd0 con 0x56397aee6ac0 2024-09-13T19:06:42.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397af1e640 con 0x56397aee6ac0 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-13T19:06:42.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af24010 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94804875819648 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397af1f650 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify (1) cookie 94804875630000 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f40bc03b040 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3fad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94804875630000 notifier 4358 bl.length()=732 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3fad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3fad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify cookie 94804875819648 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f3fad7fa640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3f8c003eb0 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== watch-notify(notify_complete (2) cookie 94804875819648 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40bc010040 con 0x56397aee6ac0 2024-09-13T19:06:42.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.239+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af23a80 con 0x56397aee6ac0 2024-09-13T19:06:42.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94804875819648 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56397af1f1a0 con 0x7f40c4070020 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== watch-notify(notify (1) cookie 94804875611584 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f40c00e1040 con 0x7f40c4070020 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f3fad7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94804875611584 notifier 4358 bl.length()=166 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f3fad7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f3fad7fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(68 notify.0 [notify cookie 94804875819648 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f3fad7fa640 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3f8c003eb0 con 0x7f40c4070020 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== watch-notify(notify_complete (2) cookie 94804875819648 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56397adbc240 con 0x7f40c4070020 2024-09-13T19:06:42.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.248 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"mIgkiNdJX6NyuYTX3CcR1L9C2qoWUlScKPJgHkIl","active":true,"create_date":"2024-09-13T19:06:42.242526Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f3f7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804875635072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af1ba00 con 0x56397aee6ac0 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94804875635072] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.243+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804875611584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af1ba00 con 0x7f40c4070020 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94804875611584] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40cc48f980 20 remove_watcher() i=0 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40cc48f980 2 removed watcher, disabling cache 2024-09-13T19:06:42.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804875615968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af1ba00 con 0x56397aee6ac0 2024-09-13T19:06:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94804875615968] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40cc48f980 20 remove_watcher() i=1 2024-09-13T19:06:42.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.247+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804875618096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef1ee0 con 0x56397aeeb480 2024-09-13T19:06:42.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40c9f9f640 1 -- 172.21.15.151:0/2081898653 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94804875618096] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c4038070 con 0x56397aeeb480 2024-09-13T19:06:42.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 20 remove_watcher() i=2 2024-09-13T19:06:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804875626448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af1ba00 con 0x7f40c4070020 2024-09-13T19:06:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40c979e640 1 -- 172.21.15.151:0/2081898653 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94804875626448] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c00d8070 con 0x7f40c4070020 2024-09-13T19:06:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 20 remove_watcher() i=3 2024-09-13T19:06:42.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804875630000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef2730 con 0x56397aee6ac0 2024-09-13T19:06:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94804875630000] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x56397aee6ac0 2024-09-13T19:06:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 20 remove_watcher() i=4 2024-09-13T19:06:42.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.251+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804875627776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef1ee0 con 0x7f40c00cd040 2024-09-13T19:06:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94804875627776] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40cc48f980 20 remove_watcher() i=5 2024-09-13T19:06:42.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804875633552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397aef47d0 con 0x7f40c00cd040 2024-09-13T19:06:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94804875633552] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40cc48f980 20 remove_watcher() i=6 2024-09-13T19:06:42.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.255+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804875631056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56397af1ba00 con 0x7f40c00cd040 2024-09-13T19:06:42.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94804875631056] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40bc0083f0 con 0x7f40c00cd040 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 20 remove_watcher() i=7 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40c00cd040 msgr2=0x7f40c00b7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f40c00cd040 0x7f40c00b7930 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aee6ac0 msgr2=0x56397aee8f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aee6ac0 0x56397aee8f80 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f40c4070020 msgr2=0x7f40c4046130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f40c4070020 0x7f40c4046130 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeeb480 msgr2=0x56397aeed870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeeb480 0x56397aeed870 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3f940346a0 msgr2=0x7f3f94036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3f940346a0 0x7f3f94036b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f40c0017e90 tx=0x7f40c00b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 msgr2=0x56397aedba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2081898653 reap_dead start 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40c40419d0 tx=0x7f40c403b210 comp rx=0 tx=0).stop 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 shutdown_connections 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2081898653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397ae9d8b0 0x56397aedba80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 >> 172.21.15.151:0/2081898653 conn(0x56397aecec60 msgr2=0x56397aeccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 shutdown_connections 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2081898653 wait complete. 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 msgr2=0x7f3fa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 0x7f3fa4036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x56397aeb0a50 tx=0x7f40c0005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 msgr2=0x56397aec6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f40c400f4c0 tx=0x7f40c4022ea0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 shutdown_connections 2024-09-13T19:06:42.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fa4034650 0x7f3fa4036b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2706405230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397aec6030 0x56397aec6450 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 >> 172.21.15.151:0/2706405230 conn(0x56397aebb180 msgr2=0x56397aebdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 shutdown_connections 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2706405230 wait complete. 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aeacf30 msgr2=0x56397aeaf320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56397aeacf30 0x56397aeaf320 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56397aeb5b00 msgr2=0x56397aeb7ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56397aeb5b00 0x56397aeb7ef0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeb1be0 msgr2=0x56397aeb3fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56397aeb1be0 0x56397aeb3fd0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fb0034650 msgr2=0x7f3fb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3fb0034650 0x7f3fb0036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f40c00ad000 tx=0x7f40c00a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 msgr2=0x56397aea7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 --2- 172.21.15.151:0/2124857935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56397adb8900 0x56397aea7e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f40c4014040 tx=0x7f40c4001260 comp rx=0 tx=0).stop 2024-09-13T19:06:42.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40ca7a0640 1 -- 172.21.15.151:0/2124857935 reap_dead start 2024-09-13T19:06:42.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 shutdown_connections 2024-09-13T19:06:42.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 >> 172.21.15.151:0/2124857935 conn(0x56397adb00a0 msgr2=0x56397ae9e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 shutdown_connections 2024-09-13T19:06:42.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.259+0000 7f40cc48f980 1 -- 172.21.15.151:0/2124857935 wait complete. 2024-09-13T19:06:42.272 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'mIgkiNdJX6NyuYTX3CcR1L9C2qoWUlScKPJgHkIl', 'active': True, 'create_date': '2024-09-13T19:06:42.242526Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.272 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:06:42.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-13T19:06:42.272 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-13T19:06:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:42.353 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f7230f13980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561046a56890 0x561046a58c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f7230f13980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610468dbae0 con 0x561046a52510 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f7230f13980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5610468ffe30 con 0x561046a56890 2024-09-13T19:06:42.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f722e222640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561046a56890 0x561046a58c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f722ea23640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x561046a52510 0x561046a528f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33452/0 (socket says 172.21.15.151:33452) 2024-09-13T19:06:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f722ea23640 1 -- 172.21.15.151:0/1219906635 learned_addr learned my addr 172.21.15.151:0/1219906635 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f722e222640 1 -- 172.21.15.151:0/1219906635 >> v1:172.21.15.12:6789/0 conn(0x561046a52510 legacy=0x561046a528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.351+0000 7f722e222640 1 -- 172.21.15.151:0/1219906635 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046a5a1d0 con 0x561046a56890 2024-09-13T19:06:42.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f722e222640 1 --2- 172.21.15.151:0/1219906635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a56890 0x561046a58c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f722400a480 tx=0x7f722401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6455fdd701f7ace server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f722da21640 1 -- 172.21.15.151:0/1219906635 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72240b0070 con 0x561046a56890 2024-09-13T19:06:42.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f722da21640 1 -- 172.21.15.151:0/1219906635 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72240ab540 con 0x561046a56890 2024-09-13T19:06:42.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f722da21640 1 -- 172.21.15.151:0/1219906635 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72240ab840 con 0x561046a56890 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 -- 172.21.15.151:0/1219906635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a56890 msgr2=0x561046a58c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 --2- 172.21.15.151:0/1219906635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a56890 0x561046a58c80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f722400a480 tx=0x7f722401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 -- 172.21.15.151:0/1219906635 shutdown_connections 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 --2- 172.21.15.151:0/1219906635 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a56890 0x561046a58c80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 -- 172.21.15.151:0/1219906635 >> 172.21.15.151:0/1219906635 conn(0x561046a4e030 msgr2=0x561046a50450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 -- 172.21.15.151:0/1219906635 shutdown_connections 2024-09-13T19:06:42.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.355+0000 7f7230f13980 1 -- 172.21.15.151:0/1219906635 wait complete. 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.367+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.367+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.367+0000 7f7230f13980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.367+0000 7f7230f13980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561046901200 con 0x561046a52510 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56394/0 (socket says 172.21.15.151:56394) 2024-09-13T19:06:42.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 -- 172.21.15.151:0/3073007401 learned_addr learned my addr 172.21.15.151:0/3073007401 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 -- 172.21.15.151:0/3073007401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046b3df70 con 0x561046a52510 2024-09-13T19:06:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 --2- 172.21.15.151:0/3073007401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72280017b0 tx=0x7f7228001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4fce67f9b4462d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f711ce09640 1 -- 172.21.15.151:0/3073007401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228016070 con 0x561046a52510 2024-09-13T19:06:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f711ce09640 1 -- 172.21.15.151:0/3073007401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228004530 con 0x561046a52510 2024-09-13T19:06:42.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f711ce09640 1 -- 172.21.15.151:0/3073007401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228004870 con 0x561046a52510 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- 172.21.15.151:0/3073007401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 msgr2=0x561046b3d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 --2- 172.21.15.151:0/3073007401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f72280017b0 tx=0x7f7228001c70 comp rx=0 tx=0).stop 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- 172.21.15.151:0/3073007401 shutdown_connections 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 --2- 172.21.15.151:0/3073007401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b3d9a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- 172.21.15.151:0/3073007401 >> 172.21.15.151:0/3073007401 conn(0x561046a4e030 msgr2=0x561046b395d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- 172.21.15.151:0/3073007401 shutdown_connections 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- 172.21.15.151:0/3073007401 wait complete. 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b43c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f7230f13980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561046a59cd0 con 0x561046a52510 2024-09-13T19:06:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b43c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56408/0 (socket says 172.21.15.151:56408) 2024-09-13T19:06:42.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 -- 172.21.15.151:0/1259309202 learned_addr learned my addr 172.21.15.151:0/1259309202 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.371+0000 7f722ea23640 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046b44180 con 0x561046a52510 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722ea23640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b43c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7228000f90 tx=0x7f7228001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 -- 172.21.15.151:0/1259309202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228020070 con 0x561046a52510 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 -- 172.21.15.151:0/1259309202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228011400 con 0x561046a52510 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561046b44410 con 0x561046a52510 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 -- 172.21.15.151:0/1259309202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228016040 con 0x561046a52510 2024-09-13T19:06:42.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561046b470f0 con 0x561046a52510 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 -- 172.21.15.151:0/1259309202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7228023070 con 0x561046a52510 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f71140368b0 0x7f7114038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f711b606640 1 -- 172.21.15.151:0/1259309202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72280491c0 con 0x561046a52510 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722e222640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f71140368b0 0x7f7114038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046a56890 0x561046b4ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b4b280 con 0x561046a56890 2024-09-13T19:06:42.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722f224640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046a56890 0x561046b4ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722e222640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f71140368b0 0x7f7114038d70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f72240ad000 tx=0x7f72240a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722f224640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046a56890 0x561046b4ad40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722f224640 1 -- 172.21.15.151:0/1259309202 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72200083f0 con 0x561046a56890 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b482e0 con 0x561046a56890 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722f224640 1 -- 172.21.15.151:0/1259309202 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72200083f0 con 0x561046a56890 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b4d520 0x561046b4f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b50000 con 0x561046b4d520 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722ea23640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b4d520 0x561046b4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722ea23640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b4d520 0x561046b4f910 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f722ea23640 1 -- 172.21.15.151:0/1259309202 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f722802c070 con 0x561046b4d520 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.375+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b4c3c0 con 0x561046a56890 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722f224640 1 -- 172.21.15.151:0/1259309202 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72200083f0 con 0x561046a56890 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561046b51460 0x561046b53850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b53ef0 con 0x561046b51460 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722e222640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561046b51460 0x561046b53850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722e222640 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561046b51460 0x561046b53850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722e222640 1 -- 172.21.15.151:0/1259309202 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72240b3040 con 0x561046b51460 2024-09-13T19:06:42.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56104695a800 con 0x561046b61990 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56416/0 (socket says 172.21.15.151:56416) 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722ea23640 1 -- 172.21.15.151:0/66878926 learned_addr learned my addr 172.21.15.151:0/66878926 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722ea23640 1 -- 172.21.15.151:0/66878926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046b622f0 con 0x561046b61990 2024-09-13T19:06:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f722ea23640 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7228006830 tx=0x7f7228023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7118e01640 1 -- 172.21.15.151:0/66878926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722803e070 con 0x561046b61990 2024-09-13T19:06:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7118e01640 1 -- 172.21.15.151:0/66878926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72280116e0 con 0x561046b61990 2024-09-13T19:06:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7118e01640 1 -- 172.21.15.151:0/66878926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722802a040 con 0x561046b61990 2024-09-13T19:06:42.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561046b62580 con 0x561046b61990 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.379+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561046b65200 con 0x561046b61990 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7118e01640 1 -- 172.21.15.151:0/66878926 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72280119c0 con 0x561046b61990 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7118e01640 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 0x7f7108036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7118e01640 1 -- 172.21.15.151:0/66878926 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f722804ea00 con 0x561046b61990 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722e222640 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 0x7f7108036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561046b3e2f0 con 0x561046b6e290 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722e222640 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 0x7f7108036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x561046b48200 tx=0x7f7224005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56422/0 (socket says 172.21.15.151:56422) 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 -- 172.21.15.151:0/3592058242 learned_addr learned my addr 172.21.15.151:0/3592058242 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 -- 172.21.15.151:0/3592058242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046b6ec40 con 0x561046b6e290 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 --2- 172.21.15.151:0/3592058242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7228023c10 tx=0x7f7228039b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4d2463b3ec1df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f71127fc640 1 -- 172.21.15.151:0/3592058242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f722805b070 con 0x561046b6e290 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f71127fc640 1 -- 172.21.15.151:0/3592058242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228012030 con 0x561046b6e290 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f71127fc640 1 -- 172.21.15.151:0/3592058242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228026640 con 0x561046b6e290 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- 172.21.15.151:0/3592058242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 msgr2=0x561046b6e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 --2- 172.21.15.151:0/3592058242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7228023c10 tx=0x7f7228039b10 comp rx=0 tx=0).stop 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- 172.21.15.151:0/3592058242 shutdown_connections 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 --2- 172.21.15.151:0/3592058242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b6e670 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- 172.21.15.151:0/3592058242 >> 172.21.15.151:0/3592058242 conn(0x561046b6a670 msgr2=0x561046b68770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- 172.21.15.151:0/3592058242 shutdown_connections 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- 172.21.15.151:0/3592058242 wait complete. 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 Processor -- start 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- start start 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f7230f13980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561046b6f0e0 con 0x561046b6e290 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56438/0 (socket says 172.21.15.151:56438) 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.383+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 learned_addr learned my addr 172.21.15.151:0/3188116726 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561046b75990 con 0x561046b6e290 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722ea23640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f722801b720 tx=0x7f7228056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 -- 172.21.15.151:0/3188116726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7228025610 con 0x561046b6e290 2024-09-13T19:06:42.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 -- 172.21.15.151:0/3188116726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72280257b0 con 0x561046b6e290 2024-09-13T19:06:42.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 -- 172.21.15.151:0/3188116726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72280498e0 con 0x561046b6e290 2024-09-13T19:06:42.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561046b75990 con 0x561046b6e290 2024-09-13T19:06:42.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561046b75990 con 0x561046b6e290 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 -- 172.21.15.151:0/3188116726 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f722806d020 con 0x561046b6e290 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f70f8034650 0x7f70f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7110ff9640 1 -- 172.21.15.151:0/3188116726 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7228034140 con 0x561046b6e290 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722e222640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f70f8034650 0x7f70f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046b804f0 0x561046b82990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b830e0 con 0x561046b804f0 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722f224640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046b804f0 0x561046b82990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722f224640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046b804f0 0x561046b82990 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722e222640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f70f8034650 0x7f70f8036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c10 tx=0x7f72240b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72200083f0 con 0x561046b804f0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 realm 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b834f0 con 0x561046b804f0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72200083f0 con 0x561046b804f0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b83d90 con 0x561046b804f0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72200083f0 con 0x561046b804f0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.387+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72200083f0 con 0x561046b804f0 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b84e90 0x561046b87280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b87920 con 0x561046b84e90 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b84e90 0x561046b87280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b84e90 0x561046b87280 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 20 searching for the correct realm 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b89180 con 0x561046b84e90 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7228060070 0x7f722804e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b89180 con 0x7f7228060070 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722e222640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7228060070 0x7f722804e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722e222640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7228060070 0x7f722804e050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722e222640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f72240dc040 0x7f72240dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b89180 con 0x7f72240dc040 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f72240dc040 0x7f72240dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f72240dc040 0x7f72240dd430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72200083f0 con 0x7f72240dc040 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72200083f0 con 0x561046b804f0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.391+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f7228060070 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f7228060070 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.395+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f7228060070 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.399+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f7228060070 2024-09-13T19:06:42.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b84e90 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f72240dc040 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x561046b804f0 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561046b84130 con 0x7f7228060070 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b88270 con 0x561046b804f0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b88ac0 con 0x561046b804f0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b88610 con 0x7f7228060070 2024-09-13T19:06:42.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 zone default found 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 4 Realm: () 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 zonegroup default 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.403+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b895b0 con 0x7f72240dc040 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b8af90 con 0x561046b84e90 2024-09-13T19:06:42.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b8b4d0 con 0x561046b84e90 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 started sync module instance, tier type = 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8a430 con 0x7f7228060070 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94627905972256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8a090 con 0x7f7228060070 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8c2f0 con 0x561046b804f0 2024-09-13T19:06:42.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.407+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94627905972256] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94627905976624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8c6e0 con 0x561046b804f0 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8d0a0 con 0x561046b84e90 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94627905981424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8d8f0 con 0x561046b84e90 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8e310 con 0x7f7228060070 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94627905988352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8efd0 con 0x7f7228060070 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.411+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8f990 con 0x561046b804f0 2024-09-13T19:06:42.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94627905988352] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94627905976624] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94627905981424] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94627905977680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8d550 con 0x561046b804f0 2024-09-13T19:06:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8f990 con 0x7f72240dc040 2024-09-13T19:06:42.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.415+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94627905977680] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94627905989824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8f990 con 0x7f72240dc040 2024-09-13T19:06:42.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b901e0 con 0x7f72240dc040 2024-09-13T19:06:42.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94627905989824] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94627905992384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b90030 con 0x7f72240dc040 2024-09-13T19:06:42.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.419+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b90b50 con 0x7f72240dc040 2024-09-13T19:06:42.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94627905992384] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94627905996320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b90b10 con 0x7f72240dc040 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=0 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=1 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=2 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=3 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=4 2024-09-13T19:06:42.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=5 2024-09-13T19:06:42.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=6 2024-09-13T19:06:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94627905996320] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 20 add_watcher() i=7 2024-09-13T19:06:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046b93f70 con 0x561046b804f0 2024-09-13T19:06:42.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.423+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94627905993440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b91460 con 0x561046b804f0 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94627905993440] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f70e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 5 note: GC not initialized 2024-09-13T19:06:42.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f705ffff640 20 reqs_thread_entry: start 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 Filter name: none 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f705dffb640 20 reqs_thread_entry: start 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046bb7640 con 0x561046b804f0 2024-09-13T19:06:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046bbddb0 con 0x561046b804f0 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94627906181152 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561046bb94e0 con 0x561046b804f0 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94627905977680 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f7220010040 con 0x561046b804f0 2024-09-13T19:06:42.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f71127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94627905977680 notifier 4365 bl.length()=732 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f71127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f71127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 94627906181152 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f71127fc640 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f70f4003eb0 con 0x561046b804f0 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.427+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94627906181152 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f722000ac90 con 0x561046b804f0 2024-09-13T19:06:42.433 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f70e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94627905993440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046bb9910 con 0x561046b804f0 2024-09-13T19:06:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94627905993440] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94627905972256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8fae0 con 0x7f7228060070 2024-09-13T19:06:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94627905972256] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f7230f13980 20 remove_watcher() i=0 2024-09-13T19:06:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f7230f13980 2 removed watcher, disabling cache 2024-09-13T19:06:42.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.431+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94627905976624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8a820 con 0x561046b804f0 2024-09-13T19:06:42.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94627905976624] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 20 remove_watcher() i=1 2024-09-13T19:06:42.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94627905981424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8fae0 con 0x561046b84e90 2024-09-13T19:06:42.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f722ea23640 1 -- 172.21.15.151:0/3188116726 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94627905981424] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f722805d030 con 0x561046b84e90 2024-09-13T19:06:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 20 remove_watcher() i=2 2024-09-13T19:06:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94627905988352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8b930 con 0x7f7228060070 2024-09-13T19:06:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f722e222640 1 -- 172.21.15.151:0/3188116726 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94627905988352] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72240c9030 con 0x7f7228060070 2024-09-13T19:06:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 20 remove_watcher() i=3 2024-09-13T19:06:42.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.435+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94627905977680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8fae0 con 0x561046b804f0 2024-09-13T19:06:42.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94627905977680] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x561046b804f0 2024-09-13T19:06:42.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f7230f13980 20 remove_watcher() i=4 2024-09-13T19:06:42.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94627905989824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8e700 con 0x7f72240dc040 2024-09-13T19:06:42.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94627905989824] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f7230f13980 20 remove_watcher() i=5 2024-09-13T19:06:42.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.439+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94627905992384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8fae0 con 0x7f72240dc040 2024-09-13T19:06:42.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.443+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94627905992384] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.443+0000 7f7230f13980 20 remove_watcher() i=6 2024-09-13T19:06:42.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.443+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94627905996320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561046b8e700 con 0x7f72240dc040 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94627905996320] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7220027040 con 0x7f72240dc040 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 20 remove_watcher() i=7 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f72240dc040 msgr2=0x7f72240dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f72240dc040 0x7f72240dd430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046b804f0 msgr2=0x561046b82990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046b804f0 0x561046b82990 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7228060070 msgr2=0x7f722804e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7228060070 0x7f722804e050 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b84e90 msgr2=0x561046b87280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b84e90 0x561046b87280 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f70f8034650 msgr2=0x7f70f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f70f8034650 0x7f70f8036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c10 tx=0x7f72240b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 msgr2=0x561046b75450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f722f224640 1 -- 172.21.15.151:0/3188116726 reap_dead start 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f722801b720 tx=0x7f7228056000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 shutdown_connections 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/3188116726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b6e290 0x561046b75450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 >> 172.21.15.151:0/3188116726 conn(0x561046b6a670 msgr2=0x561046b68740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 shutdown_connections 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/3188116726 wait complete. 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 msgr2=0x7f7108036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 0x7f7108036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x561046b48200 tx=0x7f7224005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 msgr2=0x561046b61db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7228006830 tx=0x7f7228023ac0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 shutdown_connections 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7108034650 0x7f7108036b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/66878926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046b61990 0x561046b61db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 >> 172.21.15.151:0/66878926 conn(0x561046b56ae0 msgr2=0x561046b59560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 shutdown_connections 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/66878926 wait complete. 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046a56890 msgr2=0x561046b4ad40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561046a56890 0x561046b4ad40 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561046b51460 msgr2=0x561046b53850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561046b51460 0x561046b53850 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b4d520 msgr2=0x561046b4f910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561046b4d520 0x561046b4f910 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f71140368b0 msgr2=0x7f7114038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f71140368b0 0x7f7114038d70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f72240ad000 tx=0x7f72240a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 msgr2=0x561046b43c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 --2- 172.21.15.151:0/1259309202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561046a52510 0x561046b43c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7228000f90 tx=0x7f7228001260 comp rx=0 tx=0).stop 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f722f224640 1 -- 172.21.15.151:0/1259309202 reap_dead start 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 shutdown_connections 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 >> 172.21.15.151:0/1259309202 conn(0x561046a4e030 msgr2=0x561046b38150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 shutdown_connections 2024-09-13T19:06:42.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.447+0000 7f7230f13980 1 -- 172.21.15.151:0/1259309202 wait complete. 2024-09-13T19:06:42.459 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.459 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.459 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:42.531 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:42.532 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:42.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d4d3b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b529287a10 0x55b529289e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d4d3b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b52910bae0 con 0x55b529283690 2024-09-13T19:06:42.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d4d3b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55b52912fe30 con 0x55b529287a10 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d204a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b529287a10 0x55b529289e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d284b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55b529283690 0x55b529283a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33458/0 (socket says 172.21.15.151:33458) 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d284b640 1 -- 172.21.15.151:0/1032343364 learned_addr learned my addr 172.21.15.151:0/1032343364 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d1849640 1 -- 172.21.15.151:0/1032343364 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943977043 0 0) 0x55b52910bae0 con 0x55b529283690 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d1849640 1 -- 172.21.15.151:0/1032343364 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73bc001e20 con 0x55b529283690 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d204a640 1 -- 172.21.15.151:0/1032343364 >> v1:172.21.15.12:6789/0 conn(0x55b529283690 legacy=0x55b529283a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.531+0000 7f73d204a640 1 -- 172.21.15.151:0/1032343364 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b52928b350 con 0x55b529287a10 2024-09-13T19:06:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d204a640 1 --2- 172.21.15.151:0/1032343364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529289e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f73c800a480 tx=0x7f73c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5a04cda27dee01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d1849640 1 -- 172.21.15.151:0/1032343364 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c80b0070 con 0x55b529287a10 2024-09-13T19:06:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d1849640 1 -- 172.21.15.151:0/1032343364 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c80ab540 con 0x55b529287a10 2024-09-13T19:06:42.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d1849640 1 -- 172.21.15.151:0/1032343364 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c80ab820 con 0x55b529287a10 2024-09-13T19:06:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1032343364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 msgr2=0x55b529289e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1032343364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529289e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f73c800a480 tx=0x7f73c801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1032343364 shutdown_connections 2024-09-13T19:06:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1032343364 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529289e00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1032343364 >> 172.21.15.151:0/1032343364 conn(0x55b52927f1b0 msgr2=0x55b5292815d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1032343364 shutdown_connections 2024-09-13T19:06:42.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.535+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1032343364 wait complete. 2024-09-13T19:06:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d4d3b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d4d3b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b529131200 con 0x55b529283690 2024-09-13T19:06:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56446/0 (socket says 172.21.15.151:56446) 2024-09-13T19:06:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d284b640 1 -- 172.21.15.151:0/3039804229 learned_addr learned my addr 172.21.15.151:0/3039804229 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d284b640 1 -- 172.21.15.151:0/3039804229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5291fa940 con 0x55b529283690 2024-09-13T19:06:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f73d284b640 1 --2- 172.21.15.151:0/3039804229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f73c4001dc0 tx=0x7f73c400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65230e0fac55aef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f72c0e09640 1 -- 172.21.15.151:0/3039804229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c4012020 con 0x55b529283690 2024-09-13T19:06:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f72c0e09640 1 -- 172.21.15.151:0/3039804229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c400e7c0 con 0x55b529283690 2024-09-13T19:06:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.547+0000 7f72c0e09640 1 -- 172.21.15.151:0/3039804229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c400eb40 con 0x55b529283690 2024-09-13T19:06:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/3039804229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 msgr2=0x55b5291fa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/3039804229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f73c4001dc0 tx=0x7f73c400b6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/3039804229 shutdown_connections 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/3039804229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529283690 0x55b5291fa370 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/3039804229 >> 172.21.15.151:0/3039804229 conn(0x55b52927f1b0 msgr2=0x55b52936a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/3039804229 shutdown_connections 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/3039804229 wait complete. 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529377ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b52928ae50 con 0x55b529287a10 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529377ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529377ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56460/0 (socket says 172.21.15.151:56460) 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d284b640 1 -- 172.21.15.151:0/1661474625 learned_addr learned my addr 172.21.15.151:0/1661474625 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d284b640 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b529378530 con 0x55b529287a10 2024-09-13T19:06:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d284b640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529377ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55b5291f9ef0 tx=0x7f73c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f72bf606640 1 -- 172.21.15.151:0/1661474625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c4012030 con 0x55b529287a10 2024-09-13T19:06:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5293787c0 con 0x55b529287a10 2024-09-13T19:06:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f72bf606640 1 -- 172.21.15.151:0/1661474625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c4001440 con 0x55b529287a10 2024-09-13T19:06:42.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f72bf606640 1 -- 172.21.15.151:0/1661474625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c401aa50 con 0x55b529287a10 2024-09-13T19:06:42.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b52937b4a0 con 0x55b529287a10 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.551+0000 7f72bf606640 1 -- 172.21.15.151:0/1661474625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73c4015020 con 0x55b529287a10 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f72bf606640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72b8034650 0x7f72b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f72bf606640 1 -- 172.21.15.151:0/1661474625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73c4020030 con 0x55b529287a10 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d204a640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72b8034650 0x7f72b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b52937cf70 0x55b52937f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b52937fa10 con 0x55b52937cf70 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d304c640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b52937cf70 0x55b52937f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d204a640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72b8034650 0x7f72b8036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ad000 tx=0x7f73c80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d304c640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b52937cf70 0x55b52937f3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d304c640 1 -- 172.21.15.151:0/1661474625 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b52937cf70 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b52937c6c0 con 0x55b52937cf70 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d304c640 1 -- 172.21.15.151:0/1661474625 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b52937cf70 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b529381d60 0x55b529384150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b529384840 con 0x55b529381d60 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d284b640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b529381d60 0x55b529384150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d284b640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b529381d60 0x55b529384150 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d284b640 1 -- 172.21.15.151:0/1661474625 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73c4008030 con 0x55b529381d60 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b529380c00 con 0x55b52937cf70 2024-09-13T19:06:42.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d304c640 1 -- 172.21.15.151:0/1661474625 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b52937cf70 2024-09-13T19:06:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b529385ca0 0x55b529388090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293887d0 con 0x55b529385ca0 2024-09-13T19:06:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d204a640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b529385ca0 0x55b529388090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d204a640 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b529385ca0 0x55b529388090 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d204a640 1 -- 172.21.15.151:0/1661474625 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73c80b3040 con 0x55b529385ca0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d4d3b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b52918a800 con 0x55b5293962c0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.555+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56476/0 (socket says 172.21.15.151:56476) 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 -- 172.21.15.151:0/2308933711 learned_addr learned my addr 172.21.15.151:0/2308933711 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 -- 172.21.15.151:0/2308933711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b529396c20 con 0x55b5293962c0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f73c4048430 tx=0x7f73c4016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 -- 172.21.15.151:0/2308933711 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c4018560 con 0x55b5293962c0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 -- 172.21.15.151:0/2308933711 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c40163b0 con 0x55b5293962c0 2024-09-13T19:06:42.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b529396eb0 con 0x55b5293962c0 2024-09-13T19:06:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 -- 172.21.15.151:0/2308933711 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c4017c50 con 0x55b5293962c0 2024-09-13T19:06:42.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b529399b30 con 0x55b5293962c0 2024-09-13T19:06:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 -- 172.21.15.151:0/2308933711 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73c404b020 con 0x55b5293962c0 2024-09-13T19:06:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 0x7f72ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f72bce01640 1 -- 172.21.15.151:0/2308933711 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73c4039070 con 0x55b5293962c0 2024-09-13T19:06:42.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d204a640 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 0x7f72ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d204a640 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 0x7f72ac036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55b52937fee0 tx=0x7f73c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d4d3b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b5291f8b60 con 0x55b5293a2b80 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56480/0 (socket says 172.21.15.151:56480) 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 -- 172.21.15.151:0/725616429 learned_addr learned my addr 172.21.15.151:0/725616429 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.559+0000 7f73d284b640 1 -- 172.21.15.151:0/725616429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5293a3550 con 0x55b5293a2b80 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 --2- 172.21.15.151:0/725616429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73c4020000 tx=0x7f73c4045470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b865d19967b2ed35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b67fc640 1 -- 172.21.15.151:0/725616429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c402fd30 con 0x55b5293a2b80 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b67fc640 1 -- 172.21.15.151:0/725616429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c405b070 con 0x55b5293a2b80 2024-09-13T19:06:42.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b67fc640 1 -- 172.21.15.151:0/725616429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c400c580 con 0x55b5293a2b80 2024-09-13T19:06:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/725616429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 msgr2=0x55b5293a2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/725616429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73c4020000 tx=0x7f73c4045470 comp rx=0 tx=0).stop 2024-09-13T19:06:42.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/725616429 shutdown_connections 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/725616429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a2f80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/725616429 >> 172.21.15.151:0/725616429 conn(0x55b52939efb0 msgr2=0x55b52939d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/725616429 shutdown_connections 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/725616429 wait complete. 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 Processor -- start 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- start start 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b5293a3a20 con 0x55b5293a2b80 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56484/0 (socket says 172.21.15.151:56484) 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 learned_addr learned my addr 172.21.15.151:0/2390887630 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5293aa290 con 0x55b5293a2b80 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d284b640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f73c4026040 tx=0x7f73c401fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b4ff9640 1 -- 172.21.15.151:0/2390887630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c40247a0 con 0x55b5293a2b80 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b5293aa290 con 0x55b5293a2b80 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b4ff9640 1 -- 172.21.15.151:0/2390887630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c4024940 con 0x55b5293a2b80 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f72b4ff9640 1 -- 172.21.15.151:0/2390887630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c401c9a0 con 0x55b5293a2b80 2024-09-13T19:06:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.563+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5293aa290 con 0x55b5293a2b80 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f72b4ff9640 1 -- 172.21.15.151:0/2390887630 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f73c4071060 con 0x55b5293a2b80 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f72b4ff9640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f729c034650 0x7f729c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f72b4ff9640 1 -- 172.21.15.151:0/2390887630 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73c4053040 con 0x55b5293a2b80 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f729c034650 0x7f729c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b5293b4ec0 0x55b5293b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b7ad0 con 0x55b5293b4ec0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b5293b4ec0 0x55b5293b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f729c034650 0x7f729c036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f73c8018eb0 tx=0x7f73c80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b5293b4ec0 0x55b5293b7380 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 realm 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b7ee0 con 0x55b5293b4ec0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8780 con 0x55b5293b4ec0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b5293b9880 0x55b5293bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bc1f0 con 0x55b5293b9880 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b5293b9880 0x55b5293bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b5293b9880 0x55b5293bbc70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 20 searching for the correct realm 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bda90 con 0x55b5293b9880 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f73c4073070 0x7f73c4031790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bda90 con 0x7f73c4073070 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f73c4073070 0x7f73c4031790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f73c4073070 0x7f73c4031790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f73c80dc040 0x7f73c80dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.567+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bda90 con 0x7f73c80dc040 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f73c80dc040 0x7f73c80dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f73c80dc040 0x7f73c80dd430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c4073070 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.571+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c4073070 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.575+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c4073070 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c4073070 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b9880 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c80dc040 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x55b5293b4ec0 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b5293b8b20 con 0x7f73c4073070 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.579+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bca40 con 0x55b5293b4ec0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bce30 con 0x55b5293b4ec0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bce30 con 0x7f73c4073070 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 zone default found 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 4 Realm: () 2024-09-13T19:06:42.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 zonegroup default 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bdf60 con 0x7f73c80dc040 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bf940 con 0x55b5293b9880 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bfce0 con 0x55b5293b9880 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 started sync module instance, tier type = 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bede0 con 0x7f73c4073070 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94236569235968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c0530 con 0x7f73c4073070 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.583+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c0d80 con 0x55b5293b4ec0 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94236569235968] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94236569239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c0d80 con 0x55b5293b4ec0 2024-09-13T19:06:42.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c1840 con 0x55b5293b9880 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94236569244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c20e0 con 0x55b5293b9880 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.587+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c2b00 con 0x7f73c4073070 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94236569239680] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94236569241808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c33a0 con 0x7f73c4073070 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c3bf0 con 0x55b5293b4ec0 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94236569241808] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94236569244432] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94236569251568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c37c0 con 0x55b5293b4ec0 2024-09-13T19:06:42.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.591+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c4490 con 0x7f73c80dc040 2024-09-13T19:06:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94236569255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c4750 con 0x7f73c80dc040 2024-09-13T19:06:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c4fa0 con 0x7f73c80dc040 2024-09-13T19:06:42.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94236569251568] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94236569255552] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94236569256608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c4b70 con 0x7f73c80dc040 2024-09-13T19:06:42.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.595+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c53c0 con 0x7f73c80dc040 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94236569256608] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94236569257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c5200 con 0x7f73c80dc040 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=0 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=1 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=2 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=3 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=4 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=5 2024-09-13T19:06:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=6 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94236569257936] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 20 add_watcher() i=7 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.599+0000 7f73d4d3b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c8740 con 0x55b5293b4ec0 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94236569259152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c5c00 con 0x55b5293b4ec0 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94236569259152] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f72897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 5 note: GC not initialized 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f7203fff640 20 reqs_thread_entry: start 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 Filter name: none 2024-09-13T19:06:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f7201ffb640 20 reqs_thread_entry: start 2024-09-13T19:06:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b5293eb900 con 0x55b5293b4ec0 2024-09-13T19:06:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:06:42.608 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f72897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.603+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94236569259152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293ea4b0 con 0x55b5293b4ec0 2024-09-13T19:06:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94236569259152] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94236569235968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293ea4b0 con 0x7f73c4073070 2024-09-13T19:06:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94236569235968] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 20 remove_watcher() i=0 2024-09-13T19:06:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 2 removed watcher, disabling cache 2024-09-13T19:06:42.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94236569239680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293bf200 con 0x55b5293b4ec0 2024-09-13T19:06:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94236569239680] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 20 remove_watcher() i=1 2024-09-13T19:06:42.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.607+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94236569244432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c0080 con 0x55b5293b9880 2024-09-13T19:06:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d284b640 1 -- 172.21.15.151:0/2390887630 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94236569244432] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c4008030 con 0x55b5293b9880 2024-09-13T19:06:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d4d3b980 20 remove_watcher() i=2 2024-09-13T19:06:42.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94236569241808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c1310 con 0x7f73c4073070 2024-09-13T19:06:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d204a640 1 -- 172.21.15.151:0/2390887630 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94236569241808] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73c80c9030 con 0x7f73c4073070 2024-09-13T19:06:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d4d3b980 20 remove_watcher() i=3 2024-09-13T19:06:42.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.611+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94236569251568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c1310 con 0x55b5293b4ec0 2024-09-13T19:06:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94236569251568] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x55b5293b4ec0 2024-09-13T19:06:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d4d3b980 20 remove_watcher() i=4 2024-09-13T19:06:42.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94236569255552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c2ef0 con 0x7f73c80dc040 2024-09-13T19:06:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94236569255552] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d4d3b980 20 remove_watcher() i=5 2024-09-13T19:06:42.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.615+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94236569256608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c3e80 con 0x7f73c80dc040 2024-09-13T19:06:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94236569256608] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 20 remove_watcher() i=6 2024-09-13T19:06:42.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94236569257936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b5293c2ef0 con 0x7f73c80dc040 2024-09-13T19:06:42.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94236569257936] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73cc00a4d0 con 0x7f73c80dc040 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 20 remove_watcher() i=7 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f73c80dc040 msgr2=0x7f73c80dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f73c80dc040 0x7f73c80dd430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b5293b4ec0 msgr2=0x55b5293b7380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b5293b4ec0 0x55b5293b7380 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f73c4073070 msgr2=0x7f73c4031790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f73c4073070 0x7f73c4031790 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b5293b9880 msgr2=0x55b5293bbc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b5293b9880 0x55b5293bbc70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f729c034650 msgr2=0x7f729c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f729c034650 0x7f729c036b10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f73c8018eb0 tx=0x7f73c80b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 msgr2=0x55b5293a9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d304c640 1 -- 172.21.15.151:0/2390887630 reap_dead start 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f73c4026040 tx=0x7f73c401fed0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 shutdown_connections 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2390887630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293a2b80 0x55b5293a9d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 >> 172.21.15.151:0/2390887630 conn(0x55b52939efb0 msgr2=0x55b52939d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 shutdown_connections 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2390887630 wait complete. 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 msgr2=0x7f72ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 0x7f72ac036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55b52937fee0 tx=0x7f73c8005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 msgr2=0x55b5293966e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f73c4048430 tx=0x7f73c4016b00 comp rx=0 tx=0).stop 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 shutdown_connections 2024-09-13T19:06:42.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72ac034650 0x7f72ac036b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/2308933711 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b5293962c0 0x55b5293966e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 >> 172.21.15.151:0/2308933711 conn(0x55b52938b410 msgr2=0x55b52938de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 shutdown_connections 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/2308933711 wait complete. 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b52937cf70 msgr2=0x55b52937f3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b52937cf70 0x55b52937f3a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b529385ca0 msgr2=0x55b529388090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b529385ca0 0x55b529388090 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b529381d60 msgr2=0x55b529384150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b529381d60 0x55b529384150 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72b8034650 msgr2=0x7f72b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f72b8034650 0x7f72b8036b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ad000 tx=0x7f73c80a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:42.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 msgr2=0x55b529377ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 --2- 172.21.15.151:0/1661474625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b529287a10 0x55b529377ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55b5291f9ef0 tx=0x7f73c4000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d304c640 1 -- 172.21.15.151:0/1661474625 reap_dead start 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 shutdown_connections 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 >> 172.21.15.151:0/1661474625 conn(0x55b52927f1b0 msgr2=0x55b52936a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 shutdown_connections 2024-09-13T19:06:42.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.619+0000 7f73d4d3b980 1 -- 172.21.15.151:0/1661474625 wait complete. 2024-09-13T19:06:42.633 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.633 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.633 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:42.710 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffaa1e2e980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5576920ab8e0 0x5576920abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffaa1e2e980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557691f31ae0 con 0x5576920ac230 2024-09-13T19:06:42.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffaa1e2e980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x557691f55e30 con 0x5576920ab8e0 2024-09-13T19:06:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffa9f93e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5576920ab8e0 0x5576920abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffa9f13d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5576920ac230 0x5576920b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33460/0 (socket says 172.21.15.151:33460) 2024-09-13T19:06:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.707+0000 7ffa9f13d640 1 -- 172.21.15.151:0/2325646545 learned_addr learned my addr 172.21.15.151:0/2325646545 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:42.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9e93c640 1 -- 172.21.15.151:0/2325646545 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319713039 0 0) 0x557691f31ae0 con 0x5576920ac230 2024-09-13T19:06:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9e93c640 1 -- 172.21.15.151:0/2325646545 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa8c001e20 con 0x5576920ac230 2024-09-13T19:06:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9f93e640 1 -- 172.21.15.151:0/2325646545 >> v1:172.21.15.12:6789/0 conn(0x5576920ac230 legacy=0x5576920b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9f93e640 1 -- 172.21.15.151:0/2325646545 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576920b34b0 con 0x5576920ab8e0 2024-09-13T19:06:42.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/2325646545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x5576920abcc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a420 tx=0x7ffa9001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475b3801ce0844b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9e93c640 1 -- 172.21.15.151:0/2325646545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900af070 con 0x5576920ab8e0 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9e93c640 1 -- 172.21.15.151:0/2325646545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900aa530 con 0x5576920ab8e0 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffa9e93c640 1 -- 172.21.15.151:0/2325646545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900aa850 con 0x5576920ab8e0 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/2325646545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 msgr2=0x5576920abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/2325646545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x5576920abcc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a420 tx=0x7ffa9001afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/2325646545 shutdown_connections 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/2325646545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x5576920abcc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/2325646545 >> 172.21.15.151:0/2325646545 conn(0x55769201f230 msgr2=0x55769201f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/2325646545 shutdown_connections 2024-09-13T19:06:42.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.711+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/2325646545 wait complete. 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557691f57200 con 0x5576920ab8e0 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56500/0 (socket says 172.21.15.151:56500) 2024-09-13T19:06:42.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3541487696 learned_addr learned my addr 172.21.15.151:0/3541487696 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3541487696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557692197020 con 0x5576920ab8e0 2024-09-13T19:06:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3541487696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a420 tx=0x7ffa900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802cb607ee14c3af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ff98de0b640 1 -- 172.21.15.151:0/3541487696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900af050 con 0x5576920ab8e0 2024-09-13T19:06:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ff98de0b640 1 -- 172.21.15.151:0/3541487696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900b0040 con 0x5576920ab8e0 2024-09-13T19:06:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ff98de0b640 1 -- 172.21.15.151:0/3541487696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900aab00 con 0x5576920ab8e0 2024-09-13T19:06:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3541487696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 msgr2=0x557692196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3541487696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000a420 tx=0x7ffa900033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3541487696 shutdown_connections 2024-09-13T19:06:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3541487696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ab8e0 0x557692196a50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3541487696 >> 172.21.15.151:0/3541487696 conn(0x55769201f230 msgr2=0x557692192680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3541487696 shutdown_connections 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3541487696 wait complete. 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 0x55769219ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.727+0000 7ffaa1e2e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5576920b2ef0 con 0x5576920ac230 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 0x55769219ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 0x55769219ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56514/0 (socket says 172.21.15.151:56514) 2024-09-13T19:06:42.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3261087109 learned_addr learned my addr 172.21.15.151:0/3261087109 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55769219e410 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 0x55769219ded0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa9001b010 tx=0x7ffa90019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 -- 172.21.15.151:0/3261087109 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900c5070 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55769219e6a0 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 -- 172.21.15.151:0/3261087109 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900b6a40 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 -- 172.21.15.151:0/3261087109 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900b6d40 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576921a1380 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 -- 172.21.15.151:0/3261087109 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa900c9400 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff988034650 0x7ff988036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ff987fff640 1 -- 172.21.15.151:0/3261087109 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa900bb070 con 0x5576920ac230 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff988034650 0x7ff988036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921a2fc0 0x5576921a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921a58f0 con 0x5576921a2fc0 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921a2fc0 0x5576921a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff988034650 0x7ff988036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa88000f70 tx=0x7ffa880010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921a2fc0 0x5576921a53b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.731+0000 7ffaa013f640 1 -- 172.21.15.151:0/3261087109 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921a2fc0 2024-09-13T19:06:42.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921a2580 con 0x5576921a2fc0 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa013f640 1 -- 172.21.15.151:0/3261087109 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921a2fc0 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921a7c10 0x5576921aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921aa6f0 con 0x5576921a7c10 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921a7c10 0x5576921aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921a7c10 0x5576921aa000 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3261087109 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa900c7070 con 0x5576921a7c10 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921a6ab0 con 0x5576921a2fc0 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa013f640 1 -- 172.21.15.151:0/3261087109 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921a2fc0 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576921abb50 0x5576921adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921ae680 con 0x5576921abb50 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576921abb50 0x5576921adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576921abb50 0x5576921adf40 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3261087109 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576921abb50 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffaa1e2e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557691fb0800 con 0x5576921bc150 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56516/0 (socket says 172.21.15.151:56516) 2024-09-13T19:06:42.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 -- 172.21.15.151:0/1459415184 learned_addr learned my addr 172.21.15.151:0/1459415184 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 -- 172.21.15.151:0/1459415184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576921bcab0 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.735+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa900c8b10 tx=0x7ffa900a9f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 -- 172.21.15.151:0/1459415184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900e12d0 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576921bcd40 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 -- 172.21.15.151:0/1459415184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900e1470 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 -- 172.21.15.151:0/1459415184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900e2b80 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576921bf9c0 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 -- 172.21.15.151:0/1459415184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa900e2d20 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 0x7ff978036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff9857fa640 1 -- 172.21.15.151:0/1459415184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa90007590 con 0x5576921bc150 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 0x7ff978036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 0x7ff978036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c010 tx=0x7ffa8800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffaa1e2e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5576921972e0 con 0x5576921c8880 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56530/0 (socket says 172.21.15.151:56530) 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f93e640 1 -- 172.21.15.151:0/119889160 learned_addr learned my addr 172.21.15.151:0/119889160 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f93e640 1 -- 172.21.15.151:0/119889160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576921c9250 con 0x5576921c8880 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/119889160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa900e4cc0 tx=0x7ffa900e4ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5336c04a923b10fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff97effd640 1 -- 172.21.15.151:0/119889160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900070a0 con 0x5576921c8880 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff97effd640 1 -- 172.21.15.151:0/119889160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900096b0 con 0x5576921c8880 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.739+0000 7ff97effd640 1 -- 172.21.15.151:0/119889160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900dc0d0 con 0x5576921c8880 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/119889160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 msgr2=0x5576921c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/119889160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa900e4cc0 tx=0x7ffa900e4ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/119889160 shutdown_connections 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/119889160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921c8c80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/119889160 >> 172.21.15.151:0/119889160 conn(0x5576921c4c60 msgr2=0x5576921c2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/119889160 shutdown_connections 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/119889160 wait complete. 2024-09-13T19:06:42.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 Processor -- start 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- start start 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5576921c96d0 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffa9f93e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56540/0 (socket says 172.21.15.151:56540) 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 learned_addr learned my addr 172.21.15.151:0/3321346974 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576921d0000 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa900e3010 tx=0x7ffa90007290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 -- 172.21.15.151:0/3321346974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900e4df0 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 -- 172.21.15.151:0/3321346974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900b5be0 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576921d0000 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 -- 172.21.15.151:0/3321346974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa900a93a0 con 0x5576921c8880 2024-09-13T19:06:42.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576921d0000 con 0x5576921c8880 2024-09-13T19:06:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 -- 172.21.15.151:0/3321346974 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffa9010e060 con 0x5576921c8880 2024-09-13T19:06:42.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff9680346a0 0x7ff968036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.743+0000 7ff97d7fa640 1 -- 172.21.15.151:0/3321346974 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ffa90111c60 con 0x5576921c8880 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff9680346a0 0x7ff968036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921da9e0 0x5576921dcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921dd5f0 con 0x5576921da9e0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921da9e0 0x5576921dcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff9680346a0 0x7ff968036b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5576921a5db0 tx=0x7ffa88010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921da9e0 0x5576921dcea0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 realm 2024-09-13T19:06:42.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921dda00 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921de2a0 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921df3a0 0x5576921e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e1cd0 con 0x5576921df3a0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921df3a0 0x5576921e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921df3a0 0x5576921e1790 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 20 searching for the correct realm 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921e3570 con 0x5576921df3a0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576920ab8e0 0x7ffa900d3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921e3570 con 0x5576920ab8e0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576920ab8e0 0x7ffa900d3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576920ab8e0 0x7ffa900d3810 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ffa88037040 0x7ffa88036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921e3570 con 0x7ffa88037040 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.747+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ffa88037040 0x7ffa88036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ffa88037040 0x7ffa88036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576920ab8e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.751+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576920ab8e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576920ab8e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.755+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576920ab8e0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921df3a0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x7ffa88037040 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576921da9e0 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5576921de640 con 0x5576920ab8e0 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e2520 con 0x5576921da9e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e2910 con 0x5576921da9e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.759+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e2910 con 0x5576920ab8e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 zone default found 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 4 Realm: () 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 zonegroup default 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e3a40 con 0x7ffa88037040 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e5420 con 0x5576921df3a0 2024-09-13T19:06:42.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921e57c0 con 0x5576921df3a0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 started sync module instance, tier type = 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e48c0 con 0x5576920ab8e0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967745961136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e4520 con 0x5576920ab8e0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6630 con 0x5576921da9e0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.763+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967745961136] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967745966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e65a0 con 0x5576921da9e0 2024-09-13T19:06:42.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e7400 con 0x5576921df3a0 2024-09-13T19:06:42.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967745969872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e7ca0 con 0x5576921df3a0 2024-09-13T19:06:42.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e86c0 con 0x5576920ab8e0 2024-09-13T19:06:42.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967745966464] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967745968672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e8f60 con 0x5576920ab8e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.767+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e97b0 con 0x5576921da9e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967745969872] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967745968672] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967745977008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e9380 con 0x5576921da9e0 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921ea050 con 0x7ffa88037040 2024-09-13T19:06:42.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.771+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967745977008] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967745978064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e92f0 con 0x7ffa88037040 2024-09-13T19:06:42.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921ea520 con 0x7ffa88037040 2024-09-13T19:06:42.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967745982512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921ea900 con 0x7ffa88037040 2024-09-13T19:06:42.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921eb3f0 con 0x7ffa88037040 2024-09-13T19:06:42.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.775+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967745978064] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967745982512] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967745986240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921ea450 con 0x7ffa88037040 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=0 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=1 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=2 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=3 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=4 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=5 2024-09-13T19:06:42.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.779+0000 7ffaa1e2e980 20 add_watcher() i=6 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967745986240] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 add_watcher() i=7 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5576921ee4f0 con 0x5576921da9e0 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967745980864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921eb970 con 0x5576921da9e0 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967745980864] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ff955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 5 note: GC not initialized 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ff954fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 Filter name: none 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ff8ce7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557692211510 con 0x5576921da9e0 2024-09-13T19:06:42.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ffaa1e2e980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:06:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.783+0000 7ff955fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967745980864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576922100c0 con 0x5576921da9e0 2024-09-13T19:06:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93967745980864] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967745961136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e99c0 con 0x5576920ab8e0 2024-09-13T19:06:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93967745961136] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa1e2e980 20 remove_watcher() i=0 2024-09-13T19:06:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa1e2e980 2 removed watcher, disabling cache 2024-09-13T19:06:42.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.787+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967745966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e99c0 con 0x5576921da9e0 2024-09-13T19:06:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93967745966464] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 20 remove_watcher() i=1 2024-09-13T19:06:42.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967745969872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6180 con 0x5576921df3a0 2024-09-13T19:06:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffa9f93e640 1 -- 172.21.15.151:0/3321346974 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93967745969872] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa900db070 con 0x5576921df3a0 2024-09-13T19:06:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 20 remove_watcher() i=2 2024-09-13T19:06:42.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967745968672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e99c0 con 0x5576920ab8e0 2024-09-13T19:06:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffa9f13d640 1 -- 172.21.15.151:0/3321346974 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93967745968672] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa8800e6c0 con 0x5576920ab8e0 2024-09-13T19:06:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 20 remove_watcher() i=3 2024-09-13T19:06:42.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.791+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967745977008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6ed0 con 0x5576921da9e0 2024-09-13T19:06:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93967745977008] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x5576921da9e0 2024-09-13T19:06:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa1e2e980 20 remove_watcher() i=4 2024-09-13T19:06:42.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967745978064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6180 con 0x7ffa88037040 2024-09-13T19:06:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93967745978064] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa1e2e980 20 remove_watcher() i=5 2024-09-13T19:06:42.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.795+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967745982512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6ed0 con 0x7ffa88037040 2024-09-13T19:06:42.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93967745982512] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 20 remove_watcher() i=6 2024-09-13T19:06:42.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967745986240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5576921e6180 con 0x7ffa88037040 2024-09-13T19:06:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93967745986240] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa980083f0 con 0x7ffa88037040 2024-09-13T19:06:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 20 remove_watcher() i=7 2024-09-13T19:06:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ffa88037040 msgr2=0x7ffa88036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ffa88037040 0x7ffa88036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921da9e0 msgr2=0x5576921dcea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921da9e0 0x5576921dcea0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576920ab8e0 msgr2=0x7ffa900d3810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576920ab8e0 0x7ffa900d3810 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921df3a0 msgr2=0x5576921e1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921df3a0 0x5576921e1790 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff9680346a0 msgr2=0x7ff968036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff9680346a0 0x7ff968036b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5576921a5db0 tx=0x7ffa88010000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 msgr2=0x5576921cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa013f640 1 -- 172.21.15.151:0/3321346974 reap_dead start 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa900e3010 tx=0x7ffa90007290 comp rx=0 tx=0).stop 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 shutdown_connections 2024-09-13T19:06:42.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3321346974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921c8880 0x5576921cfac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 >> 172.21.15.151:0/3321346974 conn(0x5576921c4c60 msgr2=0x5576921c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 shutdown_connections 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3321346974 wait complete. 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 msgr2=0x7ff978036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 0x7ff978036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800c010 tx=0x7ffa8800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 msgr2=0x5576921bc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa900c8b10 tx=0x7ffa900a9f90 comp rx=0 tx=0).stop 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 shutdown_connections 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff978034650 0x7ff978036b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/1459415184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576921bc150 0x5576921bc570 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.799+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 >> 172.21.15.151:0/1459415184 conn(0x5576921b12a0 msgr2=0x5576921b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 shutdown_connections 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/1459415184 wait complete. 2024-09-13T19:06:42.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921a2fc0 msgr2=0x5576921a53b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5576921a2fc0 0x5576921a53b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576921abb50 msgr2=0x5576921adf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5576921abb50 0x5576921adf40 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921a7c10 msgr2=0x5576921aa000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5576921a7c10 0x5576921aa000 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff988034650 msgr2=0x7ff988036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff988034650 0x7ff988036b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffa88000f70 tx=0x7ffa880010b0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 msgr2=0x55769219ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 --2- 172.21.15.151:0/3261087109 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576920ac230 0x55769219ded0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa9001b010 tx=0x7ffa90019810 comp rx=0 tx=0).stop 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa013f640 1 -- 172.21.15.151:0/3261087109 reap_dead start 2024-09-13T19:06:42.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 shutdown_connections 2024-09-13T19:06:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 >> 172.21.15.151:0/3261087109 conn(0x55769201f230 msgr2=0x557692191200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 shutdown_connections 2024-09-13T19:06:42.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.803+0000 7ffaa1e2e980 1 -- 172.21.15.151:0/3261087109 wait complete. 2024-09-13T19:06:42.813 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.814 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:06:42.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-13T19:06:42.814 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-13T19:06:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.883+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a60917980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5617fdc63880 0x5617fdc63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a60917980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617fdae9ae0 con 0x5617fdc641d0 2024-09-13T19:06:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a60917980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5617fdb0de30 con 0x5617fdc63880 2024-09-13T19:06:42.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5e427640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5617fdc63880 0x5617fdc63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5dc26640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5617fdc641d0 0x5617fdc68c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33472/0 (socket says 172.21.15.151:33472) 2024-09-13T19:06:42.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5dc26640 1 -- 172.21.15.151:0/3521492301 learned_addr learned my addr 172.21.15.151:0/3521492301 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:42.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5e427640 1 -- 172.21.15.151:0/3521492301 >> v1:172.21.15.12:6789/0 conn(0x5617fdc641d0 legacy=0x5617fdc68c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5e427640 1 -- 172.21.15.151:0/3521492301 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdc6b450 con 0x5617fdc63880 2024-09-13T19:06:42.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5e427640 1 --2- 172.21.15.151:0/3521492301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdc63c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000a480 tx=0x7f0a5001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf201ef14f21eb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5d425640 1 -- 172.21.15.151:0/3521492301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b0070 con 0x5617fdc63880 2024-09-13T19:06:42.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5d425640 1 -- 172.21.15.151:0/3521492301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500ab540 con 0x5617fdc63880 2024-09-13T19:06:42.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.887+0000 7f0a5d425640 1 -- 172.21.15.151:0/3521492301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500ab840 con 0x5617fdc63880 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 -- 172.21.15.151:0/3521492301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 msgr2=0x5617fdc63c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 --2- 172.21.15.151:0/3521492301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdc63c60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000a480 tx=0x7f0a5001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 -- 172.21.15.151:0/3521492301 shutdown_connections 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 --2- 172.21.15.151:0/3521492301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdc63c60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 -- 172.21.15.151:0/3521492301 >> 172.21.15.151:0/3521492301 conn(0x5617fdbd71d0 msgr2=0x5617fdbd75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 -- 172.21.15.151:0/3521492301 shutdown_connections 2024-09-13T19:06:42.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.891+0000 7f0a60917980 1 -- 172.21.15.151:0/3521492301 wait complete. 2024-09-13T19:06:42.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5617fdb0f200 con 0x5617fdc63880 2024-09-13T19:06:42.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56558/0 (socket says 172.21.15.151:56558) 2024-09-13T19:06:42.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a5e427640 1 -- 172.21.15.151:0/372999370 learned_addr learned my addr 172.21.15.151:0/372999370 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a5e427640 1 -- 172.21.15.151:0/372999370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdd4f250 con 0x5617fdc63880 2024-09-13T19:06:42.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a5e427640 1 --2- 172.21.15.151:0/372999370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a500ae040 tx=0x7f0a50003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba286f070083792a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f094b616640 1 -- 172.21.15.151:0/372999370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b0040 con 0x5617fdc63880 2024-09-13T19:06:42.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f094b616640 1 -- 172.21.15.151:0/372999370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500ab9d0 con 0x5617fdc63880 2024-09-13T19:06:42.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f094b616640 1 -- 172.21.15.151:0/372999370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500abcf0 con 0x5617fdc63880 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- 172.21.15.151:0/372999370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 msgr2=0x5617fdd4ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 --2- 172.21.15.151:0/372999370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0a500ae040 tx=0x7f0a50003030 comp rx=0 tx=0).stop 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- 172.21.15.151:0/372999370 shutdown_connections 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 --2- 172.21.15.151:0/372999370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd4ec80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- 172.21.15.151:0/372999370 >> 172.21.15.151:0/372999370 conn(0x5617fdbd71d0 msgr2=0x5617fdd4a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- 172.21.15.151:0/372999370 shutdown_connections 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.903+0000 7f0a60917980 1 -- 172.21.15.151:0/372999370 wait complete. 2024-09-13T19:06:42.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd55f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5617fdc6ae90 con 0x5617fdc63880 2024-09-13T19:06:42.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd55f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd55f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56560/0 (socket says 172.21.15.151:56560) 2024-09-13T19:06:42.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a5e427640 1 -- 172.21.15.151:0/3942212766 learned_addr learned my addr 172.21.15.151:0/3942212766 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a5e427640 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdd564b0 con 0x5617fdc63880 2024-09-13T19:06:42.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a5e427640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd55f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a50019930 tx=0x7f0a50018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0949e13640 1 -- 172.21.15.151:0/3942212766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b0070 con 0x5617fdc63880 2024-09-13T19:06:42.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0949e13640 1 -- 172.21.15.151:0/3942212766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500b68b0 con 0x5617fdc63880 2024-09-13T19:06:42.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617fdd56740 con 0x5617fdc63880 2024-09-13T19:06:42.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0949e13640 1 -- 172.21.15.151:0/3942212766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b6b90 con 0x5617fdc63880 2024-09-13T19:06:42.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fdd59420 con 0x5617fdc63880 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0949e13640 1 -- 172.21.15.151:0/3942212766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a500bf3f0 con 0x5617fdc63880 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.907+0000 7f0949e13640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09440346a0 0x7f0944036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0949e13640 1 -- 172.21.15.151:0/3942212766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0a500bc070 con 0x5617fdc63880 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09440346a0 0x7f0944036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdc641d0 0x5617fdd5cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd5d550 con 0x5617fdc641d0 2024-09-13T19:06:42.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdc641d0 0x5617fdd5cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09440346a0 0x7f0944036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a580012f0 tx=0x7f0a58006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdc641d0 0x5617fdd5cf00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5ec28640 1 -- 172.21.15.151:0/3942212766 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdc641d0 2024-09-13T19:06:42.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd5a640 con 0x5617fdc641d0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5ec28640 1 -- 172.21.15.151:0/3942212766 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdc641d0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd5f880 0x5617fdd61c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd62340 con 0x5617fdd5f880 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5e427640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd5f880 0x5617fdd61c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5e427640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd5f880 0x5617fdd61c70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5e427640 1 -- 172.21.15.151:0/3942212766 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd5f880 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd5e720 con 0x5617fdc641d0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5ec28640 1 -- 172.21.15.151:0/3942212766 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdc641d0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5617fdd637a0 0x5617fdd65b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd66290 con 0x5617fdd637a0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5617fdd637a0 0x5617fdd65b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5617fdd637a0 0x5617fdd65b90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a5dc26640 1 -- 172.21.15.151:0/3942212766 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a5800f070 con 0x5617fdd637a0 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.911+0000 7f0a60917980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5617fdb68800 con 0x5617fdd73d60 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56576/0 (socket says 172.21.15.151:56576) 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 -- 172.21.15.151:0/2464321815 learned_addr learned my addr 172.21.15.151:0/2464321815 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 -- 172.21.15.151:0/2464321815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdd746c0 con 0x5617fdd73d60 2024-09-13T19:06:42.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a500ab510 tx=0x7f0a500c64e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 -- 172.21.15.151:0/2464321815 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b4c60 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 -- 172.21.15.151:0/2464321815 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500b4e00 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617fdd74950 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 -- 172.21.15.151:0/2464321815 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a50001a50 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fdd775d0 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 -- 172.21.15.151:0/2464321815 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a50001bf0 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 0x7f0934036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0942ffd640 1 -- 172.21.15.151:0/2464321815 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0a500a8070 con 0x5617fdd73d60 2024-09-13T19:06:42.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 0x7f0934036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 0x7f0934036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a580062e0 tx=0x7f0a5800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a60917980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5617fdd4f510 con 0x5617fdd80670 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56586/0 (socket says 172.21.15.151:56586) 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.915+0000 7f0a5e427640 1 -- 172.21.15.151:0/3116268259 learned_addr learned my addr 172.21.15.151:0/3116268259 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 -- 172.21.15.151:0/3116268259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdd81040 con 0x5617fdd80670 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 --2- 172.21.15.151:0/3116268259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b49e0 tx=0x7f0a500bf850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c4061081c6fe02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0940ff9640 1 -- 172.21.15.151:0/3116268259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500f6020 con 0x5617fdd80670 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0940ff9640 1 -- 172.21.15.151:0/3116268259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500e1810 con 0x5617fdd80670 2024-09-13T19:06:42.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0940ff9640 1 -- 172.21.15.151:0/3116268259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500e12f0 con 0x5617fdd80670 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/3116268259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 msgr2=0x5617fdd80a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 --2- 172.21.15.151:0/3116268259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b49e0 tx=0x7f0a500bf850 comp rx=0 tx=0).stop 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/3116268259 shutdown_connections 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 --2- 172.21.15.151:0/3116268259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd80a70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/3116268259 >> 172.21.15.151:0/3116268259 conn(0x5617fdd7ca00 msgr2=0x5617fdd7ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/3116268259 shutdown_connections 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/3116268259 wait complete. 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 Processor -- start 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- start start 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5617fdd81410 con 0x5617fdd80670 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56588/0 (socket says 172.21.15.151:56588) 2024-09-13T19:06:42.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 learned_addr learned my addr 172.21.15.151:0/1237362275 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:42.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617fdd87b40 con 0x5617fdd80670 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a5e427640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b4740 tx=0x7f0a500c9eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0932ffd640 1 -- 172.21.15.151:0/1237362275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500dc7f0 con 0x5617fdd80670 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0932ffd640 1 -- 172.21.15.151:0/1237362275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a500e4940 con 0x5617fdd80670 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617fdd87b40 con 0x5617fdd80670 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0932ffd640 1 -- 172.21.15.151:0/1237362275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a500b5890 con 0x5617fdd80670 2024-09-13T19:06:42.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.919+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617fdd87b40 con 0x5617fdd80670 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0932ffd640 1 -- 172.21.15.151:0/1237362275 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a5010d060 con 0x5617fdd80670 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0932ffd640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09280347a0 0x7f0928036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0932ffd640 1 -- 172.21.15.151:0/1237362275 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0a50107c50 con 0x5617fdd80670 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09280347a0 0x7f0928036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdd92580 0x5617fdd94a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd95190 con 0x5617fdd92580 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdd92580 0x5617fdd94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09280347a0 0x7f0928036c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5617fdd5de30 tx=0x7f0a58010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdd92580 0x5617fdd94a40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 realm 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd955a0 con 0x5617fdd92580 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd95e70 con 0x5617fdd92580 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd96f70 0x5617fdd99360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd99970 con 0x5617fdd96f70 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd96f70 0x5617fdd99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd96f70 0x5617fdd99360 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 20 searching for the correct realm 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9b240 con 0x5617fdd96f70 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0a5010f070 0x7f0a5010f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9b240 con 0x7f0a5010f070 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0a5010f070 0x7f0a5010f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0a5010f070 0x7f0a5010f670 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a5800f070 con 0x7f0a5010f070 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0a58024070 0x7f0a58031460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.923+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9b240 con 0x7f0a58024070 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0a58024070 0x7f0a58031460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0a58024070 0x7f0a58031460 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a5010f070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a5800f070 con 0x7f0a5010f070 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.927+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a5010f070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.931+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a5010f070 2024-09-13T19:06:42.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a5010f070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd96f70 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a58024070 2024-09-13T19:06:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x5617fdd92580 2024-09-13T19:06:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd96210 con 0x7f0a5010f070 2024-09-13T19:06:42.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:42.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.935+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9a360 con 0x5617fdd92580 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd99fa0 con 0x5617fdd92580 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:42.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9ac80 con 0x7f0a5010f070 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 zone default found 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 4 Realm: () 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 zonegroup default 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9b670 con 0x7f0a58024070 2024-09-13T19:06:42.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9d050 con 0x5617fdd96f70 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9d520 con 0x5617fdd96f70 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 started sync module instance, tier type = 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:42.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9c4f0 con 0x7f0a5010f070 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94661043144928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9c150 con 0x7f0a5010f070 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.939+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9e450 con 0x5617fdd92580 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94661043144928] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94661043150752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9e870 con 0x5617fdd92580 2024-09-13T19:06:42.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9f120 con 0x5617fdd96f70 2024-09-13T19:06:42.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94661043153312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9f9c0 con 0x5617fdd96f70 2024-09-13T19:06:42.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.943+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda03c0 con 0x7f0a5010f070 2024-09-13T19:06:42.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94661043150752] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94661043151808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda0c60 con 0x7f0a5010f070 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda14f0 con 0x5617fdd92580 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94661043151808] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94661043153312] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94661043156240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda1000 con 0x5617fdd92580 2024-09-13T19:06:42.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.947+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda1d90 con 0x7f0a58024070 2024-09-13T19:06:42.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94661043156240] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94661043161008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda1cc0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda2690 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94661043167616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda2b00 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.951+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda35b0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94661043161008] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94661043165200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda3570 con 0x7f0a58024070 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=0 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=1 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=2 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=3 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=4 2024-09-13T19:06:42.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=5 2024-09-13T19:06:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94661043167616] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=6 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94661043165200] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 20 add_watcher() i=7 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.955+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda3570 con 0x5617fdd92580 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94661043171520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdda34e0 con 0x5617fdd92580 2024-09-13T19:06:42.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94661043171520] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f09137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 5 note: GC not initialized 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f09127e4640 20 reqs_thread_entry: start 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 Filter name: none 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0883fff640 20 reqs_thread_entry: start 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc9ba0 con 0x5617fdd92580 2024-09-13T19:06:42.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rados->read ofs=0 len=0 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fddca8e0 con 0x7f0a5010f070 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-13T19:06:42.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddd05f0 con 0x5617fdd92580 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94661043355776 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fddcd180 con 0x5617fdd92580 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94661043156240 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f0a4803b040 con 0x5617fdd92580 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0940ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94661043156240 notifier 4386 bl.length()=849 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0940ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0940ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify cookie 94661043355776 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.959+0000 7f0940ff9640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0920003eb0 con 0x5617fdd92580 2024-09-13T19:06:42.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94661043355776 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0a48010040 con 0x5617fdd92580 2024-09-13T19:06:42.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddd0080 con 0x7f0a5010f070 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a60917980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a60917980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a60917980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94661043355776 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5617fddcacb0 con 0x7f0a5010f070 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== watch-notify(notify (1) cookie 94661043144928 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f0a5801b030 con 0x7f0a5010f070 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0933fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94661043144928 notifier 4386 bl.length()=166 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0933fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0933fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(68 notify.0 [notify cookie 94661043355776 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0933fff640 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0890003410 con 0x7f0a5010f070 2024-09-13T19:06:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.963+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== watch-notify(notify_complete (2) cookie 94661043355776 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5617fdae9ae0 con 0x7f0a5010f070 2024-09-13T19:06:42.969 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:06:42.963120Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f09137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94661043171520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc7990 con 0x5617fdd92580 2024-09-13T19:06:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94661043171520] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94661043144928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc7990 con 0x7f0a5010f070 2024-09-13T19:06:42.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94661043144928] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a60917980 20 remove_watcher() i=0 2024-09-13T19:06:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a60917980 2 removed watcher, disabling cache 2024-09-13T19:06:42.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.967+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94661043150752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9c8e0 con 0x5617fdd92580 2024-09-13T19:06:42.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94661043150752] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 20 remove_watcher() i=1 2024-09-13T19:06:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94661043153312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc7990 con 0x5617fdd96f70 2024-09-13T19:06:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a5e427640 1 -- 172.21.15.151:0/1237362275 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94661043153312] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a500b3040 con 0x5617fdd96f70 2024-09-13T19:06:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 20 remove_watcher() i=2 2024-09-13T19:06:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94661043151808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9dfa0 con 0x7f0a5010f070 2024-09-13T19:06:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a5dc26640 1 -- 172.21.15.151:0/1237362275 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94661043151808] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a58040040 con 0x7f0a5010f070 2024-09-13T19:06:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 20 remove_watcher() i=3 2024-09-13T19:06:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.971+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94661043156240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9c8e0 con 0x5617fdd92580 2024-09-13T19:06:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.975+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94661043156240] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x5617fdd92580 2024-09-13T19:06:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.975+0000 7f0a60917980 20 remove_watcher() i=4 2024-09-13T19:06:42.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.975+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94661043161008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc7990 con 0x7f0a58024070 2024-09-13T19:06:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94661043161008] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a60917980 20 remove_watcher() i=5 2024-09-13T19:06:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94661043167616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fdd9c8e0 con 0x7f0a58024070 2024-09-13T19:06:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94661043167616] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a60917980 20 remove_watcher() i=6 2024-09-13T19:06:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.979+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94661043165200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5617fddc7990 con 0x7f0a58024070 2024-09-13T19:06:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94661043165200] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a480083f0 con 0x7f0a58024070 2024-09-13T19:06:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 20 remove_watcher() i=7 2024-09-13T19:06:42.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0a58024070 msgr2=0x7f0a58031460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0a58024070 0x7f0a58031460 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdd92580 msgr2=0x5617fdd94a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdd92580 0x5617fdd94a40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0a5010f070 msgr2=0x7f0a5010f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0a5010f070 0x7f0a5010f670 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd96f70 msgr2=0x5617fdd99360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd96f70 0x5617fdd99360 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09280347a0 msgr2=0x7f0928036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09280347a0 0x7f0928036c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5617fdd5de30 tx=0x7f0a58010000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a5ec28640 1 -- 172.21.15.151:0/1237362275 reap_dead start 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 msgr2=0x5617fdd87600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b4740 tx=0x7f0a500c9eb0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 shutdown_connections 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/1237362275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd80670 0x5617fdd87600 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 >> 172.21.15.151:0/1237362275 conn(0x5617fdd7ca00 msgr2=0x5617fdd7aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 shutdown_connections 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/1237362275 wait complete. 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 msgr2=0x7f0934036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 0x7f0934036b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a580062e0 tx=0x7f0a5800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 msgr2=0x5617fdd74180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a500ab510 tx=0x7f0a500c64e0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 shutdown_connections 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0934034650 0x7f0934036b10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/2464321815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdd73d60 0x5617fdd74180 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 >> 172.21.15.151:0/2464321815 conn(0x5617fdd68eb0 msgr2=0x5617fdd6b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 shutdown_connections 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/2464321815 wait complete. 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdc641d0 msgr2=0x5617fdd5cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5617fdc641d0 0x5617fdd5cf00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5617fdd637a0 msgr2=0x5617fdd65b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5617fdd637a0 0x5617fdd65b90 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd5f880 msgr2=0x5617fdd61c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5617fdd5f880 0x5617fdd61c70 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09440346a0 msgr2=0x7f0944036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f09440346a0 0x7f0944036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0a580012f0 tx=0x7f0a58006700 comp rx=0 tx=0).stop 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 msgr2=0x5617fdd55f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 --2- 172.21.15.151:0/3942212766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5617fdc63880 0x5617fdd55f70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a50019930 tx=0x7f0a50018020 comp rx=0 tx=0).stop 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a5ec28640 1 -- 172.21.15.151:0/3942212766 reap_dead start 2024-09-13T19:06:42.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 shutdown_connections 2024-09-13T19:06:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 >> 172.21.15.151:0/3942212766 conn(0x5617fdbd71d0 msgr2=0x5617fdd49430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 shutdown_connections 2024-09-13T19:06:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:42.983+0000 7f0a60917980 1 -- 172.21.15.151:0/3942212766 wait complete. 2024-09-13T19:06:42.995 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:06:42.963120Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:42.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:06:42.996 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:06:43.073 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.073 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0df77980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a6cc2222d0 0x55a6cc2b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0df77980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6cc135ae0 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0df77980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55a6cc159e30 con 0x55a6cc2222d0 2024-09-13T19:06:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0ba87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a6cc2222d0 0x55a6cc2b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0ba87640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a6cc2222d0 0x55a6cc2b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56592/0 (socket says 172.21.15.151:56592) 2024-09-13T19:06:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0ba87640 1 -- 172.21.15.151:0/766708921 learned_addr learned my addr 172.21.15.151:0/766708921 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0b286640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55a6cc2b2ca0 0x55a6cc2b5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33482/0 (socket says 172.21.15.151:33482) 2024-09-13T19:06:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0ba87640 1 -- 172.21.15.151:0/766708921 >> v1:172.21.15.12:6789/0 conn(0x55a6cc2b2ca0 legacy=0x55a6cc2b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.071+0000 7f6e0ba87640 1 -- 172.21.15.151:0/766708921 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc2226b0 con 0x55a6cc2222d0 2024-09-13T19:06:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/766708921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc2b2760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400a5c0 tx=0x7f6e0401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caa8865ad19158c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0aa85640 1 -- 172.21.15.151:0/766708921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040a6070 con 0x55a6cc2222d0 2024-09-13T19:06:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0aa85640 1 -- 172.21.15.151:0/766708921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040af070 con 0x55a6cc2222d0 2024-09-13T19:06:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0aa85640 1 -- 172.21.15.151:0/766708921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040aa5c0 con 0x55a6cc2222d0 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 -- 172.21.15.151:0/766708921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 msgr2=0x55a6cc2b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 --2- 172.21.15.151:0/766708921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc2b2760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400a5c0 tx=0x7f6e0401b340 comp rx=0 tx=0).stop 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 -- 172.21.15.151:0/766708921 shutdown_connections 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 --2- 172.21.15.151:0/766708921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc2b2760 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 -- 172.21.15.151:0/766708921 >> 172.21.15.151:0/766708921 conn(0x55a6cc2a8090 msgr2=0x55a6cc2aa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 -- 172.21.15.151:0/766708921 shutdown_connections 2024-09-13T19:06:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.075+0000 7f6e0df77980 1 -- 172.21.15.151:0/766708921 wait complete. 2024-09-13T19:06:43.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.087+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.087+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.087+0000 7f6e0df77980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.087+0000 7f6e0df77980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc15b200 con 0x55a6cc2222d0 2024-09-13T19:06:43.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56600/0 (socket says 172.21.15.151:56600) 2024-09-13T19:06:43.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 -- 172.21.15.151:0/886401204 learned_addr learned my addr 172.21.15.151:0/886401204 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 -- 172.21.15.151:0/886401204 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc39b1a0 con 0x55a6cc2222d0 2024-09-13T19:06:43.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/886401204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e040ac040 tx=0x7f6e04003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e40d12ee9f8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6cf9e0b640 1 -- 172.21.15.151:0/886401204 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040aa970 con 0x55a6cc2222d0 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6cf9e0b640 1 -- 172.21.15.151:0/886401204 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040aab30 con 0x55a6cc2222d0 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6cf9e0b640 1 -- 172.21.15.151:0/886401204 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040aae50 con 0x55a6cc2222d0 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- 172.21.15.151:0/886401204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 msgr2=0x55a6cc39abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 --2- 172.21.15.151:0/886401204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6e040ac040 tx=0x7f6e04003030 comp rx=0 tx=0).stop 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- 172.21.15.151:0/886401204 shutdown_connections 2024-09-13T19:06:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 --2- 172.21.15.151:0/886401204 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc39abd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- 172.21.15.151:0/886401204 >> 172.21.15.151:0/886401204 conn(0x55a6cc2a8090 msgr2=0x55a6cc396800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- 172.21.15.151:0/886401204 shutdown_connections 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- 172.21.15.151:0/886401204 wait complete. 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc3a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0df77980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc2b9210 con 0x55a6cc2222d0 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc3a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc3a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56616/0 (socket says 172.21.15.151:56616) 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.091+0000 7f6e0ba87640 1 -- 172.21.15.151:0/3836333847 learned_addr learned my addr 172.21.15.151:0/3836333847 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0ba87640 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc3a22e0 con 0x55a6cc2222d0 2024-09-13T19:06:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc3a1da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e0401bbe0 tx=0x7f6e040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 -- 172.21.15.151:0/3836333847 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040bd6d0 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6cc3a2570 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 -- 172.21.15.151:0/3836333847 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040cc070 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 -- 172.21.15.151:0/3836333847 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040bd9a0 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc3a5250 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 -- 172.21.15.151:0/3836333847 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e040bdbd0 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cf4034650 0x7f6cf4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6cf3fff640 1 -- 172.21.15.151:0/3836333847 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e040e5620 con 0x55a6cc2222d0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0b286640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cf4034650 0x7f6cf4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc2b2ca0 0x55a6cc3a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3a9420 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0c288640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc2b2ca0 0x55a6cc3a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0b286640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cf4034650 0x7f6cf4036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e00001e50 tx=0x7f6e000013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0c288640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc2b2ca0 0x55a6cc3a8ea0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0c288640 1 -- 172.21.15.151:0/3836333847 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3a6450 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0c288640 1 -- 172.21.15.151:0/3836333847 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3ab780 0x55a6cc3adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ae240 con 0x55a6cc3ab780 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3ab780 0x55a6cc3adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.095+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3ab780 0x55a6cc3adb70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 -- 172.21.15.151:0/3836333847 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e040d0410 con 0x55a6cc3ab780 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3aa620 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0c288640 1 -- 172.21.15.151:0/3836333847 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc2b2ca0 2024-09-13T19:06:43.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a6cc3af6a0 0x55a6cc3b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3b2190 con 0x55a6cc3af6a0 2024-09-13T19:06:43.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0b286640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a6cc3af6a0 0x55a6cc3b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0b286640 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a6cc3af6a0 0x55a6cc3b1a90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0b286640 1 -- 172.21.15.151:0/3836333847 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e0000f700 con 0x55a6cc3af6a0 2024-09-13T19:06:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc1b4800 con 0x55a6cc3bfc60 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56632/0 (socket says 172.21.15.151:56632) 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 -- 172.21.15.151:0/2573732883 learned_addr learned my addr 172.21.15.151:0/2573732883 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 -- 172.21.15.151:0/2573732883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc3c05c0 con 0x55a6cc3bfc60 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6e040e3a10 tx=0x7f6e040cf660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6cf17fa640 1 -- 172.21.15.151:0/2573732883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040b3ab0 con 0x55a6cc3bfc60 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6cf17fa640 1 -- 172.21.15.151:0/2573732883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040b3c50 con 0x55a6cc3bfc60 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6cc3c0850 con 0x55a6cc3bfc60 2024-09-13T19:06:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6cf17fa640 1 -- 172.21.15.151:0/2573732883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040e5050 con 0x55a6cc3bfc60 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.099+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc3c34d0 con 0x55a6cc3bfc60 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6cf17fa640 1 -- 172.21.15.151:0/2573732883 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e040e51f0 con 0x55a6cc3bfc60 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6cf17fa640 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 0x7f6ce4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6cf17fa640 1 -- 172.21.15.151:0/2573732883 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e040eec50 con 0x55a6cc3bfc60 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0b286640 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 0x7f6ce4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0b286640 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 0x7f6ce4036b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a6cc3a9d30 tx=0x7f6e0000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc39b460 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56634/0 (socket says 172.21.15.151:56634) 2024-09-13T19:06:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0ba87640 1 -- 172.21.15.151:0/2605931897 learned_addr learned my addr 172.21.15.151:0/2605931897 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0ba87640 1 -- 172.21.15.151:0/2605931897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc3ccf90 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/2605931897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e040bc6b0 tx=0x7f6e040b7580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2b9ddb0c661332 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6ceaffd640 1 -- 172.21.15.151:0/2605931897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040db800 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6ceaffd640 1 -- 172.21.15.151:0/2605931897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040bfd20 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6ceaffd640 1 -- 172.21.15.151:0/2605931897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040e5980 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- 172.21.15.151:0/2605931897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 msgr2=0x55a6cc3cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2605931897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6e040bc6b0 tx=0x7f6e040b7580 comp rx=0 tx=0).stop 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- 172.21.15.151:0/2605931897 shutdown_connections 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2605931897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3cc9c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- 172.21.15.151:0/2605931897 >> 172.21.15.151:0/2605931897 conn(0x55a6cc3c89e0 msgr2=0x55a6cc3c6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- 172.21.15.151:0/2605931897 shutdown_connections 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- 172.21.15.151:0/2605931897 wait complete. 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 Processor -- start 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- start start 2024-09-13T19:06:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3d3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.103+0000 7f6e0df77980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6cc3cd3f0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0ba87640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3d3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56642/0 (socket says 172.21.15.151:56642) 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 learned_addr learned my addr 172.21.15.151:0/964639829 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6cc3d3db0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3d3870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c2fd0 tx=0x7f6e040eef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 -- 172.21.15.151:0/964639829 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040dbc40 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 -- 172.21.15.151:0/964639829 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e040dbde0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a6cc3d3db0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 -- 172.21.15.151:0/964639829 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e040bf720 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6cc3d3db0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 -- 172.21.15.151:0/964639829 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6e040bf8c0 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cd4034650 0x7f6cd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6ce97fa640 1 -- 172.21.15.151:0/964639829 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6e040fd030 con 0x55a6cc3cc5c0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0b286640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cd4034650 0x7f6cd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc3de720 0x55a6cc3e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e1310 con 0x55a6cc3de720 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0c288640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc3de720 0x55a6cc3e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0b286640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cd4034650 0x7f6cd4036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a6cc3b2590 tx=0x7f6e00010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0c288640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc3de720 0x55a6cc3e0bc0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 realm 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e1720 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.107+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e1fc0 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3e30c0 0x55a6cc3e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e5a30 con 0x55a6cc3e30c0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3e30c0 0x55a6cc3e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3e30c0 0x55a6cc3e54b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 20 searching for the correct realm 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e7290 con 0x55a6cc3e30c0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e04009040 0x7f6e041088e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e7290 con 0x7f6e04009040 2024-09-13T19:06:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0b286640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e04009040 0x7f6e041088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0b286640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e04009040 0x7f6e041088e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0b286640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6e0001fbe0 0x7f6e0003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e7290 con 0x7f6e0001fbe0 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6e0001fbe0 0x7f6e0003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6e0001fbe0 0x7f6e0003a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.111+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e04009040 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e04009040 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.115+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e04009040 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.119+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e04009040 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3e30c0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e0001fbe0 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x55a6cc3de720 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e2360 con 0x7f6e04009040 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e63b0 con 0x55a6cc3de720 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e6c50 con 0x55a6cc3de720 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e5ff0 con 0x7f6e04009040 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 zone default found 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 4 Realm: () 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 zonegroup default 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.123+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e6c50 con 0x7f6e0001fbe0 2024-09-13T19:06:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e9140 con 0x55a6cc3e30c0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e94e0 con 0x55a6cc3e30c0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 started sync module instance, tier type = 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e85e0 con 0x7f6e04009040 2024-09-13T19:06:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94174879582720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3e8240 con 0x7f6e04009040 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ea3a0 con 0x55a6cc3de720 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94174879582720] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94174879588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ea7c0 con 0x55a6cc3de720 2024-09-13T19:06:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.127+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3eb070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94174879590640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3eb910 con 0x55a6cc3e30c0 2024-09-13T19:06:43.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ec330 con 0x7f6e04009040 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94174879588080] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94174879596064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ec720 con 0x7f6e04009040 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.131+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed0e0 con 0x55a6cc3de720 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94174879590640] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94174879596064] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94174879593568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed0e0 con 0x55a6cc3de720 2024-09-13T19:06:43.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed980 con 0x7f6e0001fbe0 2024-09-13T19:06:43.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94174879593568] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94174879599936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed6f0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.135+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ee210 con 0x7f6e0001fbe0 2024-09-13T19:06:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.139+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.139+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94174879603936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ee680 con 0x7f6e0001fbe0 2024-09-13T19:06:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.139+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ef150 con 0x7f6e0001fbe0 2024-09-13T19:06:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.139+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94174879599936] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.139+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94174879603936] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94174879607872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ee1d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=0 2024-09-13T19:06:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=1 2024-09-13T19:06:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=2 2024-09-13T19:06:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=3 2024-09-13T19:06:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=4 2024-09-13T19:06:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=5 2024-09-13T19:06:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=6 2024-09-13T19:06:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94174879607872] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 add_watcher() i=7 2024-09-13T19:06:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3f2250 con 0x55a6cc3de720 2024-09-13T19:06:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94174879600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ef6d0 con 0x55a6cc3de720 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94174879600992] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.143+0000 7f6e0df77980 5 note: GC not initialized 2024-09-13T19:06:43.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6cc0fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 20 Filter name: none 2024-09-13T19:06:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6c3a7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc415190 con 0x55a6cc3de720 2024-09-13T19:06:43.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:06:43.150 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:06:42.963120Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94174879600992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc4156d0 con 0x55a6cc3de720 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94174879600992] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94174879582720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed160 con 0x7f6e04009040 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94174879582720] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 20 remove_watcher() i=0 2024-09-13T19:06:43.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 2 removed watcher, disabling cache 2024-09-13T19:06:43.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.147+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94174879588080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed160 con 0x55a6cc3de720 2024-09-13T19:06:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94174879588080] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0df77980 20 remove_watcher() i=1 2024-09-13T19:06:43.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94174879590640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed160 con 0x55a6cc3e30c0 2024-09-13T19:06:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0ba87640 1 -- 172.21.15.151:0/964639829 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94174879590640] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e040f4070 con 0x55a6cc3e30c0 2024-09-13T19:06:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0df77980 20 remove_watcher() i=2 2024-09-13T19:06:43.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.151+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94174879596064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed160 con 0x7f6e04009040 2024-09-13T19:06:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0b286640 1 -- 172.21.15.151:0/964639829 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94174879596064] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e00037040 con 0x7f6e04009040 2024-09-13T19:06:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0df77980 20 remove_watcher() i=3 2024-09-13T19:06:43.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94174879593568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ebe20 con 0x55a6cc3de720 2024-09-13T19:06:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94174879593568] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x55a6cc3de720 2024-09-13T19:06:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0df77980 20 remove_watcher() i=4 2024-09-13T19:06:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.155+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94174879599936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3ed160 con 0x7f6e0001fbe0 2024-09-13T19:06:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94174879599936] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0df77980 20 remove_watcher() i=5 2024-09-13T19:06:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94174879603936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3eb460 con 0x7f6e0001fbe0 2024-09-13T19:06:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94174879603936] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0df77980 20 remove_watcher() i=6 2024-09-13T19:06:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.159+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94174879607872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a6cc3edce0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94174879607872] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dfc00a4d0 con 0x7f6e0001fbe0 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 20 remove_watcher() i=7 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6e0001fbe0 msgr2=0x7f6e0003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6e0001fbe0 0x7f6e0003a3c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc3de720 msgr2=0x55a6cc3e0bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc3de720 0x55a6cc3e0bc0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e04009040 msgr2=0x7f6e041088e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6e04009040 0x7f6e041088e0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3e30c0 msgr2=0x55a6cc3e54b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3e30c0 0x55a6cc3e54b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cd4034650 msgr2=0x7f6cd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cd4034650 0x7f6cd4036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55a6cc3b2590 tx=0x7f6e00010000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 msgr2=0x55a6cc3d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/964639829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3cc5c0 0x55a6cc3d3870 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6e040c2fd0 tx=0x7f6e040eef60 comp rx=0 tx=0).stop 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 reap_dead start 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0c288640 1 -- 172.21.15.151:0/964639829 reap_dead start 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 shutdown_connections 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 >> 172.21.15.151:0/964639829 conn(0x55a6cc3c89e0 msgr2=0x55a6cc3c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 shutdown_connections 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/964639829 wait complete. 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 msgr2=0x7f6ce4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 0x7f6ce4036b60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55a6cc3a9d30 tx=0x7f6e0000f000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 msgr2=0x55a6cc3c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6e040e3a10 tx=0x7f6e040cf660 comp rx=0 tx=0).stop 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 shutdown_connections 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6ce40346a0 0x7f6ce4036b60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/2573732883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc3bfc60 0x55a6cc3c0080 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 >> 172.21.15.151:0/2573732883 conn(0x55a6cc3b4db0 msgr2=0x55a6cc3b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 shutdown_connections 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/2573732883 wait complete. 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc2b2ca0 msgr2=0x55a6cc3a8ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a6cc2b2ca0 0x55a6cc3a8ea0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a6cc3af6a0 msgr2=0x55a6cc3b1a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a6cc3af6a0 0x55a6cc3b1a90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3ab780 msgr2=0x55a6cc3adb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6cc3ab780 0x55a6cc3adb70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cf4034650 msgr2=0x7f6cf4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6cf4034650 0x7f6cf4036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6e00001e50 tx=0x7f6e000013b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 msgr2=0x55a6cc3a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 --2- 172.21.15.151:0/3836333847 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6cc2222d0 0x55a6cc3a1da0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6e0401bbe0 tx=0x7f6e040180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0c288640 1 -- 172.21.15.151:0/3836333847 reap_dead start 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 shutdown_connections 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 >> 172.21.15.151:0/3836333847 conn(0x55a6cc2a8090 msgr2=0x55a6cc395380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 shutdown_connections 2024-09-13T19:06:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.163+0000 7f6e0df77980 1 -- 172.21.15.151:0/3836333847 wait complete. 2024-09-13T19:06:43.175 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:06:42.963120Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:43.175 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:06:43.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-13T19:06:43.175 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-13T19:06:43.244 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.244 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27e0dc3980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5598c986c6a0 0x5598c986ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27e0dc3980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598c96f4ae0 con 0x5598c986cff0 2024-09-13T19:06:43.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27e0dc3980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5598c9718e30 con 0x5598c986c6a0 2024-09-13T19:06:43.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27de8d3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5598c986c6a0 0x5598c986ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27de0d2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5598c986cff0 0x5598c9871a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33492/0 (socket says 172.21.15.151:33492) 2024-09-13T19:06:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27de0d2640 1 -- 172.21.15.151:0/3018780897 learned_addr learned my addr 172.21.15.151:0/3018780897 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27dd8d1640 1 -- 172.21.15.151:0/3018780897 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381082415 0 0) 0x5598c96f4ae0 con 0x5598c986cff0 2024-09-13T19:06:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27dd8d1640 1 -- 172.21.15.151:0/3018780897 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27c8001e20 con 0x5598c986cff0 2024-09-13T19:06:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27de8d3640 1 -- 172.21.15.151:0/3018780897 >> v1:172.21.15.12:6789/0 conn(0x5598c986cff0 legacy=0x5598c9871a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.243+0000 7f27de8d3640 1 -- 172.21.15.151:0/3018780897 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c9874270 con 0x5598c986c6a0 2024-09-13T19:06:43.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27de8d3640 1 --2- 172.21.15.151:0/3018780897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c986ca80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f27d800a420 tx=0x7f27d801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb35266db00ae78d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27dd8d1640 1 -- 172.21.15.151:0/3018780897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80af070 con 0x5598c986c6a0 2024-09-13T19:06:43.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27dd8d1640 1 -- 172.21.15.151:0/3018780897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80aa530 con 0x5598c986c6a0 2024-09-13T19:06:43.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27dd8d1640 1 -- 172.21.15.151:0/3018780897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80aa850 con 0x5598c986c6a0 2024-09-13T19:06:43.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3018780897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 msgr2=0x5598c986ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3018780897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c986ca80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f27d800a420 tx=0x7f27d801afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3018780897 shutdown_connections 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3018780897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c986ca80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3018780897 >> 172.21.15.151:0/3018780897 conn(0x5598c98681c0 msgr2=0x5598c986a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3018780897 shutdown_connections 2024-09-13T19:06:43.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.247+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3018780897 wait complete. 2024-09-13T19:06:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27e0dc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27e0dc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598c971a200 con 0x5598c986c6a0 2024-09-13T19:06:43.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56658/0 (socket says 172.21.15.151:56658) 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27de8d3640 1 -- 172.21.15.151:0/4805795 learned_addr learned my addr 172.21.15.151:0/4805795 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27de8d3640 1 -- 172.21.15.151:0/4805795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c9957e20 con 0x5598c986c6a0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f27de8d3640 1 --2- 172.21.15.151:0/4805795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27d8017be0 tx=0x7f27d80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727630c2111f1bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.259+0000 7f26cce09640 1 -- 172.21.15.151:0/4805795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80af050 con 0x5598c986c6a0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f26cce09640 1 -- 172.21.15.151:0/4805795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80b0040 con 0x5598c986c6a0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f26cce09640 1 -- 172.21.15.151:0/4805795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80aaaf0 con 0x5598c986c6a0 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4805795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 msgr2=0x5598c9957850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4805795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f27d8017be0 tx=0x7f27d80033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4805795 shutdown_connections 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4805795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c9957850 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4805795 >> 172.21.15.151:0/4805795 conn(0x5598c98681c0 msgr2=0x5598c9953480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4805795 shutdown_connections 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4805795 wait complete. 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c995ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598c9873cb0 con 0x5598c986c6a0 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c995ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c995ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56666/0 (socket says 172.21.15.151:56666) 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27de8d3640 1 -- 172.21.15.151:0/3224128164 learned_addr learned my addr 172.21.15.151:0/3224128164 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27de8d3640 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c995ef60 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27de8d3640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c995ea20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f27d801b870 tx=0x7f27d8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f26cb606640 1 -- 172.21.15.151:0/3224128164 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80b6bf0 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f26cb606640 1 -- 172.21.15.151:0/3224128164 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80b6d90 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598c995f1f0 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f26cb606640 1 -- 172.21.15.151:0/3224128164 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80bf530 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.263+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c9961ed0 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f26cb606640 1 -- 172.21.15.151:0/3224128164 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27d80bf7e0 con 0x5598c986c6a0 2024-09-13T19:06:43.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f26cb606640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26c4034650 0x7f26c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f26cb606640 1 -- 172.21.15.151:0/3224128164 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f27d80bb070 con 0x5598c986c6a0 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27de0d2640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26c4034650 0x7f26c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c986cff0 0x5598c99659b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c9966020 con 0x5598c986cff0 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27df0d4640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c986cff0 0x5598c99659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27de0d2640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26c4034650 0x7f26c4036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f70 tx=0x7f27d40010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27df0d4640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c986cff0 0x5598c99659b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27df0d4640 1 -- 172.21.15.151:0/3224128164 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c986cff0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99630d0 con 0x5598c986cff0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27df0d4640 1 -- 172.21.15.151:0/3224128164 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c986cff0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c9968350 0x5598c996a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c996ae30 con 0x5598c9968350 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27de8d3640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c9968350 0x5598c996a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27de8d3640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c9968350 0x5598c996a740 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27de8d3640 1 -- 172.21.15.151:0/3224128164 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f27d80b2070 con 0x5598c9968350 2024-09-13T19:06:43.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.267+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99671c0 con 0x5598c986cff0 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27df0d4640 1 -- 172.21.15.151:0/3224128164 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c986cff0 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598c996c290 0x5598c996e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c996ed80 con 0x5598c996c290 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de0d2640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598c996c290 0x5598c996e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de0d2640 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598c996c290 0x5598c996e680 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de0d2640 1 -- 172.21.15.151:0/3224128164 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f27d400e6c0 con 0x5598c996c290 2024-09-13T19:06:43.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598c9773800 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56670/0 (socket says 172.21.15.151:56670) 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de8d3640 1 -- 172.21.15.151:0/4011636206 learned_addr learned my addr 172.21.15.151:0/4011636206 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de8d3640 1 -- 172.21.15.151:0/4011636206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c997d1b0 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27de8d3640 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27d80e2bd0 tx=0x7f27d80d62e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f26c8e01640 1 -- 172.21.15.151:0/4011636206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80be670 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598c997d440 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f26c8e01640 1 -- 172.21.15.151:0/4011636206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80be810 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c99800c0 con 0x5598c997c850 2024-09-13T19:06:43.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.271+0000 7f26c8e01640 1 -- 172.21.15.151:0/4011636206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8004740 con 0x5598c997c850 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c8e01640 1 -- 172.21.15.151:0/4011636206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27d80e4050 con 0x5598c997c850 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c8e01640 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 0x7f26b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c8e01640 1 -- 172.21.15.151:0/4011636206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f27d80dd070 con 0x5598c997c850 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de0d2640 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 0x7f26b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598c99580e0 con 0x5598c97e1be0 2024-09-13T19:06:43.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de0d2640 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 0x7f26b8036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5598c99664f0 tx=0x7f27d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56678/0 (socket says 172.21.15.151:56678) 2024-09-13T19:06:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de8d3640 1 -- 172.21.15.151:0/3111660839 learned_addr learned my addr 172.21.15.151:0/3111660839 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de8d3640 1 -- 172.21.15.151:0/3111660839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c97e25b0 con 0x5598c97e1be0 2024-09-13T19:06:43.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27de8d3640 1 --2- 172.21.15.151:0/3111660839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f27d80be9e0 tx=0x7f27d80e06d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84e48d155e70b4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c27fc640 1 -- 172.21.15.151:0/3111660839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80fc070 con 0x5598c97e1be0 2024-09-13T19:06:43.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c27fc640 1 -- 172.21.15.151:0/3111660839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80c8c50 con 0x5598c97e1be0 2024-09-13T19:06:43.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f26c27fc640 1 -- 172.21.15.151:0/3111660839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80d5080 con 0x5598c97e1be0 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3111660839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 msgr2=0x5598c97e1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3111660839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f27d80be9e0 tx=0x7f27d80e06d0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3111660839 shutdown_connections 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3111660839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c97e1fe0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3111660839 >> 172.21.15.151:0/3111660839 conn(0x5598c9985510 msgr2=0x5598c9983660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3111660839 shutdown_connections 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.275+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3111660839 wait complete. 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 Processor -- start 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 -- start start 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c9996920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598c97e2b90 con 0x5598c97e1be0 2024-09-13T19:06:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c9996920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27de8d3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c9996920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56684/0 (socket says 172.21.15.151:56684) 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 learned_addr learned my addr 172.21.15.151:0/650798719 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c9996e60 con 0x5598c97e1be0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27de8d3640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c9996920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f27d80fa040 tx=0x7f27d80c0f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f26c0ff9640 1 -- 172.21.15.151:0/650798719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d8107070 con 0x5598c97e1be0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f26c0ff9640 1 -- 172.21.15.151:0/650798719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d80b53b0 con 0x5598c97e1be0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f26c0ff9640 1 -- 172.21.15.151:0/650798719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27d80fc040 con 0x5598c97e1be0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598c9996e60 con 0x5598c97e1be0 2024-09-13T19:06:43.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.279+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c9996e60 con 0x5598c97e1be0 2024-09-13T19:06:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f26c0ff9640 1 -- 172.21.15.151:0/650798719 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f27d810a070 con 0x5598c97e1be0 2024-09-13T19:06:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f26c0ff9640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26a8034650 0x7f26a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f26c0ff9640 1 -- 172.21.15.151:0/650798719 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f27d80f4070 con 0x5598c97e1be0 2024-09-13T19:06:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de0d2640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26a8034650 0x7f26a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c99a1a80 0x5598c99a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a4690 con 0x5598c99a1a80 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c99a1a80 0x5598c99a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de0d2640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26a8034650 0x7f26a8036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c010 tx=0x7f27d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c99a1a80 0x5598c99a3f40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 realm 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a4aa0 con 0x5598c99a1a80 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a5340 con 0x5598c99a1a80 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c99a6440 0x5598c99a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a8e80 con 0x5598c99a6440 2024-09-13T19:06:43.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c99a6440 0x5598c99a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c99a6440 0x5598c99a8830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 20 searching for the correct realm 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aa6e0 con 0x5598c99a6440 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f27d810c070 0x7f27d80d6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aa6e0 con 0x7f27d810c070 2024-09-13T19:06:43.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.283+0000 7f27de0d2640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f27d810c070 0x7f27d80d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27de0d2640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f27d810c070 0x7f27d80d6850 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27de0d2640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f27d4037040 0x7f27d4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aa6e0 con 0x7f27d4037040 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f27d4037040 0x7f27d4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f27d4037040 0x7f27d4036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.287+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d810c070 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d810c070 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.291+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d810c070 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.295+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d810c070 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a6440 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d4037040 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x5598c99a1a80 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a56e0 con 0x7f27d810c070 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a9800 con 0x5598c99a1a80 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aa050 con 0x5598c99a1a80 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a9460 con 0x7f27d810c070 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 zone default found 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 4 Realm: () 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 zonegroup default 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.299+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aab10 con 0x7f27d4037040 2024-09-13T19:06:43.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99a9d10 con 0x5598c99a6440 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99aca70 con 0x5598c99a6440 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 started sync module instance, tier type = 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99abe30 con 0x7f27d810c070 2024-09-13T19:06:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114705752608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99ad380 con 0x7f27d810c070 2024-09-13T19:06:43.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99adbd0 con 0x5598c99a1a80 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.303+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114705752608] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114705755856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99adbd0 con 0x5598c99a1a80 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99ae670 con 0x5598c99a6440 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114705755856] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114705757984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99adb40 con 0x5598c99a6440 2024-09-13T19:06:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.307+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99af430 con 0x7f27d810c070 2024-09-13T19:06:43.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114705766432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b00f0 con 0x7f27d810c070 2024-09-13T19:06:43.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b0ab0 con 0x5598c99a1a80 2024-09-13T19:06:43.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114705766432] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114705757984] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.311+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114705769984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b00f0 con 0x5598c99a1a80 2024-09-13T19:06:43.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.315+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b0a20 con 0x7f27d4037040 2024-09-13T19:06:43.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.315+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114705769984] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.319+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.319+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114705767488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b0060 con 0x7f27d4037040 2024-09-13T19:06:43.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.319+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b17f0 con 0x7f27d4037040 2024-09-13T19:06:43.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.323+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114705767488] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.323+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.323+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114705772048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b17b0 con 0x7f27d4037040 2024-09-13T19:06:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.323+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b21b0 con 0x7f27d4037040 2024-09-13T19:06:43.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.327+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114705772048] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114705773104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b2170 con 0x7f27d4037040 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=0 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=1 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=2 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=3 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=4 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=5 2024-09-13T19:06:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=6 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114705773104] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 20 add_watcher() i=7 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.331+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b55d0 con 0x5598c99a1a80 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114705776272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b2af0 con 0x5598c99a1a80 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114705776272] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f26957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 5 note: GC not initialized 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f260ffff640 20 reqs_thread_entry: start 2024-09-13T19:06:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 Filter name: none 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f260dffb640 20 reqs_thread_entry: start 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99d8c40 con 0x5598c99a1a80 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 20 rados_obj.operate() r=0 bl.length=673 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99df7f0 con 0x5598c99a1a80 2024-09-13T19:06:43.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94114705961568 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daf40 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94114705769984 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f27d003b040 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f26c27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94114705769984 notifier 4400 bl.length()=758 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f26c27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f26c27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f26c27fc640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f26a4003eb0 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 94114705961568 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.335+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94114705961568 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f27d0010040 con 0x5598c99a1a80 2024-09-13T19:06:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99df260 con 0x5598c99a1a80 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27e0dc3980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94114705961568 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daa90 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== watch-notify(notify (1) cookie 94114705752608 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f27c8001e20 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f26c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94114705752608 notifier 4400 bl.length()=159 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f26c1ffb640 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f26140032d0 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [notify cookie 94114705961568 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== watch-notify(notify_complete (2) cookie 94114705961568 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f27d4036950 con 0x7f27d810c070 2024-09-13T19:06:43.343 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:06:42.963120Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:43.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f26957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114705776272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daa90 con 0x5598c99a1a80 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94114705776272] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.339+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114705752608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daa90 con 0x7f27d810c070 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94114705752608] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27e0dc3980 20 remove_watcher() i=0 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27e0dc3980 2 removed watcher, disabling cache 2024-09-13T19:06:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114705755856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daa90 con 0x5598c99a1a80 2024-09-13T19:06:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94114705755856] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27e0dc3980 20 remove_watcher() i=1 2024-09-13T19:06:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.343+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114705757984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99daa90 con 0x5598c99a6440 2024-09-13T19:06:43.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27de8d3640 1 -- 172.21.15.151:0/650798719 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94114705757984] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d8113070 con 0x5598c99a6440 2024-09-13T19:06:43.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27e0dc3980 20 remove_watcher() i=2 2024-09-13T19:06:43.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114705766432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99ad720 con 0x7f27d810c070 2024-09-13T19:06:43.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27de0d2640 1 -- 172.21.15.151:0/650798719 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94114705766432] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d400e6c0 con 0x7f27d810c070 2024-09-13T19:06:43.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27e0dc3980 20 remove_watcher() i=3 2024-09-13T19:06:43.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.347+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114705769984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99af820 con 0x5598c99a1a80 2024-09-13T19:06:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94114705769984] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x5598c99a1a80 2024-09-13T19:06:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27e0dc3980 20 remove_watcher() i=4 2024-09-13T19:06:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114705767488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99ad720 con 0x7f27d4037040 2024-09-13T19:06:43.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94114705767488] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27e0dc3980 20 remove_watcher() i=5 2024-09-13T19:06:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.351+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114705772048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99b0600 con 0x7f27d4037040 2024-09-13T19:06:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.355+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94114705772048] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.355+0000 7f27e0dc3980 20 remove_watcher() i=6 2024-09-13T19:06:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.355+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114705773104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598c99ad720 con 0x7f27d4037040 2024-09-13T19:06:43.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94114705773104] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27d00083f0 con 0x7f27d4037040 2024-09-13T19:06:43.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 20 remove_watcher() i=7 2024-09-13T19:06:43.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f27d4037040 msgr2=0x7f27d4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f27d4037040 0x7f27d4036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c99a1a80 msgr2=0x5598c99a3f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c99a1a80 0x5598c99a3f40 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f27d810c070 msgr2=0x7f27d80d6850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f27d810c070 0x7f27d80d6850 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c99a6440 msgr2=0x5598c99a8830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c99a6440 0x5598c99a8830 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26a8034650 msgr2=0x7f26a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26a8034650 0x7f26a8036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c010 tx=0x7f27d4010000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 msgr2=0x5598c9996920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/650798719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c97e1be0 0x5598c9996920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f27d80fa040 tx=0x7f27d80c0f70 comp rx=0 tx=0).stop 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27df0d4640 1 -- 172.21.15.151:0/650798719 reap_dead start 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 shutdown_connections 2024-09-13T19:06:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 >> 172.21.15.151:0/650798719 conn(0x5598c9985510 msgr2=0x5598c99835d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 shutdown_connections 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/650798719 wait complete. 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 msgr2=0x7f26b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 0x7f26b8036b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x5598c99664f0 tx=0x7f27d400f000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 msgr2=0x5598c997cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f27d80e2bd0 tx=0x7f27d80d62e0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 shutdown_connections 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26b80346a0 0x7f26b8036b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/4011636206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c997c850 0x5598c997cc70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 >> 172.21.15.151:0/4011636206 conn(0x5598c99719a0 msgr2=0x5598c9974420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 shutdown_connections 2024-09-13T19:06:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/4011636206 wait complete. 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c986cff0 msgr2=0x5598c99659b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598c986cff0 0x5598c99659b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598c996c290 msgr2=0x5598c996e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598c996c290 0x5598c996e680 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c9968350 msgr2=0x5598c996a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598c9968350 0x5598c996a740 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26c4034650 msgr2=0x7f26c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f26c4034650 0x7f26c4036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f27d4000f70 tx=0x7f27d40010b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 msgr2=0x5598c995ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 --2- 172.21.15.151:0/3224128164 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598c986c6a0 0x5598c995ea20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f27d801b870 tx=0x7f27d8019810 comp rx=0 tx=0).stop 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27df0d4640 1 -- 172.21.15.151:0/3224128164 reap_dead start 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 shutdown_connections 2024-09-13T19:06:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 >> 172.21.15.151:0/3224128164 conn(0x5598c98681c0 msgr2=0x5598c9952000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 shutdown_connections 2024-09-13T19:06:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.359+0000 7f27e0dc3980 1 -- 172.21.15.151:0/3224128164 wait complete. 2024-09-13T19:06:43.371 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:06:42.963120Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:43.371 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:06:43.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-13T19:06:43.371 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-13T19:06:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f8921c61980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564b016b9290 0x564b017473a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f8921c61980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b015ccae0 con 0x564b017478e0 2024-09-13T19:06:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f8921c61980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x564b015f0e30 con 0x564b016b9290 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891f771640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564b016b9290 0x564b017473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891f771640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564b016b9290 0x564b017473a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56688/0 (socket says 172.21.15.151:56688) 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891f771640 1 -- 172.21.15.151:0/804663414 learned_addr learned my addr 172.21.15.151:0/804663414 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891ef70640 1 --1- 172.21.15.151:0/804663414 >> v1:172.21.15.12:6789/0 conn(0x564b017478e0 0x564b01749cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33498/0 (socket says 172.21.15.151:33498) 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891f771640 1 -- 172.21.15.151:0/804663414 >> v1:172.21.15.12:6789/0 conn(0x564b017478e0 legacy=0x564b01749cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.439+0000 7f891f771640 1 -- 172.21.15.151:0/804663414 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b016b9820 con 0x564b016b9290 2024-09-13T19:06:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f891f771640 1 --2- 172.21.15.151:0/804663414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b017473a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f891800a4e0 tx=0x7f891801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae4cc5b7ab9a807 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f891e76f640 1 -- 172.21.15.151:0/804663414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180aa540 con 0x564b016b9290 2024-09-13T19:06:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f891e76f640 1 -- 172.21.15.151:0/804663414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180aa6e0 con 0x564b016b9290 2024-09-13T19:06:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f891e76f640 1 -- 172.21.15.151:0/804663414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180aaa40 con 0x564b016b9290 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 -- 172.21.15.151:0/804663414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 msgr2=0x564b017473a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 --2- 172.21.15.151:0/804663414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b017473a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f891800a4e0 tx=0x7f891801b090 comp rx=0 tx=0).stop 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 -- 172.21.15.151:0/804663414 shutdown_connections 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 --2- 172.21.15.151:0/804663414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b017473a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 -- 172.21.15.151:0/804663414 >> 172.21.15.151:0/804663414 conn(0x564b0173f090 msgr2=0x564b017414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 -- 172.21.15.151:0/804663414 shutdown_connections 2024-09-13T19:06:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.443+0000 7f8921c61980 1 -- 172.21.15.151:0/804663414 wait complete. 2024-09-13T19:06:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.455+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564b015f2200 con 0x564b016b9290 2024-09-13T19:06:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56690/0 (socket says 172.21.15.151:56690) 2024-09-13T19:06:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 -- 172.21.15.151:0/3994202719 learned_addr learned my addr 172.21.15.151:0/3994202719 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 -- 172.21.15.151:0/3994202719 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b017450d0 con 0x564b016b9290 2024-09-13T19:06:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 --2- 172.21.15.151:0/3994202719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8918017ca0 tx=0x7f89180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26d3a35585facb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f880d60a640 1 -- 172.21.15.151:0/3994202719 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180b9030 con 0x564b016b9290 2024-09-13T19:06:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f880d60a640 1 -- 172.21.15.151:0/3994202719 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180aaac0 con 0x564b016b9290 2024-09-13T19:06:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f880d60a640 1 -- 172.21.15.151:0/3994202719 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180aada0 con 0x564b016b9290 2024-09-13T19:06:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- 172.21.15.151:0/3994202719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 msgr2=0x564b01744b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 --2- 172.21.15.151:0/3994202719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8918017ca0 tx=0x7f89180033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- 172.21.15.151:0/3994202719 shutdown_connections 2024-09-13T19:06:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 --2- 172.21.15.151:0/3994202719 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01744b00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- 172.21.15.151:0/3994202719 >> 172.21.15.151:0/3994202719 conn(0x564b0173f090 msgr2=0x564b0182b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- 172.21.15.151:0/3994202719 shutdown_connections 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- 172.21.15.151:0/3994202719 wait complete. 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01838db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f8921c61980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564b0174bf00 con 0x564b016b9290 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01838db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01838db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56696/0 (socket says 172.21.15.151:56696) 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 -- 172.21.15.151:0/242741913 learned_addr learned my addr 172.21.15.151:0/242741913 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.459+0000 7f891f771640 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b018392f0 con 0x564b016b9290 2024-09-13T19:06:43.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891f771640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01838db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8918005cc0 tx=0x7f8918017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 -- 172.21.15.151:0/242741913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180b9030 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 -- 172.21.15.151:0/242741913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180c3070 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b01839580 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 -- 172.21.15.151:0/242741913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180bf750 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0183c260 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 -- 172.21.15.151:0/242741913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89180c5030 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f88040346a0 0x7f8804036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f880be07640 1 -- 172.21.15.151:0/242741913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f89180ba070 con 0x564b016b9290 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ef70640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f88040346a0 0x7f8804036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b017478e0 0x564b0183fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018403b0 con 0x564b017478e0 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ff72640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b017478e0 0x564b0183fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ef70640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f88040346a0 0x7f8804036b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8914001e50 tx=0x7f89140013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ff72640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b017478e0 0x564b0183fd40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ff72640 1 -- 172.21.15.151:0/242741913 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b017478e0 2024-09-13T19:06:43.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0183d460 con 0x564b017478e0 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891ff72640 1 -- 172.21.15.151:0/242741913 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89100083f0 con 0x564b017478e0 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b01842730 0x564b01844b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018451f0 con 0x564b01842730 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891f771640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b01842730 0x564b01844b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891f771640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b01842730 0x564b01844b20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f891f771640 1 -- 172.21.15.151:0/242741913 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f89180ce070 con 0x564b01842730 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.463+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018415d0 con 0x564b017478e0 2024-09-13T19:06:43.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891ff72640 1 -- 172.21.15.151:0/242741913 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89100083f0 con 0x564b017478e0 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564b01846650 0x564b01848a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b01849180 con 0x564b01846650 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891ef70640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564b01846650 0x564b01848a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891ef70640 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564b01846650 0x564b01848a40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891ef70640 1 -- 172.21.15.151:0/242741913 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f891400f700 con 0x564b01846650 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564b0164b800 con 0x564b01856c00 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56710/0 (socket says 172.21.15.151:56710) 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891f771640 1 -- 172.21.15.151:0/3970636693 learned_addr learned my addr 172.21.15.151:0/3970636693 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891f771640 1 -- 172.21.15.151:0/3970636693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b01857560 con 0x564b01856c00 2024-09-13T19:06:43.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f891f771640 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89180bdb40 tx=0x7f89180a96b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8809602640 1 -- 172.21.15.151:0/3970636693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180cc040 con 0x564b01856c00 2024-09-13T19:06:43.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8809602640 1 -- 172.21.15.151:0/3970636693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180a9750 con 0x564b01856c00 2024-09-13T19:06:43.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b018577f0 con 0x564b01856c00 2024-09-13T19:06:43.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8809602640 1 -- 172.21.15.151:0/3970636693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180a9a30 con 0x564b01856c00 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.467+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0185a470 con 0x564b01856c00 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8809602640 1 -- 172.21.15.151:0/3970636693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f89180b3040 con 0x564b01856c00 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8809602640 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 0x7f87f8036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8809602640 1 -- 172.21.15.151:0/3970636693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f89180ebc80 con 0x564b01856c00 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891ef70640 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 0x7f87f8036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891ef70640 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 0x7f87f8036bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x564b01840ce0 tx=0x7f891400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564b01743230 con 0x564b01863570 2024-09-13T19:06:43.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56726/0 (socket says 172.21.15.151:56726) 2024-09-13T19:06:43.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891f771640 1 -- 172.21.15.151:0/3101930564 learned_addr learned my addr 172.21.15.151:0/3101930564 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891f771640 1 -- 172.21.15.151:0/3101930564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b01863f40 con 0x564b01863570 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f891f771640 1 --2- 172.21.15.151:0/3101930564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8918003000 tx=0x7f89180e2100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bf6e11d2ab6e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8802ffd640 1 -- 172.21.15.151:0/3101930564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180f8070 con 0x564b01863570 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8802ffd640 1 -- 172.21.15.151:0/3101930564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180c90b0 con 0x564b01863570 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8802ffd640 1 -- 172.21.15.151:0/3101930564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180bfc70 con 0x564b01863570 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- 172.21.15.151:0/3101930564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 msgr2=0x564b01863970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 --2- 172.21.15.151:0/3101930564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8918003000 tx=0x7f89180e2100 comp rx=0 tx=0).stop 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- 172.21.15.151:0/3101930564 shutdown_connections 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 --2- 172.21.15.151:0/3101930564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b01863970 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- 172.21.15.151:0/3101930564 >> 172.21.15.151:0/3101930564 conn(0x564b0185f900 msgr2=0x564b0185da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- 172.21.15.151:0/3101930564 shutdown_connections 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- 172.21.15.151:0/3101930564 wait complete. 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 Processor -- start 2024-09-13T19:06:43.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.471+0000 7f8921c61980 1 -- start start 2024-09-13T19:06:43.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b0186a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564b01864310 con 0x564b01863570 2024-09-13T19:06:43.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b0186a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891f771640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b0186a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56728/0 (socket says 172.21.15.151:56728) 2024-09-13T19:06:43.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 learned_addr learned my addr 172.21.15.151:0/1349371912 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b0186abe0 con 0x564b01863570 2024-09-13T19:06:43.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891f771640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b0186a6a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89180d1bb0 tx=0x7f89180daf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 -- 172.21.15.151:0/1349371912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891810d070 con 0x564b01863570 2024-09-13T19:06:43.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 -- 172.21.15.151:0/1349371912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180ce300 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b0186abe0 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 -- 172.21.15.151:0/1349371912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89180f8040 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0186abe0 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 -- 172.21.15.151:0/1349371912 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8918110070 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87e8034650 0x7f87e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f88017fa640 1 -- 172.21.15.151:0/1349371912 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8918104030 con 0x564b01863570 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891ef70640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87e8034650 0x7f87e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b01875820 0x564b01877cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b01878410 con 0x564b01875820 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891ff72640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b01875820 0x564b01877cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891ef70640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87e8034650 0x7f87e8036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x564b01841970 tx=0x7f8914010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891ff72640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b01875820 0x564b01877cc0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 20 realm 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.475+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b01878820 con 0x564b01875820 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018790c0 con 0x564b01875820 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b0187a1c0 0x564b0187c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0187cc00 con 0x564b0187a1c0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b0187a1c0 0x564b0187c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b0187a1c0 0x564b0187c5b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 20 searching for the correct realm 2024-09-13T19:06:43.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b0187e460 con 0x564b0187a1c0 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8918112060 0x7f89180da430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b0187e460 con 0x7f8918112060 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ef70640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8918112060 0x7f89180da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ef70640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8918112060 0x7f89180da430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ef70640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f891401fbe0 0x7f891403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b0187e460 con 0x7f891401fbe0 2024-09-13T19:06:43.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ff72640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f891401fbe0 0x7f891403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.479+0000 7f891ff72640 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f891401fbe0 0x7f891403a3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f8918112060 2024-09-13T19:06:43.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f8918112060 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.483+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f8918112060 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.487+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f8918112060 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b0187a1c0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x564b01875820 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b01879460 con 0x7f8918112060 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0187d580 con 0x564b01875820 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0187ddd0 con 0x564b01875820 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0187d920 con 0x7f8918112060 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 zone default found 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 4 Realm: () 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:43.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 zonegroup default 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b0187e890 con 0x7f891401fbe0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.491+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b01880270 con 0x564b0187a1c0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018807b0 con 0x564b0187a1c0 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 20 started sync module instance, tier type = 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b0187f710 con 0x7f8918112060 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880148224768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b0187f370 con 0x7f8918112060 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018816e0 con 0x564b01875820 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880148224768] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880148230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01881b00 con 0x564b01875820 2024-09-13T19:06:43.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.495+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018823b0 con 0x564b0187a1c0 2024-09-13T19:06:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.499+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880148230704] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880148231760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01882750 con 0x564b0187a1c0 2024-09-13T19:06:43.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01883110 con 0x7f8918112060 2024-09-13T19:06:43.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880148239616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01883dd0 con 0x7f8918112060 2024-09-13T19:06:43.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01884790 con 0x564b01875820 2024-09-13T19:06:43.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.503+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880148239616] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.507+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880148231760] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.507+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.507+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880148240672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01884790 con 0x564b01875820 2024-09-13T19:06:43.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.507+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01885030 con 0x7f891401fbe0 2024-09-13T19:06:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.511+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880148240672] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.511+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.511+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880148243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01884dc0 con 0x7f891401fbe0 2024-09-13T19:06:43.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.511+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018858e0 con 0x7f891401fbe0 2024-09-13T19:06:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.515+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880148243440] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880148247472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018858a0 con 0x7f891401fbe0 2024-09-13T19:06:43.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018862c0 con 0x7f891401fbe0 2024-09-13T19:06:43.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880148247472] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880148250032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01886280 con 0x7f891401fbe0 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=0 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=1 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=2 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=3 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=4 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=5 2024-09-13T19:06:43.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.519+0000 7f8921c61980 20 add_watcher() i=6 2024-09-13T19:06:43.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880148250032] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 20 add_watcher() i=7 2024-09-13T19:06:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018896e0 con 0x564b01875820 2024-09-13T19:06:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880148244496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01886c00 con 0x564b01875820 2024-09-13T19:06:43.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880148244496] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f87d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.523+0000 7f8921c61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 5 note: GC not initialized 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f87d4fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 20 Filter name: none 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f874e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018acd60 con 0x564b01875820 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 20 rados_obj.operate() r=0 bl.length=582 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018b3380 con 0x564b01875820 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94880148434416 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b018aed20 con 0x564b01875820 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94880148240672 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f891003b040 con 0x564b01875820 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8802ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94880148240672 notifier 4407 bl.length()=732 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8802ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8802ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 94880148434416 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8802ffd640 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f87e4003eb0 con 0x564b01875820 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94880148434416 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8910010040 con 0x564b01875820 2024-09-13T19:06:43.533 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-13T19:06:42.963120Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:43.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f87d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.527+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880148244496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x564b01875820 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94880148244496] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880148224768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x7f8918112060 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94880148224768] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 20 remove_watcher() i=0 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 2 removed watcher, disabling cache 2024-09-13T19:06:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880148230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x564b01875820 2024-09-13T19:06:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94880148230704] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 20 remove_watcher() i=1 2024-09-13T19:06:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.531+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880148231760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01881230 con 0x564b0187a1c0 2024-09-13T19:06:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f891f771640 1 -- 172.21.15.151:0/1349371912 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94880148231760] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891810f030 con 0x564b0187a1c0 2024-09-13T19:06:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f8921c61980 20 remove_watcher() i=2 2024-09-13T19:06:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880148239616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x7f8918112060 2024-09-13T19:06:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f891ef70640 1 -- 172.21.15.151:0/1349371912 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94880148239616] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8914037040 con 0x7f8918112060 2024-09-13T19:06:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f8921c61980 20 remove_watcher() i=3 2024-09-13T19:06:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.535+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880148240672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b01883500 con 0x564b01875820 2024-09-13T19:06:43.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.539+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94880148240672] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x564b01875820 2024-09-13T19:06:43.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.539+0000 7f8921c61980 20 remove_watcher() i=4 2024-09-13T19:06:43.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.539+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880148243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x7f891401fbe0 2024-09-13T19:06:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94880148243440] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f8921c61980 20 remove_watcher() i=5 2024-09-13T19:06:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880148247472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018aab90 con 0x7f891401fbe0 2024-09-13T19:06:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94880148247472] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f8921c61980 20 remove_watcher() i=6 2024-09-13T19:06:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.543+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880148250032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b018853b0 con 0x7f891401fbe0 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94880148250032] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f89100083f0 con 0x7f891401fbe0 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 20 remove_watcher() i=7 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f891401fbe0 msgr2=0x7f891403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f891401fbe0 0x7f891403a3c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b01875820 msgr2=0x564b01877cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b01875820 0x564b01877cc0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8918112060 msgr2=0x7f89180da430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8918112060 0x7f89180da430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b0187a1c0 msgr2=0x564b0187c5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b0187a1c0 0x564b0187c5b0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87e8034650 msgr2=0x7f87e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87e8034650 0x7f87e8036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x564b01841970 tx=0x7f8914010000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 msgr2=0x564b0186a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/1349371912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01863570 0x564b0186a6a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f89180d1bb0 tx=0x7f89180daf90 comp rx=0 tx=0).stop 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f891ff72640 1 -- 172.21.15.151:0/1349371912 reap_dead start 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 shutdown_connections 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 >> 172.21.15.151:0/1349371912 conn(0x564b0185f900 msgr2=0x564b0185d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 shutdown_connections 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/1349371912 wait complete. 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 msgr2=0x7f87f8036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 0x7f87f8036bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x564b01840ce0 tx=0x7f891400f000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 msgr2=0x564b01857020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f89180bdb40 tx=0x7f89180a96b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 shutdown_connections 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f87f80346f0 0x7f87f8036bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/3970636693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b01856c00 0x564b01857020 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 >> 172.21.15.151:0/3970636693 conn(0x564b0184bd50 msgr2=0x564b0184e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 shutdown_connections 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/3970636693 wait complete. 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b017478e0 msgr2=0x564b0183fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564b017478e0 0x564b0183fd40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564b01846650 msgr2=0x564b01848a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564b01846650 0x564b01848a40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b01842730 msgr2=0x564b01844b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564b01842730 0x564b01844b20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f88040346a0 msgr2=0x7f8804036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f88040346a0 0x7f8804036b60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8914001e50 tx=0x7f89140013b0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 msgr2=0x564b01838db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 --2- 172.21.15.151:0/242741913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564b016b9290 0x564b01838db0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8918005cc0 tx=0x7f8918017e30 comp rx=0 tx=0).stop 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f891ff72640 1 -- 172.21.15.151:0/242741913 reap_dead start 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 shutdown_connections 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 >> 172.21.15.151:0/242741913 conn(0x564b0173f090 msgr2=0x564b01743750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 shutdown_connections 2024-09-13T19:06:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.547+0000 7f8921c61980 1 -- 172.21.15.151:0/242741913 wait complete. 2024-09-13T19:06:43.559 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-13T19:06:42.963120Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:43.560 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:06:43.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-13T19:06:43.560 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-13T19:06:43.639 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.639 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.635+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.635+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f871f2e7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55713a7899f0 0x55713a78bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f871f2e7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55713a60dae0 con 0x55713a6f9aa0 2024-09-13T19:06:43.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f871f2e7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55713a631e30 con 0x55713a7899f0 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f8717fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55713a7899f0 0x55713a78bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f871cdf7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55713a6f9aa0 0x55713a7882d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33504/0 (socket says 172.21.15.151:33504) 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f871cdf7640 1 -- 172.21.15.151:0/4185429333 learned_addr learned my addr 172.21.15.151:0/4185429333 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f8717fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55713a7899f0 0x55713a78bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56742/0 (socket says 172.21.15.151:56742) 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f8717fff640 1 -- 172.21.15.151:0/4185429333 >> v1:172.21.15.12:6789/0 conn(0x55713a6f9aa0 legacy=0x55713a7882d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f8717fff640 1 -- 172.21.15.151:0/4185429333 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a78d330 con 0x55713a7899f0 2024-09-13T19:06:43.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f8717fff640 1 --2- 172.21.15.151:0/4185429333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a7899f0 0x55713a78bde0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f871000a480 tx=0x7f871001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0385487c38dcfdb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f87177fe640 1 -- 172.21.15.151:0/4185429333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87100b0070 con 0x55713a7899f0 2024-09-13T19:06:43.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f87177fe640 1 -- 172.21.15.151:0/4185429333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100ab540 con 0x55713a7899f0 2024-09-13T19:06:43.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.639+0000 7f87177fe640 1 -- 172.21.15.151:0/4185429333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87100ab840 con 0x55713a7899f0 2024-09-13T19:06:43.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 -- 172.21.15.151:0/4185429333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a7899f0 msgr2=0x55713a78bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 --2- 172.21.15.151:0/4185429333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a7899f0 0x55713a78bde0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f871000a480 tx=0x7f871001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 -- 172.21.15.151:0/4185429333 shutdown_connections 2024-09-13T19:06:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 --2- 172.21.15.151:0/4185429333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a7899f0 0x55713a78bde0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 -- 172.21.15.151:0/4185429333 >> 172.21.15.151:0/4185429333 conn(0x55713a780000 msgr2=0x55713a782420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 -- 172.21.15.151:0/4185429333 shutdown_connections 2024-09-13T19:06:43.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.643+0000 7f871f2e7980 1 -- 172.21.15.151:0/4185429333 wait complete. 2024-09-13T19:06:43.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55713a633200 con 0x55713a6f9aa0 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56754/0 (socket says 172.21.15.151:56754) 2024-09-13T19:06:43.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871cdf7640 1 -- 172.21.15.151:0/852058730 learned_addr learned my addr 172.21.15.151:0/852058730 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871cdf7640 1 -- 172.21.15.151:0/852058730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a870f90 con 0x55713a6f9aa0 2024-09-13T19:06:43.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871cdf7640 1 --2- 172.21.15.151:0/852058730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8708001d90 tx=0x7f8708001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aecdf263ed6519 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f860ae05640 1 -- 172.21.15.151:0/852058730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708013030 con 0x55713a6f9aa0 2024-09-13T19:06:43.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f860ae05640 1 -- 172.21.15.151:0/852058730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870800e690 con 0x55713a6f9aa0 2024-09-13T19:06:43.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f860ae05640 1 -- 172.21.15.151:0/852058730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870800ea10 con 0x55713a6f9aa0 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- 172.21.15.151:0/852058730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 msgr2=0x55713a8709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 --2- 172.21.15.151:0/852058730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8708001d90 tx=0x7f8708001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- 172.21.15.151:0/852058730 shutdown_connections 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 --2- 172.21.15.151:0/852058730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a8709c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- 172.21.15.151:0/852058730 >> 172.21.15.151:0/852058730 conn(0x55713a780000 msgr2=0x55713a86c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- 172.21.15.151:0/852058730 shutdown_connections 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.655+0000 7f871f2e7980 1 -- 172.21.15.151:0/852058730 wait complete. 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a877e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55713a78cdd0 con 0x55713a6f9aa0 2024-09-13T19:06:43.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a877e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a877e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56758/0 (socket says 172.21.15.151:56758) 2024-09-13T19:06:43.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871cdf7640 1 -- 172.21.15.151:0/1405930929 learned_addr learned my addr 172.21.15.151:0/1405930929 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871cdf7640 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a878340 con 0x55713a6f9aa0 2024-09-13T19:06:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871cdf7640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a877e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55713a871ba0 tx=0x7f8708000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 -- 172.21.15.151:0/1405930929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708027070 con 0x55713a6f9aa0 2024-09-13T19:06:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55713a8785d0 con 0x55713a6f9aa0 2024-09-13T19:06:43.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 -- 172.21.15.151:0/1405930929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8708019900 con 0x55713a6f9aa0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 -- 172.21.15.151:0/1405930929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708019c20 con 0x55713a6f9aa0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713a87b2b0 con 0x55713a6f9aa0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 -- 172.21.15.151:0/1405930929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f870802a070 con 0x55713a6f9aa0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8604034650 0x7f8604036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8609602640 1 -- 172.21.15.151:0/1405930929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f870801f070 con 0x55713a6f9aa0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8717fff640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8604034650 0x7f8604036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a7899f0 0x55713a87edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a87f440 con 0x55713a7899f0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871d5f8640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a7899f0 0x55713a87edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f8717fff640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8604034650 0x7f8604036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f87100ad000 tx=0x7f87100a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.659+0000 7f871d5f8640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a7899f0 0x55713a87edd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871d5f8640 1 -- 172.21.15.151:0/1405930929 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a7899f0 2024-09-13T19:06:43.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a87c4d0 con 0x55713a7899f0 2024-09-13T19:06:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871d5f8640 1 -- 172.21.15.151:0/1405930929 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a7899f0 2024-09-13T19:06:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a881790 0x55713a883b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a884270 con 0x55713a881790 2024-09-13T19:06:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a881790 0x55713a883b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a881790 0x55713a883b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 -- 172.21.15.151:0/1405930929 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8708029030 con 0x55713a881790 2024-09-13T19:06:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a880630 con 0x55713a7899f0 2024-09-13T19:06:43.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871d5f8640 1 -- 172.21.15.151:0/1405930929 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a7899f0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55713a8856d0 0x55713a887ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a888200 con 0x55713a8856d0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f8717fff640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55713a8856d0 0x55713a887ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f8717fff640 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55713a8856d0 0x55713a887ac0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f8717fff640 1 -- 172.21.15.151:0/1405930929 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87100b3040 con 0x55713a8856d0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871f2e7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55713a68c800 con 0x55713a785c50 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56762/0 (socket says 172.21.15.151:56762) 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 -- 172.21.15.151:0/75063494 learned_addr learned my addr 172.21.15.151:0/75063494 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 -- 172.21.15.151:0/75063494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a786070 con 0x55713a785c50 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.663+0000 7f871cdf7640 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f870800c010 tx=0x7f870800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 -- 172.21.15.151:0/75063494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870803c070 con 0x55713a785c50 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55713a784870 con 0x55713a785c50 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 -- 172.21.15.151:0/75063494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870802aa40 con 0x55713a785c50 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 -- 172.21.15.151:0/75063494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870802b3b0 con 0x55713a785c50 2024-09-13T19:06:43.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713a784d40 con 0x55713a785c50 2024-09-13T19:06:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 -- 172.21.15.151:0/75063494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8708036040 con 0x55713a785c50 2024-09-13T19:06:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 0x7f85f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f86027fc640 1 -- 172.21.15.151:0/75063494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8708014070 con 0x55713a785c50 2024-09-13T19:06:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f8717fff640 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 0x7f85f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f8717fff640 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 0x7f85f4036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55713a87f910 tx=0x7f8710005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55713a871310 con 0x55713a8a4820 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56766/0 (socket says 172.21.15.151:56766) 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871cdf7640 1 -- 172.21.15.151:0/2271488588 learned_addr learned my addr 172.21.15.151:0/2271488588 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871cdf7640 1 -- 172.21.15.151:0/2271488588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a8a51d0 con 0x55713a8a4820 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871cdf7640 1 --2- 172.21.15.151:0/2271488588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8708016b80 tx=0x7f8708022520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cd28343ee449eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f85f3fff640 1 -- 172.21.15.151:0/2271488588 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f870802bba0 con 0x55713a8a4820 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f85f3fff640 1 -- 172.21.15.151:0/2271488588 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870802b550 con 0x55713a8a4820 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f85f3fff640 1 -- 172.21.15.151:0/2271488588 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708041630 con 0x55713a8a4820 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 -- 172.21.15.151:0/2271488588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 msgr2=0x55713a8a4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.667+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2271488588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8708016b80 tx=0x7f8708022520 comp rx=0 tx=0).stop 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2271488588 shutdown_connections 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2271488588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8a4c00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2271488588 >> 172.21.15.151:0/2271488588 conn(0x55713a8a0c00 msgr2=0x55713a89ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2271488588 shutdown_connections 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2271488588 wait complete. 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 Processor -- start 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- start start 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55713a8a5670 con 0x55713a8a4820 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871cdf7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56768/0 (socket says 172.21.15.151:56768) 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 learned_addr learned my addr 172.21.15.151:0/2429373347 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55713a8abf60 con 0x55713a8a4820 2024-09-13T19:06:43.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871cdf7640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f87080472b0 tx=0x7f8708015f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 -- 172.21.15.151:0/2429373347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708038440 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55713a8abf60 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 -- 172.21.15.151:0/2429373347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870806c030 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 -- 172.21.15.151:0/2429373347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8708038750 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55713a8ac3d0 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 -- 172.21.15.151:0/2429373347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8708063040 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85e8034650 0x7f85e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f85f27fc640 1 -- 172.21.15.151:0/2429373347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8708058040 con 0x55713a8a4820 2024-09-13T19:06:43.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f8717fff640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85e8034650 0x7f85e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a8b6ab0 0x55713a8b8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8b96a0 con 0x55713a8b6ab0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f871d5f8640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a8b6ab0 0x55713a8b8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.671+0000 7f8717fff640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85e8034650 0x7f85e8036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8710018eb0 tx=0x7f87100b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a8b6ab0 0x55713a8b8f50 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 realm 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8b9ab0 con 0x55713a8b6ab0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba350 con 0x55713a8b6ab0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a8bb450 0x55713a8bd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bdee0 con 0x55713a8bb450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a8bb450 0x55713a8bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a8bb450 0x55713a8bd840 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 20 searching for the correct realm 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bf740 con 0x55713a8bb450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f870804f450 0x7f8708068440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bf740 con 0x7f870804f450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f8717fff640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f870804f450 0x7f8708068440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f8717fff640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f870804f450 0x7f8708068440 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f8717fff640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f87100dc040 0x7f87100dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bf740 con 0x7f87100dc040 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f87100dc040 0x7f87100dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.675+0000 7f871d5f8640 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f87100dc040 0x7f87100dd430 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f870804f450 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.679+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f870804f450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f870804f450 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.683+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f870804f450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8bb450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f87100dc040 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x55713a8b6ab0 2024-09-13T19:06:43.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ba6f0 con 0x7f870804f450 2024-09-13T19:06:43.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8be830 con 0x55713a8b6ab0 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bf080 con 0x55713a8b6ab0 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bebd0 con 0x7f870804f450 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 zone default found 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 4 Realm: () 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:43.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 zonegroup default 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.687+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8bf090 con 0x7f87100dc040 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c15d0 con 0x55713a8bb450 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c19e0 con 0x55713a8bb450 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 started sync module instance, tier type = 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c0a70 con 0x7f870804f450 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93944801922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c06d0 con 0x7f870804f450 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2910 con 0x55713a8b6ab0 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.691+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93944801922656] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93944801928288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2d30 con 0x55713a8b6ab0 2024-09-13T19:06:43.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c3600 con 0x55713a8bb450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93944801930848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c3ea0 con 0x55713a8bb450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.695+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c48c0 con 0x7f870804f450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93944801936304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c5160 con 0x7f870804f450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c5bb0 con 0x55713a8b6ab0 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93944801936304] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93944801928288] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93944801930848] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93944801933808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2880 con 0x55713a8b6ab0 2024-09-13T19:06:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.699+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c5160 con 0x7f87100dc040 2024-09-13T19:06:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93944801933808] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93944801941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c5160 con 0x7f87100dc040 2024-09-13T19:06:43.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c6400 con 0x7f87100dc040 2024-09-13T19:06:43.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93944801941152] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93944801938608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c65e0 con 0x7f87100dc040 2024-09-13T19:06:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.703+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c6e30 con 0x7f87100dc040 2024-09-13T19:06:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93944801945328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c71c0 con 0x7f87100dc040 2024-09-13T19:06:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=0 2024-09-13T19:06:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=1 2024-09-13T19:06:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=2 2024-09-13T19:06:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=3 2024-09-13T19:06:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=4 2024-09-13T19:06:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=5 2024-09-13T19:06:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93944801938608] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.707+0000 7f871f2e7980 20 add_watcher() i=6 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93944801945328] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 add_watcher() i=7 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c6160 con 0x55713a8b6ab0 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93944801943856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c6da0 con 0x55713a8b6ab0 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93944801943856] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f85d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 5 note: GC not initialized 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f85d27e4640 20 reqs_thread_entry: start 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 Filter name: none 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f85cb7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:43.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:43.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ed830 con 0x55713a8b6ab0 2024-09-13T19:06:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 20 rados_obj.operate() r=0 bl.length=556 2024-09-13T19:06:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8f3f70 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.711+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93944802130432 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ef700 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 93944801933808 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f871802d040 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 93944801933808 notifier 4414 bl.length()=567 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 93944802130432 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f3fff640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f85e0003eb0 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 93944802130432 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f871801e040 con 0x55713a8b6ab0 2024-09-13T19:06:43.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8f3a00 con 0x7f870804f450 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871f2e7980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93944802130432 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55713a8ef250 con 0x7f870804f450 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== watch-notify(notify (1) cookie 93944801922656 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55713a78d330 con 0x7f870804f450 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93944801922656 notifier 4414 bl.length()=159 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85f37fe640 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f85440032d0 con 0x7f870804f450 2024-09-13T19:06:43.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(67 notify.0 [notify cookie 93944802130432 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== watch-notify(notify_complete (2) cookie 93944802130432 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f87100b74e0 con 0x7f870804f450 2024-09-13T19:06:43.720 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:43.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f85d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.715+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93944801943856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8eb660 con 0x55713a8b6ab0 2024-09-13T19:06:43.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93944801943856] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93944801922656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8eb660 con 0x7f870804f450 2024-09-13T19:06:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93944801922656] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f871f2e7980 20 remove_watcher() i=0 2024-09-13T19:06:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f871f2e7980 2 removed watcher, disabling cache 2024-09-13T19:06:43.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.719+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93944801928288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8eb660 con 0x55713a8b6ab0 2024-09-13T19:06:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93944801928288] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 20 remove_watcher() i=1 2024-09-13T19:06:43.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93944801930848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2460 con 0x55713a8bb450 2024-09-13T19:06:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871cdf7640 1 -- 172.21.15.151:0/2429373347 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93944801930848] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f870804fd70 con 0x55713a8bb450 2024-09-13T19:06:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 20 remove_watcher() i=2 2024-09-13T19:06:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93944801936304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8eb660 con 0x7f870804f450 2024-09-13T19:06:43.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f8717fff640 1 -- 172.21.15.151:0/2429373347 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93944801936304] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87100c9030 con 0x7f870804f450 2024-09-13T19:06:43.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 20 remove_watcher() i=3 2024-09-13T19:06:43.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.723+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93944801933808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2460 con 0x55713a8b6ab0 2024-09-13T19:06:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93944801933808] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x55713a8b6ab0 2024-09-13T19:06:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871f2e7980 20 remove_watcher() i=4 2024-09-13T19:06:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93944801941152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8eb660 con 0x7f87100dc040 2024-09-13T19:06:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93944801941152] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871f2e7980 20 remove_watcher() i=5 2024-09-13T19:06:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.727+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93944801938608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c2460 con 0x7f87100dc040 2024-09-13T19:06:43.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93944801938608] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 20 remove_watcher() i=6 2024-09-13T19:06:43.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93944801945328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55713a8c56a0 con 0x7f87100dc040 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93944801945328] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f871800a4d0 con 0x7f87100dc040 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 20 remove_watcher() i=7 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f87100dc040 msgr2=0x7f87100dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f87100dc040 0x7f87100dd430 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a8b6ab0 msgr2=0x55713a8b8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a8b6ab0 0x55713a8b8f50 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f870804f450 msgr2=0x7f8708068440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f870804f450 0x7f8708068440 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a8bb450 msgr2=0x55713a8bd840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a8bb450 0x55713a8bd840 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85e8034650 msgr2=0x7f85e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85e8034650 0x7f85e8036b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8710018eb0 tx=0x7f87100b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 msgr2=0x55713a8aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871d5f8640 1 -- 172.21.15.151:0/2429373347 reap_dead start 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f87080472b0 tx=0x7f8708015f80 comp rx=0 tx=0).stop 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 shutdown_connections 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 --2- 172.21.15.151:0/2429373347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a8a4820 0x55713a8aba20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 >> 172.21.15.151:0/2429373347 conn(0x55713a8a0c00 msgr2=0x55713a89ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 shutdown_connections 2024-09-13T19:06:43.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.731+0000 7f871f2e7980 1 -- 172.21.15.151:0/2429373347 wait complete. 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 msgr2=0x7f85f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 0x7f85f4036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55713a87f910 tx=0x7f8710005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 msgr2=0x55713a7842d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f870800c010 tx=0x7f870800df80 comp rx=0 tx=0).stop 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 shutdown_connections 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f85f4034650 0x7f85f4036b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/75063494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a785c50 0x55713a7842d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 >> 172.21.15.151:0/75063494 conn(0x55713a88ae40 msgr2=0x55713a88d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 shutdown_connections 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/75063494 wait complete. 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a7899f0 msgr2=0x55713a87edd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55713a7899f0 0x55713a87edd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55713a8856d0 msgr2=0x55713a887ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55713a8856d0 0x55713a887ac0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a881790 msgr2=0x55713a883b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55713a881790 0x55713a883b80 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8604034650 msgr2=0x7f8604036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8604034650 0x7f8604036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f87100ad000 tx=0x7f87100a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 msgr2=0x55713a877e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 --2- 172.21.15.151:0/1405930929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55713a6f9aa0 0x55713a877e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55713a871ba0 tx=0x7f8708000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871d5f8640 1 -- 172.21.15.151:0/1405930929 reap_dead start 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 shutdown_connections 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 >> 172.21.15.151:0/1405930929 conn(0x55713a780000 msgr2=0x55713a86b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 shutdown_connections 2024-09-13T19:06:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.735+0000 7f871f2e7980 1 -- 172.21.15.151:0/1405930929 wait complete. 2024-09-13T19:06:43.746 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:43.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:06:43.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:06:43.746 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:06:43.816 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.816 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:43.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf45ca5980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555e9f499ec0 0x555e9f49c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf45ca5980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e9f31bae0 con 0x555e9f408290 2024-09-13T19:06:43.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf45ca5980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x555e9f33fe30 con 0x555e9f499ec0 2024-09-13T19:06:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf42fb4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555e9f499ec0 0x555e9f49c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf42fb4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x555e9f499ec0 0x555e9f49c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56770/0 (socket says 172.21.15.151:56770) 2024-09-13T19:06:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf437b5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x555e9f408290 0x555e9f4987a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33508/0 (socket says 172.21.15.151:33508) 2024-09-13T19:06:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3263424868 learned_addr learned my addr 172.21.15.151:0/3263424868 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf427b3640 1 -- 172.21.15.151:0/3263424868 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652928634 0 0) 0x555e9f31bae0 con 0x555e9f408290 2024-09-13T19:06:43.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf427b3640 1 -- 172.21.15.151:0/3263424868 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf2c001e20 con 0x555e9f408290 2024-09-13T19:06:43.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3263424868 >> v1:172.21.15.12:6789/0 conn(0x555e9f408290 legacy=0x555e9f4987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.815+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3263424868 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f408670 con 0x555e9f499ec0 2024-09-13T19:06:43.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3263424868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f499ec0 0x555e9f49c2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800a5c0 tx=0x7fcf3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40efd4b47f2d22e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf427b3640 1 -- 172.21.15.151:0/3263424868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf380a6070 con 0x555e9f499ec0 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf427b3640 1 -- 172.21.15.151:0/3263424868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf380af070 con 0x555e9f499ec0 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf427b3640 1 -- 172.21.15.151:0/3263424868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf380aa5a0 con 0x555e9f499ec0 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3263424868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f499ec0 msgr2=0x555e9f49c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3263424868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f499ec0 0x555e9f49c2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf3800a5c0 tx=0x7fcf3801b340 comp rx=0 tx=0).stop 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3263424868 shutdown_connections 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3263424868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f499ec0 0x555e9f49c2b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3263424868 >> 172.21.15.151:0/3263424868 conn(0x555e9f48e090 msgr2=0x555e9f4904b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3263424868 shutdown_connections 2024-09-13T19:06:43.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.819+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3263424868 wait complete. 2024-09-13T19:06:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf45ca5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf45ca5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e9f341200 con 0x555e9f408290 2024-09-13T19:06:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56778/0 (socket says 172.21.15.151:56778) 2024-09-13T19:06:43.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf437b5640 1 -- 172.21.15.151:0/3291588286 learned_addr learned my addr 172.21.15.151:0/3291588286 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf437b5640 1 -- 172.21.15.151:0/3291588286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f581030 con 0x555e9f408290 2024-09-13T19:06:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3291588286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001e70 tx=0x7fcf3400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca01971034c63a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fce3160a640 1 -- 172.21.15.151:0/3291588286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3400e5d0 con 0x555e9f408290 2024-09-13T19:06:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fce3160a640 1 -- 172.21.15.151:0/3291588286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3400e770 con 0x555e9f408290 2024-09-13T19:06:43.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.831+0000 7fce3160a640 1 -- 172.21.15.151:0/3291588286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3400ead0 con 0x555e9f408290 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3291588286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 msgr2=0x555e9f580a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3291588286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001e70 tx=0x7fcf3400b6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3291588286 shutdown_connections 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3291588286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f580a60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3291588286 >> 172.21.15.151:0/3291588286 conn(0x555e9f48e090 msgr2=0x555e9f57c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3291588286 shutdown_connections 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3291588286 wait complete. 2024-09-13T19:06:43.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f587db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e9f49f220 con 0x555e9f408290 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f587db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f587db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56782/0 (socket says 172.21.15.151:56782) 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf437b5640 1 -- 172.21.15.151:0/2859556170 learned_addr learned my addr 172.21.15.151:0/2859556170 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf437b5640 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f5882f0 con 0x555e9f408290 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf437b5640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f587db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001ee0 tx=0x7fcf34000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fce2fe07640 1 -- 172.21.15.151:0/2859556170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3400fa40 con 0x555e9f408290 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e9f588580 con 0x555e9f408290 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fce2fe07640 1 -- 172.21.15.151:0/2859556170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3400fc00 con 0x555e9f408290 2024-09-13T19:06:43.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fce2fe07640 1 -- 172.21.15.151:0/2859556170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3401a480 con 0x555e9f408290 2024-09-13T19:06:43.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9f58b260 con 0x555e9f408290 2024-09-13T19:06:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.835+0000 7fce2fe07640 1 -- 172.21.15.151:0/2859556170 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf34017070 con 0x555e9f408290 2024-09-13T19:06:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fce2fe07640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce28034650 0x7fce28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fce2fe07640 1 -- 172.21.15.151:0/2859556170 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcf34015020 con 0x555e9f408290 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce28034650 0x7fce28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f499ec0 0x555e9f58eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f58f3f0 con 0x555e9f499ec0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f499ec0 0x555e9f58eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce28034650 0x7fce28036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf380ae000 tx=0x7fcf380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f499ec0 0x555e9f58eeb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf43fb6640 1 -- 172.21.15.151:0/2859556170 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f499ec0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f58c480 con 0x555e9f499ec0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf43fb6640 1 -- 172.21.15.151:0/2859556170 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f499ec0 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f591730 0x555e9f593b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5941f0 con 0x555e9f591730 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf437b5640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f591730 0x555e9f593b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf437b5640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f591730 0x555e9f593b20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf437b5640 1 -- 172.21.15.151:0/2859556170 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcf34042d70 con 0x555e9f591730 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5905a0 con 0x555e9f499ec0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf43fb6640 1 -- 172.21.15.151:0/2859556170 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f499ec0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555e9f595650 0x555e9f597a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f598140 con 0x555e9f595650 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555e9f595650 0x555e9f597a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555e9f595650 0x555e9f597a40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf42fb4640 1 -- 172.21.15.151:0/2859556170 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcf380aa9a0 con 0x555e9f595650 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.839+0000 7fcf45ca5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e9f39a800 con 0x555e9f5a5bd0 2024-09-13T19:06:43.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56786/0 (socket says 172.21.15.151:56786) 2024-09-13T19:06:43.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 -- 172.21.15.151:0/167417949 learned_addr learned my addr 172.21.15.151:0/167417949 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 -- 172.21.15.151:0/167417949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f5a6530 con 0x555e9f5a5bd0 2024-09-13T19:06:43.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf34048fb0 tx=0x7fcf34019e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 -- 172.21.15.151:0/167417949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3402c040 con 0x555e9f5a5bd0 2024-09-13T19:06:43.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 -- 172.21.15.151:0/167417949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf34042070 con 0x555e9f5a5bd0 2024-09-13T19:06:43.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e9f5a67c0 con 0x555e9f5a5bd0 2024-09-13T19:06:43.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 -- 172.21.15.151:0/167417949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3401a940 con 0x555e9f5a5bd0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9f5a67c0 con 0x555e9f5a5bd0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 -- 172.21.15.151:0/167417949 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf3401aae0 con 0x555e9f5a5bd0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 0x7fce1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fce2d602640 1 -- 172.21.15.151:0/167417949 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcf3403a040 con 0x555e9f5a5bd0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 0x7fce1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 0x7fce1c036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x555e9f58fce0 tx=0x7fcf38005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf45ca5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e9f5813b0 con 0x555e9f5b2360 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56796/0 (socket says 172.21.15.151:56796) 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.843+0000 7fcf437b5640 1 -- 172.21.15.151:0/3735168610 learned_addr learned my addr 172.21.15.151:0/3735168610 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 -- 172.21.15.151:0/3735168610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f5b2d30 con 0x555e9f5b2360 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3735168610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf340174d0 tx=0x7fcf34053690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497e309b515aafc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce26ffd640 1 -- 172.21.15.151:0/3735168610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf34031450 con 0x555e9f5b2360 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce26ffd640 1 -- 172.21.15.151:0/3735168610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf34053bb0 con 0x555e9f5b2360 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce26ffd640 1 -- 172.21.15.151:0/3735168610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf340315f0 con 0x555e9f5b2360 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3735168610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 msgr2=0x555e9f5b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3735168610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf340174d0 tx=0x7fcf34053690 comp rx=0 tx=0).stop 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3735168610 shutdown_connections 2024-09-13T19:06:43.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3735168610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b2760 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3735168610 >> 172.21.15.151:0/3735168610 conn(0x555e9f5ae6f0 msgr2=0x555e9f5ac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3735168610 shutdown_connections 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3735168610 wait complete. 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 Processor -- start 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- start start 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x555e9f5b3280 con 0x555e9f5b2360 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56810/0 (socket says 172.21.15.151:56810) 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 learned_addr learned my addr 172.21.15.151:0/3651078397 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e9f5b9a70 con 0x555e9f5b2360 2024-09-13T19:06:43.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcf34019860 tx=0x7fcf34039f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce257fa640 1 -- 172.21.15.151:0/3651078397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf34031580 con 0x555e9f5b2360 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce257fa640 1 -- 172.21.15.151:0/3651078397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3403f9b0 con 0x555e9f5b2360 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e9f5b9a70 con 0x555e9f5b2360 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fce257fa640 1 -- 172.21.15.151:0/3651078397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf3403fcd0 con 0x555e9f5b2360 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.847+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e9f5b9a70 con 0x555e9f5b2360 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fce257fa640 1 -- 172.21.15.151:0/3651078397 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf34042610 con 0x555e9f5b2360 2024-09-13T19:06:43.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fce257fa640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce0c0346a0 0x7fce0c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fce257fa640 1 -- 172.21.15.151:0/3651078397 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcf34073c90 con 0x555e9f5b2360 2024-09-13T19:06:43.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce0c0346a0 0x7fce0c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f5c4670 0x555e9f5c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c7260 con 0x555e9f5c4670 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f5c4670 0x555e9f5c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce0c0346a0 0x7fce0c036b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801b380 tx=0x7fcf380c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f5c4670 0x555e9f5c6b10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 realm 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c7670 con 0x555e9f5c4670 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c7f10 con 0x555e9f5c4670 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f5c8de0 0x555e9f5cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cb910 con 0x555e9f5c8de0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f5c8de0 0x555e9f5cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f5c8de0 0x555e9f5cb1d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 20 searching for the correct realm 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cd1e0 con 0x555e9f5c8de0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcf34069040 0x7fcf34068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cd1e0 con 0x7fcf34069040 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcf34069040 0x7fcf34068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.851+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcf34069040 0x7fcf34068640 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf42fb4640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf380e2040 0x7fcf380d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cd1e0 con 0x7fcf380e2040 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf380e2040 0x7fcf380d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf380e2040 0x7fcf380d5410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf34069040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.855+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf34069040 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.859+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf34069040 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf34069040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c8de0 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf380e2040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x555e9f5c4670 2024-09-13T19:06:43.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.863+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5c82b0 con 0x7fcf34069040 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cc2d0 con 0x555e9f5c4670 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cbf10 con 0x555e9f5c4670 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cbee0 con 0x7fcf34069040 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 zone default found 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 4 Realm: () 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:43.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 zonegroup default 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cd0f0 con 0x7fcf380e2040 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cf070 con 0x555e9f5c8de0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5cf410 con 0x555e9f5c8de0 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 started sync module instance, tier type = 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5ce510 con 0x7fcf34069040 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93864888953088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5ce170 con 0x7fcf34069040 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.867+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d0280 con 0x555e9f5c4670 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.871+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93864888953088] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.871+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.871+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93864888958416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d06a0 con 0x555e9f5c4670 2024-09-13T19:06:43.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.871+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d1060 con 0x555e9f5c8de0 2024-09-13T19:06:43.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.871+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93864888958416] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93864888959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d0610 con 0x555e9f5c8de0 2024-09-13T19:06:43.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d1da0 con 0x7fcf34069040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93864888967568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d2a60 con 0x7fcf34069040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d3420 con 0x555e9f5c4670 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93864888967568] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93864888959472] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93864888968624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d1510 con 0x555e9f5c4670 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.875+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d3420 con 0x7fcf380e2040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.879+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93864888968624] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.879+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.879+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93864888973744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d3420 con 0x7fcf380e2040 2024-09-13T19:06:43.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.879+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d4550 con 0x7fcf380e2040 2024-09-13T19:06:43.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.883+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93864888973744] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.883+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.883+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93864888971392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d4550 con 0x7fcf380e2040 2024-09-13T19:06:43.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.883+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d4f10 con 0x7fcf380e2040 2024-09-13T19:06:43.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.883+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93864888971392] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93864888975792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d4f10 con 0x7fcf380e2040 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=0 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=1 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=2 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=3 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=4 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=5 2024-09-13T19:06:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=6 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93864888975792] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 20 add_watcher() i=7 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d8220 con 0x555e9f5c4670 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.887+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93864888990832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5d5080 con 0x555e9f5c4670 2024-09-13T19:06:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93864888990832] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 5 note: GC not initialized 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcdf8fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 Filter name: none 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcd727fc640 20 reqs_thread_entry: start 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5fb4a0 con 0x555e9f5c4670 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5fbe90 con 0x555e9f5c4670 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5fcea0 con 0x7fcf34069040 2024-09-13T19:06:43.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:43.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93864888990832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x555e9f5c4670 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93864888990832] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.891+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93864888953088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x7fcf34069040 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93864888953088] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf45ca5980 20 remove_watcher() i=0 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf45ca5980 2 removed watcher, disabling cache 2024-09-13T19:06:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93864888958416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x555e9f5c4670 2024-09-13T19:06:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93864888958416] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf45ca5980 20 remove_watcher() i=1 2024-09-13T19:06:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.895+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93864888959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x555e9f5c8de0 2024-09-13T19:06:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf437b5640 1 -- 172.21.15.151:0/3651078397 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93864888959472] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf34078020 con 0x555e9f5c8de0 2024-09-13T19:06:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf45ca5980 20 remove_watcher() i=2 2024-09-13T19:06:43.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93864888967568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x7fcf34069040 2024-09-13T19:06:43.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf42fb4640 1 -- 172.21.15.151:0/3651078397 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93864888967568] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf380aa9a0 con 0x7fcf34069040 2024-09-13T19:06:43.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf45ca5980 20 remove_watcher() i=3 2024-09-13T19:06:43.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.899+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93864888968624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x555e9f5c4670 2024-09-13T19:06:43.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93864888968624] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x555e9f5c4670 2024-09-13T19:06:43.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf45ca5980 20 remove_watcher() i=4 2024-09-13T19:06:43.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93864888973744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x7fcf380e2040 2024-09-13T19:06:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93864888973744] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf45ca5980 20 remove_watcher() i=5 2024-09-13T19:06:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.903+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93864888971392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x7fcf380e2040 2024-09-13T19:06:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93864888971392] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 20 remove_watcher() i=6 2024-09-13T19:06:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93864888975792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555e9f5f9380 con 0x7fcf380e2040 2024-09-13T19:06:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93864888975792] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcf3c00a4d0 con 0x7fcf380e2040 2024-09-13T19:06:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 20 remove_watcher() i=7 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf380e2040 msgr2=0x7fcf380d5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf380e2040 0x7fcf380d5410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f5c4670 msgr2=0x555e9f5c6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f5c4670 0x555e9f5c6b10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcf34069040 msgr2=0x7fcf34068640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcf34069040 0x7fcf34068640 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f5c8de0 msgr2=0x555e9f5cb1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f5c8de0 0x555e9f5cb1d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce0c0346a0 msgr2=0x7fce0c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce0c0346a0 0x7fce0c036b60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf3801b380 tx=0x7fcf380c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf43fb6640 1 -- 172.21.15.151:0/3651078397 reap_dead start 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 msgr2=0x555e9f5b9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcf34019860 tx=0x7fcf34039f10 comp rx=0 tx=0).stop 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 shutdown_connections 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/3651078397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5b2360 0x555e9f5b9530 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 >> 172.21.15.151:0/3651078397 conn(0x555e9f5ae6f0 msgr2=0x555e9f5ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 shutdown_connections 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.907+0000 7fcf45ca5980 1 -- 172.21.15.151:0/3651078397 wait complete. 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 msgr2=0x7fce1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 0x7fce1c036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x555e9f58fce0 tx=0x7fcf38005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 msgr2=0x555e9f5a5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf34048fb0 tx=0x7fcf34019e20 comp rx=0 tx=0).stop 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 shutdown_connections 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce1c034650 0x7fce1c036b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/167417949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f5a5bd0 0x555e9f5a5ff0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 >> 172.21.15.151:0/167417949 conn(0x555e9f59ad20 msgr2=0x555e9f59d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 shutdown_connections 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/167417949 wait complete. 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f499ec0 msgr2=0x555e9f58eeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x555e9f499ec0 0x555e9f58eeb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555e9f595650 msgr2=0x555e9f597a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x555e9f595650 0x555e9f597a40 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f591730 msgr2=0x555e9f593b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x555e9f591730 0x555e9f593b20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce28034650 msgr2=0x7fce28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fce28034650 0x7fce28036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf380ae000 tx=0x7fcf380a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 msgr2=0x555e9f587db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 --2- 172.21.15.151:0/2859556170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555e9f408290 0x555e9f587db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf34001ee0 tx=0x7fcf34000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf43fb6640 1 -- 172.21.15.151:0/2859556170 reap_dead start 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 shutdown_connections 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 >> 172.21.15.151:0/2859556170 conn(0x555e9f48e090 msgr2=0x555e9f57b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 shutdown_connections 2024-09-13T19:06:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.911+0000 7fcf45ca5980 1 -- 172.21.15.151:0/2859556170 wait complete. 2024-09-13T19:06:43.921 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-13T19:06:43.921 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:06:43.922 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:06:43.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:06:43.922 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:06:43.996 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:43.997 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:44.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f32903b4980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5586fe7bd2d0 0x5586fe84b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f32903b4980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586fe6d0ae0 con 0x5586fe84b8a0 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f32903b4980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5586fe6f4e30 con 0x5586fe7bd2d0 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f328dec4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5586fe7bd2d0 0x5586fe84b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f328dec4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5586fe7bd2d0 0x5586fe84b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56814/0 (socket says 172.21.15.151:56814) 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f328dec4640 1 -- 172.21.15.151:0/2206116105 learned_addr learned my addr 172.21.15.151:0/2206116105 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f328dec4640 1 -- 172.21.15.151:0/2206116105 >> v1:172.21.15.12:6789/0 conn(0x5586fe84b8a0 legacy=0x5586fe84dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.995+0000 7f328dec4640 1 -- 172.21.15.151:0/2206116105 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe8503c0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f328dec4640 1 --2- 172.21.15.151:0/2206116105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe84b360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f328000a4e0 tx=0x7f328001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ac08560e001851 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f328cec2640 1 -- 172.21.15.151:0/2206116105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800aa540 con 0x5586fe7bd2d0 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f328cec2640 1 -- 172.21.15.151:0/2206116105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32800aa6e0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f328cec2640 1 -- 172.21.15.151:0/2206116105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800aaa40 con 0x5586fe7bd2d0 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 -- 172.21.15.151:0/2206116105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 msgr2=0x5586fe84b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 --2- 172.21.15.151:0/2206116105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe84b360 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f328000a4e0 tx=0x7f328001b090 comp rx=0 tx=0).stop 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 -- 172.21.15.151:0/2206116105 shutdown_connections 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 --2- 172.21.15.151:0/2206116105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe84b360 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 -- 172.21.15.151:0/2206116105 >> 172.21.15.151:0/2206116105 conn(0x5586fe843090 msgr2=0x5586fe8454b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 -- 172.21.15.151:0/2206116105 shutdown_connections 2024-09-13T19:06:44.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:43.999+0000 7f32903b4980 1 -- 172.21.15.151:0/2206116105 wait complete. 2024-09-13T19:06:44.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f32903b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f32903b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5586fe6f6200 con 0x5586fe7bd2d0 2024-09-13T19:06:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56824/0 (socket says 172.21.15.151:56824) 2024-09-13T19:06:44.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f328dec4640 1 -- 172.21.15.151:0/13997762 learned_addr learned my addr 172.21.15.151:0/13997762 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f328dec4640 1 -- 172.21.15.151:0/13997762 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe849090 con 0x5586fe7bd2d0 2024-09-13T19:06:44.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.011+0000 7f328dec4640 1 --2- 172.21.15.151:0/13997762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3280017ca0 tx=0x7f32800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2fccaab18ec319 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317be07640 1 -- 172.21.15.151:0/13997762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800b9030 con 0x5586fe7bd2d0 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317be07640 1 -- 172.21.15.151:0/13997762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32800aaac0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317be07640 1 -- 172.21.15.151:0/13997762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800aada0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/13997762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 msgr2=0x5586fe848ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 --2- 172.21.15.151:0/13997762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3280017ca0 tx=0x7f32800033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/13997762 shutdown_connections 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 --2- 172.21.15.151:0/13997762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe848ac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/13997762 >> 172.21.15.151:0/13997762 conn(0x5586fe843090 msgr2=0x5586fe92f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/13997762 shutdown_connections 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/13997762 wait complete. 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe93ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5586fe84fe30 con 0x5586fe7bd2d0 2024-09-13T19:06:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe93ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe93ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56830/0 (socket says 172.21.15.151:56830) 2024-09-13T19:06:44.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f328dec4640 1 -- 172.21.15.151:0/4053471774 learned_addr learned my addr 172.21.15.151:0/4053471774 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f328dec4640 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe93d340 con 0x5586fe7bd2d0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f328dec4640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe93ce00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3280005cc0 tx=0x7f3280017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317a604640 1 -- 172.21.15.151:0/4053471774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800b9030 con 0x5586fe7bd2d0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fe93d5d0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317a604640 1 -- 172.21.15.151:0/4053471774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32800c3070 con 0x5586fe7bd2d0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f317a604640 1 -- 172.21.15.151:0/4053471774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800bf750 con 0x5586fe7bd2d0 2024-09-13T19:06:44.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.015+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fe9402b0 con 0x5586fe7bd2d0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f317a604640 1 -- 172.21.15.151:0/4053471774 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32800c5030 con 0x5586fe7bd2d0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f317a604640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3174034650 0x7f3174036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f317a604640 1 -- 172.21.15.151:0/4053471774 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f32800ba070 con 0x5586fe7bd2d0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328d6c3640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3174034650 0x7f3174036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe84b8a0 0x5586fe943d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9443d0 con 0x5586fe84b8a0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328e6c5640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe84b8a0 0x5586fe943d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328d6c3640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3174034650 0x7f3174036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3284001e20 tx=0x7f32840013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328e6c5640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe84b8a0 0x5586fe943d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328e6c5640 1 -- 172.21.15.151:0/4053471774 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe84b8a0 2024-09-13T19:06:44.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe944c90 con 0x5586fe84b8a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328e6c5640 1 -- 172.21.15.151:0/4053471774 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe84b8a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe9465a0 0x5586fe948a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9491d0 con 0x5586fe9465a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328dec4640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe9465a0 0x5586fe948a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328dec4640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe9465a0 0x5586fe948a40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328dec4640 1 -- 172.21.15.151:0/4053471774 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe9465a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9454e0 con 0x5586fe84b8a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328e6c5640 1 -- 172.21.15.151:0/4053471774 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe84b8a0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5586fe94a630 0x5586fe94ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe94d190 con 0x5586fe94a630 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328d6c3640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5586fe94a630 0x5586fe94ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328d6c3640 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5586fe94a630 0x5586fe94ca20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f328d6c3640 1 -- 172.21.15.151:0/4053471774 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f328400d040 con 0x5586fe94a630 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.019+0000 7f32903b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5586fe74f800 con 0x5586fe95ac40 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56834/0 (socket says 172.21.15.151:56834) 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 -- 172.21.15.151:0/3248081174 learned_addr learned my addr 172.21.15.151:0/3248081174 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 -- 172.21.15.151:0/3248081174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe95b5a0 con 0x5586fe95ac40 2024-09-13T19:06:44.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f32800bdad0 tx=0x7f32800a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 -- 172.21.15.151:0/3248081174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800c63c0 con 0x5586fe95ac40 2024-09-13T19:06:44.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fe95b7d0 con 0x5586fe95ac40 2024-09-13T19:06:44.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 -- 172.21.15.151:0/3248081174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32800c6560 con 0x5586fe95ac40 2024-09-13T19:06:44.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fe95e450 con 0x5586fe95ac40 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 -- 172.21.15.151:0/3248081174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800b4a20 con 0x5586fe95ac40 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 -- 172.21.15.151:0/3248081174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32800b3040 con 0x5586fe95ac40 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 0x7f3168036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f31737fe640 1 -- 172.21.15.151:0/3248081174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f32800d7070 con 0x5586fe95ac40 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328d6c3640 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 0x7f3168036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328d6c3640 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 0x7f3168036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5586fe949570 tx=0x7f3284006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f32903b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5586fe8471f0 con 0x5586fe967540 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56846/0 (socket says 172.21.15.151:56846) 2024-09-13T19:06:44.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.023+0000 7f328dec4640 1 -- 172.21.15.151:0/4093547561 learned_addr learned my addr 172.21.15.151:0/4093547561 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 -- 172.21.15.151:0/4093547561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe967f10 con 0x5586fe967540 2024-09-13T19:06:44.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 --2- 172.21.15.151:0/4093547561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f32800b7010 tx=0x7f32800d1510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b7b33dd1ffe43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f31717fa640 1 -- 172.21.15.151:0/4093547561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800e3e20 con 0x5586fe967540 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f31717fa640 1 -- 172.21.15.151:0/4093547561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32800dc850 con 0x5586fe967540 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f31717fa640 1 -- 172.21.15.151:0/4093547561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800dcb50 con 0x5586fe967540 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/4093547561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 msgr2=0x5586fe967940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 --2- 172.21.15.151:0/4093547561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f32800b7010 tx=0x7f32800d1510 comp rx=0 tx=0).stop 2024-09-13T19:06:44.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/4093547561 shutdown_connections 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 --2- 172.21.15.151:0/4093547561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe967940 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/4093547561 >> 172.21.15.151:0/4093547561 conn(0x5586fe9638d0 msgr2=0x5586fe9619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/4093547561 shutdown_connections 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/4093547561 wait complete. 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 Processor -- start 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- start start 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5586fe968460 con 0x5586fe967540 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56850/0 (socket says 172.21.15.151:56850) 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 learned_addr learned my addr 172.21.15.151:0/1037839054 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586fe96ec90 con 0x5586fe967540 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f328dec4640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32800b7010 tx=0x7f32800b0e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f315f7fe640 1 -- 172.21.15.151:0/1037839054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800dcb50 con 0x5586fe967540 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f315f7fe640 1 -- 172.21.15.151:0/1037839054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f328010a070 con 0x5586fe967540 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5586fe96ec90 con 0x5586fe967540 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f315f7fe640 1 -- 172.21.15.151:0/1037839054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32800a4160 con 0x5586fe967540 2024-09-13T19:06:44.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.027+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586fe96ec90 con 0x5586fe967540 2024-09-13T19:06:44.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f315f7fe640 1 -- 172.21.15.151:0/1037839054 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32800c7790 con 0x5586fe967540 2024-09-13T19:06:44.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f315f7fe640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3158034650 0x7f3158036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f315f7fe640 1 -- 172.21.15.151:0/1037839054 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3280100040 con 0x5586fe967540 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328d6c3640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3158034650 0x7f3158036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe979640 0x5586fe97bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97c250 con 0x5586fe979640 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe979640 0x5586fe97bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328d6c3640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3158034650 0x7f3158036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5586fe94d570 tx=0x7f3284011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe979640 0x5586fe97bb00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 realm 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97c660 con 0x5586fe979640 2024-09-13T19:06:44.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97cf00 con 0x5586fe979640 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe97e000 0x5586fe9803f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe980970 con 0x5586fe97e000 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe97e000 0x5586fe9803f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe97e000 0x5586fe9803f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 20 searching for the correct realm 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9821d0 con 0x5586fe97e000 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32800b4bc0 0x7f32800bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9821d0 con 0x7f32800b4bc0 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.031+0000 7f328d6c3640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32800b4bc0 0x7f32800bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328d6c3640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32800b4bc0 0x7f32800bb310 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328d6c3640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f328400f3d0 0x7f328400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9821d0 con 0x7f328400f3d0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f328400f3d0 0x7f328400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f328400f3d0 0x7f328400f7f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.035+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f32800b4bc0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f32800b4bc0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.039+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f32800b4bc0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f32800b4bc0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe97e000 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f328400f3d0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x5586fe979640 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.043+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586fe97d2a0 con 0x7f32800b4bc0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:44.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9812f0 con 0x5586fe979640 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe981b90 con 0x5586fe979640 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe980f30 con 0x7f32800b4bc0 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 zone default found 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 4 Realm: () 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 zonegroup default 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe981b90 con 0x7f328400f3d0 2024-09-13T19:06:44.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe984050 con 0x5586fe97e000 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9843f0 con 0x5586fe97e000 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 started sync module instance, tier type = 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9834f0 con 0x7f32800b4bc0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94038285367520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe984c40 con 0x7f32800b4bc0 2024-09-13T19:06:44.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.047+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe985490 con 0x5586fe979640 2024-09-13T19:06:44.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94038285367520] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94038285371280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9854d0 con 0x5586fe979640 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe985fb0 con 0x5586fe97e000 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94038285376096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe986850 con 0x5586fe97e000 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.051+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe987270 con 0x7f32800b4bc0 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94038285371280] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94038285380960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe987660 con 0x7f32800b4bc0 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe988020 con 0x5586fe979640 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94038285380960] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94038285376096] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94038285378464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe987b70 con 0x5586fe979640 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.055+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe988400 con 0x7f328400f3d0 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94038285378464] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94038285373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe988020 con 0x7f328400f3d0 2024-09-13T19:06:44.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe988e10 con 0x7f328400f3d0 2024-09-13T19:06:44.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94038285373408] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94038285384832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe988e10 con 0x7f328400f3d0 2024-09-13T19:06:44.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.059+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9896e0 con 0x7f328400f3d0 2024-09-13T19:06:44.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94038285389328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe989d70 con 0x7f328400f3d0 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=0 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=1 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=2 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=3 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=4 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=5 2024-09-13T19:06:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94038285384832] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.063+0000 7f32903b4980 20 add_watcher() i=6 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94038285389328] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 add_watcher() i=7 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe98cc90 con 0x5586fe979640 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94038285391792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe98a080 con 0x5586fe979640 2024-09-13T19:06:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94038285391792] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f313f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 5 note: GC not initialized 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f313e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 Filter name: none 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f30affff640 20 reqs_thread_entry: start 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9afd50 con 0x5586fe979640 2024-09-13T19:06:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9b0740 con 0x5586fe979640 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9b1750 con 0x7f32800b4bc0 2024-09-13T19:06:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.067+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f313f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94038285391792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9adc10 con 0x5586fe979640 2024-09-13T19:06:44.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94038285391792] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94038285367520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9adc10 con 0x7f32800b4bc0 2024-09-13T19:06:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94038285367520] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f32903b4980 20 remove_watcher() i=0 2024-09-13T19:06:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f32903b4980 2 removed watcher, disabling cache 2024-09-13T19:06:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.071+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94038285371280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9adc10 con 0x5586fe979640 2024-09-13T19:06:44.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94038285371280] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 20 remove_watcher() i=1 2024-09-13T19:06:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94038285376096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9adc10 con 0x5586fe97e000 2024-09-13T19:06:44.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f328dec4640 1 -- 172.21.15.151:0/1037839054 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94038285376096] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32800ce070 con 0x5586fe97e000 2024-09-13T19:06:44.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 20 remove_watcher() i=2 2024-09-13T19:06:44.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94038285380960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9838e0 con 0x7f32800b4bc0 2024-09-13T19:06:44.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f328d6c3640 1 -- 172.21.15.151:0/1037839054 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94038285380960] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3284036040 con 0x7f32800b4bc0 2024-09-13T19:06:44.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 20 remove_watcher() i=3 2024-09-13T19:06:44.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.075+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94038285378464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe984790 con 0x5586fe979640 2024-09-13T19:06:44.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.079+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94038285378464] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x5586fe979640 2024-09-13T19:06:44.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.079+0000 7f32903b4980 20 remove_watcher() i=4 2024-09-13T19:06:44.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.079+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94038285373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe986d60 con 0x7f328400f3d0 2024-09-13T19:06:44.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94038285373408] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f32903b4980 20 remove_watcher() i=5 2024-09-13T19:06:44.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94038285384832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe9838e0 con 0x7f328400f3d0 2024-09-13T19:06:44.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94038285384832] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f32903b4980 20 remove_watcher() i=6 2024-09-13T19:06:44.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.083+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94038285389328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586fe986d60 con 0x7f328400f3d0 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94038285389328] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32880083f0 con 0x7f328400f3d0 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 20 remove_watcher() i=7 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f328400f3d0 msgr2=0x7f328400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f328400f3d0 0x7f328400f7f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe979640 msgr2=0x5586fe97bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe979640 0x5586fe97bb00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32800b4bc0 msgr2=0x7f32800bb310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32800b4bc0 0x7f32800bb310 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe97e000 msgr2=0x5586fe9803f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe97e000 0x5586fe9803f0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3158034650 msgr2=0x7f3158036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3158034650 0x7f3158036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x5586fe94d570 tx=0x7f3284011000 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f328e6c5640 1 -- 172.21.15.151:0/1037839054 reap_dead start 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 msgr2=0x5586fe96e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32800b7010 tx=0x7f32800b0e80 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 shutdown_connections 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/1037839054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe967540 0x5586fe96e750 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 >> 172.21.15.151:0/1037839054 conn(0x5586fe9638d0 msgr2=0x5586fe9619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 shutdown_connections 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/1037839054 wait complete. 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 msgr2=0x7f3168036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 0x7f3168036b10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x5586fe949570 tx=0x7f3284006000 comp rx=0 tx=0).stop 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 msgr2=0x5586fe95b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f32800bdad0 tx=0x7f32800a9f70 comp rx=0 tx=0).stop 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 shutdown_connections 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3168034650 0x7f3168036b10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/3248081174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe95ac40 0x5586fe95b060 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 >> 172.21.15.151:0/3248081174 conn(0x5586fe94fd90 msgr2=0x5586fe952810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 shutdown_connections 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/3248081174 wait complete. 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe84b8a0 msgr2=0x5586fe943d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5586fe84b8a0 0x5586fe943d90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5586fe94a630 msgr2=0x5586fe94ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5586fe94a630 0x5586fe94ca20 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe9465a0 msgr2=0x5586fe948a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5586fe9465a0 0x5586fe948a40 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3174034650 msgr2=0x7f3174036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3174034650 0x7f3174036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3284001e20 tx=0x7f32840013a0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 msgr2=0x5586fe93ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 --2- 172.21.15.151:0/4053471774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5586fe7bd2d0 0x5586fe93ce00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3280005cc0 tx=0x7f3280017e30 comp rx=0 tx=0).stop 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f328e6c5640 1 -- 172.21.15.151:0/4053471774 reap_dead start 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 shutdown_connections 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 >> 172.21.15.151:0/4053471774 conn(0x5586fe843090 msgr2=0x5586fe847710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 shutdown_connections 2024-09-13T19:06:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.087+0000 7f32903b4980 1 -- 172.21.15.151:0/4053471774 wait complete. 2024-09-13T19:06:44.099 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-13T19:06:44.099 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:06:44.233 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-13T19:06:44.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-13T19:06:44.234 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-13T19:06:44.269 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:44.269 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:44.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe354cd6980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55925e365ac0 0x55925e3f4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe354cd6980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55925e279ae0 con 0x55925e3f48b0 2024-09-13T19:06:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe354cd6980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55925e29de30 con 0x55925e365ac0 2024-09-13T19:06:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe3527e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55925e365ac0 0x55925e3f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe351fe5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55925e3f48b0 0x55925e3f6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33520/0 (socket says 172.21.15.151:33520) 2024-09-13T19:06:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe3527e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55925e365ac0 0x55925e3f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56858/0 (socket says 172.21.15.151:56858) 2024-09-13T19:06:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe351fe5640 1 -- 172.21.15.151:0/3150682877 learned_addr learned my addr 172.21.15.151:0/3150682877 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe3527e6640 1 -- 172.21.15.151:0/3150682877 >> v1:172.21.15.12:6789/0 conn(0x55925e3f48b0 legacy=0x55925e3f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.267+0000 7fe3527e6640 1 -- 172.21.15.151:0/3150682877 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e3f93d0 con 0x55925e365ac0 2024-09-13T19:06:44.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe3527e6640 1 --2- 172.21.15.151:0/3150682877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e3f4370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a420 tx=0x7fe34c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2ef85b4cae74d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe3517e4640 1 -- 172.21.15.151:0/3150682877 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0af070 con 0x55925e365ac0 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe3517e4640 1 -- 172.21.15.151:0/3150682877 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0aa530 con 0x55925e365ac0 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe3517e4640 1 -- 172.21.15.151:0/3150682877 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0aa850 con 0x55925e365ac0 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 -- 172.21.15.151:0/3150682877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 msgr2=0x55925e3f4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 --2- 172.21.15.151:0/3150682877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e3f4370 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe34c00a420 tx=0x7fe34c01afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 -- 172.21.15.151:0/3150682877 shutdown_connections 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 --2- 172.21.15.151:0/3150682877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e3f4370 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 -- 172.21.15.151:0/3150682877 >> 172.21.15.151:0/3150682877 conn(0x55925e3ec060 msgr2=0x55925e3ee480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 -- 172.21.15.151:0/3150682877 shutdown_connections 2024-09-13T19:06:44.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.271+0000 7fe354cd6980 1 -- 172.21.15.151:0/3150682877 wait complete. 2024-09-13T19:06:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55925e29f200 con 0x55925e365ac0 2024-09-13T19:06:44.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56864/0 (socket says 172.21.15.151:56864) 2024-09-13T19:06:44.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe3527e6640 1 -- 172.21.15.151:0/1833749228 learned_addr learned my addr 172.21.15.151:0/1833749228 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe3527e6640 1 -- 172.21.15.151:0/1833749228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e4dd080 con 0x55925e365ac0 2024-09-13T19:06:44.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1833749228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ad040 tx=0x7fe34c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95706143b444903 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe240608640 1 -- 172.21.15.151:0/1833749228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0af050 con 0x55925e365ac0 2024-09-13T19:06:44.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe240608640 1 -- 172.21.15.151:0/1833749228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0b0040 con 0x55925e365ac0 2024-09-13T19:06:44.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe240608640 1 -- 172.21.15.151:0/1833749228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0aaca0 con 0x55925e365ac0 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 -- 172.21.15.151:0/1833749228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 msgr2=0x55925e4dcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1833749228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ad040 tx=0x7fe34c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 -- 172.21.15.151:0/1833749228 shutdown_connections 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.287+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1833749228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4dcab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- 172.21.15.151:0/1833749228 >> 172.21.15.151:0/1833749228 conn(0x55925e3ec060 msgr2=0x55925e4d86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- 172.21.15.151:0/1833749228 shutdown_connections 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- 172.21.15.151:0/1833749228 wait complete. 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4e3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55925e3f8e10 con 0x55925e365ac0 2024-09-13T19:06:44.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4e3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4e3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56874/0 (socket says 172.21.15.151:56874) 2024-09-13T19:06:44.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe3527e6640 1 -- 172.21.15.151:0/2010420306 learned_addr learned my addr 172.21.15.151:0/2010420306 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe3527e6640 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e4e4240 con 0x55925e365ac0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe3527e6640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4e3d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe34c019680 tx=0x7fe34c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 -- 172.21.15.151:0/2010420306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0c5070 con 0x55925e365ac0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55925e4e44d0 con 0x55925e365ac0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 -- 172.21.15.151:0/2010420306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0b6d60 con 0x55925e365ac0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 -- 172.21.15.151:0/2010420306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0c15f0 con 0x55925e365ac0 2024-09-13T19:06:44.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925e4e71b0 con 0x55925e365ac0 2024-09-13T19:06:44.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 -- 172.21.15.151:0/2010420306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe34c0c8070 con 0x55925e365ac0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe2380346a0 0x7fe238036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.291+0000 7fe23ee05640 1 -- 172.21.15.151:0/2010420306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe34c0bb070 con 0x55925e365ac0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe351fe5640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe2380346a0 0x7fe238036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e3f48b0 0x55925e4eac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e4eb2d0 con 0x55925e3f48b0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe352fe7640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e3f48b0 0x55925e4eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe351fe5640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe2380346a0 0x7fe238036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f70 tx=0x7fe3480012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe352fe7640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e3f48b0 0x55925e4eac90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe352fe7640 1 -- 172.21.15.151:0/2010420306 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e3f48b0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e4e83d0 con 0x55925e3f48b0 2024-09-13T19:06:44.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe352fe7640 1 -- 172.21.15.151:0/2010420306 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e3f48b0 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e4ed600 0x55925e4ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e4f00c0 con 0x55925e4ed600 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe3527e6640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e4ed600 0x55925e4ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe3527e6640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e4ed600 0x55925e4ef9f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe3527e6640 1 -- 172.21.15.151:0/2010420306 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe34c0d1070 con 0x55925e4ed600 2024-09-13T19:06:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e4ec4a0 con 0x55925e3f48b0 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe352fe7640 1 -- 172.21.15.151:0/2010420306 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e3f48b0 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55925e4f1500 0x55925e4f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e4f4030 con 0x55925e4f1500 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe351fe5640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55925e4f1500 0x55925e4f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe351fe5640 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55925e4f1500 0x55925e4f38f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe351fe5640 1 -- 172.21.15.151:0/2010420306 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe34800e620 con 0x55925e4f1500 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.295+0000 7fe354cd6980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55925e2f8800 con 0x55925e501ac0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56888/0 (socket says 172.21.15.151:56888) 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 -- 172.21.15.151:0/1039581337 learned_addr learned my addr 172.21.15.151:0/1039581337 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 -- 172.21.15.151:0/1039581337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e502420 con 0x55925e501ac0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe34c01b010 tx=0x7fe34c0a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 -- 172.21.15.151:0/1039581337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0e2250 con 0x55925e501ac0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 -- 172.21.15.151:0/1039581337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0c1790 con 0x55925e501ac0 2024-09-13T19:06:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55925e5026b0 con 0x55925e501ac0 2024-09-13T19:06:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 -- 172.21.15.151:0/1039581337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0c1a70 con 0x55925e501ac0 2024-09-13T19:06:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925e505330 con 0x55925e501ac0 2024-09-13T19:06:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 -- 172.21.15.151:0/1039581337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe34c0dd030 con 0x55925e501ac0 2024-09-13T19:06:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 0x7fe22c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe237fff640 1 -- 172.21.15.151:0/1039581337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe34c0e7cb0 con 0x55925e501ac0 2024-09-13T19:06:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 0x7fe22c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 0x7fe22c036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe34800bf60 tx=0x7fe34800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe354cd6980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55925e4dd340 con 0x55925e3f0330 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56890/0 (socket says 172.21.15.151:56890) 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 -- 172.21.15.151:0/673884258 learned_addr learned my addr 172.21.15.151:0/673884258 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.299+0000 7fe3527e6640 1 -- 172.21.15.151:0/673884258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e3f0d00 con 0x55925e3f0330 2024-09-13T19:06:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.303+0000 7fe3527e6640 1 --2- 172.21.15.151:0/673884258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0e7ff0 tx=0x7fe34c0ef4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff19c29e6c0d351f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe235ffb640 1 -- 172.21.15.151:0/673884258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0c0da0 con 0x55925e3f0330 2024-09-13T19:06:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe235ffb640 1 -- 172.21.15.151:0/673884258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0fd070 con 0x55925e3f0330 2024-09-13T19:06:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe235ffb640 1 -- 172.21.15.151:0/673884258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0e3780 con 0x55925e3f0330 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/673884258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 msgr2=0x55925e3f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 --2- 172.21.15.151:0/673884258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0e7ff0 tx=0x7fe34c0ef4f0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/673884258 shutdown_connections 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 --2- 172.21.15.151:0/673884258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e3f0730 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/673884258 >> 172.21.15.151:0/673884258 conn(0x55925e50a7b0 msgr2=0x55925e5088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/673884258 shutdown_connections 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/673884258 wait complete. 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 Processor -- start 2024-09-13T19:06:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- start start 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55925e3f1330 con 0x55925e3f0330 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe3527e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56894/0 (socket says 172.21.15.151:56894) 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 learned_addr learned my addr 172.21.15.151:0/1238222659 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55925e517d60 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0b68d0 tx=0x7fe34c0daf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe223fff640 1 -- 172.21.15.151:0/1238222659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0e3780 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe223fff640 1 -- 172.21.15.151:0/1238222659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34c0efb10 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55925e517d60 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55925e517d60 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.307+0000 7fe223fff640 1 -- 172.21.15.151:0/1238222659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe34c0efcc0 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe223fff640 1 -- 172.21.15.151:0/1238222659 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe34c113060 con 0x55925e3f0330 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe223fff640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe21c0346a0 0x7fe21c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe223fff640 1 -- 172.21.15.151:0/1238222659 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe34c116c60 con 0x55925e3f0330 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe21c0346a0 0x7fe21c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e5227b0 0x55925e524c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e5253a0 con 0x55925e5227b0 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e5227b0 0x55925e524c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe21c0346a0 0x7fe21c036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55925e4f4430 tx=0x7fe348010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e5227b0 0x55925e524c50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 realm 2024-09-13T19:06:44.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e5257b0 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e526050 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e527150 0x55925e529540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e529ac0 con 0x55925e527150 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e527150 0x55925e529540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e527150 0x55925e529540 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 20 searching for the correct realm 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e52b360 con 0x55925e527150 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe34c0e6070 0x7fe34c0c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e52b360 con 0x7fe34c0e6070 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe34c0e6070 0x7fe34c0c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe34c0e6070 0x7fe34c0c5210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe348037040 0x7fe348036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.311+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e52b360 con 0x7fe348037040 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe348037040 0x7fe348036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe348037040 0x7fe348036410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe34c0e6070 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.315+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe34c0e6070 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.319+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe34c0e6070 2024-09-13T19:06:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe34c0e6070 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e527150 2024-09-13T19:06:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.323+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe348037040 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x55925e5227b0 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55925e5263f0 con 0x7fe34c0e6070 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52a310 con 0x55925e5227b0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52a700 con 0x55925e5227b0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52a700 con 0x7fe34c0e6070 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 zone default found 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 4 Realm: () 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 zonegroup default 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52b830 con 0x7fe348037040 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52d210 con 0x55925e527150 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e52d5b0 con 0x55925e527150 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 started sync module instance, tier type = 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.327+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52c6b0 con 0x7fe34c0e6070 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94087136070304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52de00 con 0x7fe34c0e6070 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52e650 con 0x55925e5227b0 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94087136070304] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94087136074064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52e690 con 0x55925e5227b0 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.331+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52f180 con 0x55925e527150 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94087136078928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52fa20 con 0x55925e527150 2024-09-13T19:06:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e530440 con 0x7fe34c0e6070 2024-09-13T19:06:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94087136074064] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94087136076192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e530ce0 con 0x7fe34c0e6070 2024-09-13T19:06:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e531530 con 0x55925e5227b0 2024-09-13T19:06:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94087136078928] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94087136076192] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94087136086064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e531100 con 0x55925e5227b0 2024-09-13T19:06:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.335+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e531dd0 con 0x7fe348037040 2024-09-13T19:06:44.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.339+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94087136086064] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.339+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.339+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94087136087120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e531070 con 0x7fe348037040 2024-09-13T19:06:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.339+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5322b0 con 0x7fe348037040 2024-09-13T19:06:44.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94087136091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e532760 con 0x7fe348037040 2024-09-13T19:06:44.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5331d0 con 0x7fe348037040 2024-09-13T19:06:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94087136087120] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94087136091616] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94087136095392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5322f0 con 0x7fe348037040 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=0 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=1 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=2 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=3 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=4 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=5 2024-09-13T19:06:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.343+0000 7fe354cd6980 20 add_watcher() i=6 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94087136095392] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 add_watcher() i=7 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e5362d0 con 0x55925e5227b0 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94087136089968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e533750 con 0x55925e5227b0 2024-09-13T19:06:44.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94087136089968] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe208fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:44.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 5 note: GC not initialized 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe1837fe640 20 reqs_thread_entry: start 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 Filter name: none 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe1817fa640 20 reqs_thread_entry: start 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.347+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e559220 con 0x55925e5227b0 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e559c10 con 0x55925e5227b0 2024-09-13T19:06:44.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:44.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55925e55ac20 con 0x7fe34c0e6070 2024-09-13T19:06:44.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe208fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94087136089968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5570b0 con 0x55925e5227b0 2024-09-13T19:06:44.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94087136089968] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94087136070304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5570b0 con 0x7fe34c0e6070 2024-09-13T19:06:44.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94087136070304] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 20 remove_watcher() i=0 2024-09-13T19:06:44.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 2 removed watcher, disabling cache 2024-09-13T19:06:44.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.351+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94087136074064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52caa0 con 0x55925e5227b0 2024-09-13T19:06:44.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.355+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94087136074064] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.355+0000 7fe354cd6980 20 remove_watcher() i=1 2024-09-13T19:06:44.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.355+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94087136078928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5570b0 con 0x55925e527150 2024-09-13T19:06:44.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe3527e6640 1 -- 172.21.15.151:0/1238222659 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94087136078928] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34c0f6030 con 0x55925e527150 2024-09-13T19:06:44.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 20 remove_watcher() i=2 2024-09-13T19:06:44.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94087136076192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52caa0 con 0x7fe34c0e6070 2024-09-13T19:06:44.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe351fe5640 1 -- 172.21.15.151:0/1238222659 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94087136076192] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe34800e620 con 0x7fe34c0e6070 2024-09-13T19:06:44.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 20 remove_watcher() i=3 2024-09-13T19:06:44.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94087136086064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5570b0 con 0x55925e5227b0 2024-09-13T19:06:44.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94087136086064] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x55925e5227b0 2024-09-13T19:06:44.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 20 remove_watcher() i=4 2024-09-13T19:06:44.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.359+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94087136087120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52e1a0 con 0x7fe348037040 2024-09-13T19:06:44.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.363+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94087136087120] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.363+0000 7fe354cd6980 20 remove_watcher() i=5 2024-09-13T19:06:44.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.363+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94087136091616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e52caa0 con 0x7fe348037040 2024-09-13T19:06:44.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94087136091616] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 20 remove_watcher() i=6 2024-09-13T19:06:44.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94087136095392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55925e5570b0 con 0x7fe348037040 2024-09-13T19:06:44.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94087136095392] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3440083f0 con 0x7fe348037040 2024-09-13T19:06:44.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 20 remove_watcher() i=7 2024-09-13T19:06:44.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe348037040 msgr2=0x7fe348036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe348037040 0x7fe348036410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e5227b0 msgr2=0x55925e524c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e5227b0 0x55925e524c50 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe34c0e6070 msgr2=0x7fe34c0c5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe34c0e6070 0x7fe34c0c5210 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e527150 msgr2=0x55925e529540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e527150 0x55925e529540 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe21c0346a0 msgr2=0x7fe21c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe21c0346a0 0x7fe21c036b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55925e4f4430 tx=0x7fe348010000 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe352fe7640 1 -- 172.21.15.151:0/1238222659 reap_dead start 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 msgr2=0x55925e517820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0b68d0 tx=0x7fe34c0daf50 comp rx=0 tx=0).stop 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 shutdown_connections 2024-09-13T19:06:44.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1238222659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e3f0330 0x55925e517820 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 >> 172.21.15.151:0/1238222659 conn(0x55925e50a7b0 msgr2=0x55925e508880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 shutdown_connections 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1238222659 wait complete. 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 msgr2=0x7fe22c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 0x7fe22c036b10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe34800bf60 tx=0x7fe34800f000 comp rx=0 tx=0).stop 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 msgr2=0x55925e501ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe34c01b010 tx=0x7fe34c0a9690 comp rx=0 tx=0).stop 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 shutdown_connections 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe22c034650 0x7fe22c036b10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/1039581337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e501ac0 0x55925e501ee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 >> 172.21.15.151:0/1039581337 conn(0x55925e4f6c10 msgr2=0x55925e4f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 shutdown_connections 2024-09-13T19:06:44.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/1039581337 wait complete. 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e3f48b0 msgr2=0x55925e4eac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55925e3f48b0 0x55925e4eac90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55925e4f1500 msgr2=0x55925e4f38f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55925e4f1500 0x55925e4f38f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e4ed600 msgr2=0x55925e4ef9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55925e4ed600 0x55925e4ef9f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe2380346a0 msgr2=0x7fe238036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe2380346a0 0x7fe238036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f70 tx=0x7fe3480012c0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 msgr2=0x55925e4e3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 --2- 172.21.15.151:0/2010420306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55925e365ac0 0x55925e4e3d00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe34c019680 tx=0x7fe34c019810 comp rx=0 tx=0).stop 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe352fe7640 1 -- 172.21.15.151:0/2010420306 reap_dead start 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 shutdown_connections 2024-09-13T19:06:44.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 >> 172.21.15.151:0/2010420306 conn(0x55925e3ec060 msgr2=0x55925e4d7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 shutdown_connections 2024-09-13T19:06:44.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.367+0000 7fe354cd6980 1 -- 172.21.15.151:0/2010420306 wait complete. 2024-09-13T19:06:44.380 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-13T19:06:44.381 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:06:44.474 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-13T19:06:44.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-13T19:06:44.475 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-13T19:06:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d4333980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55cff07708e0 0x55cff0772cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d4333980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cff05f5ae0 con 0x55cff076c560 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d4333980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55cff0619e30 con 0x55cff07708e0 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d1642640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55cff07708e0 0x55cff0772cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d1e43640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55cff076c560 0x55cff076c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33522/0 (socket says 172.21.15.151:33522) 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d1e43640 1 -- 172.21.15.151:0/3426440163 learned_addr learned my addr 172.21.15.151:0/3426440163 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d1642640 1 -- 172.21.15.151:0/3426440163 >> v1:172.21.15.12:6789/0 conn(0x55cff076c560 legacy=0x55cff076c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.507+0000 7f78d1642640 1 -- 172.21.15.151:0/3426440163 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff0774220 con 0x55cff07708e0 2024-09-13T19:06:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d1642640 1 --2- 172.21.15.151:0/3426440163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff0772cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00a480 tx=0x7f78bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e655fff096e93b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d0e41640 1 -- 172.21.15.151:0/3426440163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78bc0b0070 con 0x55cff07708e0 2024-09-13T19:06:44.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d0e41640 1 -- 172.21.15.151:0/3426440163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78bc0ab540 con 0x55cff07708e0 2024-09-13T19:06:44.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d0e41640 1 -- 172.21.15.151:0/3426440163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78bc0ab840 con 0x55cff07708e0 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 -- 172.21.15.151:0/3426440163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 msgr2=0x55cff0772cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 --2- 172.21.15.151:0/3426440163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff0772cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f78bc00a480 tx=0x7f78bc01b280 comp rx=0 tx=0).stop 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 -- 172.21.15.151:0/3426440163 shutdown_connections 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 --2- 172.21.15.151:0/3426440163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff0772cd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 -- 172.21.15.151:0/3426440163 >> 172.21.15.151:0/3426440163 conn(0x55cff0768080 msgr2=0x55cff076a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 -- 172.21.15.151:0/3426440163 shutdown_connections 2024-09-13T19:06:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.511+0000 7f78d4333980 1 -- 172.21.15.151:0/3426440163 wait complete. 2024-09-13T19:06:44.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cff061b200 con 0x55cff076c560 2024-09-13T19:06:44.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56914/0 (socket says 172.21.15.151:56914) 2024-09-13T19:06:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d1e43640 1 -- 172.21.15.151:0/3891208669 learned_addr learned my addr 172.21.15.151:0/3891208669 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d1e43640 1 -- 172.21.15.151:0/3891208669 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff0856e10 con 0x55cff076c560 2024-09-13T19:06:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d1e43640 1 --2- 172.21.15.151:0/3891208669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f78c40017b0 tx=0x7f78c4001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae30e2745e05d30b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f77bfe07640 1 -- 172.21.15.151:0/3891208669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4016070 con 0x55cff076c560 2024-09-13T19:06:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f77bfe07640 1 -- 172.21.15.151:0/3891208669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c4004530 con 0x55cff076c560 2024-09-13T19:06:44.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f77bfe07640 1 -- 172.21.15.151:0/3891208669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4004870 con 0x55cff076c560 2024-09-13T19:06:44.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- 172.21.15.151:0/3891208669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 msgr2=0x55cff0856840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 --2- 172.21.15.151:0/3891208669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f78c40017b0 tx=0x7f78c4001c70 comp rx=0 tx=0).stop 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- 172.21.15.151:0/3891208669 shutdown_connections 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 --2- 172.21.15.151:0/3891208669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff076c560 0x55cff0856840 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- 172.21.15.151:0/3891208669 >> 172.21.15.151:0/3891208669 conn(0x55cff0768080 msgr2=0x55cff0852470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- 172.21.15.151:0/3891208669 shutdown_connections 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- 172.21.15.151:0/3891208669 wait complete. 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.527+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff085ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cff0773d20 con 0x55cff07708e0 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff085ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff085ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56930/0 (socket says 172.21.15.151:56930) 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1e43640 1 -- 172.21.15.151:0/1672061163 learned_addr learned my addr 172.21.15.151:0/1672061163 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1e43640 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff085e310 con 0x55cff07708e0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1e43640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff085ddd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000f90 tx=0x7f78c4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 -- 172.21.15.151:0/1672061163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4020020 con 0x55cff07708e0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff085e5a0 con 0x55cff07708e0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 -- 172.21.15.151:0/1672061163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c4017040 con 0x55cff07708e0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 -- 172.21.15.151:0/1672061163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4016070 con 0x55cff07708e0 2024-09-13T19:06:44.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff0861280 con 0x55cff07708e0 2024-09-13T19:06:44.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 -- 172.21.15.151:0/1672061163 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f78c4023020 con 0x55cff07708e0 2024-09-13T19:06:44.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77b8034650 0x7f77b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f77be604640 1 -- 172.21.15.151:0/1672061163 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f78c4048e90 con 0x55cff07708e0 2024-09-13T19:06:44.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d1642640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77b8034650 0x7f77b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff0862ec0 0x55cff08652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08657f0 con 0x55cff0862ec0 2024-09-13T19:06:44.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.531+0000 7f78d2644640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff0862ec0 0x55cff08652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1642640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77b8034650 0x7f77b8036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0ad000 tx=0x7f78bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d2644640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff0862ec0 0x55cff08652b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d2644640 1 -- 172.21.15.151:0/1672061163 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff0862ec0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff0865c40 con 0x55cff0862ec0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d2644640 1 -- 172.21.15.151:0/1672061163 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff0862ec0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff0867a50 0x55cff0869e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff086a510 con 0x55cff0867a50 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff0867a50 0x55cff0869e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff0867a50 0x55cff0869e40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 -- 172.21.15.151:0/1672061163 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f78c400f070 con 0x55cff0867a50 2024-09-13T19:06:44.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08668c0 con 0x55cff0862ec0 2024-09-13T19:06:44.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d2644640 1 -- 172.21.15.151:0/1672061163 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff0862ec0 2024-09-13T19:06:44.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55cff086b970 0x55cff086dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff086e450 con 0x55cff086b970 2024-09-13T19:06:44.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1642640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55cff086b970 0x55cff086dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1642640 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55cff086b970 0x55cff086dd60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1642640 1 -- 172.21.15.151:0/1672061163 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f78bc0b3040 con 0x55cff086b970 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d4333980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cff0674800 con 0x55cff087bea0 2024-09-13T19:06:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56944/0 (socket says 172.21.15.151:56944) 2024-09-13T19:06:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.535+0000 7f78d1e43640 1 -- 172.21.15.151:0/997156411 learned_addr learned my addr 172.21.15.151:0/997156411 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1e43640 1 -- 172.21.15.151:0/997156411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff087c800 con 0x55cff087bea0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1e43640 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f78c40472b0 tx=0x7f78c401b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 -- 172.21.15.151:0/997156411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c402c660 con 0x55cff087bea0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 -- 172.21.15.151:0/997156411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c402c800 con 0x55cff087bea0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 -- 172.21.15.151:0/997156411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c401ba60 con 0x55cff087bea0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff087ca30 con 0x55cff087bea0 2024-09-13T19:06:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff087f6b0 con 0x55cff087bea0 2024-09-13T19:06:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 -- 172.21.15.151:0/997156411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f78c404b060 con 0x55cff087bea0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 0x7f77ac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f77b77fe640 1 -- 172.21.15.151:0/997156411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f78c4038070 con 0x55cff087bea0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1642640 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 0x7f77ac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1642640 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 0x7f77ac036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55cff0866000 tx=0x7f78bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d4333980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cff0857190 con 0x55cff08887e0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56948/0 (socket says 172.21.15.151:56948) 2024-09-13T19:06:44.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.539+0000 7f78d1e43640 1 -- 172.21.15.151:0/1319123569 learned_addr learned my addr 172.21.15.151:0/1319123569 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 -- 172.21.15.151:0/1319123569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff08891b0 con 0x55cff08887e0 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 --2- 172.21.15.151:0/1319123569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78c40303d0 tx=0x7f78c403cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc0af687f788f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77b57fa640 1 -- 172.21.15.151:0/1319123569 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4053040 con 0x55cff08887e0 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77b57fa640 1 -- 172.21.15.151:0/1319123569 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c401ac00 con 0x55cff08887e0 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77b57fa640 1 -- 172.21.15.151:0/1319123569 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c401bde0 con 0x55cff08887e0 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/1319123569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 msgr2=0x55cff0888be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 --2- 172.21.15.151:0/1319123569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78c40303d0 tx=0x7f78c403cb10 comp rx=0 tx=0).stop 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/1319123569 shutdown_connections 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 --2- 172.21.15.151:0/1319123569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff0888be0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/1319123569 >> 172.21.15.151:0/1319123569 conn(0x55cff0884b10 msgr2=0x55cff0882c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/1319123569 shutdown_connections 2024-09-13T19:06:44.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/1319123569 wait complete. 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 Processor -- start 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- start start 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cff08896a0 con 0x55cff08887e0 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56952/0 (socket says 172.21.15.151:56952) 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 learned_addr learned my addr 172.21.15.151:0/3369099589 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:44.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cff088feb0 con 0x55cff08887e0 2024-09-13T19:06:44.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d1e43640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f78c4002210 tx=0x7f78c4030f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77a37fe640 1 -- 172.21.15.151:0/3369099589 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c4067070 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cff088feb0 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77a37fe640 1 -- 172.21.15.151:0/3369099589 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78c4024d70 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f77a37fe640 1 -- 172.21.15.151:0/3369099589 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f78c40401c0 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.543+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cff0890320 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f77a37fe640 1 -- 172.21.15.151:0/3369099589 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f78c401a2e0 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f77a37fe640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f779c034650 0x7f779c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f77a37fe640 1 -- 172.21.15.151:0/3369099589 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f78c405d070 con 0x55cff08887e0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1642640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f779c034650 0x7f779c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff089aa40 0x55cff089cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff089d630 con 0x55cff089aa40 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff089aa40 0x55cff089cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1642640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f779c034650 0x7f779c036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c10 tx=0x7f78bc0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff089aa40 0x55cff089cee0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 realm 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff089da40 con 0x55cff089aa40 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e2e0 con 0x55cff089aa40 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff089f3e0 0x55cff08a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a1d50 con 0x55cff089f3e0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff089f3e0 0x55cff08a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff089f3e0 0x55cff08a17d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 20 searching for the correct realm 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a35d0 con 0x55cff089f3e0 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f78c4025020 0x7f78c40485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a35d0 con 0x7f78c4025020 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.547+0000 7f78d1642640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f78c4025020 0x7f78c40485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d1642640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f78c4025020 0x7f78c40485d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d1642640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f78bc0dc040 0x7f78bc0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a35d0 con 0x7f78bc0dc040 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f78bc0dc040 0x7f78bc0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f78bc0dc040 0x7f78bc0dd430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.551+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78c4025020 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78c4025020 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.555+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78c4025020 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78c4025020 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089f3e0 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.559+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78bc0dc040 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x55cff089aa40 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff089e680 con 0x7f78c4025020 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x55cff089aa40 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a2990 con 0x55cff089aa40 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a2990 con 0x7f78c4025020 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 zone default found 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 4 Realm: () 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:44.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 zonegroup default 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a3aa0 con 0x7f78bc0dc040 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a5480 con 0x55cff089f3e0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados->read ofs=0 len=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a5820 con 0x55cff089f3e0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:44.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 started sync module instance, tier type = 2024-09-13T19:06:44.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:44.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.563+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a4920 con 0x7f78c4025020 2024-09-13T19:06:44.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94351582186816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a4580 con 0x7f78c4025020 2024-09-13T19:06:44.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a6690 con 0x55cff089aa40 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94351582186816] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94351582192096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a6ab0 con 0x55cff089aa40 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.567+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a7340 con 0x55cff089f3e0 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94351582192096] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94351582193424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a7730 con 0x55cff089f3e0 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78c4025020 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94351582198848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a8940 con 0x7f78c4025020 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a9340 con 0x55cff089aa40 2024-09-13T19:06:44.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94351582193424] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94351582198848] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94351582194672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a8490 con 0x55cff089aa40 2024-09-13T19:06:44.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.571+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a9be0 con 0x7f78bc0dc040 2024-09-13T19:06:44.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.575+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94351582194672] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.575+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.575+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94351582203472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a8490 con 0x7f78bc0dc040 2024-09-13T19:06:44.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.575+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08aa0e0 con 0x7f78bc0dc040 2024-09-13T19:06:44.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.579+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94351582203472] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.579+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.579+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94351582206928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08aa0a0 con 0x7f78bc0dc040 2024-09-13T19:06:44.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.579+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08aaaa0 con 0x7f78bc0dc040 2024-09-13T19:06:44.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94351582206928] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94351582209456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08aaec0 con 0x7f78bc0dc040 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=0 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=1 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=2 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=3 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=4 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=5 2024-09-13T19:06:44.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=6 2024-09-13T19:06:44.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94351582209456] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 add_watcher() i=7 2024-09-13T19:06:44.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:44.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a9610 con 0x55cff089aa40 2024-09-13T19:06:44.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94351582205456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08ab3e0 con 0x55cff089aa40 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94351582205456] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f77837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.583+0000 7f78d4333980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d4333980 5 note: GC not initialized 2024-09-13T19:06:44.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f77827fc640 20 reqs_thread_entry: start 2024-09-13T19:06:44.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d4333980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:44.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d4333980 20 Filter name: none 2024-09-13T19:06:44.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f76f3fff640 20 reqs_thread_entry: start 2024-09-13T19:06:44.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08d0c40 con 0x55cff089f3e0 2024-09-13T19:06:44.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a7340 con 0x55cff089f3e0 2024-09-13T19:06:44.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a7340 con 0x55cff089aa40 2024-09-13T19:06:44.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x55cff089aa40 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x7f78c4025020 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089f3e0 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089aa40 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089f3e0 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78c4025020 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089f3e0 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089aa40 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.587+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089f3e0 2024-09-13T19:06:44.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78bc0dc040 2024-09-13T19:06:44.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78bc0dc040 2024-09-13T19:06:44.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089f3e0 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78c4025020 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.591+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089aa40 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089aa40 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089f3e0 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78c4025020 2024-09-13T19:06:44.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78bc0dc040 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089aa40 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78bc0dc040 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089f3e0 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78c4025020 2024-09-13T19:06:44.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78bc0dc040 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.595+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089aa40 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x55cff089f3e0 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f78cc040040 con 0x7f78c4025020 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d4333980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:44.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d4333980 20 RGWRados::pool_iterate: got myfoo 2024-09-13T19:06:44.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f77837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:44.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94351582205456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a7340 con 0x55cff089aa40 2024-09-13T19:06:44.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94351582205456] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.599+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94351582186816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x7f78c4025020 2024-09-13T19:06:44.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94351582186816] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d4333980 20 remove_watcher() i=0 2024-09-13T19:06:44.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d4333980 2 removed watcher, disabling cache 2024-09-13T19:06:44.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94351582192096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x55cff089aa40 2024-09-13T19:06:44.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94351582192096] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d4333980 20 remove_watcher() i=1 2024-09-13T19:06:44.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.603+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94351582193424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a80f0 con 0x55cff089f3e0 2024-09-13T19:06:44.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d1e43640 1 -- 172.21.15.151:0/3369099589 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94351582193424] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78c4072070 con 0x55cff089f3e0 2024-09-13T19:06:44.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d4333980 20 remove_watcher() i=2 2024-09-13T19:06:44.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94351582198848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x7f78c4025020 2024-09-13T19:06:44.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d1642640 1 -- 172.21.15.151:0/3369099589 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94351582198848] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78bc0c9030 con 0x7f78c4025020 2024-09-13T19:06:44.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d4333980 20 remove_watcher() i=3 2024-09-13T19:06:44.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.607+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94351582194672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x55cff089aa40 2024-09-13T19:06:44.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94351582194672] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x55cff089aa40 2024-09-13T19:06:44.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d4333980 20 remove_watcher() i=4 2024-09-13T19:06:44.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94351582203472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x7f78bc0dc040 2024-09-13T19:06:44.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94351582203472] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d4333980 20 remove_watcher() i=5 2024-09-13T19:06:44.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.611+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94351582206928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x7f78bc0dc040 2024-09-13T19:06:44.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94351582206928] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d4333980 20 remove_watcher() i=6 2024-09-13T19:06:44.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94351582209456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55cff08a25a0 con 0x7f78bc0dc040 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94351582209456] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f78cc0083f0 con 0x7f78bc0dc040 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d4333980 20 remove_watcher() i=7 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.615+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f78bc0dc040 msgr2=0x7f78bc0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f78bc0dc040 0x7f78bc0dd430 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff089aa40 msgr2=0x55cff089cee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff089aa40 0x55cff089cee0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f78c4025020 msgr2=0x7f78c40485d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f78c4025020 0x7f78c40485d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff089f3e0 msgr2=0x55cff08a17d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff089f3e0 0x55cff08a17d0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f779c034650 msgr2=0x7f779c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f779c034650 0x7f779c036b10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c10 tx=0x7f78bc0b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 msgr2=0x55cff088f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d2644640 1 -- 172.21.15.151:0/3369099589 reap_dead start 2024-09-13T19:06:44.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f78c4002210 tx=0x7f78c4030f30 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 shutdown_connections 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/3369099589 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff08887e0 0x55cff088f970 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 >> 172.21.15.151:0/3369099589 conn(0x55cff0884b10 msgr2=0x55cff0882be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 shutdown_connections 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/3369099589 wait complete. 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 msgr2=0x7f77ac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 0x7f77ac036b60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55cff0866000 tx=0x7f78bc005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 msgr2=0x55cff087c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f78c40472b0 tx=0x7f78c401b990 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 shutdown_connections 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77ac0346a0 0x7f77ac036b60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/997156411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff087bea0 0x55cff087c2c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 >> 172.21.15.151:0/997156411 conn(0x55cff0870ff0 msgr2=0x55cff0873a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 shutdown_connections 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/997156411 wait complete. 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff0862ec0 msgr2=0x55cff08652b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55cff0862ec0 0x55cff08652b0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55cff086b970 msgr2=0x55cff086dd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55cff086b970 0x55cff086dd60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff0867a50 msgr2=0x55cff0869e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55cff0867a50 0x55cff0869e40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77b8034650 msgr2=0x7f77b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f77b8034650 0x7f77b8036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0ad000 tx=0x7f78bc0a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 msgr2=0x55cff085ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 --2- 172.21.15.151:0/1672061163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cff07708e0 0x55cff085ddd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000f90 tx=0x7f78c4001260 comp rx=0 tx=0).stop 2024-09-13T19:06:44.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d2644640 1 -- 172.21.15.151:0/1672061163 reap_dead start 2024-09-13T19:06:44.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 shutdown_connections 2024-09-13T19:06:44.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 >> 172.21.15.151:0/1672061163 conn(0x55cff0768080 msgr2=0x55cff0850ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:44.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 shutdown_connections 2024-09-13T19:06:44.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.619+0000 7f78d4333980 1 -- 172.21.15.151:0/1672061163 wait complete. 2024-09-13T19:06:44.630 INFO:teuthology.orchestra.run.smithi151.stdout:["myfoo"] 2024-09-13T19:06:44.630 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-13T19:06:44.648 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.666 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.681 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.729 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-13T19:06:44.798 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.869 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.945 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:44.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:44.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:44.945 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.979+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bf3db980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559bbd1799d0 0x559bbd17bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bf3db980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559bbcffdae0 con 0x559bbd175650 2024-09-13T19:06:45.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bf3db980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559bbd021e30 con 0x559bbd1799d0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04b46ea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559bbd1799d0 0x559bbd17bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bceeb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x559bbd175650 0x559bbd175a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33528/0 (socket says 172.21.15.151:33528) 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04bceeb640 1 -- 172.21.15.151:0/557060316 learned_addr learned my addr 172.21.15.151:0/557060316 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04b46ea640 1 -- 172.21.15.151:0/557060316 >> v1:172.21.15.12:6789/0 conn(0x559bbd175650 legacy=0x559bbd175a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04b46ea640 1 -- 172.21.15.151:0/557060316 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd17d310 con 0x559bbd1799d0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.983+0000 7f04b46ea640 1 --2- 172.21.15.151:0/557060316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd1799d0 0x559bbd17bdc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f04a400a480 tx=0x7f04a401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd05887a987385b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04b7fff640 1 -- 172.21.15.151:0/557060316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a40b0070 con 0x559bbd1799d0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04b7fff640 1 -- 172.21.15.151:0/557060316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a40ab540 con 0x559bbd1799d0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04b7fff640 1 -- 172.21.15.151:0/557060316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a40ab840 con 0x559bbd1799d0 2024-09-13T19:06:45.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 -- 172.21.15.151:0/557060316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd1799d0 msgr2=0x559bbd17bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 --2- 172.21.15.151:0/557060316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd1799d0 0x559bbd17bdc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f04a400a480 tx=0x7f04a401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 -- 172.21.15.151:0/557060316 shutdown_connections 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 --2- 172.21.15.151:0/557060316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd1799d0 0x559bbd17bdc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 -- 172.21.15.151:0/557060316 >> 172.21.15.151:0/557060316 conn(0x559bbd171170 msgr2=0x559bbd173590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 -- 172.21.15.151:0/557060316 shutdown_connections 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:44.987+0000 7f04bf3db980 1 -- 172.21.15.151:0/557060316 wait complete. 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559bbd023200 con 0x559bbd175650 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56980/0 (socket says 172.21.15.151:56980) 2024-09-13T19:06:45.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bceeb640 1 -- 172.21.15.151:0/2141457396 learned_addr learned my addr 172.21.15.151:0/2141457396 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bceeb640 1 -- 172.21.15.151:0/2141457396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd0ec120 con 0x559bbd175650 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bceeb640 1 --2- 172.21.15.151:0/2141457396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f04ac001d90 tx=0x7f04ac001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67334d9b15ca3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f03aae0d640 1 -- 172.21.15.151:0/2141457396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac013030 con 0x559bbd175650 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f03aae0d640 1 -- 172.21.15.151:0/2141457396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac00e690 con 0x559bbd175650 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f03aae0d640 1 -- 172.21.15.151:0/2141457396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac00ea10 con 0x559bbd175650 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- 172.21.15.151:0/2141457396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 msgr2=0x559bbd0ebb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2141457396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f04ac001d90 tx=0x7f04ac001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- 172.21.15.151:0/2141457396 shutdown_connections 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2141457396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd0ebb50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- 172.21.15.151:0/2141457396 >> 172.21.15.151:0/2141457396 conn(0x559bbd171170 msgr2=0x559bbd25c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- 172.21.15.151:0/2141457396 shutdown_connections 2024-09-13T19:06:45.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- 172.21.15.151:0/2141457396 wait complete. 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.003+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd269fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559bbd17ce10 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd269fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd269fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:56996/0 (socket says 172.21.15.151:56996) 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bceeb640 1 -- 172.21.15.151:0/2872124157 learned_addr learned my addr 172.21.15.151:0/2872124157 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bceeb640 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd26a510 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bceeb640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd269fd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x559bbd0eb6d0 tx=0x7f04ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 -- 172.21.15.151:0/2872124157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac027070 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bbd26a7a0 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 -- 172.21.15.151:0/2872124157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac0198e0 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 -- 172.21.15.151:0/2872124157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac019c00 con 0x559bbd175650 2024-09-13T19:06:45.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbd26d480 con 0x559bbd175650 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 -- 172.21.15.151:0/2872124157 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f04ac02a070 con 0x559bbd175650 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f03a4034650 0x7f03a4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f03a960a640 1 -- 172.21.15.151:0/2872124157 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04ac01f070 con 0x559bbd175650 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04b46ea640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f03a4034650 0x7f03a4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd1799d0 0x559bbd270fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd271600 con 0x559bbd1799d0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.007+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd1799d0 0x559bbd270fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd1799d0 0x559bbd270fc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04b46ea640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f03a4034650 0x7f03a4036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ad000 tx=0x7f04a40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bd6ec640 1 -- 172.21.15.151:0/2872124157 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd1799d0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd26e6a0 con 0x559bbd1799d0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bd6ec640 1 -- 172.21.15.151:0/2872124157 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd1799d0 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd273930 0x559bbd275d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2763f0 con 0x559bbd273930 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bceeb640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd273930 0x559bbd275d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bceeb640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd273930 0x559bbd275d20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bceeb640 1 -- 172.21.15.151:0/2872124157 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04ac029030 con 0x559bbd273930 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2727a0 con 0x559bbd1799d0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bd6ec640 1 -- 172.21.15.151:0/2872124157 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd1799d0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559bbd277830 0x559bbd279c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd27a390 con 0x559bbd277830 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04b46ea640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559bbd277830 0x559bbd279c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04b46ea640 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559bbd277830 0x559bbd279c20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04b46ea640 1 -- 172.21.15.151:0/2872124157 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04a40b3040 con 0x559bbd277830 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.011+0000 7f04bf3db980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559bbd07c800 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57010/0 (socket says 172.21.15.151:57010) 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bceeb640 1 -- 172.21.15.151:0/1503331678 learned_addr learned my addr 172.21.15.151:0/1503331678 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bceeb640 1 -- 172.21.15.151:0/1503331678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd288760 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bceeb640 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0484e0 tx=0x7f04ac00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 -- 172.21.15.151:0/1503331678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac02aa00 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 -- 172.21.15.151:0/1503331678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac02aba0 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bbd2889f0 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 -- 172.21.15.151:0/1503331678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac02c590 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbd28b670 con 0x559bbd287e00 2024-09-13T19:06:45.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 -- 172.21.15.151:0/1503331678 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f04ac016070 con 0x559bbd287e00 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 0x7f0394036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f03a27fc640 1 -- 172.21.15.151:0/1503331678 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04ac014070 con 0x559bbd287e00 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04b46ea640 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 0x7f0394036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04bf3db980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559bbd0ea340 con 0x559bbd294730 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.015+0000 7f04b46ea640 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 0x7f0394036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ae040 tx=0x7f04a4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57012/0 (socket says 172.21.15.151:57012) 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 -- 172.21.15.151:0/355590274 learned_addr learned my addr 172.21.15.151:0/355590274 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 -- 172.21.15.151:0/355590274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd295100 con 0x559bbd294730 2024-09-13T19:06:45.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- 172.21.15.151:0/355590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04ac02b720 tx=0x7f04ac01aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe98b381bc34bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f0393fff640 1 -- 172.21.15.151:0/355590274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac0485c0 con 0x559bbd294730 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f0393fff640 1 -- 172.21.15.151:0/355590274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac05e070 con 0x559bbd294730 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f0393fff640 1 -- 172.21.15.151:0/355590274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac051120 con 0x559bbd294730 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- 172.21.15.151:0/355590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 msgr2=0x559bbd294b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 --2- 172.21.15.151:0/355590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f04ac02b720 tx=0x7f04ac01aed0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- 172.21.15.151:0/355590274 shutdown_connections 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 --2- 172.21.15.151:0/355590274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd294b30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- 172.21.15.151:0/355590274 >> 172.21.15.151:0/355590274 conn(0x559bbd290b10 msgr2=0x559bbd28ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- 172.21.15.151:0/355590274 shutdown_connections 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- 172.21.15.151:0/355590274 wait complete. 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 Processor -- start 2024-09-13T19:06:45.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- start start 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bf3db980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559bbd295580 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57014/0 (socket says 172.21.15.151:57014) 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 learned_addr learned my addr 172.21.15.151:0/3816429639 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bbd29bf10 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.019+0000 7f04bceeb640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04ac047300 tx=0x7f04ac043e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 -- 172.21.15.151:0/3816429639 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac0385d0 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 -- 172.21.15.151:0/3816429639 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac038770 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bbd29bf10 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 -- 172.21.15.151:0/3816429639 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04ac02b9d0 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bbd29bf10 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 -- 172.21.15.151:0/3816429639 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f04ac009070 con 0x559bbd294730 2024-09-13T19:06:45.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0388034650 0x7f0388036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f03927fc640 1 -- 172.21.15.151:0/3816429639 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f04ac005050 con 0x559bbd294730 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04b46ea640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0388034650 0x7f0388036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd2a69e0 0x559bbd2a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2a95d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd2a69e0 0x559bbd2a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04b46ea640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0388034650 0x7f0388036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04a4017e90 tx=0x7f04a40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd2a69e0 0x559bbd2a8e80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 realm 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2a99e0 con 0x559bbd2a69e0 2024-09-13T19:06:45.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa280 con 0x559bbd2a69e0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd2ab380 0x559bbd2ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2adcf0 con 0x559bbd2ab380 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.023+0000 7f04bceeb640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd2ab380 0x559bbd2ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bceeb640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd2ab380 0x559bbd2ad770 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bf3db980 20 searching for the correct realm 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2af550 con 0x559bbd2ab380 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bceeb640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f04ac02c060 0x7f04ac02c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2af550 con 0x7f04ac02c060 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04b46ea640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f04ac02c060 0x7f04ac02c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04b46ea640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f04ac02c060 0x7f04ac02c730 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04b46ea640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f04a40dc040 0x7f04a40dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2af550 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f04a40dc040 0x7f04a40dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f04a40dc040 0x7f04a40dd430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.027+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04ac02c060 2024-09-13T19:06:45.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04ac02c060 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.031+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04ac02c060 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.035+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04ac02c060 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2ab380 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04a40dc040 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x559bbd2a69e0 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aa620 con 0x7f04ac02c060 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:45.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2ae670 con 0x559bbd2a69e0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.039+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aef10 con 0x559bbd2a69e0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2ae2b0 con 0x7f04ac02c060 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 zone default found 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 4 Realm: () 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 zonegroup default 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2aef10 con 0x7f04a40dc040 2024-09-13T19:06:45.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b13d0 con 0x559bbd2ab380 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b1770 con 0x559bbd2ab380 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 started sync module instance, tier type = 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b0870 con 0x7f04ac02c060 2024-09-13T19:06:45.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94127382006880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b04d0 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.043+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b2650 con 0x559bbd2a69e0 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.047+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94127382006880] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.047+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.047+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94127382012320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b2a70 con 0x559bbd2a69e0 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.047+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b3430 con 0x559bbd2ab380 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.051+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94127382012320] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.051+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.051+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94127382013648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b3430 con 0x559bbd2ab380 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.051+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b3df0 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.055+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.055+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94127382018368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b4640 con 0x7f04ac02c060 2024-09-13T19:06:45.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.055+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b5040 con 0x559bbd2a69e0 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.055+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94127382018368] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.055+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94127382013648] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.059+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.059+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94127382015872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b4190 con 0x559bbd2a69e0 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.059+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b58e0 con 0x7f04a40dc040 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.059+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94127382015872] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.063+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.063+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94127382022992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b5600 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.063+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b5e50 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.067+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.067+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94127382026000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b61a0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.067+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b6cc0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.067+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94127382022992] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94127382026000] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94127382030224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b5bf0 con 0x7f04a40dc040 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=0 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=1 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=2 2024-09-13T19:06:45.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=3 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=4 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=5 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.071+0000 7f04bf3db980 20 add_watcher() i=6 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94127382030224] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 add_watcher() i=7 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b9cb0 con 0x559bbd2a69e0 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94127382024528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2b7130 con 0x559bbd2a69e0 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94127382024528] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f03737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 5 note: GC not initialized 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f03727e4640 20 reqs_thread_entry: start 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 Filter name: none 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f036b7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.075+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2dd2d0 con 0x7f04ac02c060 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2ddb60 con 0x559bbd2ab380 2024-09-13T19:06:45.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(63 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2dc670 con 0x7f04ac02c060 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2dc670 con 0x559bbd2ab380 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(65 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 4.38 4:1ff120aa:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2e06b0 con 0x559bbd2a69e0 2024-09-13T19:06:45.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 4.1d 4:bae4f2e0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2e3060 con 0x559bbd2ab380 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 4.30 4:0fd070c2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2e5c80 con 0x559bbd2ab380 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 4.37 4:ee587ea9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2e8530 con 0x7f04a40dc040 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 4.38 4:1fbd4d3b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2eade0 con 0x559bbd2a69e0 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 4.36 4:6c04294d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2ed810 con 0x559bbd2a69e0 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2f01e0 con 0x7f04a40dc040 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 4.3b 4:df1c5111:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2f2a50 con 0x559bbd2ab380 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 4.7 4:e3c8d61b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2f55e0 con 0x7f04a40dc040 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 4.33 4:cdf112e2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2f80e0 con 0x7f04a40dc040 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 4.36 4:6cd87e9b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2faf60 con 0x559bbd2a69e0 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(68 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(66 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(71 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(70 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(74 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.079+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f03737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94127382024528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2faf60 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94127382024528] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94127382006880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x7f04ac02c060 2024-09-13T19:06:45.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94127382006880] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40c9030 con 0x7f04ac02c060 2024-09-13T19:06:45.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bf3db980 20 remove_watcher() i=0 2024-09-13T19:06:45.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bf3db980 2 removed watcher, disabling cache 2024-09-13T19:06:45.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.083+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94127382012320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x559bbd2a69e0 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.087+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94127382012320] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.087+0000 7f04bf3db980 20 remove_watcher() i=1 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.087+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94127382013648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x559bbd2ab380 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04bceeb640 1 -- 172.21.15.151:0/3816429639 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94127382013648] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04ac074020 con 0x559bbd2ab380 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04bf3db980 20 remove_watcher() i=2 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94127382018368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x7f04ac02c060 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04b46ea640 1 -- 172.21.15.151:0/3816429639 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94127382018368] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04a40f4040 con 0x7f04ac02c060 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04bf3db980 20 remove_watcher() i=3 2024-09-13T19:06:45.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.091+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94127382015872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x559bbd2a69e0 2024-09-13T19:06:45.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94127382015872] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x559bbd2a69e0 2024-09-13T19:06:45.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bf3db980 20 remove_watcher() i=4 2024-09-13T19:06:45.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94127382022992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x7f04a40dc040 2024-09-13T19:06:45.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94127382022992] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bf3db980 20 remove_watcher() i=5 2024-09-13T19:06:45.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.095+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94127382026000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x7f04a40dc040 2024-09-13T19:06:45.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.099+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94127382026000] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.099+0000 7f04bf3db980 20 remove_watcher() i=6 2024-09-13T19:06:45.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.099+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94127382030224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bbd2cda60 con 0x7f04a40dc040 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.099+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94127382030224] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b800a4d0 con 0x7f04a40dc040 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.099+0000 7f04bf3db980 20 remove_watcher() i=7 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f04a40dc040 msgr2=0x7f04a40dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f04a40dc040 0x7f04a40dd430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd2a69e0 msgr2=0x559bbd2a8e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd2a69e0 0x559bbd2a8e80 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f04ac02c060 msgr2=0x7f04ac02c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f04ac02c060 0x7f04ac02c730 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd2ab380 msgr2=0x559bbd2ad770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd2ab380 0x559bbd2ad770 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0388034650 msgr2=0x7f0388036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0388034650 0x7f0388036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04a4017e90 tx=0x7f04a40b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 msgr2=0x559bbd29b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bd6ec640 1 -- 172.21.15.151:0/3816429639 reap_dead start 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f04ac047300 tx=0x7f04ac043e90 comp rx=0 tx=0).stop 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 shutdown_connections 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/3816429639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd294730 0x559bbd29b9d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 >> 172.21.15.151:0/3816429639 conn(0x559bbd290b10 msgr2=0x559bbd28ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 shutdown_connections 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/3816429639 wait complete. 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 msgr2=0x7f0394036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 0x7f0394036b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ae040 tx=0x7f04a4005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 msgr2=0x559bbd288220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f04ac0484e0 tx=0x7f04ac00df80 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 shutdown_connections 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0394034650 0x7f0394036b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/1503331678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd287e00 0x559bbd288220 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 >> 172.21.15.151:0/1503331678 conn(0x559bbd27cf50 msgr2=0x559bbd27f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 shutdown_connections 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/1503331678 wait complete. 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd1799d0 msgr2=0x559bbd270fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559bbd1799d0 0x559bbd270fc0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559bbd277830 msgr2=0x559bbd279c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559bbd277830 0x559bbd279c20 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd273930 msgr2=0x559bbd275d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559bbd273930 0x559bbd275d20 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f03a4034650 msgr2=0x7f03a4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f03a4034650 0x7f03a4036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04a40ad000 tx=0x7f04a40a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 msgr2=0x559bbd269fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 --2- 172.21.15.151:0/2872124157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559bbd175650 0x559bbd269fd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x559bbd0eb6d0 tx=0x7f04ac000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bd6ec640 1 -- 172.21.15.151:0/2872124157 reap_dead start 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 shutdown_connections 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 >> 172.21.15.151:0/2872124157 conn(0x559bbd171170 msgr2=0x559bbd25c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 shutdown_connections 2024-09-13T19:06:45.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.103+0000 7f04bf3db980 1 -- 172.21.15.151:0/2872124157 wait complete. 2024-09-13T19:06:45.117 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"ef9ca8b0-9ae4-481e-ba9d-bc0942310d85","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:06:44.219530Z","creation_time":"2024-09-13T19:06:44.212931Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:06:45.117 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:06:44.219530Z', 'creation_time': '2024-09-13T19:06:44.212931Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:06:45.117 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:06:45.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-13T19:06:45.118 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-13T19:06:45.196 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:45.196 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:45.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d74f0980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56553fc8a3b0 0x56553fc88b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d74f0980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56553fb9bae0 con 0x56553fc8a7c0 2024-09-13T19:06:45.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d74f0980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56553fbbfe30 con 0x56553fc8a3b0 2024-09-13T19:06:45.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d5000640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56553fc8a3b0 0x56553fc88b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d5000640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56553fc8a3b0 0x56553fc88b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57020/0 (socket says 172.21.15.151:57020) 2024-09-13T19:06:45.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d5000640 1 -- 172.21.15.151:0/982182709 learned_addr learned my addr 172.21.15.151:0/982182709 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d47ff640 1 --1- 172.21.15.151:0/982182709 >> v1:172.21.15.12:6789/0 conn(0x56553fc8a7c0 0x56553fc890b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33534/0 (socket says 172.21.15.151:33534) 2024-09-13T19:06:45.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d5000640 1 -- 172.21.15.151:0/982182709 >> v1:172.21.15.12:6789/0 conn(0x56553fc8a7c0 legacy=0x56553fc890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.195+0000 7fa9d5000640 1 -- 172.21.15.151:0/982182709 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fc898e0 con 0x56553fc8a3b0 2024-09-13T19:06:45.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d5000640 1 --2- 172.21.15.151:0/982182709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fc88b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00a5c0 tx=0x7fa9cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0740115be53bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d3ffe640 1 -- 172.21.15.151:0/982182709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0a6070 con 0x56553fc8a3b0 2024-09-13T19:06:45.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d3ffe640 1 -- 172.21.15.151:0/982182709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0af070 con 0x56553fc8a3b0 2024-09-13T19:06:45.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d3ffe640 1 -- 172.21.15.151:0/982182709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0aa5c0 con 0x56553fc8a3b0 2024-09-13T19:06:45.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 -- 172.21.15.151:0/982182709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 msgr2=0x56553fc88b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/982182709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fc88b70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00a5c0 tx=0x7fa9cc01b340 comp rx=0 tx=0).stop 2024-09-13T19:06:45.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 -- 172.21.15.151:0/982182709 shutdown_connections 2024-09-13T19:06:45.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/982182709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fc88b70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 -- 172.21.15.151:0/982182709 >> 172.21.15.151:0/982182709 conn(0x56553fd0f1b0 msgr2=0x56553fd115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 -- 172.21.15.151:0/982182709 shutdown_connections 2024-09-13T19:06:45.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.199+0000 7fa9d74f0980 1 -- 172.21.15.151:0/982182709 wait complete. 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d74f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d74f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56553fbc1200 con 0x56553fc8a3b0 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57024/0 (socket says 172.21.15.151:57024) 2024-09-13T19:06:45.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d5000640 1 -- 172.21.15.151:0/3768197353 learned_addr learned my addr 172.21.15.151:0/3768197353 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.215+0000 7fa9d5000640 1 -- 172.21.15.151:0/3768197353 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fe01160 con 0x56553fc8a3b0 2024-09-13T19:06:45.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 --2- 172.21.15.151:0/3768197353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc018f70 tx=0x7fa9cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba05c650ba29926b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c2e0d640 1 -- 172.21.15.151:0/3768197353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0aa960 con 0x56553fc8a3b0 2024-09-13T19:06:45.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c2e0d640 1 -- 172.21.15.151:0/3768197353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0aab00 con 0x56553fc8a3b0 2024-09-13T19:06:45.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c2e0d640 1 -- 172.21.15.151:0/3768197353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0aade0 con 0x56553fc8a3b0 2024-09-13T19:06:45.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3768197353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 msgr2=0x56553fe00b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3768197353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc018f70 tx=0x7fa9cc003030 comp rx=0 tx=0).stop 2024-09-13T19:06:45.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3768197353 shutdown_connections 2024-09-13T19:06:45.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3768197353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe00b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3768197353 >> 172.21.15.151:0/3768197353 conn(0x56553fd0f1b0 msgr2=0x56553fdfc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3768197353 shutdown_connections 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3768197353 wait complete. 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe07de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d74f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56553fd1f200 con 0x56553fc8a3b0 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe07de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe07de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57028/0 (socket says 172.21.15.151:57028) 2024-09-13T19:06:45.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 -- 172.21.15.151:0/3166259391 learned_addr learned my addr 172.21.15.151:0/3166259391 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fe08320 con 0x56553fc8a3b0 2024-09-13T19:06:45.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa9d5000640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe07de0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00a5c0 tx=0x7fa9cc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c160a640 1 -- 172.21.15.151:0/3166259391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0cb030 con 0x56553fc8a3b0 2024-09-13T19:06:45.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c160a640 1 -- 172.21.15.151:0/3166259391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0bd7c0 con 0x56553fc8a3b0 2024-09-13T19:06:45.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.219+0000 7fa8c160a640 1 -- 172.21.15.151:0/3166259391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0bdaa0 con 0x56553fc8a3b0 2024-09-13T19:06:45.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56553fe085b0 con 0x56553fc8a3b0 2024-09-13T19:06:45.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553fe0b290 con 0x56553fc8a3b0 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa8c160a640 1 -- 172.21.15.151:0/3166259391 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9cc0ce070 con 0x56553fc8a3b0 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa8c160a640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8bc0346a0 0x7fa8bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa8c160a640 1 -- 172.21.15.151:0/3166259391 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa9cc0cc070 con 0x56553fc8a3b0 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8bc0346a0 0x7fa8bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fc8a7c0 0x56553fe0edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe0f420 con 0x56553fc8a7c0 2024-09-13T19:06:45.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5801640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fc8a7c0 0x56553fe0edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8bc0346a0 0x7fa8bc036b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000f70 tx=0x7fa9bc001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5801640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fc8a7c0 0x56553fe0edb0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5801640 1 -- 172.21.15.151:0/3166259391 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fc8a7c0 2024-09-13T19:06:45.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe0c4b0 con 0x56553fc8a7c0 2024-09-13T19:06:45.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5801640 1 -- 172.21.15.151:0/3166259391 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fc8a7c0 2024-09-13T19:06:45.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe11750 0x56553fe13b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe14210 con 0x56553fe11750 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5000640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe11750 0x56553fe13b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.223+0000 7fa9d5000640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe11750 0x56553fe13b40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 -- 172.21.15.151:0/3166259391 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9cc0c6a00 con 0x56553fe11750 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe105f0 con 0x56553fc8a7c0 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5801640 1 -- 172.21.15.151:0/3166259391 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fc8a7c0 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56553fe15670 0x56553fe17a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe181a0 con 0x56553fe15670 2024-09-13T19:06:45.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56553fe15670 0x56553fe17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56553fe15670 0x56553fe17a60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d47ff640 1 -- 172.21.15.151:0/3166259391 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9bc00f6a0 con 0x56553fe15670 2024-09-13T19:06:45.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56553fc1a800 con 0x56553fe25c70 2024-09-13T19:06:45.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57042/0 (socket says 172.21.15.151:57042) 2024-09-13T19:06:45.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 -- 172.21.15.151:0/2196422067 learned_addr learned my addr 172.21.15.151:0/2196422067 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 -- 172.21.15.151:0/2196422067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fe265d0 con 0x56553fe25c70 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0d6fd0 tx=0x7fa9cc0bdc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa8ba7fc640 1 -- 172.21.15.151:0/2196422067 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0c5720 con 0x56553fe25c70 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa8ba7fc640 1 -- 172.21.15.151:0/2196422067 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0c58c0 con 0x56553fe25c70 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56553fe26860 con 0x56553fe25c70 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa8ba7fc640 1 -- 172.21.15.151:0/2196422067 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0e5890 con 0x56553fe25c70 2024-09-13T19:06:45.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.227+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553fe26860 con 0x56553fe25c70 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8ba7fc640 1 -- 172.21.15.151:0/2196422067 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9cc0e5a50 con 0x56553fe25c70 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8ba7fc640 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 0x7fa8ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8ba7fc640 1 -- 172.21.15.151:0/2196422067 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa9cc0eec50 con 0x56553fe25c70 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 0x7fa8ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56553fe01420 con 0x56553fe32480 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 0x7fa8ac036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56553fe0fd00 tx=0x7fa9bc00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57044/0 (socket says 172.21.15.151:57044) 2024-09-13T19:06:45.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d5000640 1 -- 172.21.15.151:0/2792066580 learned_addr learned my addr 172.21.15.151:0/2792066580 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d5000640 1 -- 172.21.15.151:0/2792066580 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fe32e30 con 0x56553fe32480 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2792066580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0cf610 tx=0x7fa9cc0cbeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced85a8c80e376c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8abfff640 1 -- 172.21.15.151:0/2792066580 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0a7ae0 con 0x56553fe32480 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8abfff640 1 -- 172.21.15.151:0/2792066580 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc0e5570 con 0x56553fe32480 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa8abfff640 1 -- 172.21.15.151:0/2792066580 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0e3130 con 0x56553fe32480 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2792066580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 msgr2=0x56553fe32860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2792066580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0cf610 tx=0x7fa9cc0cbeb0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2792066580 shutdown_connections 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2792066580 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe32860 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2792066580 >> 172.21.15.151:0/2792066580 conn(0x56553fe2e7b0 msgr2=0x56553fe2c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2792066580 shutdown_connections 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.231+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2792066580 wait complete. 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 Processor -- start 2024-09-13T19:06:45.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 -- start start 2024-09-13T19:06:45.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56553fe331c0 con 0x56553fe32480 2024-09-13T19:06:45.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d5000640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57058/0 (socket says 172.21.15.151:57058) 2024-09-13T19:06:45.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 learned_addr learned my addr 172.21.15.151:0/2608830347 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56553fe39a30 con 0x56553fe32480 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a8fd0 tx=0x7fa9cc0a8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa8aa7fc640 1 -- 172.21.15.151:0/2608830347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0a7ae0 con 0x56553fe32480 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa8aa7fc640 1 -- 172.21.15.151:0/2608830347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9cc10c070 con 0x56553fe32480 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56553fe39a30 con 0x56553fe32480 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa8aa7fc640 1 -- 172.21.15.151:0/2608830347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9cc0da980 con 0x56553fe32480 2024-09-13T19:06:45.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553fe39a30 con 0x56553fe32480 2024-09-13T19:06:45.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.235+0000 7fa8aa7fc640 1 -- 172.21.15.151:0/2608830347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9cc100030 con 0x56553fe32480 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa8aa7fc640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8a00346a0 0x7fa8a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa8aa7fc640 1 -- 172.21.15.151:0/2608830347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa9cc0fe070 con 0x56553fe32480 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8a00346a0 0x7fa8a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fe44460 0x56553fe46920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe47070 con 0x56553fe44460 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fe44460 0x56553fe46920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8a00346a0 0x7fa8a0036b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c010 tx=0x7fa9bc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fe44460 0x56553fe46920 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 realm 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe474d0 con 0x56553fe44460 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe47d70 con 0x56553fe44460 2024-09-13T19:06:45.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe48c40 0x56553fe4b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4b770 con 0x56553fe48c40 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe48c40 0x56553fe4b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe48c40 0x56553fe4b030 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:45.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 20 searching for the correct realm 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4d040 con 0x56553fe48c40 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa9cc0d0030 0x7fa9cc0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4d040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.239+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa9cc0d0030 0x7fa9cc0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa9cc0d0030 0x7fa9cc0b5750 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d47ff640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa9bc01fbe0 0x7fa9bc03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4d040 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa9bc01fbe0 0x7fa9bc03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa9bc01fbe0 0x7fa9bc03a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.243+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9cc0d0030 2024-09-13T19:06:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9cc0d0030 2024-09-13T19:06:45.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.247+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9cc0d0030 2024-09-13T19:06:45.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.251+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9cc0d0030 2024-09-13T19:06:45.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe48c40 2024-09-13T19:06:45.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x56553fe44460 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56553fe48110 con 0x7fa9cc0d0030 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4c160 con 0x56553fe44460 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4ca00 con 0x56553fe44460 2024-09-13T19:06:45.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.255+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4bda0 con 0x7fa9cc0d0030 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 zone default found 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 4 Realm: () 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 zonegroup default 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4ca00 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4eed0 con 0x56553fe48c40 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4f270 con 0x56553fe48c40 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 started sync module instance, tier type = 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4e370 con 0x7fa9cc0d0030 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94924144174992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe4fb10 con 0x7fa9cc0d0030 2024-09-13T19:06:45.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.259+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe50360 con 0x56553fe44460 2024-09-13T19:06:45.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.263+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94924144174992] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.307+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.307+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94924144178784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe50360 con 0x56553fe44460 2024-09-13T19:06:45.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.307+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe50c00 con 0x56553fe48c40 2024-09-13T19:06:45.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94924144183120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe515d0 con 0x56553fe48c40 2024-09-13T19:06:45.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe520f0 con 0x7fa9cc0d0030 2024-09-13T19:06:45.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94924144178784] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94924144180912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe52990 con 0x7fa9cc0d0030 2024-09-13T19:06:45.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.311+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe531e0 con 0x56553fe44460 2024-09-13T19:06:45.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.315+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94924144183120] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.315+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94924144180912] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.315+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.315+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94924144185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe531e0 con 0x56553fe44460 2024-09-13T19:06:45.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.315+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe53ab0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94924144185376] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94924144193088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe53a60 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe542f0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.319+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94924144196672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe54710 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe55230 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94924144193088] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94924144200960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe551f0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=0 2024-09-13T19:06:45.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=1 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=2 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=3 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=4 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=5 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94924144196672] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.323+0000 7fa9d74f0980 20 add_watcher() i=6 2024-09-13T19:06:45.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94924144200960] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d74f0980 20 add_watcher() i=7 2024-09-13T19:06:45.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d74f0980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:45.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe541a0 con 0x56553fe44460 2024-09-13T19:06:45.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.327+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94924144197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe55650 con 0x56553fe44460 2024-09-13T19:06:45.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94924144197984] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa88afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:45.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:45.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 5 note: GC not initialized 2024-09-13T19:06:45.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa889fe3640 20 reqs_thread_entry: start 2024-09-13T19:06:45.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:45.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 Filter name: none 2024-09-13T19:06:45.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa7fb7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:45.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7b290 con 0x56553fe44460 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7bc80 con 0x56553fe44460 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7cc90 con 0x7fa9cc0d0030 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7a540 con 0x7fa9cc0d0030 2024-09-13T19:06:45.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.331+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7cc90 con 0x56553fe48c40 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 4.38 4:1ff120aa:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe7e520 con 0x56553fe44460 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 4.1d 4:bae4f2e0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe810a0 con 0x56553fe48c40 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 4.30 4:0fd070c2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe83a00 con 0x56553fe48c40 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 4.37 4:ee587ea9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe86270 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 4.38 4:1fbd4d3b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe88ae0 con 0x56553fe44460 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 4.36 4:6c04294d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe8b7e0 con 0x56553fe44460 2024-09-13T19:06:45.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe8e6a0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:74 4.3b 4:df1c5111:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe91510 con 0x56553fe48c40 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 4.7 4:e3c8d61b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe943d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 4.33 4:cdf112e2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe97120 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 4.36 4:6cd87e9b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56553fe99990 con 0x56553fe44460 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(67 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(74 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(71 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(72 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(76 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(77 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa88afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.335+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94924144197984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x56553fe44460 2024-09-13T19:06:45.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94924144197984] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94924144174992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x7fa9cc0d0030 2024-09-13T19:06:45.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94924144174992] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d74f0980 20 remove_watcher() i=0 2024-09-13T19:06:45.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d74f0980 2 removed watcher, disabling cache 2024-09-13T19:06:45.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.339+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94924144178784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x56553fe44460 2024-09-13T19:06:45.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.343+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94924144178784] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.343+0000 7fa9d74f0980 20 remove_watcher() i=1 2024-09-13T19:06:45.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.343+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94924144183120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x56553fe48c40 2024-09-13T19:06:45.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d5000640 1 -- 172.21.15.151:0/2608830347 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94924144183120] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9cc0f4070 con 0x56553fe48c40 2024-09-13T19:06:45.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d74f0980 20 remove_watcher() i=2 2024-09-13T19:06:45.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94924144180912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x7fa9cc0d0030 2024-09-13T19:06:45.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d47ff640 1 -- 172.21.15.151:0/2608830347 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94924144180912] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9bc037040 con 0x7fa9cc0d0030 2024-09-13T19:06:45.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d74f0980 20 remove_watcher() i=3 2024-09-13T19:06:45.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.347+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94924144185376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x56553fe44460 2024-09-13T19:06:45.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94924144185376] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x56553fe44460 2024-09-13T19:06:45.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d74f0980 20 remove_watcher() i=4 2024-09-13T19:06:45.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94924144193088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94924144193088] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d74f0980 20 remove_watcher() i=5 2024-09-13T19:06:45.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.351+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94924144196672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94924144196672] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 20 remove_watcher() i=6 2024-09-13T19:06:45.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94924144200960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56553fe6bf50 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94924144200960] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9c400a4d0 con 0x7fa9bc01fbe0 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 20 remove_watcher() i=7 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa9bc01fbe0 msgr2=0x7fa9bc03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa9bc01fbe0 0x7fa9bc03a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fe44460 msgr2=0x56553fe46920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fe44460 0x56553fe46920 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa9cc0d0030 msgr2=0x7fa9cc0b5750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa9cc0d0030 0x7fa9cc0b5750 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe48c40 msgr2=0x56553fe4b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe48c40 0x56553fe4b030 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8a00346a0 msgr2=0x7fa8a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8a00346a0 0x7fa8a0036b60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c010 tx=0x7fa9bc010000 comp rx=0 tx=0).stop 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d5801640 1 -- 172.21.15.151:0/2608830347 reap_dead start 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 msgr2=0x56553fe394f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0a8fd0 tx=0x7fa9cc0a8f20 comp rx=0 tx=0).stop 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 shutdown_connections 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2608830347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe32480 0x56553fe394f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 >> 172.21.15.151:0/2608830347 conn(0x56553fe2e7b0 msgr2=0x56553fe2c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.355+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 shutdown_connections 2024-09-13T19:06:45.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2608830347 wait complete. 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 msgr2=0x7fa8ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 0x7fa8ac036b10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x56553fe0fd00 tx=0x7fa9bc00f000 comp rx=0 tx=0).stop 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 msgr2=0x56553fe26090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0d6fd0 tx=0x7fa9cc0bdc40 comp rx=0 tx=0).stop 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 shutdown_connections 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8ac034650 0x7fa8ac036b10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/2196422067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fe25c70 0x56553fe26090 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 >> 172.21.15.151:0/2196422067 conn(0x56553fe1adc0 msgr2=0x56553fe1d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 shutdown_connections 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/2196422067 wait complete. 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fc8a7c0 msgr2=0x56553fe0edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56553fc8a7c0 0x56553fe0edb0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56553fe15670 msgr2=0x56553fe17a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56553fe15670 0x56553fe17a60 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe11750 msgr2=0x56553fe13b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56553fe11750 0x56553fe13b40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8bc0346a0 msgr2=0x7fa8bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa8bc0346a0 0x7fa8bc036b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc000f70 tx=0x7fa9bc001380 comp rx=0 tx=0).stop 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 msgr2=0x56553fe07de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 --2- 172.21.15.151:0/3166259391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56553fc8a3b0 0x56553fe07de0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00a5c0 tx=0x7fa9cc0180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d5801640 1 -- 172.21.15.151:0/3166259391 reap_dead start 2024-09-13T19:06:45.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 shutdown_connections 2024-09-13T19:06:45.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 >> 172.21.15.151:0/3166259391 conn(0x56553fd0f1b0 msgr2=0x56553fdfb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 shutdown_connections 2024-09-13T19:06:45.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.359+0000 7fa9d74f0980 1 -- 172.21.15.151:0/3166259391 wait complete. 2024-09-13T19:06:45.374 INFO:teuthology.orchestra.run.smithi151.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"ef9ca8b0-9ae4-481e-ba9d-bc0942310d85","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:06:44.219530Z","creation_time":"2024-09-13T19:06:44.212931Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-13T19:06:45.374 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:06:44.219530Z', 'creation_time': '2024-09-13T19:06:44.212931Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:06:45.383 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:06:45.384 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:45.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:45.384 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:06:45.452 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:45.452 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:45.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d55ff5980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649bdb60fa0 0x5649bdb5fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d55ff5980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649bda72ae0 con 0x5649bdb60b90 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d55ff5980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5649bda96e30 con 0x5649bdb60fa0 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53304640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649bdb60fa0 0x5649bdb5fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53b05640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5649bdb60b90 0x5649bdb5f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33550/0 (socket says 172.21.15.151:33550) 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53304640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649bdb60fa0 0x5649bdb5fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57072/0 (socket says 172.21.15.151:57072) 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53b05640 1 -- 172.21.15.151:0/730810727 learned_addr learned my addr 172.21.15.151:0/730810727 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53304640 1 -- 172.21.15.151:0/730810727 >> v1:172.21.15.12:6789/0 conn(0x5649bdb60b90 legacy=0x5649bdb5f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.451+0000 7f8d53304640 1 -- 172.21.15.151:0/730810727 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdb600c0 con 0x5649bdb60fa0 2024-09-13T19:06:45.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d53304640 1 --2- 172.21.15.151:0/730810727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60fa0 0x5649bdb5fa60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800a480 tx=0x7f8d4801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dc5aed023ad8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d52b03640 1 -- 172.21.15.151:0/730810727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d480b0070 con 0x5649bdb60fa0 2024-09-13T19:06:45.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d52b03640 1 -- 172.21.15.151:0/730810727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d480ab540 con 0x5649bdb60fa0 2024-09-13T19:06:45.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d52b03640 1 -- 172.21.15.151:0/730810727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d480ab840 con 0x5649bdb60fa0 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 -- 172.21.15.151:0/730810727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60fa0 msgr2=0x5649bdb5fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/730810727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60fa0 0x5649bdb5fa60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800a480 tx=0x7f8d4801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 -- 172.21.15.151:0/730810727 shutdown_connections 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/730810727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60fa0 0x5649bdb5fa60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 -- 172.21.15.151:0/730810727 >> 172.21.15.151:0/730810727 conn(0x5649bdbe6170 msgr2=0x5649bdbe8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 -- 172.21.15.151:0/730810727 shutdown_connections 2024-09-13T19:06:45.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.455+0000 7f8d55ff5980 1 -- 172.21.15.151:0/730810727 wait complete. 2024-09-13T19:06:45.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d55ff5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d55ff5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649bda98200 con 0x5649bdb60b90 2024-09-13T19:06:45.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57080/0 (socket says 172.21.15.151:57080) 2024-09-13T19:06:45.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d53b05640 1 -- 172.21.15.151:0/177846322 learned_addr learned my addr 172.21.15.151:0/177846322 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d53b05640 1 -- 172.21.15.151:0/177846322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdcd8190 con 0x5649bdb60b90 2024-09-13T19:06:45.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8d53b05640 1 --2- 172.21.15.151:0/177846322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d44001d90 tx=0x7f8d44001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22efb7b2c44e672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8c41e0b640 1 -- 172.21.15.151:0/177846322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44013030 con 0x5649bdb60b90 2024-09-13T19:06:45.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8c41e0b640 1 -- 172.21.15.151:0/177846322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4400e690 con 0x5649bdb60b90 2024-09-13T19:06:45.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.471+0000 7f8c41e0b640 1 -- 172.21.15.151:0/177846322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d4400ea10 con 0x5649bdb60b90 2024-09-13T19:06:45.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/177846322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 msgr2=0x5649bdcd7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/177846322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d44001d90 tx=0x7f8d44001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/177846322 shutdown_connections 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/177846322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcd7bc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/177846322 >> 172.21.15.151:0/177846322 conn(0x5649bdbe6170 msgr2=0x5649bdcd37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/177846322 shutdown_connections 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/177846322 wait complete. 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcdef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649bdbf61c0 con 0x5649bdb60b90 2024-09-13T19:06:45.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcdef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcdef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57082/0 (socket says 172.21.15.151:57082) 2024-09-13T19:06:45.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53b05640 1 -- 172.21.15.151:0/1985994995 learned_addr learned my addr 172.21.15.151:0/1985994995 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53b05640 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdcdf490 con 0x5649bdb60b90 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcdef50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5649bdcd8da0 tx=0x7f8d44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 -- 172.21.15.151:0/1985994995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44027070 con 0x5649bdb60b90 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 -- 172.21.15.151:0/1985994995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d44019900 con 0x5649bdb60b90 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bdcdf720 con 0x5649bdb60b90 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 -- 172.21.15.151:0/1985994995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44019c20 con 0x5649bdb60b90 2024-09-13T19:06:45.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bdce2400 con 0x5649bdb60b90 2024-09-13T19:06:45.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 -- 172.21.15.151:0/1985994995 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d4402a070 con 0x5649bdb60b90 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c3c034650 0x7f8c3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8c3bfff640 1 -- 172.21.15.151:0/1985994995 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d4401f070 con 0x5649bdb60b90 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.475+0000 7f8d53304640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c3c034650 0x7f8c3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdb60fa0 0x5649bdce5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdce6580 con 0x5649bdb60fa0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d54306640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdb60fa0 0x5649bdce5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53304640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c3c034650 0x7f8c3c036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d480ad000 tx=0x7f8d480a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d54306640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdb60fa0 0x5649bdce5f40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d54306640 1 -- 172.21.15.151:0/1985994995 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdb60fa0 2024-09-13T19:06:45.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdce3620 con 0x5649bdb60fa0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d54306640 1 -- 172.21.15.151:0/1985994995 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdb60fa0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdce88b0 0x5649bdceaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdceb370 con 0x5649bdce88b0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdce88b0 0x5649bdceaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdce88b0 0x5649bdceaca0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53b05640 1 -- 172.21.15.151:0/1985994995 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d44029030 con 0x5649bdce88b0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdce7750 con 0x5649bdb60fa0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d54306640 1 -- 172.21.15.151:0/1985994995 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdb60fa0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649bdcec7b0 0x5649bdceeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdcef330 con 0x5649bdcec7b0 2024-09-13T19:06:45.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53304640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649bdcec7b0 0x5649bdceeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53304640 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649bdcec7b0 0x5649bdceeba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d53304640 1 -- 172.21.15.151:0/1985994995 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d480b3040 con 0x5649bdcec7b0 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.479+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649bdaf1800 con 0x5649bdcfcde0 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57090/0 (socket says 172.21.15.151:57090) 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53b05640 1 -- 172.21.15.151:0/1113782056 learned_addr learned my addr 172.21.15.151:0/1113782056 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53b05640 1 -- 172.21.15.151:0/1113782056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdcfd740 con 0x5649bdcfcde0 2024-09-13T19:06:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d44048460 tx=0x7f8d4400d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 -- 172.21.15.151:0/1113782056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44048bd0 con 0x5649bdcfcde0 2024-09-13T19:06:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 -- 172.21.15.151:0/1113782056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d44048d70 con 0x5649bdcfcde0 2024-09-13T19:06:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bdcfd9d0 con 0x5649bdcfcde0 2024-09-13T19:06:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 -- 172.21.15.151:0/1113782056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d4402a6b0 con 0x5649bdcfcde0 2024-09-13T19:06:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bdd00650 con 0x5649bdcfcde0 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 -- 172.21.15.151:0/1113782056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d44036040 con 0x5649bdcfcde0 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 0x7f8c2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8c397fa640 1 -- 172.21.15.151:0/1113782056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d44014070 con 0x5649bdcfcde0 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53304640 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 0x7f8c2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d55ff5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649bdcd8510 con 0x5649bdd09710 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.483+0000 7f8d53304640 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 0x7f8c2c036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d4801b2c0 tx=0x7f8d48005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57106/0 (socket says 172.21.15.151:57106) 2024-09-13T19:06:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 -- 172.21.15.151:0/2563937298 learned_addr learned my addr 172.21.15.151:0/2563937298 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 -- 172.21.15.151:0/2563937298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdd0a0e0 con 0x5649bdd09710 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- 172.21.15.151:0/2563937298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d44019380 tx=0x7f8d4402ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47eca30ee2141ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8c32ffd640 1 -- 172.21.15.151:0/2563937298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44055040 con 0x5649bdd09710 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8c32ffd640 1 -- 172.21.15.151:0/2563937298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4405f070 con 0x5649bdd09710 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8c32ffd640 1 -- 172.21.15.151:0/2563937298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d4402a850 con 0x5649bdd09710 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- 172.21.15.151:0/2563937298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 msgr2=0x5649bdd09b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/2563937298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8d44019380 tx=0x7f8d4402ae30 comp rx=0 tx=0).stop 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- 172.21.15.151:0/2563937298 shutdown_connections 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/2563937298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd09b10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- 172.21.15.151:0/2563937298 >> 172.21.15.151:0/2563937298 conn(0x5649bdd05af0 msgr2=0x5649bdd03bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- 172.21.15.151:0/2563937298 shutdown_connections 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- 172.21.15.151:0/2563937298 wait complete. 2024-09-13T19:06:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 Processor -- start 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- start start 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d55ff5980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649bdd0a560 con 0x5649bdd09710 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57114/0 (socket says 172.21.15.151:57114) 2024-09-13T19:06:45.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 learned_addr learned my addr 172.21.15.151:0/1357085720 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649bdd10e50 con 0x5649bdd09710 2024-09-13T19:06:45.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.487+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8d44047280 tx=0x7f8d44047180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 -- 172.21.15.151:0/1357085720 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44022410 con 0x5649bdd09710 2024-09-13T19:06:45.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649bdd10e50 con 0x5649bdd09710 2024-09-13T19:06:45.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 -- 172.21.15.151:0/1357085720 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4406a070 con 0x5649bdd09710 2024-09-13T19:06:45.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 -- 172.21.15.151:0/1357085720 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d44021370 con 0x5649bdd09710 2024-09-13T19:06:45.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649bdd11320 con 0x5649bdd09710 2024-09-13T19:06:45.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 -- 172.21.15.151:0/1357085720 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d44016070 con 0x5649bdd09710 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c1c034650 0x7f8c1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8c317fa640 1 -- 172.21.15.151:0/1357085720 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d44005050 con 0x5649bdd09710 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d53304640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c1c034650 0x7f8c1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdd1b960 0x5649bdd1ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1e540 con 0x5649bdd1b960 2024-09-13T19:06:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdd1b960 0x5649bdd1ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d53304640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c1c034650 0x7f8c1c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d48018eb0 tx=0x7f8d480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdd1b960 0x5649bdd1ddf0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 realm 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1e950 con 0x5649bdd1b960 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f1f0 con 0x5649bdd1b960 2024-09-13T19:06:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x5649bdd1b960 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdd202f0 0x5649bdd226e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd22c60 con 0x5649bdd202f0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.491+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdd202f0 0x5649bdd226e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdd202f0 0x5649bdd226e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:45.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d55ff5980 20 searching for the correct realm 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd244c0 con 0x5649bdd202f0 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53b05640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d44066040 0x7f8d44065880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e030 con 0x7f8d44066040 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53304640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d44066040 0x7f8d44065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53304640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d44066040 0x7f8d44065880 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53304640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d480cd040 0x7f8d480ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e030 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d54306640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d480cd040 0x7f8d480ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d54306640 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d480cd040 0x7f8d480ce430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.495+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x5649bdd1b960 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x5649bdd1b960 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x7f8d44066040 2024-09-13T19:06:45.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x5649bdd202f0 2024-09-13T19:06:45.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.499+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d44066040 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.503+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d44066040 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d44066040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd202f0 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d480cd040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x5649bdd1b960 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8d4406e040 con 0x7f8d44066040 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.507+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd1f590 con 0x5649bdd1b960 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd234d0 con 0x5649bdd1b960 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd234a0 con 0x7f8d44066040 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 zone default found 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 4 Realm: () 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 zonegroup default 2024-09-13T19:06:45.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd23df0 con 0x7f8d480cd040 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd259b0 con 0x5649bdd202f0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd25ea0 con 0x5649bdd202f0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 started sync module instance, tier type = 2024-09-13T19:06:45.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd248b0 con 0x7f8d44066040 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94874717275136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd26300 con 0x7f8d44066040 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.511+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd26b50 con 0x5649bdd1b960 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.515+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94874717275136] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.515+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.515+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94874717284000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd26f70 con 0x5649bdd1b960 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.515+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd277c0 con 0x5649bdd202f0 2024-09-13T19:06:45.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.515+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94874717284000] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94874717285328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd275c0 con 0x5649bdd202f0 2024-09-13T19:06:45.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd280e0 con 0x7f8d44066040 2024-09-13T19:06:45.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94874717289392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd28980 con 0x7f8d44066040 2024-09-13T19:06:45.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd293a0 con 0x5649bdd1b960 2024-09-13T19:06:45.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94874717285328] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.519+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94874717289392] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94874717291728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd27030 con 0x5649bdd1b960 2024-09-13T19:06:45.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd29c40 con 0x7f8d480cd040 2024-09-13T19:06:45.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94874717291728] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94874717294224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd29bb0 con 0x7f8d480cd040 2024-09-13T19:06:45.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.523+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2a570 con 0x7f8d480cd040 2024-09-13T19:06:45.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.527+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.527+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94874717298880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2a990 con 0x7f8d480cd040 2024-09-13T19:06:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.527+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2b3e0 con 0x7f8d480cd040 2024-09-13T19:06:45.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.527+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94874717294224] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94874717298880] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94874717302480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2a4e0 con 0x7f8d480cd040 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=0 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=1 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=2 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=3 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=4 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=5 2024-09-13T19:06:45.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=6 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94874717302480] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 20 add_watcher() i=7 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2e4e0 con 0x5649bdd1b960 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.531+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94874717296384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd2b960 con 0x5649bdd1b960 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94874717296384] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 5 note: GC not initialized 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8c08fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:45.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:45.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 Filter name: none 2024-09-13T19:06:45.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8b827fc640 20 reqs_thread_entry: start 2024-09-13T19:06:45.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd51990 con 0x7f8d44066040 2024-09-13T19:06:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd52220 con 0x5649bdd202f0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(63 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd523d0 con 0x7f8d44066040 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd50d30 con 0x5649bdd202f0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(65 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 4.38 4:1ff120aa:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd54d10 con 0x5649bdd1b960 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 4.1d 4:bae4f2e0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd57780 con 0x5649bdd202f0 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 4.30 4:0fd070c2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd5a3a0 con 0x5649bdd202f0 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 4.37 4:ee587ea9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd57780 con 0x7f8d480cd040 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 4.38 4:1fbd4d3b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd5f160 con 0x5649bdd1b960 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 4.36 4:6c04294d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd61e30 con 0x5649bdd1b960 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd646a0 con 0x7f8d480cd040 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 4.3b 4:df1c5111:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd66f90 con 0x5649bdd202f0 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 4.7 4:e3c8d61b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd699a0 con 0x7f8d480cd040 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 4.33 4:cdf112e2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d480cd040 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 4.36 4:6cd87e9b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6f280 con 0x5649bdd1b960 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.535+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(68 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(66 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(70 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(71 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(74 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8c09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94874717296384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x5649bdd1b960 2024-09-13T19:06:45.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94874717296384] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.539+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94874717275136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d44066040 2024-09-13T19:06:45.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94874717275136] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480d8070 con 0x7f8d44066040 2024-09-13T19:06:45.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d55ff5980 20 remove_watcher() i=0 2024-09-13T19:06:45.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d55ff5980 2 removed watcher, disabling cache 2024-09-13T19:06:45.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94874717284000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x5649bdd1b960 2024-09-13T19:06:45.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94874717284000] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d55ff5980 20 remove_watcher() i=1 2024-09-13T19:06:45.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.543+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94874717285328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x5649bdd202f0 2024-09-13T19:06:45.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d53b05640 1 -- 172.21.15.151:0/1357085720 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94874717285328] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d44058040 con 0x5649bdd202f0 2024-09-13T19:06:45.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d55ff5980 20 remove_watcher() i=2 2024-09-13T19:06:45.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94874717289392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d44066040 2024-09-13T19:06:45.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d53304640 1 -- 172.21.15.151:0/1357085720 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94874717289392] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d480f4040 con 0x7f8d44066040 2024-09-13T19:06:45.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d55ff5980 20 remove_watcher() i=3 2024-09-13T19:06:45.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.547+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94874717291728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x5649bdd1b960 2024-09-13T19:06:45.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94874717291728] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x5649bdd1b960 2024-09-13T19:06:45.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d55ff5980 20 remove_watcher() i=4 2024-09-13T19:06:45.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94874717294224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d480cd040 2024-09-13T19:06:45.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94874717294224] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d55ff5980 20 remove_watcher() i=5 2024-09-13T19:06:45.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.551+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94874717298880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d480cd040 2024-09-13T19:06:45.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94874717298880] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d55ff5980 20 remove_watcher() i=6 2024-09-13T19:06:45.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94874717302480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5649bdd6c430 con 0x7f8d480cd040 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94874717302480] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d4c00a4d0 con 0x7f8d480cd040 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d55ff5980 20 remove_watcher() i=7 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.555+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d480cd040 msgr2=0x7f8d480ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d480cd040 0x7f8d480ce430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdd1b960 msgr2=0x5649bdd1ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdd1b960 0x5649bdd1ddf0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d44066040 msgr2=0x7f8d44065880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d44066040 0x7f8d44065880 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdd202f0 msgr2=0x5649bdd226e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdd202f0 0x5649bdd226e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c1c034650 msgr2=0x7f8c1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c1c034650 0x7f8c1c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d48018eb0 tx=0x7f8d480a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 msgr2=0x5649bdd10910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d54306640 1 -- 172.21.15.151:0/1357085720 reap_dead start 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8d44047280 tx=0x7f8d44047180 comp rx=0 tx=0).stop 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 shutdown_connections 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1357085720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdd09710 0x5649bdd10910 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 >> 172.21.15.151:0/1357085720 conn(0x5649bdd05af0 msgr2=0x5649bdd03bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 shutdown_connections 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1357085720 wait complete. 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 msgr2=0x7f8c2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 0x7f8c2c036b10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d4801b2c0 tx=0x7f8d48005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 msgr2=0x5649bdcfd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8d44048460 tx=0x7f8d4400d9e0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 shutdown_connections 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c2c034650 0x7f8c2c036b10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1113782056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdcfcde0 0x5649bdcfd200 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 >> 172.21.15.151:0/1113782056 conn(0x5649bdcf1f30 msgr2=0x5649bdcf49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 shutdown_connections 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1113782056 wait complete. 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdb60fa0 msgr2=0x5649bdce5f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649bdb60fa0 0x5649bdce5f40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649bdcec7b0 msgr2=0x5649bdceeba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649bdcec7b0 0x5649bdceeba0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdce88b0 msgr2=0x5649bdceaca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649bdce88b0 0x5649bdceaca0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c3c034650 msgr2=0x7f8c3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c3c034650 0x7f8c3c036b10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d480ad000 tx=0x7f8d480a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 msgr2=0x5649bdcdef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 --2- 172.21.15.151:0/1985994995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649bdb60b90 0x5649bdcdef50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x5649bdcd8da0 tx=0x7f8d44000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d54306640 1 -- 172.21.15.151:0/1985994995 reap_dead start 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 shutdown_connections 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 >> 172.21.15.151:0/1985994995 conn(0x5649bdbe6170 msgr2=0x5649bdcd2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 shutdown_connections 2024-09-13T19:06:45.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.559+0000 7f8d55ff5980 1 -- 172.21.15.151:0/1985994995 wait complete. 2024-09-13T19:06:45.573 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"ef9ca8b0-9ae4-481e-ba9d-bc0942310d85","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:06:44.219530Z","creation_time":"2024-09-13T19:06:44.212931Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:06:45.573 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:06:44.219530Z', 'creation_time': '2024-09-13T19:06:44.212931Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:06:45.573 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:06:45.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-13T19:06:45.573 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-13T19:06:45.648 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:45.649 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:45.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd6cad980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55572d024c70 0x55572d027060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd6cad980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55572cea6ae0 con 0x55572d0208f0 2024-09-13T19:06:45.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd6cad980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55572cecae30 con 0x55572d024c70 2024-09-13T19:06:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd3fbc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55572d024c70 0x55572d027060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd3fbc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55572d024c70 0x55572d027060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57118/0 (socket says 172.21.15.151:57118) 2024-09-13T19:06:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/2984470894 learned_addr learned my addr 172.21.15.151:0/2984470894 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd47bd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55572d0208f0 0x55572d020cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33560/0 (socket says 172.21.15.151:33560) 2024-09-13T19:06:45.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/2984470894 >> v1:172.21.15.12:6789/0 conn(0x55572d0208f0 legacy=0x55572d020cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.647+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/2984470894 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d0285b0 con 0x55572d024c70 2024-09-13T19:06:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/2984470894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d024c70 0x55572d027060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00a5c0 tx=0x7f7bbc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39774cf8a8e37e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd37bb640 1 -- 172.21.15.151:0/2984470894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bbc0a6070 con 0x55572d024c70 2024-09-13T19:06:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd37bb640 1 -- 172.21.15.151:0/2984470894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bbc0af070 con 0x55572d024c70 2024-09-13T19:06:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd37bb640 1 -- 172.21.15.151:0/2984470894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bbc0aa5c0 con 0x55572d024c70 2024-09-13T19:06:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2984470894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d024c70 msgr2=0x55572d027060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/2984470894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d024c70 0x55572d027060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00a5c0 tx=0x7f7bbc01b340 comp rx=0 tx=0).stop 2024-09-13T19:06:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2984470894 shutdown_connections 2024-09-13T19:06:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/2984470894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d024c70 0x55572d027060 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2984470894 >> 172.21.15.151:0/2984470894 conn(0x55572cf94240 msgr2=0x55572cf94650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2984470894 shutdown_connections 2024-09-13T19:06:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.651+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2984470894 wait complete. 2024-09-13T19:06:45.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd6cad980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd6cad980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55572cecc200 con 0x55572d0208f0 2024-09-13T19:06:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57128/0 (socket says 172.21.15.151:57128) 2024-09-13T19:06:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd47bd640 1 -- 172.21.15.151:0/2524910121 learned_addr learned my addr 172.21.15.151:0/2524910121 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd47bd640 1 -- 172.21.15.151:0/2524910121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d10c210 con 0x55572d0208f0 2024-09-13T19:06:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/2524910121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001690 tx=0x7f7bc4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82ccf0d6aeb30a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7ac260c640 1 -- 172.21.15.151:0/2524910121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4003460 con 0x55572d0208f0 2024-09-13T19:06:45.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7ac260c640 1 -- 172.21.15.151:0/2524910121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4003600 con 0x55572d0208f0 2024-09-13T19:06:45.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.667+0000 7f7ac260c640 1 -- 172.21.15.151:0/2524910121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4003920 con 0x55572d0208f0 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2524910121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 msgr2=0x55572d10bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/2524910121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001690 tx=0x7f7bc4001b50 comp rx=0 tx=0).stop 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2524910121 shutdown_connections 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/2524910121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d10bc40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2524910121 >> 172.21.15.151:0/2524910121 conn(0x55572cf94240 msgr2=0x55572d107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2524910121 shutdown_connections 2024-09-13T19:06:45.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/2524910121 wait complete. 2024-09-13T19:06:45.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55572d0280b0 con 0x55572d0208f0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57140/0 (socket says 172.21.15.151:57140) 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd47bd640 1 -- 172.21.15.151:0/1961148259 learned_addr learned my addr 172.21.15.151:0/1961148259 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd47bd640 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d113490 con 0x55572d0208f0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d112f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001360 tx=0x7f7bc4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7ac0e09640 1 -- 172.21.15.151:0/1961148259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4022020 con 0x55572d0208f0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7ac0e09640 1 -- 172.21.15.151:0/1961148259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4006840 con 0x55572d0208f0 2024-09-13T19:06:45.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55572d113720 con 0x55572d0208f0 2024-09-13T19:06:45.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7ac0e09640 1 -- 172.21.15.151:0/1961148259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc401e800 con 0x55572d0208f0 2024-09-13T19:06:45.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.671+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572d116400 con 0x55572d0208f0 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7ac0e09640 1 -- 172.21.15.151:0/1961148259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7bc4025020 con 0x55572d0208f0 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7ac0e09640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7abc034650 0x7f7abc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7ac0e09640 1 -- 172.21.15.151:0/1961148259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7bc4049c20 con 0x55572d0208f0 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7abc034650 0x7f7abc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d024c70 0x55572d11a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d11a590 con 0x55572d024c70 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d024c70 0x55572d11a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7abc034650 0x7f7abc036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0ae000 tx=0x7f7bbc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d024c70 0x55572d11a050 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/1961148259 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d024c70 2024-09-13T19:06:45.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d117620 con 0x55572d024c70 2024-09-13T19:06:45.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/1961148259 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d024c70 2024-09-13T19:06:45.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d11c8a0 0x55572d11ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d11f360 con 0x55572d11c8a0 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d11c8a0 0x55572d11ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d11c8a0 0x55572d11ec90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd47bd640 1 -- 172.21.15.151:0/1961148259 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7bc401b040 con 0x55572d11c8a0 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d11b710 con 0x55572d024c70 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/1961148259 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d024c70 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55572d1207a0 0x55572d122b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d123300 con 0x55572d1207a0 2024-09-13T19:06:45.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55572d1207a0 0x55572d122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.675+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55572d1207a0 0x55572d122b90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/1961148259 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7bbc0aab50 con 0x55572d1207a0 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55572cf25800 con 0x55572d130d70 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57154/0 (socket says 172.21.15.151:57154) 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3393650248 learned_addr learned my addr 172.21.15.151:0/3393650248 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3393650248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d1316d0 con 0x55572d130d70 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4047f80 tx=0x7f7bc4010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7ab9ffb640 1 -- 172.21.15.151:0/3393650248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40320b0 con 0x55572d130d70 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7ab9ffb640 1 -- 172.21.15.151:0/3393650248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4032250 con 0x55572d130d70 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55572d131900 con 0x55572d130d70 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7ab9ffb640 1 -- 172.21.15.151:0/3393650248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4026860 con 0x55572d130d70 2024-09-13T19:06:45.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572d134580 con 0x55572d130d70 2024-09-13T19:06:45.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.679+0000 7f7ab9ffb640 1 -- 172.21.15.151:0/3393650248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7bc4041210 con 0x55572d130d70 2024-09-13T19:06:45.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7ab9ffb640 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 0x7f7aac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7ab9ffb640 1 -- 172.21.15.151:0/3393650248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7bc4039070 con 0x55572d130d70 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 0x7f7aac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 0x7f7aac036b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c10 tx=0x7f7bbc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55572d10c530 con 0x55572d13d660 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57158/0 (socket says 172.21.15.151:57158) 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3748724491 learned_addr learned my addr 172.21.15.151:0/3748724491 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3748724491 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d13e010 con 0x55572d13d660 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3748724491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4047fb0 tx=0x7f7bc403b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a80333c436a021 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7ab37fe640 1 -- 172.21.15.151:0/3748724491 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4041960 con 0x55572d13d660 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7ab37fe640 1 -- 172.21.15.151:0/3748724491 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc403c400 con 0x55572d13d660 2024-09-13T19:06:45.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7ab37fe640 1 -- 172.21.15.151:0/3748724491 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4041b00 con 0x55572d13d660 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3748724491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 msgr2=0x55572d13da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3748724491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4047fb0 tx=0x7f7bc403b520 comp rx=0 tx=0).stop 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3748724491 shutdown_connections 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3748724491 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d13da40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3748724491 >> 172.21.15.151:0/3748724491 conn(0x55572d139a40 msgr2=0x55572d137b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3748724491 shutdown_connections 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3748724491 wait complete. 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 Processor -- start 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- start start 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd6cad980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55572d13e4b0 con 0x55572d13d660 2024-09-13T19:06:45.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.683+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd47bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57174/0 (socket says 172.21.15.151:57174) 2024-09-13T19:06:45.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 learned_addr learned my addr 172.21.15.151:0/3383684699 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55572d144da0 con 0x55572d13d660 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40498a0 tx=0x7f7bc401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 -- 172.21.15.151:0/3383684699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc406c020 con 0x55572d13d660 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55572d144da0 con 0x55572d13d660 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 -- 172.21.15.151:0/3383684699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc4022e20 con 0x55572d13d660 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 -- 172.21.15.151:0/3383684699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc401d510 con 0x55572d13d660 2024-09-13T19:06:45.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55572d145210 con 0x55572d13d660 2024-09-13T19:06:45.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 -- 172.21.15.151:0/3383684699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7bc406f020 con 0x55572d13d660 2024-09-13T19:06:45.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aa4034650 0x7f7aa4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7ab1ffb640 1 -- 172.21.15.151:0/3383684699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7bc4062050 con 0x55572d13d660 2024-09-13T19:06:45.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aa4034650 0x7f7aa4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d14f910 0x55572d151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d152520 con 0x55572d14f910 2024-09-13T19:06:45.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d14f910 0x55572d151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aa4034650 0x7f7aa4036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0aafd0 tx=0x7f7bbc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d14f910 0x55572d151dd0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 20 realm 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.687+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d152930 con 0x55572d14f910 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:45.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1531d0 con 0x55572d14f910 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d1542d0 0x55572d1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d156c40 con 0x55572d1542d0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d1542d0 0x55572d1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d1542d0 0x55572d1566c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 20 searching for the correct realm 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d1584a0 con 0x55572d1542d0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7bc4071020 0x7f7bc403b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d1584a0 con 0x7f7bc4071020 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7bc4071020 0x7f7bc403b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7bc4071020 0x7f7bc403b980 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd3fbc640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7bbc0e0040 0x7f7bbc0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d1584a0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7bbc0e0040 0x7f7bbc0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.691+0000 7f7bd4fbe640 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7bbc0e0040 0x7f7bbc0e0930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bc4071020 2024-09-13T19:06:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.695+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bc4071020 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.699+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bc4071020 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bc4071020 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d1542d0 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.703+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bbc0e0040 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x55572d14f910 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55572d153570 con 0x7f7bc4071020 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d157590 con 0x55572d14f910 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1571d0 con 0x55572d14f910 2024-09-13T19:06:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1571a0 con 0x7f7bc4071020 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 zone default found 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 4 Realm: () 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 zonegroup default 2024-09-13T19:06:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1583b0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d15a330 con 0x55572d1542d0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d15a6d0 con 0x55572d1542d0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 started sync module instance, tier type = 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.707+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d1597d0 con 0x7f7bc4071020 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93832906906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159430 con 0x7f7bc4071020 2024-09-13T19:06:45.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15b590 con 0x55572d14f910 2024-09-13T19:06:45.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93832906906560] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93832906911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15b500 con 0x55572d14f910 2024-09-13T19:06:45.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.711+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15c310 con 0x55572d1542d0 2024-09-13T19:06:45.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93832906911968] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93832906914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15c700 con 0x55572d1542d0 2024-09-13T19:06:45.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15d0c0 con 0x7f7bc4071020 2024-09-13T19:06:45.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93832906918928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15d910 con 0x7f7bc4071020 2024-09-13T19:06:45.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.715+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15e330 con 0x55572d14f910 2024-09-13T19:06:45.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93832906914224] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93832906918928] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93832906923552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15d460 con 0x55572d14f910 2024-09-13T19:06:45.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15ebd0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93832906923552] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.719+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93832906915280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15d460 con 0x7f7bbc0e0040 2024-09-13T19:06:45.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.723+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15f040 con 0x7f7bbc0e0040 2024-09-13T19:06:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.723+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93832906915280] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.723+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.723+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93832906926896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15f000 con 0x7f7bbc0e0040 2024-09-13T19:06:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.723+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15fa00 con 0x7f7bbc0e0040 2024-09-13T19:06:45.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93832906929424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15fe20 con 0x7f7bbc0e0040 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=0 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=1 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=2 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=3 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=4 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=5 2024-09-13T19:06:45.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93832906926896] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=6 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93832906929424] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 20 add_watcher() i=7 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d15e510 con 0x55572d14f910 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.727+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93832906925328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d160330 con 0x55572d14f910 2024-09-13T19:06:45.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93832906925328] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7a8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:45.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 5 note: GC not initialized 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7a897e2640 20 reqs_thread_entry: start 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 Filter name: none 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f79faffd640 20 reqs_thread_entry: start 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d186070 con 0x55572d14f910 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1875c0 con 0x7f7bc4071020 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv16 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1875c0 con 0x55572d1542d0 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 4.38 4:1ff120aa:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d188ce0 con 0x55572d14f910 2024-09-13T19:06:45.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 4.1d 4:bae4f2e0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d18b8f0 con 0x55572d1542d0 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 4.30 4:0fd070c2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d18e650 con 0x55572d1542d0 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 4.37 4:ee587ea9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d18b8f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 4.38 4:1fbd4d3b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d193510 con 0x55572d14f910 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 4.36 4:6c04294d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d196160 con 0x55572d14f910 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d198d70 con 0x7f7bbc0e0040 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:72 4.3b 4:df1c5111:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d19b660 con 0x55572d1542d0 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 4.7 4:e3c8d61b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d19ded0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 4.33 4:cdf112e2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1a0740 con 0x7f7bbc0e0040 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 4.36 4:6cd87e9b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d1a3330 con 0x55572d14f910 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(69 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(70 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5 [call out=124b] v0'0 uv4 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.731+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(72 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(68 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(75 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(74 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(71 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d184fc0 con 0x7f7bc4071020 2024-09-13T19:06:45.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(76 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.735+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d184fc0 con 0x7f7bc4071020 2024-09-13T19:06:45.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(77 foo.buckets [call] v32'18 uv18 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd6cad980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d184fc0 con 0x55572d14f910 2024-09-13T19:06:45.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd6cad980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:45.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55572d184fc0 con 0x7f7bc4071020 2024-09-13T19:06:45.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv18 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7a8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.739+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93832906925328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d184fc0 con 0x55572d14f910 2024-09-13T19:06:45.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93832906925328] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93832906906560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15e510 con 0x7f7bc4071020 2024-09-13T19:06:45.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93832906906560] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 20 remove_watcher() i=0 2024-09-13T19:06:45.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 2 removed watcher, disabling cache 2024-09-13T19:06:45.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93832906911968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159bc0 con 0x55572d14f910 2024-09-13T19:06:45.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93832906911968] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 20 remove_watcher() i=1 2024-09-13T19:06:45.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.743+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93832906914224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159bc0 con 0x55572d1542d0 2024-09-13T19:06:45.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd47bd640 1 -- 172.21.15.151:0/3383684699 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93832906914224] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc4050070 con 0x55572d1542d0 2024-09-13T19:06:45.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd6cad980 20 remove_watcher() i=2 2024-09-13T19:06:45.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93832906918928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159bc0 con 0x7f7bc4071020 2024-09-13T19:06:45.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd3fbc640 1 -- 172.21.15.151:0/3383684699 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93832906918928] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bbc0aab50 con 0x7f7bc4071020 2024-09-13T19:06:45.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd6cad980 20 remove_watcher() i=3 2024-09-13T19:06:45.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.747+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93832906923552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159bc0 con 0x55572d14f910 2024-09-13T19:06:45.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.751+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93832906923552] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x55572d14f910 2024-09-13T19:06:45.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.751+0000 7f7bd6cad980 20 remove_watcher() i=4 2024-09-13T19:06:45.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.751+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93832906915280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15de20 con 0x7f7bbc0e0040 2024-09-13T19:06:45.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93832906915280] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd6cad980 20 remove_watcher() i=5 2024-09-13T19:06:45.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93832906926896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d159bc0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93832906926896] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd6cad980 20 remove_watcher() i=6 2024-09-13T19:06:45.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.755+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93832906929424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55572d15de20 con 0x7f7bbc0e0040 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93832906929424] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x7f7bbc0e0040 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 20 remove_watcher() i=7 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7bbc0e0040 msgr2=0x7f7bbc0e0930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7bbc0e0040 0x7f7bbc0e0930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d14f910 msgr2=0x55572d151dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d14f910 0x55572d151dd0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7bc4071020 msgr2=0x7f7bc403b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7bc4071020 0x7f7bc403b980 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d1542d0 msgr2=0x55572d1566c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d1542d0 0x55572d1566c0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aa4034650 msgr2=0x7f7aa4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aa4034650 0x7f7aa4036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0aafd0 tx=0x7f7bbc0c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 msgr2=0x55572d144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40498a0 tx=0x7f7bc401cbd0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/3383684699 reap_dead start 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 shutdown_connections 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3383684699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d13d660 0x55572d144860 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 >> 172.21.15.151:0/3383684699 conn(0x55572d139a40 msgr2=0x55572d137b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 shutdown_connections 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3383684699 wait complete. 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 msgr2=0x7f7aac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 0x7f7aac036b60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc000c10 tx=0x7f7bbc005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 msgr2=0x55572d131190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4047f80 tx=0x7f7bc4010ed0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 shutdown_connections 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7aac0346a0 0x7f7aac036b60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/3393650248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d130d70 0x55572d131190 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 >> 172.21.15.151:0/3393650248 conn(0x55572d125ec0 msgr2=0x55572d128940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 shutdown_connections 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/3393650248 wait complete. 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d024c70 msgr2=0x55572d11a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55572d024c70 0x55572d11a050 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55572d1207a0 msgr2=0x55572d122b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55572d1207a0 0x55572d122b90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d11c8a0 msgr2=0x55572d11ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55572d11c8a0 0x55572d11ec90 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7abc034650 msgr2=0x7f7abc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7abc034650 0x7f7abc036b10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0ae000 tx=0x7f7bbc0a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 msgr2=0x55572d112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 --2- 172.21.15.151:0/1961148259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55572d0208f0 0x55572d112f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4001360 tx=0x7f7bc4001260 comp rx=0 tx=0).stop 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd4fbe640 1 -- 172.21.15.151:0/1961148259 reap_dead start 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 shutdown_connections 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 >> 172.21.15.151:0/1961148259 conn(0x55572cf94240 msgr2=0x55572d1063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 shutdown_connections 2024-09-13T19:06:45.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.759+0000 7f7bd6cad980 1 -- 172.21.15.151:0/1961148259 wait complete. 2024-09-13T19:06:45.774 INFO:teuthology.orchestra.run.smithi151.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-13T19:06:45.739334Z","last_stats_update":"2024-09-13T19:06:45.736909Z"} 2024-09-13T19:06:45.774 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-13T19:06:45.739334Z', 'last_stats_update': '2024-09-13T19:06:45.736909Z'} 2024-09-13T19:06:45.781 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:45.781 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:06:45.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-13T19:06:45.782 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-13T19:06:45.849 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:45.849 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7d01a54980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556397c3dc70 0x556397c40060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7d01a54980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556397abfae0 con 0x556397c398f0 2024-09-13T19:06:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7d01a54980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x556397ae3e30 con 0x556397c3dc70 2024-09-13T19:06:45.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7cfed63640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556397c3dc70 0x556397c40060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7cff564640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x556397c398f0 0x556397c39cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33568/0 (socket says 172.21.15.151:33568) 2024-09-13T19:06:45.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7cff564640 1 -- 172.21.15.151:0/1008229850 learned_addr learned my addr 172.21.15.151:0/1008229850 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:45.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7cfed63640 1 -- 172.21.15.151:0/1008229850 >> v1:172.21.15.12:6789/0 conn(0x556397c398f0 legacy=0x556397c39cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.847+0000 7f7cfed63640 1 -- 172.21.15.151:0/1008229850 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397c415b0 con 0x556397c3dc70 2024-09-13T19:06:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1008229850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c3dc70 0x556397c40060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a480 tx=0x7f7cf401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1850ae7450c0ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7cfe562640 1 -- 172.21.15.151:0/1008229850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf40b0070 con 0x556397c3dc70 2024-09-13T19:06:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7cfe562640 1 -- 172.21.15.151:0/1008229850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf40ab540 con 0x556397c3dc70 2024-09-13T19:06:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7cfe562640 1 -- 172.21.15.151:0/1008229850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf40ab840 con 0x556397c3dc70 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 -- 172.21.15.151:0/1008229850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c3dc70 msgr2=0x556397c40060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1008229850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c3dc70 0x556397c40060 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400a480 tx=0x7f7cf401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 -- 172.21.15.151:0/1008229850 shutdown_connections 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1008229850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c3dc70 0x556397c40060 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 -- 172.21.15.151:0/1008229850 >> 172.21.15.151:0/1008229850 conn(0x556397bad240 msgr2=0x556397bad650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 -- 172.21.15.151:0/1008229850 shutdown_connections 2024-09-13T19:06:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.851+0000 7f7d01a54980 1 -- 172.21.15.151:0/1008229850 wait complete. 2024-09-13T19:06:45.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7d01a54980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7d01a54980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556397ae5200 con 0x556397c398f0 2024-09-13T19:06:45.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57196/0 (socket says 172.21.15.151:57196) 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7cff564640 1 -- 172.21.15.151:0/691103602 learned_addr learned my addr 172.21.15.151:0/691103602 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.867+0000 7f7cff564640 1 -- 172.21.15.151:0/691103602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397d25390 con 0x556397c398f0 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 --2- 172.21.15.151:0/691103602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001d90 tx=0x7f7cf0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22a3c079cf0fb34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bed60a640 1 -- 172.21.15.151:0/691103602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0013030 con 0x556397c398f0 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bed60a640 1 -- 172.21.15.151:0/691103602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf000e690 con 0x556397c398f0 2024-09-13T19:06:45.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bed60a640 1 -- 172.21.15.151:0/691103602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf000ea10 con 0x556397c398f0 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/691103602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 msgr2=0x556397d24dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 --2- 172.21.15.151:0/691103602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0001d90 tx=0x7f7cf0001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/691103602 shutdown_connections 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 --2- 172.21.15.151:0/691103602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d24dc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/691103602 >> 172.21.15.151:0/691103602 conn(0x556397bad240 msgr2=0x556397d20950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/691103602 shutdown_connections 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/691103602 wait complete. 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d2c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556397c410b0 con 0x556397c398f0 2024-09-13T19:06:45.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d2c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d2c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57202/0 (socket says 172.21.15.151:57202) 2024-09-13T19:06:45.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 -- 172.21.15.151:0/651342085 learned_addr learned my addr 172.21.15.151:0/651342085 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397d2c690 con 0x556397c398f0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7cff564640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d2c150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x556397d25fa0 tx=0x7f7cf0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bebe07640 1 -- 172.21.15.151:0/651342085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0027070 con 0x556397c398f0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556397d2c920 con 0x556397c398f0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bebe07640 1 -- 172.21.15.151:0/651342085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf0019900 con 0x556397c398f0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7bebe07640 1 -- 172.21.15.151:0/651342085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0019c20 con 0x556397c398f0 2024-09-13T19:06:45.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.871+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556397d2f600 con 0x556397c398f0 2024-09-13T19:06:45.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7bebe07640 1 -- 172.21.15.151:0/651342085 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7cf002a070 con 0x556397c398f0 2024-09-13T19:06:45.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7bebe07640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7be4034650 0x7f7be4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7bebe07640 1 -- 172.21.15.151:0/651342085 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf001f070 con 0x556397c398f0 2024-09-13T19:06:45.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cfed63640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7be4034650 0x7f7be4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d31240 0x556397d33630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d33bb0 con 0x556397d31240 2024-09-13T19:06:45.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cffd65640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d31240 0x556397d33630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cfed63640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7be4034650 0x7f7be4036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40ad000 tx=0x7f7cf40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cffd65640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d31240 0x556397d33630 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cffd65640 1 -- 172.21.15.151:0/651342085 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d31240 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d30820 con 0x556397d31240 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cffd65640 1 -- 172.21.15.151:0/651342085 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d31240 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d35ee0 0x556397d382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d389a0 con 0x556397d35ee0 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cff564640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d35ee0 0x556397d382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cff564640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d35ee0 0x556397d382d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cff564640 1 -- 172.21.15.151:0/651342085 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d35ee0 2024-09-13T19:06:45.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d34d80 con 0x556397d31240 2024-09-13T19:06:45.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cffd65640 1 -- 172.21.15.151:0/651342085 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d31240 2024-09-13T19:06:45.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556397d39e00 0x556397d3c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d3c8f0 con 0x556397d39e00 2024-09-13T19:06:45.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.875+0000 7f7cfed63640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556397d39e00 0x556397d3c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cfed63640 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556397d39e00 0x556397d3c1f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cfed63640 1 -- 172.21.15.151:0/651342085 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7cf40abc90 con 0x556397d39e00 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556397b3e800 con 0x556397d4a3c0 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57208/0 (socket says 172.21.15.151:57208) 2024-09-13T19:06:45.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cff564640 1 -- 172.21.15.151:0/2518441121 learned_addr learned my addr 172.21.15.151:0/2518441121 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cff564640 1 -- 172.21.15.151:0/2518441121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397d4ad20 con 0x556397d4a3c0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7cff564640 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0048460 tx=0x7f7cf0041e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7be9602640 1 -- 172.21.15.151:0/2518441121 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00169c0 con 0x556397d4a3c0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7be9602640 1 -- 172.21.15.151:0/2518441121 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf00487d0 con 0x556397d4a3c0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556397d4afb0 con 0x556397d4a3c0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7be9602640 1 -- 172.21.15.151:0/2518441121 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0048ab0 con 0x556397d4a3c0 2024-09-13T19:06:45.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556397d4dc30 con 0x556397d4a3c0 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.879+0000 7f7be9602640 1 -- 172.21.15.151:0/2518441121 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7cf0016070 con 0x556397d4a3c0 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7be9602640 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 0x7f7bd8036d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7be9602640 1 -- 172.21.15.151:0/2518441121 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf0014070 con 0x556397d4a3c0 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cfed63640 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 0x7f7bd8036d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cfed63640 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 0x7f7bd8036d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556397d34490 tx=0x7f7cf4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556397d25710 con 0x556397d56d70 2024-09-13T19:06:45.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57220/0 (socket says 172.21.15.151:57220) 2024-09-13T19:06:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cff564640 1 -- 172.21.15.151:0/228433076 learned_addr learned my addr 172.21.15.151:0/228433076 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cff564640 1 -- 172.21.15.151:0/228433076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397d57740 con 0x556397d56d70 2024-09-13T19:06:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7cff564640 1 --2- 172.21.15.151:0/228433076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0029fd0 tx=0x7f7cf002a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8367f73c32829a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7be2ffd640 1 -- 172.21.15.151:0/228433076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0048c50 con 0x556397d56d70 2024-09-13T19:06:45.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7be2ffd640 1 -- 172.21.15.151:0/228433076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf0048df0 con 0x556397d56d70 2024-09-13T19:06:45.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7be2ffd640 1 -- 172.21.15.151:0/228433076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00214c0 con 0x556397d56d70 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- 172.21.15.151:0/228433076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 msgr2=0x556397d57170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 --2- 172.21.15.151:0/228433076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0029fd0 tx=0x7f7cf002a850 comp rx=0 tx=0).stop 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- 172.21.15.151:0/228433076 shutdown_connections 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 --2- 172.21.15.151:0/228433076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d57170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- 172.21.15.151:0/228433076 >> 172.21.15.151:0/228433076 conn(0x556397d530a0 msgr2=0x556397d511a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- 172.21.15.151:0/228433076 shutdown_connections 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- 172.21.15.151:0/228433076 wait complete. 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 Processor -- start 2024-09-13T19:06:45.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- start start 2024-09-13T19:06:45.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.883+0000 7f7d01a54980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556397d57c30 con 0x556397d56d70 2024-09-13T19:06:45.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cff564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57236/0 (socket says 172.21.15.151:57236) 2024-09-13T19:06:45.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 learned_addr learned my addr 172.21.15.151:0/1030302254 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556397d5e3a0 con 0x556397d56d70 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cff564640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7cf002cfd0 tx=0x7f7cf002ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 -- 172.21.15.151:0/1030302254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf002aaa0 con 0x556397d56d70 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 -- 172.21.15.151:0/1030302254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf000c9b0 con 0x556397d56d70 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556397d5e3a0 con 0x556397d56d70 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 -- 172.21.15.151:0/1030302254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cf0021c10 con 0x556397d56d70 2024-09-13T19:06:45.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556397d5e3a0 con 0x556397d56d70 2024-09-13T19:06:45.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 -- 172.21.15.151:0/1030302254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7cf0061030 con 0x556397d56d70 2024-09-13T19:06:45.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bc80346a0 0x7f7bc8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7be17fa640 1 -- 172.21.15.151:0/1030302254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7cf005f020 con 0x556397d56d70 2024-09-13T19:06:45.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.887+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bc80346a0 0x7f7bc8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d68f20 0x556397d6b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d6bb30 con 0x556397d68f20 2024-09-13T19:06:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bc80346a0 0x7f7bc8036b60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40c2010 tx=0x7f7cf40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d68f20 0x556397d6b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d68f20 0x556397d6b3e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 realm 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d6bf40 con 0x556397d68f20 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d6c810 con 0x556397d68f20 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d6d910 0x556397d6fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d70310 con 0x556397d6d910 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d6d910 0x556397d6fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d6d910 0x556397d6fd00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 20 searching for the correct realm 2024-09-13T19:06:45.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d71be0 con 0x556397d6d910 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7cf002c060 0x7f7cf0066920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d71be0 con 0x7f7cf002c060 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7cf002c060 0x7f7cf0066920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7cf002c060 0x7f7cf0066920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7cf40ce040 0x7f7cf40db920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:45.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.891+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d71be0 con 0x7f7cf40ce040 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7cf40ce040 0x7f7cf40db920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7cf40ce040 0x7f7cf40db920 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf002c060 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.895+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf002c060 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.899+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf002c060 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.903+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf002c060 2024-09-13T19:06:45.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d6d910 2024-09-13T19:06:45.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x556397d68f20 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556397d6cbb0 con 0x7f7cf002c060 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:45.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d70d00 con 0x556397d68f20 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d70940 con 0x556397d68f20 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d71620 con 0x7f7cf002c060 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:45.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 zone default found 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 4 Realm: () 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 zonegroup default 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d72010 con 0x7f7cf40ce040 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.907+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d739f0 con 0x556397d6d910 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d73e70 con 0x556397d6d910 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 20 started sync module instance, tier type = 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d72e90 con 0x7f7cf002c060 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93886237583840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d742d0 con 0x7f7cf002c060 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d74b20 con 0x556397d68f20 2024-09-13T19:06:45.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.911+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93886237583840] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93886237591152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d74f40 con 0x556397d68f20 2024-09-13T19:06:45.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d75790 con 0x556397d6d910 2024-09-13T19:06:45.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93886237591152] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93886237592480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d755f0 con 0x556397d6d910 2024-09-13T19:06:45.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.915+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d761a0 con 0x7f7cf002c060 2024-09-13T19:06:45.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93886237596912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d76a40 con 0x7f7cf002c060 2024-09-13T19:06:45.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d77400 con 0x556397d68f20 2024-09-13T19:06:45.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93886237592480] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93886237596912] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93886237593728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d77400 con 0x556397d68f20 2024-09-13T19:06:45.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.919+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d77ca0 con 0x7f7cf40ce040 2024-09-13T19:06:45.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93886237593728] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93886237601888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d779b0 con 0x7f7cf40ce040 2024-09-13T19:06:45.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d784d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93886237601888] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93886237605792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d78490 con 0x7f7cf40ce040 2024-09-13T19:06:45.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.923+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d78eb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93886237605792] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93886237608352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d79320 con 0x7f7cf40ce040 2024-09-13T19:06:45.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=0 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=1 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=2 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=3 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=4 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=5 2024-09-13T19:06:45.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.927+0000 7f7d01a54980 20 add_watcher() i=6 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93886237608352] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 add_watcher() i=7 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d79320 con 0x556397d68f20 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93886237609584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d79290 con 0x556397d68f20 2024-09-13T19:06:45.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93886237609584] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7bb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 5 note: GC not initialized 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7bb4fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 Filter name: none 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7b2e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397d9f970 con 0x556397d68f20 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.931+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397da1a50 con 0x7f7cf002c060 2024-09-13T19:06:45.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:45.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397da32d0 con 0x556397d6d910 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:45.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da6540 con 0x7f7cf002c060 2024-09-13T19:06:45.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:06:45.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 20 rados->read ofs=0 len=0 2024-09-13T19:06:45.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397da5680 con 0x7f7cf002c060 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:45.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.935+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da6200 con 0x7f7cf002c060 2024-09-13T19:06:45.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7d01a54980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:06:45.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7d01a54980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:45.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7d01a54980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:45.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93886237793424 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556397da7de0 con 0x7f7cf40ce040 2024-09-13T19:06:45.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== watch-notify(notify (1) cookie 93886237605792 notify 137438953474 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f7cf802d040 con 0x7f7cf40ce040 2024-09-13T19:06:45.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(68 notify.6 [notify cookie 93886237793424 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7be2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93886237605792 notifier 4477 bl.length()=338 2024-09-13T19:06:45.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7be2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:06:45.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7be2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:45.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.939+0000 7f7be2ffd640 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7bc4003eb0 con 0x7f7cf40ce040 2024-09-13T19:06:45.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify_complete (2) cookie 93886237793424 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7cf801e040 con 0x7f7cf40ce040 2024-09-13T19:06:45.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7bb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:45.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93886237609584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397d9d7a0 con 0x556397d68f20 2024-09-13T19:06:45.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93886237609584] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93886237583840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x7f7cf002c060 2024-09-13T19:06:45.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93886237583840] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7d01a54980 20 remove_watcher() i=0 2024-09-13T19:06:45.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7d01a54980 2 removed watcher, disabling cache 2024-09-13T19:06:45.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.943+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93886237591152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x556397d68f20 2024-09-13T19:06:45.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.947+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93886237591152] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.947+0000 7f7d01a54980 20 remove_watcher() i=1 2024-09-13T19:06:45.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.947+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93886237592480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x556397d6d910 2024-09-13T19:06:45.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7cff564640 1 -- 172.21.15.151:0/1030302254 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93886237592480] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf0029030 con 0x556397d6d910 2024-09-13T19:06:45.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7d01a54980 20 remove_watcher() i=2 2024-09-13T19:06:45.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93886237596912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x7f7cf002c060 2024-09-13T19:06:45.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7cfed63640 1 -- 172.21.15.151:0/1030302254 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93886237596912] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf40d9070 con 0x7f7cf002c060 2024-09-13T19:06:45.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7d01a54980 20 remove_watcher() i=3 2024-09-13T19:06:45.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.951+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93886237593728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x556397d68f20 2024-09-13T19:06:45.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93886237593728] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x556397d68f20 2024-09-13T19:06:45.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7d01a54980 20 remove_watcher() i=4 2024-09-13T19:06:45.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93886237601888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x7f7cf40ce040 2024-09-13T19:06:45.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93886237601888] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7d01a54980 20 remove_watcher() i=5 2024-09-13T19:06:45.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.955+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93886237605792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x7f7cf40ce040 2024-09-13T19:06:45.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93886237605792] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 20 remove_watcher() i=6 2024-09-13T19:06:45.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93886237608352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556397da61b0 con 0x7f7cf40ce040 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93886237608352] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7cf800a4d0 con 0x7f7cf40ce040 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 20 remove_watcher() i=7 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7cf40ce040 msgr2=0x7f7cf40db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7cf40ce040 0x7f7cf40db920 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d68f20 msgr2=0x556397d6b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d68f20 0x556397d6b3e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7cf002c060 msgr2=0x7f7cf0066920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7cf002c060 0x7f7cf0066920 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d6d910 msgr2=0x556397d6fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d6d910 0x556397d6fd00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bc80346a0 msgr2=0x7f7bc8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bc80346a0 0x7f7bc8036b60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40c2010 tx=0x7f7cf40a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7cffd65640 1 -- 172.21.15.151:0/1030302254 reap_dead start 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 msgr2=0x556397d5de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7cf002cfd0 tx=0x7f7cf002ff40 comp rx=0 tx=0).stop 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 shutdown_connections 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/1030302254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d56d70 0x556397d5de60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 >> 172.21.15.151:0/1030302254 conn(0x556397d530a0 msgr2=0x556397d51170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 shutdown_connections 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/1030302254 wait complete. 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 msgr2=0x7f7bd8036d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 0x7f7bd8036d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x556397d34490 tx=0x7f7cf4005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 msgr2=0x556397d4a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0048460 tx=0x7f7cf0041e60 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 shutdown_connections 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7bd8034840 0x7f7bd8036d00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 --2- 172.21.15.151:0/2518441121 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397d4a3c0 0x556397d4a7e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.959+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 >> 172.21.15.151:0/2518441121 conn(0x556397d3f510 msgr2=0x556397d41f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 shutdown_connections 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/2518441121 wait complete. 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d31240 msgr2=0x556397d33630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556397d31240 0x556397d33630 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556397d39e00 msgr2=0x556397d3c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556397d39e00 0x556397d3c1f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d35ee0 msgr2=0x556397d382d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556397d35ee0 0x556397d382d0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7be4034650 msgr2=0x7f7be4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7be4034650 0x7f7be4036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40ad000 tx=0x7f7cf40a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 msgr2=0x556397d2c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 --2- 172.21.15.151:0/651342085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556397c398f0 0x556397d2c150 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x556397d25fa0 tx=0x7f7cf0000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7cffd65640 1 -- 172.21.15.151:0/651342085 reap_dead start 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 shutdown_connections 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 >> 172.21.15.151:0/651342085 conn(0x556397bad240 msgr2=0x556397d1f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 shutdown_connections 2024-09-13T19:06:45.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:45.963+0000 7f7d01a54980 1 -- 172.21.15.151:0/651342085 wait complete. 2024-09-13T19:06:45.975 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:06:45.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:06:45.976 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:06:46.062 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:46.062 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.059+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.059+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.059+0000 7fa928600980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556277b2abd0 0x556277b29390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.059+0000 7fa928600980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556277a3cae0 con 0x556277b2afe0 2024-09-13T19:06:46.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.059+0000 7fa928600980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x556277a60e30 con 0x556277b2abd0 2024-09-13T19:06:46.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa926110640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556277b2abd0 0x556277b29390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa92590f640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x556277b2afe0 0x556277b298d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33582/0 (socket says 172.21.15.151:33582) 2024-09-13T19:06:46.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa926110640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556277b2abd0 0x556277b29390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57242/0 (socket says 172.21.15.151:57242) 2024-09-13T19:06:46.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa92590f640 1 -- 172.21.15.151:0/4015898529 learned_addr learned my addr 172.21.15.151:0/4015898529 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:46.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa926110640 1 -- 172.21.15.151:0/4015898529 >> v1:172.21.15.12:6789/0 conn(0x556277b2afe0 legacy=0x556277b298d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa926110640 1 -- 172.21.15.151:0/4015898529 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277b2a100 con 0x556277b2abd0 2024-09-13T19:06:46.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa926110640 1 --2- 172.21.15.151:0/4015898529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277b29390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa91800a420 tx=0x7fa91801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef994c8ab483e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa92510e640 1 -- 172.21.15.151:0/4015898529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180b0070 con 0x556277b2abd0 2024-09-13T19:06:46.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa92510e640 1 -- 172.21.15.151:0/4015898529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180a3b00 con 0x556277b2abd0 2024-09-13T19:06:46.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.063+0000 7fa92510e640 1 -- 172.21.15.151:0/4015898529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180a3e20 con 0x556277b2abd0 2024-09-13T19:06:46.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 -- 172.21.15.151:0/4015898529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 msgr2=0x556277b29390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 --2- 172.21.15.151:0/4015898529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277b29390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa91800a420 tx=0x7fa91801ac80 comp rx=0 tx=0).stop 2024-09-13T19:06:46.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 -- 172.21.15.151:0/4015898529 shutdown_connections 2024-09-13T19:06:46.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 --2- 172.21.15.151:0/4015898529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277b29390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 -- 172.21.15.151:0/4015898529 >> 172.21.15.151:0/4015898529 conn(0x556277bb01b0 msgr2=0x556277bb25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 -- 172.21.15.151:0/4015898529 shutdown_connections 2024-09-13T19:06:46.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.067+0000 7fa928600980 1 -- 172.21.15.151:0/4015898529 wait complete. 2024-09-13T19:06:46.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.079+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.079+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.079+0000 7fa928600980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.079+0000 7fa928600980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556277a62200 con 0x556277b2abd0 2024-09-13T19:06:46.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57256/0 (socket says 172.21.15.151:57256) 2024-09-13T19:06:46.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 -- 172.21.15.151:0/754951682 learned_addr learned my addr 172.21.15.151:0/754951682 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 -- 172.21.15.151:0/754951682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277ca6a50 con 0x556277b2abd0 2024-09-13T19:06:46.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 --2- 172.21.15.151:0/754951682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9180188b0 tx=0x7fa9180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfee9fb9b6b97de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa814608640 1 -- 172.21.15.151:0/754951682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180b0040 con 0x556277b2abd0 2024-09-13T19:06:46.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa814608640 1 -- 172.21.15.151:0/754951682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180ab440 con 0x556277b2abd0 2024-09-13T19:06:46.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa814608640 1 -- 172.21.15.151:0/754951682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180ab740 con 0x556277b2abd0 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- 172.21.15.151:0/754951682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 msgr2=0x556277ca6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 --2- 172.21.15.151:0/754951682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9180188b0 tx=0x7fa9180033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- 172.21.15.151:0/754951682 shutdown_connections 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 --2- 172.21.15.151:0/754951682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277ca6480 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- 172.21.15.151:0/754951682 >> 172.21.15.151:0/754951682 conn(0x556277bb01b0 msgr2=0x556277ca20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- 172.21.15.151:0/754951682 shutdown_connections 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- 172.21.15.151:0/754951682 wait complete. 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277cad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa928600980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556277bc49f0 con 0x556277b2abd0 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277cad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277cad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57270/0 (socket says 172.21.15.151:57270) 2024-09-13T19:06:46.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 -- 172.21.15.151:0/1135140029 learned_addr learned my addr 172.21.15.151:0/1135140029 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.083+0000 7fa926110640 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277cadcf0 con 0x556277b2abd0 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926110640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277cad7b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa918005c00 tx=0x7fa918017a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 -- 172.21.15.151:0/1135140029 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180b8040 con 0x556277b2abd0 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 -- 172.21.15.151:0/1135140029 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180be430 con 0x556277b2abd0 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556277cadf80 con 0x556277b2abd0 2024-09-13T19:06:46.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 -- 172.21.15.151:0/1135140029 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180b0040 con 0x556277b2abd0 2024-09-13T19:06:46.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556277cb0c60 con 0x556277b2abd0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 -- 172.21.15.151:0/1135140029 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9180be820 con 0x556277b2abd0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa80c034650 0x7fa80c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa812e05640 1 -- 172.21.15.151:0/1135140029 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa9180e3910 con 0x556277b2abd0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa92590f640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa80c034650 0x7fa80c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277b2afe0 0x556277cb48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cb4df0 con 0x556277b2afe0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926911640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277b2afe0 0x556277cb48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa92590f640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa80c034650 0x7fa80c036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b330 tx=0x7fa910001510 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926911640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277b2afe0 0x556277cb48b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926911640 1 -- 172.21.15.151:0/1135140029 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277b2afe0 2024-09-13T19:06:46.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cb1e60 con 0x556277b2afe0 2024-09-13T19:06:46.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926911640 1 -- 172.21.15.151:0/1135140029 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9200083f0 con 0x556277b2afe0 2024-09-13T19:06:46.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277cb70c0 0x556277cb94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cb9b80 con 0x556277cb70c0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.087+0000 7fa926110640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277cb70c0 0x556277cb94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277cb70c0 0x556277cb94b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 -- 172.21.15.151:0/1135140029 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9180b4930 con 0x556277cb70c0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cb5f60 con 0x556277b2afe0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926911640 1 -- 172.21.15.151:0/1135140029 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9200083f0 con 0x556277b2afe0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556277cbafc0 0x556277cbd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cbdb40 con 0x556277cbafc0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa92590f640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556277cbafc0 0x556277cbd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa92590f640 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556277cbafc0 0x556277cbd3b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa92590f640 1 -- 172.21.15.151:0/1135140029 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa91000f800 con 0x556277cbafc0 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa928600980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556277abb800 con 0x556277ccb5d0 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57280/0 (socket says 172.21.15.151:57280) 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 -- 172.21.15.151:0/3850376205 learned_addr learned my addr 172.21.15.151:0/3850376205 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 -- 172.21.15.151:0/3850376205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277ccbf30 con 0x556277ccb5d0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.091+0000 7fa926110640 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9180e1f60 tx=0x7fa9180bbf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 -- 172.21.15.151:0/3850376205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180bee40 con 0x556277ccb5d0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 -- 172.21.15.151:0/3850376205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180b36f0 con 0x556277ccb5d0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556277ccc1c0 con 0x556277ccb5d0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 -- 172.21.15.151:0/3850376205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180b39d0 con 0x556277ccb5d0 2024-09-13T19:06:46.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556277ccc1c0 con 0x556277ccb5d0 2024-09-13T19:06:46.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 -- 172.21.15.151:0/3850376205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa9180e30c0 con 0x556277ccb5d0 2024-09-13T19:06:46.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 0x7fa800036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa80bfff640 1 -- 172.21.15.151:0/3850376205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa9180d9050 con 0x556277ccb5d0 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa92590f640 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 0x7fa800036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa92590f640 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 0x7fa800036ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556277cbdf40 tx=0x7fa910006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa928600980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556277ca6d10 con 0x556277cd7df0 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57286/0 (socket says 172.21.15.151:57286) 2024-09-13T19:06:46.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa926110640 1 -- 172.21.15.151:0/4141836728 learned_addr learned my addr 172.21.15.151:0/4141836728 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa926110640 1 -- 172.21.15.151:0/4141836728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277cd87c0 con 0x556277cd7df0 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa926110640 1 --2- 172.21.15.151:0/4141836728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9180c2040 tx=0x7fa9180dc540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f28bc723a5eece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa809ffb640 1 -- 172.21.15.151:0/4141836728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180fd070 con 0x556277cd7df0 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa809ffb640 1 -- 172.21.15.151:0/4141836728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180c6b60 con 0x556277cd7df0 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.095+0000 7fa809ffb640 1 -- 172.21.15.151:0/4141836728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180bd8a0 con 0x556277cd7df0 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/4141836728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 msgr2=0x556277cd81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 --2- 172.21.15.151:0/4141836728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa9180c2040 tx=0x7fa9180dc540 comp rx=0 tx=0).stop 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/4141836728 shutdown_connections 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 --2- 172.21.15.151:0/4141836728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cd81f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/4141836728 >> 172.21.15.151:0/4141836728 conn(0x556277cd4170 msgr2=0x556277cd2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/4141836728 shutdown_connections 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/4141836728 wait complete. 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 Processor -- start 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- start start 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556277cd8b80 con 0x556277cd7df0 2024-09-13T19:06:46.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa926110640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57288/0 (socket says 172.21.15.151:57288) 2024-09-13T19:06:46.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 learned_addr learned my addr 172.21.15.151:0/2207621042 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556277cdf4d0 con 0x556277cd7df0 2024-09-13T19:06:46.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa926110640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa9180dc580 tx=0x7fa9180d4a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa7f7fff640 1 -- 172.21.15.151:0/2207621042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa918107070 con 0x556277cd7df0 2024-09-13T19:06:46.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa7f7fff640 1 -- 172.21.15.151:0/2207621042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9180df0f0 con 0x556277cd7df0 2024-09-13T19:06:46.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556277cdf4d0 con 0x556277cd7df0 2024-09-13T19:06:46.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa7f7fff640 1 -- 172.21.15.151:0/2207621042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9180fd040 con 0x556277cd7df0 2024-09-13T19:06:46.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.099+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556277cdf4d0 con 0x556277cd7df0 2024-09-13T19:06:46.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa7f7fff640 1 -- 172.21.15.151:0/2207621042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa91810a070 con 0x556277cd7df0 2024-09-13T19:06:46.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa7f7fff640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa7f00346a0 0x7fa7f0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa7f7fff640 1 -- 172.21.15.151:0/2207621042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa91810dcb0 con 0x556277cd7df0 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa92590f640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa7f00346a0 0x7fa7f0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277cea0a0 0x556277cec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277ceccb0 con 0x556277cea0a0 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277cea0a0 0x556277cec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa92590f640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa7f00346a0 0x7fa7f0036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa91000fd50 tx=0x7fa910023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277cea0a0 0x556277cec560 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 realm 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277ced0c0 con 0x556277cea0a0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277ced990 con 0x556277cea0a0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277ceea90 0x556277cf0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf1490 con 0x556277ceea90 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926110640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277ceea90 0x556277cf0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.103+0000 7fa926110640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277ceea90 0x556277cf0e80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa928600980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa928600980 20 searching for the correct realm 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cf2d60 con 0x556277ceea90 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926110640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa91810c070 0x7fa9180eaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cf2d60 con 0x7fa91810c070 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa92590f640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa91810c070 0x7fa9180eaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa92590f640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa91810c070 0x7fa9180eaa80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa92590f640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa91002e910 0x7fa91003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cf2d60 con 0x7fa91002e910 2024-09-13T19:06:46.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa91002e910 0x7fa91003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa91002e910 0x7fa91003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.107+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91810c070 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91810c070 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.111+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91810c070 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.115+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91810c070 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277ceea90 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91002e910 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x556277cea0a0 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556277cedd30 con 0x7fa91810c070 2024-09-13T19:06:46.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:46.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:46.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf1e80 con 0x556277cea0a0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf1ac0 con 0x556277cea0a0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.119+0000 7fa928600980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf27a0 con 0x7fa91810c070 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 zone default found 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 4 Realm: () 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 zonegroup default 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf3190 con 0x7fa91002e910 2024-09-13T19:06:46.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf4b70 con 0x556277ceea90 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cf5080 con 0x556277ceea90 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 started sync module instance, tier type = 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:46.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf4010 con 0x7fa91810c070 2024-09-13T19:06:46.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93881405228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf3c70 con 0x7fa91810c070 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.123+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf5fb0 con 0x556277cea0a0 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.127+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93881405228032] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.127+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.127+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93881405233920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf63d0 con 0x556277cea0a0 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.127+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf6ca0 con 0x556277ceea90 2024-09-13T19:06:46.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.127+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93881405233920] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93881405235248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf7090 con 0x556277ceea90 2024-09-13T19:06:46.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf7a50 con 0x7fa91810c070 2024-09-13T19:06:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93881405240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf82f0 con 0x7fa91810c070 2024-09-13T19:06:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf8cf0 con 0x556277cea0a0 2024-09-13T19:06:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93881405235248] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93881405240736] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93881405242944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf8800 con 0x556277cea0a0 2024-09-13T19:06:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.131+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf9590 con 0x7fa91002e910 2024-09-13T19:06:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.135+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93881405242944] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.135+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.135+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93881405236432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf9510 con 0x7fa91002e910 2024-09-13T19:06:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.135+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf9ed0 con 0x7fa91002e910 2024-09-13T19:06:46.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93881405250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cfa2f0 con 0x7fa91002e910 2024-09-13T19:06:46.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cfad40 con 0x7fa91002e910 2024-09-13T19:06:46.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93881405236432] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93881405250080] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93881405253680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf9e40 con 0x7fa91002e910 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=0 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=1 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=2 2024-09-13T19:06:46.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=3 2024-09-13T19:06:46.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=4 2024-09-13T19:06:46.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=5 2024-09-13T19:06:46.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.139+0000 7fa928600980 20 add_watcher() i=6 2024-09-13T19:06:46.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93881405253680] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa928600980 20 add_watcher() i=7 2024-09-13T19:06:46.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa928600980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:46.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277cfde40 con 0x556277cea0a0 2024-09-13T19:06:46.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93881405247504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cfb2c0 con 0x556277cea0a0 2024-09-13T19:06:46.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93881405247504] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.143+0000 7fa7dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:46.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:46.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 5 note: GC not initialized 2024-09-13T19:06:46.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa7577fe640 20 reqs_thread_entry: start 2024-09-13T19:06:46.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:46.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 Filter name: none 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa7557fa640 20 reqs_thread_entry: start 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277d21310 con 0x7fa91002e910 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277d1fab0 con 0x7fa91002e910 2024-09-13T19:06:46.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:06:46.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:46.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:06:46.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:06:46.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.147+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d20350 con 0x7fa91002e910 2024-09-13T19:06:46.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa928600980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa928600980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa928600980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93881405406880 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277d24db0 con 0x7fa91002e910 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify (1) cookie 93881405236432 notify 137438953475 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556277d206f0 con 0x7fa91002e910 2024-09-13T19:06:46.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa809ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93881405236432 notifier 4484 bl.length()=556 2024-09-13T19:06:46.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa809ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:06:46.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa809ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:46.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(65 notify.5 [notify cookie 93881405406880 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa809ffb640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa7ec003eb0 con 0x7fa91002e910 2024-09-13T19:06:46.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== watch-notify(notify_complete (2) cookie 93881405406880 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556277d20d60 con 0x7fa91002e910 2024-09-13T19:06:46.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.151+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d228e0 con 0x7fa91002e910 2024-09-13T19:06:46.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa928600980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:46.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa928600980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:46.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa928600980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:46.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93881405406768 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556277d24db0 con 0x556277ceea90 2024-09-13T19:06:46.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 93881405235248 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x556277ccbf30 con 0x556277ceea90 2024-09-13T19:06:46.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa8097fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93881405235248 notifier 4484 bl.length()=177 2024-09-13T19:06:46.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa8097fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:46.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa8097fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:46.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa8097fa640 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa75c003410 con 0x556277ceea90 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [notify cookie 93881405406768 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== watch-notify(notify_complete (2) cookie 93881405406768 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556277cb0c60 con 0x556277ceea90 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:06:46.150693Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:46.150677Z","tags":[],"group_ids":[]} 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa7dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.155+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93881405247504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d1f0b0 con 0x556277cea0a0 2024-09-13T19:06:46.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93881405247504] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93881405228032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d1f0b0 con 0x7fa91810c070 2024-09-13T19:06:46.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93881405228032] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa928600980 20 remove_watcher() i=0 2024-09-13T19:06:46.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa928600980 2 removed watcher, disabling cache 2024-09-13T19:06:46.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.159+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93881405233920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf4400 con 0x556277cea0a0 2024-09-13T19:06:46.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93881405233920] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 20 remove_watcher() i=1 2024-09-13T19:06:46.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93881405235248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d1f0b0 con 0x556277ceea90 2024-09-13T19:06:46.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa926110640 1 -- 172.21.15.151:0/2207621042 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93881405235248] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa918113070 con 0x556277ceea90 2024-09-13T19:06:46.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 20 remove_watcher() i=2 2024-09-13T19:06:46.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93881405240736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf5b00 con 0x7fa91810c070 2024-09-13T19:06:46.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa92590f640 1 -- 172.21.15.151:0/2207621042 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93881405240736] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa910037040 con 0x7fa91810c070 2024-09-13T19:06:46.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 20 remove_watcher() i=3 2024-09-13T19:06:46.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.163+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93881405242944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf4400 con 0x556277cea0a0 2024-09-13T19:06:46.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93881405242944] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x556277cea0a0 2024-09-13T19:06:46.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa928600980 20 remove_watcher() i=4 2024-09-13T19:06:46.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93881405236432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf6030 con 0x7fa91002e910 2024-09-13T19:06:46.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93881405236432] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa928600980 20 remove_watcher() i=5 2024-09-13T19:06:46.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.167+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93881405250080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277d1f0b0 con 0x7fa91002e910 2024-09-13T19:06:46.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.171+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93881405250080] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.171+0000 7fa928600980 20 remove_watcher() i=6 2024-09-13T19:06:46.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.171+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93881405253680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556277cf75a0 con 0x7fa91002e910 2024-09-13T19:06:46.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93881405253680] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9200083f0 con 0x7fa91002e910 2024-09-13T19:06:46.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 20 remove_watcher() i=7 2024-09-13T19:06:46.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa91002e910 msgr2=0x7fa91003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa91002e910 0x7fa91003a3c0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277cea0a0 msgr2=0x556277cec560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277cea0a0 0x556277cec560 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa91810c070 msgr2=0x7fa9180eaa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa91810c070 0x7fa9180eaa80 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277ceea90 msgr2=0x556277cf0e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277ceea90 0x556277cf0e80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa7f00346a0 msgr2=0x7fa7f0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa7f00346a0 0x7fa7f0036b60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa91000fd50 tx=0x7fa910023040 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 msgr2=0x556277cdef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa926911640 1 -- 172.21.15.151:0/2207621042 reap_dead start 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa9180dc580 tx=0x7fa9180d4a10 comp rx=0 tx=0).stop 2024-09-13T19:06:46.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 shutdown_connections 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/2207621042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277cd7df0 0x556277cdef90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 >> 172.21.15.151:0/2207621042 conn(0x556277cd4170 msgr2=0x556277cd2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 shutdown_connections 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/2207621042 wait complete. 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 msgr2=0x7fa800036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 0x7fa800036ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556277cbdf40 tx=0x7fa910006000 comp rx=0 tx=0).stop 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 msgr2=0x556277ccb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9180e1f60 tx=0x7fa9180bbf70 comp rx=0 tx=0).stop 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 shutdown_connections 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa800034600 0x7fa800036ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/3850376205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277ccb5d0 0x556277ccb9f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 >> 172.21.15.151:0/3850376205 conn(0x556277cc0720 msgr2=0x556277cc31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 shutdown_connections 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/3850376205 wait complete. 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277b2afe0 msgr2=0x556277cb48b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556277b2afe0 0x556277cb48b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556277cbafc0 msgr2=0x556277cbd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556277cbafc0 0x556277cbd3b0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277cb70c0 msgr2=0x556277cb94b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556277cb70c0 0x556277cb94b0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa80c034650 msgr2=0x7fa80c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa80c034650 0x7fa80c036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b330 tx=0x7fa910001510 comp rx=0 tx=0).stop 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 msgr2=0x556277cad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 --2- 172.21.15.151:0/1135140029 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556277b2abd0 0x556277cad7b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa918005c00 tx=0x7fa918017a20 comp rx=0 tx=0).stop 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa926911640 1 -- 172.21.15.151:0/1135140029 reap_dead start 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 shutdown_connections 2024-09-13T19:06:46.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 >> 172.21.15.151:0/1135140029 conn(0x556277bb01b0 msgr2=0x556277ca0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 shutdown_connections 2024-09-13T19:06:46.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.175+0000 7fa928600980 1 -- 172.21.15.151:0/1135140029 wait complete. 2024-09-13T19:06:46.189 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:06:46.150693Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:46.150677Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:46.198 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:06:46.205 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:46.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:06:46.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-13T19:06:46.205 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-13T19:06:46.261 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:46.262 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f9b44a980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ae467298e0 0x55ae46729cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f9b44a980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae465afae0 con 0x55ae4672a230 2024-09-13T19:06:46.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f9b44a980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55ae465d3e30 con 0x55ae467298e0 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98f5a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ae467298e0 0x55ae46729cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98f5a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ae467298e0 0x55ae46729cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57300/0 (socket says 172.21.15.151:57300) 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98f5a640 1 -- 172.21.15.151:0/1138923238 learned_addr learned my addr 172.21.15.151:0/1138923238 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98759640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55ae4672a230 0x55ae4672ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33586/0 (socket says 172.21.15.151:33586) 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98f5a640 1 -- 172.21.15.151:0/1138923238 >> v1:172.21.15.12:6789/0 conn(0x55ae4672a230 legacy=0x55ae4672ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.259+0000 7f9f98f5a640 1 -- 172.21.15.151:0/1138923238 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae467314b0 con 0x55ae467298e0 2024-09-13T19:06:46.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/1138923238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46729cc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800a4e0 tx=0x7f9f8801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf51172c6c54399 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f97f58640 1 -- 172.21.15.151:0/1138923238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880aa540 con 0x55ae467298e0 2024-09-13T19:06:46.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f97f58640 1 -- 172.21.15.151:0/1138923238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880aa6e0 con 0x55ae467298e0 2024-09-13T19:06:46.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f97f58640 1 -- 172.21.15.151:0/1138923238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880aaa40 con 0x55ae467298e0 2024-09-13T19:06:46.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1138923238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 msgr2=0x55ae46729cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/1138923238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46729cc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800a4e0 tx=0x7f9f8801b090 comp rx=0 tx=0).stop 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1138923238 shutdown_connections 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/1138923238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46729cc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1138923238 >> 172.21.15.151:0/1138923238 conn(0x55ae4669d230 msgr2=0x55ae4669d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1138923238 shutdown_connections 2024-09-13T19:06:46.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.263+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1138923238 wait complete. 2024-09-13T19:06:46.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f9b44a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f9b44a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ae465d5200 con 0x55ae467298e0 2024-09-13T19:06:46.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57304/0 (socket says 172.21.15.151:57304) 2024-09-13T19:06:46.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.279+0000 7f9f98f5a640 1 -- 172.21.15.151:0/4112781787 learned_addr learned my addr 172.21.15.151:0/4112781787 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 -- 172.21.15.151:0/4112781787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae468151d0 con 0x55ae467298e0 2024-09-13T19:06:46.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/4112781787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f88017ca0 tx=0x7f9f880033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5be587fb05280bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e86614640 1 -- 172.21.15.151:0/4112781787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880b9070 con 0x55ae467298e0 2024-09-13T19:06:46.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e86614640 1 -- 172.21.15.151:0/4112781787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880aaa80 con 0x55ae467298e0 2024-09-13T19:06:46.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e86614640 1 -- 172.21.15.151:0/4112781787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880aad60 con 0x55ae467298e0 2024-09-13T19:06:46.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- 172.21.15.151:0/4112781787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 msgr2=0x55ae46814c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/4112781787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9f88017ca0 tx=0x7f9f880033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- 172.21.15.151:0/4112781787 shutdown_connections 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/4112781787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae46814c00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- 172.21.15.151:0/4112781787 >> 172.21.15.151:0/4112781787 conn(0x55ae4669d230 msgr2=0x55ae46810830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- 172.21.15.151:0/4112781787 shutdown_connections 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- 172.21.15.151:0/4112781787 wait complete. 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae4681be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f9b44a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ae46730ef0 con 0x55ae467298e0 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae4681be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae4681be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57308/0 (socket says 172.21.15.151:57308) 2024-09-13T19:06:46.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2039936994 learned_addr learned my addr 172.21.15.151:0/2039936994 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4681c3b0 con 0x55ae467298e0 2024-09-13T19:06:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae4681be70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f8801aec0 tx=0x7f9f88017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e84e11640 1 -- 172.21.15.151:0/2039936994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880cc070 con 0x55ae467298e0 2024-09-13T19:06:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e84e11640 1 -- 172.21.15.151:0/2039936994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880c7410 con 0x55ae467298e0 2024-09-13T19:06:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.283+0000 7f9e84e11640 1 -- 172.21.15.151:0/2039936994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880b9070 con 0x55ae467298e0 2024-09-13T19:06:46.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4681c640 con 0x55ae467298e0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4681f320 con 0x55ae467298e0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9e84e11640 1 -- 172.21.15.151:0/2039936994 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f880b3040 con 0x55ae467298e0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9e84e11640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e80034650 0x7f9e80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9e84e11640 1 -- 172.21.15.151:0/2039936994 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f880c4070 con 0x55ae467298e0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f98759640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e80034650 0x7f9e80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae4672a230 0x55ae46822f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae468234f0 con 0x55ae4672a230 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae4672a230 0x55ae46822f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f98759640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e80034650 0x7f9e80036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000f70 tx=0x7f9f84001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae4672a230 0x55ae46822f70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9975b640 1 -- 172.21.15.151:0/2039936994 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae4672a230 2024-09-13T19:06:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46820540 con 0x55ae4672a230 2024-09-13T19:06:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9975b640 1 -- 172.21.15.151:0/2039936994 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae4672a230 2024-09-13T19:06:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae46825840 0x55ae46827c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46828300 con 0x55ae46825840 2024-09-13T19:06:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae46825840 0x55ae46827c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.287+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae46825840 0x55ae46827c30 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2039936994 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9f880b43a0 con 0x55ae46825840 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae468246e0 con 0x55ae4672a230 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9975b640 1 -- 172.21.15.151:0/2039936994 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae4672a230 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ae46829740 0x55ae4682bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4682c2c0 con 0x55ae46829740 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98759640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ae46829740 0x55ae4682bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98759640 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ae46829740 0x55ae4682bb30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98759640 1 -- 172.21.15.151:0/2039936994 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9f8400f6a0 con 0x55ae46829740 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ae4662e800 con 0x55ae46839d50 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57310/0 (socket says 172.21.15.151:57310) 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2882184188 learned_addr learned my addr 172.21.15.151:0/2882184188 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2882184188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4683a6b0 con 0x55ae46839d50 2024-09-13T19:06:46.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000f90 tx=0x7f9f880c6f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9e7dffb640 1 -- 172.21.15.151:0/2882184188 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880e9070 con 0x55ae46839d50 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9e7dffb640 1 -- 172.21.15.151:0/2882184188 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880d1be0 con 0x55ae46839d50 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4683a940 con 0x55ae46839d50 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9e7dffb640 1 -- 172.21.15.151:0/2882184188 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880e1070 con 0x55ae46839d50 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.291+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4683d5c0 con 0x55ae46839d50 2024-09-13T19:06:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e7dffb640 1 -- 172.21.15.151:0/2882184188 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f880ec070 con 0x55ae46839d50 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e7dffb640 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 0x7f9e70036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e7dffb640 1 -- 172.21.15.151:0/2882184188 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f880d6040 con 0x55ae46839d50 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98759640 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 0x7f9e70036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98759640 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 0x7f9e70036bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55ae4682c6c0 tx=0x7f9f8400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ae46815490 con 0x55ae46846700 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57316/0 (socket says 172.21.15.151:57316) 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98f5a640 1 -- 172.21.15.151:0/1524569445 learned_addr learned my addr 172.21.15.151:0/1524569445 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98f5a640 1 -- 172.21.15.151:0/1524569445 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae468470b0 con 0x55ae46846700 2024-09-13T19:06:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/1524569445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b5c20 tx=0x7f9f880e15e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e642af02aeef2da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e777fe640 1 -- 172.21.15.151:0/1524569445 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880e1b30 con 0x55ae46846700 2024-09-13T19:06:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e777fe640 1 -- 172.21.15.151:0/1524569445 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880ce310 con 0x55ae46846700 2024-09-13T19:06:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9e777fe640 1 -- 172.21.15.151:0/1524569445 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880d11a0 con 0x55ae46846700 2024-09-13T19:06:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1524569445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 msgr2=0x55ae46846ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/1524569445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9f880b5c20 tx=0x7f9f880e15e0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1524569445 shutdown_connections 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/1524569445 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae46846ae0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1524569445 >> 172.21.15.151:0/1524569445 conn(0x55ae46842a30 msgr2=0x55ae46840b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1524569445 shutdown_connections 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.295+0000 7f9f9b44a980 1 -- 172.21.15.151:0/1524569445 wait complete. 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 Processor -- start 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 -- start start 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ae46847440 con 0x55ae46846700 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f98f5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57328/0 (socket says 172.21.15.151:57328) 2024-09-13T19:06:46.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 learned_addr learned my addr 172.21.15.151:0/2404008040 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae4684dd10 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f880e16b0 tx=0x7f9f880ebe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 -- 172.21.15.151:0/2404008040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f8810b070 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae4684dd10 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 -- 172.21.15.151:0/2404008040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f880e1b30 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 -- 172.21.15.151:0/2404008040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f880d1720 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae4684dd10 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 -- 172.21.15.151:0/2404008040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9f88104040 con 0x55ae46846700 2024-09-13T19:06:46.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e68034650 0x7f9e68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.299+0000 7f9e75ffb640 1 -- 172.21.15.151:0/2404008040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f9f880f9070 con 0x55ae46846700 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e68034650 0x7f9e68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae468588e0 0x55ae4685ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685b4f0 con 0x55ae468588e0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae468588e0 0x55ae4685ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e68034650 0x7f9e68036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c010 tx=0x7f9f84010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae468588e0 0x55ae4685ada0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 realm 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685b900 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c1a0 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae4685d2a0 0x55ae4685f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685fc10 con 0x55ae4685d2a0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae4685d2a0 0x55ae4685f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae4685d2a0 0x55ae4685f690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 20 searching for the correct realm 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae468614b0 con 0x55ae4685d2a0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9f88107040 0x7f9f880ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae468614b0 con 0x7f9f88107040 2024-09-13T19:06:46.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9f88107040 0x7f9f880ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9f88107040 0x7f9f880ee8c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9f8401fbe0 0x7f9f8403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.303+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae468614b0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9f8401fbe0 0x7f9f8403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9f8401fbe0 0x7f9f8403a3c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f88107040 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.307+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f88107040 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.311+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f88107040 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f88107040 2024-09-13T19:06:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae4685d2a0 2024-09-13T19:06:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.315+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f8401fbe0 2024-09-13T19:06:46.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x55ae468588e0 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae4685c540 con 0x7f9f88107040 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46860460 con 0x55ae468588e0 2024-09-13T19:06:46.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46860850 con 0x55ae468588e0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46860850 con 0x7f9f88107040 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:46.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 zone default found 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 4 Realm: () 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 zonegroup default 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46861980 con 0x7f9f8401fbe0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46863360 con 0x55ae4685d2a0 2024-09-13T19:06:46.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae46863700 con 0x55ae4685d2a0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 started sync module instance, tier type = 2024-09-13T19:06:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.319+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46862800 con 0x7f9f88107040 2024-09-13T19:06:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94206995868704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46863fc0 con 0x7f9f88107040 2024-09-13T19:06:46.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46864810 con 0x55ae468588e0 2024-09-13T19:06:46.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94206995868704] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94206995872528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46864850 con 0x55ae468588e0 2024-09-13T19:06:46.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.323+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46865340 con 0x55ae4685d2a0 2024-09-13T19:06:46.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94206995877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46865be0 con 0x55ae4685d2a0 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46866620 con 0x7f9f88107040 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94206995872528] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94206995874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46866ec0 con 0x7f9f88107040 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.327+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46867750 con 0x55ae468588e0 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.331+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94206995877392] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.331+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94206995874656] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.331+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.331+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94206995884560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46867260 con 0x55ae468588e0 2024-09-13T19:06:46.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.331+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46867ff0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.335+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94206995884560] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.335+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.335+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94206995879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46867f30 con 0x7f9f8401fbe0 2024-09-13T19:06:46.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.335+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae468688f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.335+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94206995879728] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.339+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.339+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94206995889040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae468688f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.339+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae468692b0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.343+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94206995889040] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94206995891536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae468692b0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=0 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=1 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=2 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=3 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=4 2024-09-13T19:06:46.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=5 2024-09-13T19:06:46.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=6 2024-09-13T19:06:46.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94206995891536] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 20 add_watcher() i=7 2024-09-13T19:06:46.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:46.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4686c5e0 con 0x55ae468588e0 2024-09-13T19:06:46.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.347+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94206995906576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46869420 con 0x55ae468588e0 2024-09-13T19:06:46.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94206995906576] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9e4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 5 note: GC not initialized 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9e4d7e2640 20 reqs_thread_entry: start 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 Filter name: none 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9dbeffd640 20 reqs_thread_entry: start 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae4688f770 con 0x7f9f88107040 2024-09-13T19:06:46.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:46.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9e4e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.351+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94206995906576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46852cd0 con 0x55ae468588e0 2024-09-13T19:06:46.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94206995906576] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94206995868704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae4686c010 con 0x7f9f88107040 2024-09-13T19:06:46.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94206995868704] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f9b44a980 20 remove_watcher() i=0 2024-09-13T19:06:46.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f9b44a980 2 removed watcher, disabling cache 2024-09-13T19:06:46.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.355+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94206995872528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae4686c010 con 0x55ae468588e0 2024-09-13T19:06:46.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94206995872528] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f9b44a980 20 remove_watcher() i=1 2024-09-13T19:06:46.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94206995877392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46863b10 con 0x55ae4685d2a0 2024-09-13T19:06:46.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f98f5a640 1 -- 172.21.15.151:0/2404008040 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94206995877392] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f880eb030 con 0x55ae4685d2a0 2024-09-13T19:06:46.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f9b44a980 20 remove_watcher() i=2 2024-09-13T19:06:46.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.359+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94206995874656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae4686c010 con 0x7f9f88107040 2024-09-13T19:06:46.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f98759640 1 -- 172.21.15.151:0/2404008040 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94206995874656] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f84037040 con 0x7f9f88107040 2024-09-13T19:06:46.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f9b44a980 20 remove_watcher() i=3 2024-09-13T19:06:46.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94206995884560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46864360 con 0x55ae468588e0 2024-09-13T19:06:46.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94206995884560] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x55ae468588e0 2024-09-13T19:06:46.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f9b44a980 20 remove_watcher() i=4 2024-09-13T19:06:46.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.363+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94206995879728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae4686c010 con 0x7f9f8401fbe0 2024-09-13T19:06:46.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.367+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94206995879728] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.367+0000 7f9f9b44a980 20 remove_watcher() i=5 2024-09-13T19:06:46.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.367+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94206995889040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46866a10 con 0x7f9f8401fbe0 2024-09-13T19:06:46.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94206995889040] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 20 remove_watcher() i=6 2024-09-13T19:06:46.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94206995891536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae46864360 con 0x7f9f8401fbe0 2024-09-13T19:06:46.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94206995891536] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9f900083f0 con 0x7f9f8401fbe0 2024-09-13T19:06:46.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 20 remove_watcher() i=7 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9f8401fbe0 msgr2=0x7f9f8403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9f8401fbe0 0x7f9f8403a3c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae468588e0 msgr2=0x55ae4685ada0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae468588e0 0x55ae4685ada0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9f88107040 msgr2=0x7f9f880ee8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9f88107040 0x7f9f880ee8c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae4685d2a0 msgr2=0x55ae4685f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae4685d2a0 0x55ae4685f690 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e68034650 msgr2=0x7f9e68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e68034650 0x7f9e68036b10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c010 tx=0x7f9f84010000 comp rx=0 tx=0).stop 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 msgr2=0x55ae4684d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9975b640 1 -- 172.21.15.151:0/2404008040 reap_dead start 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9f880e16b0 tx=0x7f9f880ebe90 comp rx=0 tx=0).stop 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 shutdown_connections 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2404008040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46846700 0x55ae4684d7d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 >> 172.21.15.151:0/2404008040 conn(0x55ae46842a30 msgr2=0x55ae46840b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 shutdown_connections 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.371+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2404008040 wait complete. 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 msgr2=0x7f9e70036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 0x7f9e70036bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x55ae4682c6c0 tx=0x7f9f8400f000 comp rx=0 tx=0).stop 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 msgr2=0x55ae4683a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9f88000f90 tx=0x7f9f880c6f00 comp rx=0 tx=0).stop 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 shutdown_connections 2024-09-13T19:06:46.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e700346f0 0x7f9e70036bb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2882184188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae46839d50 0x55ae4683a170 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 >> 172.21.15.151:0/2882184188 conn(0x55ae4682eea0 msgr2=0x55ae46831920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 shutdown_connections 2024-09-13T19:06:46.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2882184188 wait complete. 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae4672a230 msgr2=0x55ae46822f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ae4672a230 0x55ae46822f70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ae46829740 msgr2=0x55ae4682bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ae46829740 0x55ae4682bb30 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae46825840 msgr2=0x55ae46827c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ae46825840 0x55ae46827c30 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e80034650 msgr2=0x7f9e80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9e80034650 0x7f9e80036b10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000f70 tx=0x7f9f84001380 comp rx=0 tx=0).stop 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 msgr2=0x55ae4681be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 --2- 172.21.15.151:0/2039936994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ae467298e0 0x55ae4681be70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9f8801aec0 tx=0x7f9f88017e30 comp rx=0 tx=0).stop 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9975b640 1 -- 172.21.15.151:0/2039936994 reap_dead start 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 shutdown_connections 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 >> 172.21.15.151:0/2039936994 conn(0x55ae4669d230 msgr2=0x55ae4680f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 shutdown_connections 2024-09-13T19:06:46.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.375+0000 7f9f9b44a980 1 -- 172.21.15.151:0/2039936994 wait complete. 2024-09-13T19:06:46.390 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:myfoo","ver":{"tag":"_I3rq3txaK8Tg0FiLE94kWOK","ver":2},"mtime":"2024-09-13T19:06:45.940293Z","data":{"bucket":{"name":"myfoo","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","bucket_id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-13T19:06:44.212931Z","linked":false,"has_bucket_info":false}} 2024-09-13T19:06:46.390 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_I3rq3txaK8Tg0FiLE94kWOK', 'ver': 2}, 'mtime': '2024-09-13T19:06:45.940293Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'bucket_id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-13T19:06:44.212931Z', 'linked': False, 'has_bucket_info': False}} 2024-09-13T19:06:46.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1'] 2024-09-13T19:06:46.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1'] 2024-09-13T19:06:46.390 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:46.469 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:46.469 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:46.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba3e0d980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56007278e970 0x560072790d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba3e0d980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560072612ae0 con 0x56007278a5f0 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba3e0d980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x560072636e30 con 0x56007278e970 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba111c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56007278e970 0x560072790d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba111c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56007278e970 0x560072790d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57334/0 (socket says 172.21.15.151:57334) 2024-09-13T19:06:46.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba111c640 1 -- 172.21.15.151:0/1142082286 learned_addr learned my addr 172.21.15.151:0/1142082286 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba191d640 1 --1- 172.21.15.151:0/1142082286 >> v1:172.21.15.12:6789/0 conn(0x56007278a5f0 0x56007278a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33596/0 (socket says 172.21.15.151:33596) 2024-09-13T19:06:46.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba111c640 1 -- 172.21.15.151:0/1142082286 >> v1:172.21.15.12:6789/0 conn(0x56007278a5f0 legacy=0x56007278a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.467+0000 7fcba111c640 1 -- 172.21.15.151:0/1142082286 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600727922b0 con 0x56007278e970 2024-09-13T19:06:46.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba111c640 1 --2- 172.21.15.151:0/1142082286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278e970 0x560072790d60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00a5c0 tx=0x7fcb8c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07afff6548b90e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba091b640 1 -- 172.21.15.151:0/1142082286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8c0a6070 con 0x56007278e970 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba091b640 1 -- 172.21.15.151:0/1142082286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb8c0af070 con 0x56007278e970 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba091b640 1 -- 172.21.15.151:0/1142082286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb8c0aa5c0 con 0x56007278e970 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1142082286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278e970 msgr2=0x560072790d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1142082286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278e970 0x560072790d60 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c00a5c0 tx=0x7fcb8c01b340 comp rx=0 tx=0).stop 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1142082286 shutdown_connections 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1142082286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278e970 0x560072790d60 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1142082286 >> 172.21.15.151:0/1142082286 conn(0x560072786110 msgr2=0x560072788530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1142082286 shutdown_connections 2024-09-13T19:06:46.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.471+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1142082286 wait complete. 2024-09-13T19:06:46.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba3e0d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba3e0d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560072638200 con 0x56007278a5f0 2024-09-13T19:06:46.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57348/0 (socket says 172.21.15.151:57348) 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.487+0000 7fcba191d640 1 -- 172.21.15.151:0/2378972894 learned_addr learned my addr 172.21.15.151:0/2378972894 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 -- 172.21.15.151:0/2378972894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560072876050 con 0x56007278a5f0 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 --2- 172.21.15.151:0/2378972894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0015f0 tx=0x7fcb9c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e16e0d787e254e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fca8fe07640 1 -- 172.21.15.151:0/2378972894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c013420 con 0x56007278a5f0 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fca8fe07640 1 -- 172.21.15.151:0/2378972894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0135e0 con 0x56007278a5f0 2024-09-13T19:06:46.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fca8fe07640 1 -- 172.21.15.151:0/2378972894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c013940 con 0x56007278a5f0 2024-09-13T19:06:46.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2378972894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 msgr2=0x560072875a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2378972894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0015f0 tx=0x7fcb9c001ab0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2378972894 shutdown_connections 2024-09-13T19:06:46.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2378972894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072875a80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2378972894 >> 172.21.15.151:0/2378972894 conn(0x560072786110 msgr2=0x5600728716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2378972894 shutdown_connections 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2378972894 wait complete. 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072700c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560072791db0 con 0x56007278a5f0 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072700c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072700c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57362/0 (socket says 172.21.15.151:57362) 2024-09-13T19:06:46.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 -- 172.21.15.151:0/2140733610 learned_addr learned my addr 172.21.15.151:0/2140733610 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600726ff3b0 con 0x56007278a5f0 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba191d640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072700c90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006640 tx=0x7fcb9c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fca8e604640 1 -- 172.21.15.151:0/2140733610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c022020 con 0x56007278a5f0 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600726ff640 con 0x56007278a5f0 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.491+0000 7fca8e604640 1 -- 172.21.15.151:0/2140733610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c006320 con 0x56007278a5f0 2024-09-13T19:06:46.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fca8e604640 1 -- 172.21.15.151:0/2140733610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c004af0 con 0x56007278a5f0 2024-09-13T19:06:46.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600726ffb30 con 0x56007278a5f0 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fca8e604640 1 -- 172.21.15.151:0/2140733610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb9c025020 con 0x56007278a5f0 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fca8e604640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca88034650 0x7fca88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fca8e604640 1 -- 172.21.15.151:0/2140733610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c018030 con 0x56007278a5f0 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba111c640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca88034650 0x7fca88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56007278e970 0x5600728862b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728867f0 con 0x56007278e970 2024-09-13T19:06:46.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba211e640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56007278e970 0x5600728862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba111c640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca88034650 0x7fca88036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ae000 tx=0x7fcb8c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba211e640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56007278e970 0x5600728862b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba211e640 1 -- 172.21.15.151:0/2140733610 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x56007278e970 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560072886bf0 con 0x56007278e970 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba211e640 1 -- 172.21.15.151:0/2140733610 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb940083f0 con 0x56007278e970 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560072888a00 0x56007288adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56007288b4c0 con 0x560072888a00 2024-09-13T19:06:46.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba191d640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560072888a00 0x56007288adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.495+0000 7fcba191d640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560072888a00 0x56007288adf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 -- 172.21.15.151:0/2140733610 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb9c01b070 con 0x560072888a00 2024-09-13T19:06:46.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728878a0 con 0x56007278e970 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba211e640 1 -- 172.21.15.151:0/2140733610 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb940083f0 con 0x56007278e970 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56007288c920 0x56007288ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56007288f410 con 0x56007288c920 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba111c640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56007288c920 0x56007288ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba111c640 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56007288c920 0x56007288ed10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba111c640 1 -- 172.21.15.151:0/2140733610 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x56007288c920 2024-09-13T19:06:46.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560072691800 con 0x56007289cee0 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57364/0 (socket says 172.21.15.151:57364) 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 -- 172.21.15.151:0/1158163917 learned_addr learned my addr 172.21.15.151:0/1158163917 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 -- 172.21.15.151:0/1158163917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56007289d840 con 0x56007289cee0 2024-09-13T19:06:46.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba191d640 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c010470 tx=0x7fcb9c005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fca877fe640 1 -- 172.21.15.151:0/1158163917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c040070 con 0x56007289cee0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fca877fe640 1 -- 172.21.15.151:0/1158163917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c01d950 con 0x56007289cee0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56007289dad0 con 0x56007289cee0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fca877fe640 1 -- 172.21.15.151:0/1158163917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c01dc30 con 0x56007289cee0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.499+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600728a0750 con 0x56007289cee0 2024-09-13T19:06:46.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca877fe640 1 -- 172.21.15.151:0/1158163917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb9c046040 con 0x56007289cee0 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca877fe640 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 0x7fca7c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca877fe640 1 -- 172.21.15.151:0/1158163917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c04fc70 con 0x56007289cee0 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba111c640 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 0x7fca7c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba3e0d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba3e0d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5600728763d0 con 0x5600728a97c0 2024-09-13T19:06:46.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba111c640 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 0x7fca7c036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560072886fb0 tx=0x7fcb8c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57380/0 (socket says 172.21.15.151:57380) 2024-09-13T19:06:46.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba191d640 1 -- 172.21.15.151:0/698720076 learned_addr learned my addr 172.21.15.151:0/698720076 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba191d640 1 -- 172.21.15.151:0/698720076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600728aa170 con 0x5600728a97c0 2024-09-13T19:06:46.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fcba191d640 1 --2- 172.21.15.151:0/698720076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c004d30 tx=0x7fcb9c03bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3438ae9099b72022 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca857fa640 1 -- 172.21.15.151:0/698720076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c031410 con 0x5600728a97c0 2024-09-13T19:06:46.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca857fa640 1 -- 172.21.15.151:0/698720076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c041420 con 0x5600728a97c0 2024-09-13T19:06:46.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.503+0000 7fca857fa640 1 -- 172.21.15.151:0/698720076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c033e70 con 0x5600728a97c0 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/698720076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 msgr2=0x5600728a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/698720076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c004d30 tx=0x7fcb9c03bb80 comp rx=0 tx=0).stop 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/698720076 shutdown_connections 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/698720076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728a9ba0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/698720076 >> 172.21.15.151:0/698720076 conn(0x5600728a5ba0 msgr2=0x5600728a3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/698720076 shutdown_connections 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/698720076 wait complete. 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 Processor -- start 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- start start 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5600728aa610 con 0x5600728a97c0 2024-09-13T19:06:46.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba191d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57388/0 (socket says 172.21.15.151:57388) 2024-09-13T19:06:46.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 learned_addr learned my addr 172.21.15.151:0/3471377620 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600728b0e20 con 0x5600728a97c0 2024-09-13T19:06:46.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba191d640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728b08e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c051ff0 tx=0x7fcb9c037e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fca737fe640 1 -- 172.21.15.151:0/3471377620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c041260 con 0x5600728a97c0 2024-09-13T19:06:46.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fca737fe640 1 -- 172.21.15.151:0/3471377620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c031870 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600728b0e20 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fca737fe640 1 -- 172.21.15.151:0/3471377620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c0418d0 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.507+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600728b0e20 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fca737fe640 1 -- 172.21.15.151:0/3471377620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb9c010070 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fca737fe640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca6c034650 0x7fca6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fca737fe640 1 -- 172.21.15.151:0/3471377620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c070c60 con 0x5600728a97c0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba111c640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca6c034650 0x7fca6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5600728bba00 0x5600728bdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728be610 con 0x5600728bba00 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5600728bba00 0x5600728bdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba111c640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca6c034650 0x7fca6c036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c000c10 tx=0x7fcb8c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5600728bba00 0x5600728bdec0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 realm 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728bea20 con 0x5600728bba00 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf2f0 con 0x5600728bba00 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5600728c03f0 0x5600728c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c2df0 con 0x5600728c03f0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba191d640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5600728c03f0 0x5600728c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba191d640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5600728c03f0 0x5600728c27e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 20 searching for the correct realm 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.511+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728c46c0 con 0x5600728c03f0 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba191d640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcb9c027020 0x7fcb9c04c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728c46c0 con 0x7fcb9c027020 2024-09-13T19:06:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba111c640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcb9c027020 0x7fcb9c04c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba111c640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcb9c027020 0x7fcb9c04c740 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba111c640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcb8c0e0040 0x7fcb8c0e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728c46c0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcb8c0e0040 0x7fcb8c0e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcb8c0e0040 0x7fcb8c0e0420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.515+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb9c027020 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb9c027020 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.519+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb9c027020 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.523+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb9c027020 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728c03f0 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x5600728bba00 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5600728bf690 con 0x7fcb9c027020 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c37e0 con 0x5600728bba00 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c3420 con 0x5600728bba00 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.527+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c4100 con 0x7fcb9c027020 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 zone default found 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 4 Realm: () 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:46.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 zonegroup default 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c4af0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c64d0 con 0x5600728c03f0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728c68f0 con 0x5600728c03f0 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 started sync module instance, tier type = 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:46.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c45d0 con 0x7fcb9c027020 2024-09-13T19:06:46.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94559921789504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c6d30 con 0x7fcb9c027020 2024-09-13T19:06:46.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.531+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c77c0 con 0x5600728bba00 2024-09-13T19:06:46.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.535+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94559921789504] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.535+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.535+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94559921795728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c7bb0 con 0x5600728bba00 2024-09-13T19:06:46.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.535+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c8570 con 0x5600728c03f0 2024-09-13T19:06:46.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.539+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94559921795728] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.539+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.539+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94559921799360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c8960 con 0x5600728c03f0 2024-09-13T19:06:46.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.539+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c9320 con 0x7fcb9c027020 2024-09-13T19:06:46.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.543+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.543+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94559921804992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c9f90 con 0x7fcb9c027020 2024-09-13T19:06:46.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.543+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728ca950 con 0x5600728bba00 2024-09-13T19:06:46.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.543+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94559921804992] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.543+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94559921799360] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94559921808544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c9f90 con 0x5600728bba00 2024-09-13T19:06:46.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728ca8c0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94559921810608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728ca8c0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.547+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728cbc90 con 0x7fcb8c0e0040 2024-09-13T19:06:46.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.551+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94559921808544] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.555+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94559921810608] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.555+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.555+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94559921811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728cb770 con 0x7fcb8c0e0040 2024-09-13T19:06:46.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.555+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728cc140 con 0x7fcb8c0e0040 2024-09-13T19:06:46.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94559921811664] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94559921806048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728cc140 con 0x7fcb8c0e0040 2024-09-13T19:06:46.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=0 2024-09-13T19:06:46.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=1 2024-09-13T19:06:46.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=2 2024-09-13T19:06:46.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=3 2024-09-13T19:06:46.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=4 2024-09-13T19:06:46.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=5 2024-09-13T19:06:46.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.559+0000 7fcba3e0d980 20 add_watcher() i=6 2024-09-13T19:06:46.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94559921806048] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 add_watcher() i=7 2024-09-13T19:06:46.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:46.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728cf4b0 con 0x5600728bba00 2024-09-13T19:06:46.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94559921827488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728cc2b0 con 0x5600728bba00 2024-09-13T19:06:46.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94559921827488] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fca537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 5 note: GC not initialized 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fca527fc640 20 reqs_thread_entry: start 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:46.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 Filter name: none 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fc9c3fff640 20 reqs_thread_entry: start 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.563+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728f2c40 con 0x7fcb8c0e0040 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:46.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728f2790 con 0x7fcb9c027020 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728f68e0 con 0x5600728c03f0 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:46.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728faac0 con 0x7fcb9c027020 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.567+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 foo.buckets [call] v32'21 uv19 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600729009e0 con 0x5600728c03f0 2024-09-13T19:06:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:46.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:46.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94559921989712 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728faef0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== watch-notify(notify (1) cookie 94559921811664 notify 137438953476 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fcb9403b040 con 0x7fcb8c0e0040 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fca84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94559921811664 notifier 4498 bl.length()=752 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(67 notify.6 [notify cookie 94559921989712 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fca84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fca84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fca84ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fca84ff9640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc9cc003540 con 0x7fcb8c0e0040 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify_complete (2) cookie 94559921989712 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb94010040 con 0x7fcb8c0e0040 2024-09-13T19:06:46.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:46.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:46.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:46.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:46.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.571+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f6850 con 0x7fcb8c0e0040 2024-09-13T19:06:46.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.575+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.575+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f6850 con 0x7fcb9c027020 2024-09-13T19:06:46.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'22 uv22 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba3e0d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:46.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba3e0d980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:46.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba3e0d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:46.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94559921989712 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600728ff690 con 0x7fcb8c0e0040 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== watch-notify(notify (1) cookie 94559921811664 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fcb9403c510 con 0x7fcb8c0e0040 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fca84ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94559921811664 notifier 4498 bl.length()=314 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(71 notify.6 [notify cookie 94559921989712 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fca84ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fca84ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fca84ff9640 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc9cc003520 con 0x7fcb8c0e0040 2024-09-13T19:06:46.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== watch-notify(notify_complete (2) cookie 94559921989712 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcb9403c7b0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fca537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.579+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94559921827488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f0a70 con 0x5600728bba00 2024-09-13T19:06:46.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94559921827488] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94559921789504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f0a70 con 0x7fcb9c027020 2024-09-13T19:06:46.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94559921789504] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba3e0d980 20 remove_watcher() i=0 2024-09-13T19:06:46.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba3e0d980 2 removed watcher, disabling cache 2024-09-13T19:06:46.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.583+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94559921795728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f0a70 con 0x5600728bba00 2024-09-13T19:06:46.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94559921795728] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba3e0d980 20 remove_watcher() i=1 2024-09-13T19:06:46.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94559921799360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c7290 con 0x5600728c03f0 2024-09-13T19:06:46.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba191d640 1 -- 172.21.15.151:0/3471377620 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94559921799360] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c059070 con 0x5600728c03f0 2024-09-13T19:06:46.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba3e0d980 20 remove_watcher() i=2 2024-09-13T19:06:46.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.587+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94559921804992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f0a70 con 0x7fcb9c027020 2024-09-13T19:06:46.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba111c640 1 -- 172.21.15.151:0/3471377620 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94559921804992] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb8c0aaae0 con 0x7fcb9c027020 2024-09-13T19:06:46.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba3e0d980 20 remove_watcher() i=3 2024-09-13T19:06:46.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94559921808544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c7290 con 0x5600728bba00 2024-09-13T19:06:46.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94559921808544] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x5600728bba00 2024-09-13T19:06:46.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba3e0d980 20 remove_watcher() i=4 2024-09-13T19:06:46.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.591+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94559921810608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c96c0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94559921810608] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba3e0d980 20 remove_watcher() i=5 2024-09-13T19:06:46.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94559921811664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728f0a70 con 0x7fcb8c0e0040 2024-09-13T19:06:46.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94559921811664] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba3e0d980 20 remove_watcher() i=6 2024-09-13T19:06:46.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.595+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94559921806048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600728c7290 con 0x7fcb8c0e0040 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94559921806048] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb940083f0 con 0x7fcb8c0e0040 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 20 remove_watcher() i=7 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcb8c0e0040 msgr2=0x7fcb8c0e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcb8c0e0040 0x7fcb8c0e0420 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5600728bba00 msgr2=0x5600728bdec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5600728bba00 0x5600728bdec0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcb9c027020 msgr2=0x7fcb9c04c740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcb9c027020 0x7fcb9c04c740 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5600728c03f0 msgr2=0x5600728c27e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5600728c03f0 0x5600728c27e0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca6c034650 msgr2=0x7fca6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca6c034650 0x7fca6c036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c000c10 tx=0x7fcb8c0c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 msgr2=0x5600728b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/3471377620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5600728a97c0 0x5600728b08e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c051ff0 tx=0x7fcb9c037e90 comp rx=0 tx=0).stop 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 reap_dead start 2024-09-13T19:06:46.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba211e640 1 -- 172.21.15.151:0/3471377620 reap_dead start 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 shutdown_connections 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 >> 172.21.15.151:0/3471377620 conn(0x5600728a5ba0 msgr2=0x5600728a3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 shutdown_connections 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/3471377620 wait complete. 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 msgr2=0x7fca7c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 0x7fca7c036b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560072886fb0 tx=0x7fcb8c005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 msgr2=0x56007289d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c010470 tx=0x7fcb9c005130 comp rx=0 tx=0).stop 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 shutdown_connections 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca7c0346a0 0x7fca7c036b60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/1158163917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007289cee0 0x56007289d300 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 >> 172.21.15.151:0/1158163917 conn(0x560072892030 msgr2=0x560072894ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 shutdown_connections 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/1158163917 wait complete. 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56007278e970 msgr2=0x5600728862b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56007278e970 0x5600728862b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56007288c920 msgr2=0x56007288ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56007288c920 0x56007288ed10 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560072888a00 msgr2=0x56007288adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560072888a00 0x56007288adf0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca88034650 msgr2=0x7fca88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fca88034650 0x7fca88036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c0ae000 tx=0x7fcb8c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 msgr2=0x560072700c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 --2- 172.21.15.151:0/2140733610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56007278a5f0 0x560072700c90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006640 tx=0x7fcb9c000f50 comp rx=0 tx=0).stop 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba211e640 1 -- 172.21.15.151:0/2140733610 reap_dead start 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 shutdown_connections 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 >> 172.21.15.151:0/2140733610 conn(0x560072786110 msgr2=0x560072870230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.599+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 shutdown_connections 2024-09-13T19:06:46.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.603+0000 7fcba3e0d980 1 -- 172.21.15.151:0/2140733610 wait complete. 2024-09-13T19:06:46.617 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:46.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:46.618 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:06:46.693 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:46.693 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:46.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa347b04980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56162704bc60 0x56162704e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa347b04980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561626ecdae0 con 0x5616270478e0 2024-09-13T19:06:46.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa347b04980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x561626ef1e30 con 0x56162704bc60 2024-09-13T19:06:46.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa344e13640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56162704bc60 0x56162704e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa345614640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5616270478e0 0x561627047cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33610/0 (socket says 172.21.15.151:33610) 2024-09-13T19:06:46.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa345614640 1 -- 172.21.15.151:0/1939437536 learned_addr learned my addr 172.21.15.151:0/1939437536 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:46.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa337fff640 1 -- 172.21.15.151:0/1939437536 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370574348 0 0) 0x561626ecdae0 con 0x5616270478e0 2024-09-13T19:06:46.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa337fff640 1 -- 172.21.15.151:0/1939437536 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa330001e20 con 0x5616270478e0 2024-09-13T19:06:46.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa344e13640 1 -- 172.21.15.151:0/1939437536 >> v1:172.21.15.12:6789/0 conn(0x5616270478e0 legacy=0x561627047cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.691+0000 7fa344e13640 1 -- 172.21.15.151:0/1939437536 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162704f5a0 con 0x56162704bc60 2024-09-13T19:06:46.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa344e13640 1 --2- 172.21.15.151:0/1939437536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162704bc60 0x56162704e050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00a480 tx=0x7fa33c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50c2a284f1a543b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa337fff640 1 -- 172.21.15.151:0/1939437536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c0b0070 con 0x56162704bc60 2024-09-13T19:06:46.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa337fff640 1 -- 172.21.15.151:0/1939437536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c0ab540 con 0x56162704bc60 2024-09-13T19:06:46.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa337fff640 1 -- 172.21.15.151:0/1939437536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33c0ab820 con 0x56162704bc60 2024-09-13T19:06:46.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 -- 172.21.15.151:0/1939437536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162704bc60 msgr2=0x56162704e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 --2- 172.21.15.151:0/1939437536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162704bc60 0x56162704e050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00a480 tx=0x7fa33c01b280 comp rx=0 tx=0).stop 2024-09-13T19:06:46.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 -- 172.21.15.151:0/1939437536 shutdown_connections 2024-09-13T19:06:46.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 --2- 172.21.15.151:0/1939437536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162704bc60 0x56162704e050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 -- 172.21.15.151:0/1939437536 >> 172.21.15.151:0/1939437536 conn(0x561626fbb230 msgr2=0x561626fbb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 -- 172.21.15.151:0/1939437536 shutdown_connections 2024-09-13T19:06:46.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.695+0000 7fa347b04980 1 -- 172.21.15.151:0/1939437536 wait complete. 2024-09-13T19:06:46.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa347b04980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa347b04980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561626ef3200 con 0x5616270478e0 2024-09-13T19:06:46.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57410/0 (socket says 172.21.15.151:57410) 2024-09-13T19:06:46.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.711+0000 7fa345614640 1 -- 172.21.15.151:0/4245970526 learned_addr learned my addr 172.21.15.151:0/4245970526 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 -- 172.21.15.151:0/4245970526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561627132ff0 con 0x5616270478e0 2024-09-13T19:06:46.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 --2- 172.21.15.151:0/4245970526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa338001dc0 tx=0x7fa33800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6166265b6d295374 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa233606640 1 -- 172.21.15.151:0/4245970526 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa338012020 con 0x5616270478e0 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa233606640 1 -- 172.21.15.151:0/4245970526 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33800e7c0 con 0x5616270478e0 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa233606640 1 -- 172.21.15.151:0/4245970526 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33800eb40 con 0x5616270478e0 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- 172.21.15.151:0/4245970526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 msgr2=0x561627132a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 --2- 172.21.15.151:0/4245970526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa338001dc0 tx=0x7fa33800b6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- 172.21.15.151:0/4245970526 shutdown_connections 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 --2- 172.21.15.151:0/4245970526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627132a20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- 172.21.15.151:0/4245970526 >> 172.21.15.151:0/4245970526 conn(0x561626fbb230 msgr2=0x56162712e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- 172.21.15.151:0/4245970526 shutdown_connections 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- 172.21.15.151:0/4245970526 wait complete. 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627139dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa347b04980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56162704f0a0 con 0x5616270478e0 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627139dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627139dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57416/0 (socket says 172.21.15.151:57416) 2024-09-13T19:06:46.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 -- 172.21.15.151:0/355662860 learned_addr learned my addr 172.21.15.151:0/355662860 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162713a310 con 0x5616270478e0 2024-09-13T19:06:46.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.715+0000 7fa345614640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627139dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x561627133c00 tx=0x7fa338000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 -- 172.21.15.151:0/355662860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa338012030 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56162713a5a0 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 -- 172.21.15.151:0/355662860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa338001440 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 -- 172.21.15.151:0/355662860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33801aaf0 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162713d280 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 -- 172.21.15.151:0/355662860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa338015020 con 0x5616270478e0 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa22c034650 0x7fa22c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa231e03640 1 -- 172.21.15.151:0/355662860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa338020030 con 0x5616270478e0 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa344e13640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa22c034650 0x7fa22c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56162704bc60 0x561627140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616271413e0 con 0x56162704bc60 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345e15640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56162704bc60 0x561627140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa344e13640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa22c034650 0x7fa22c036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0ad000 tx=0x7fa33c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345e15640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56162704bc60 0x561627140da0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345e15640 1 -- 172.21.15.151:0/355662860 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x56162704bc60 2024-09-13T19:06:46.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162713e4a0 con 0x56162704bc60 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345e15640 1 -- 172.21.15.151:0/355662860 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa34000a4d0 con 0x56162704bc60 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561627143730 0x561627145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616271461f0 con 0x561627143730 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345614640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561627143730 0x561627145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.719+0000 7fa345614640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561627143730 0x561627145b20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 -- 172.21.15.151:0/355662860 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa338008030 con 0x561627143730 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616271425d0 con 0x56162704bc60 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345e15640 1 -- 172.21.15.151:0/355662860 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa34000a4d0 con 0x56162704bc60 2024-09-13T19:06:46.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561627147630 0x561627149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162714a1b0 con 0x561627147630 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa344e13640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561627147630 0x561627149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa344e13640 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561627147630 0x561627149a20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa344e13640 1 -- 172.21.15.151:0/355662860 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa33c0b3040 con 0x561627147630 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561626f4c800 con 0x561627157c60 2024-09-13T19:06:46.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57418/0 (socket says 172.21.15.151:57418) 2024-09-13T19:06:46.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 -- 172.21.15.151:0/2935725627 learned_addr learned my addr 172.21.15.151:0/2935725627 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 -- 172.21.15.151:0/2935725627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616271585c0 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa345614640 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa338048560 tx=0x7fa3380303b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa22affd640 1 -- 172.21.15.151:0/2935725627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3380166a0 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616271587f0 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa22affd640 1 -- 172.21.15.151:0/2935725627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa338016840 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa22affd640 1 -- 172.21.15.151:0/2935725627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3380185a0 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.723+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162715b470 con 0x561627157c60 2024-09-13T19:06:46.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa22affd640 1 -- 172.21.15.151:0/2935725627 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa338009070 con 0x561627157c60 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa22affd640 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 0x7fa21c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa22affd640 1 -- 172.21.15.151:0/2935725627 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa338037070 con 0x561627157c60 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa344e13640 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 0x7fa21c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa344e13640 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 0x7fa21c036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa33c01b2c0 tx=0x7fa33c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561627133370 con 0x561627164560 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57432/0 (socket says 172.21.15.151:57432) 2024-09-13T19:06:46.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa345614640 1 -- 172.21.15.151:0/522116950 learned_addr learned my addr 172.21.15.151:0/522116950 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa345614640 1 -- 172.21.15.151:0/522116950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561627164f10 con 0x561627164560 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa345614640 1 --2- 172.21.15.151:0/522116950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa338009f30 tx=0x7fa33804e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cfe1b8a29c0647 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa228ff9640 1 -- 172.21.15.151:0/522116950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33800c960 con 0x561627164560 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa228ff9640 1 -- 172.21.15.151:0/522116950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3380095f0 con 0x561627164560 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa228ff9640 1 -- 172.21.15.151:0/522116950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33800cb00 con 0x561627164560 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 -- 172.21.15.151:0/522116950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 msgr2=0x561627164940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 --2- 172.21.15.151:0/522116950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa338009f30 tx=0x7fa33804e450 comp rx=0 tx=0).stop 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 -- 172.21.15.151:0/522116950 shutdown_connections 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 --2- 172.21.15.151:0/522116950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627164560 0x561627164940 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.727+0000 7fa347b04980 1 -- 172.21.15.151:0/522116950 >> 172.21.15.151:0/522116950 conn(0x561627160940 msgr2=0x56162715ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- 172.21.15.151:0/522116950 shutdown_connections 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- 172.21.15.151:0/522116950 wait complete. 2024-09-13T19:06:46.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 Processor -- start 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- start start 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 0x56162716bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616271653b0 con 0x56162716b900 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 0x56162716bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa345614640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 0x56162716bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57446/0 (socket says 172.21.15.151:57446) 2024-09-13T19:06:46.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 learned_addr learned my addr 172.21.15.151:0/3639138947 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56162716c260 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa345614640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 0x56162716bd20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa338041d30 tx=0x7fa33804e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 -- 172.21.15.151:0/3639138947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa338068020 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56162716c260 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 -- 172.21.15.151:0/3639138947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33800d860 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 -- 172.21.15.151:0/3639138947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa33800db80 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56162716edf0 con 0x56162716b900 2024-09-13T19:06:46.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 -- 172.21.15.151:0/3639138947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa33806b020 con 0x56162716b900 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa210034650 0x7fa210036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa21affd640 1 -- 172.21.15.151:0/3639138947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa33805f070 con 0x56162716b900 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.731+0000 7fa344e13640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa210034650 0x7fa210036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561627176e00 0x5616271792c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561627179a10 con 0x561627176e00 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561627176e00 0x5616271792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa344e13640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa210034650 0x7fa210036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0abaa0 tx=0x7fa33c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561627176e00 0x5616271792c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 realm 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561627179e20 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717a6f0 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56162717b7f0 0x56162717dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717e1b0 con 0x56162717b7f0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56162717b7f0 0x56162717dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56162717b7f0 0x56162717dbe0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 20 searching for the correct realm 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717fa80 con 0x56162717b7f0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa33806d020 0x7fa33804e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717fa80 con 0x7fa33806d020 2024-09-13T19:06:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa344e13640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa33806d020 0x7fa33804e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.735+0000 7fa344e13640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa33806d020 0x7fa33804e5c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa344e13640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa33c0dc040 0x7fa33c0ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717fa80 con 0x7fa33c0dc040 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa33c0dc040 0x7fa33c0ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa33c0dc040 0x7fa33c0ce430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33806d020 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.739+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33806d020 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.743+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33806d020 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33806d020 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x56162717b7f0 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.747+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33c0dc040 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x561627176e00 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56162717aa90 con 0x7fa33806d020 2024-09-13T19:06:46.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717eb70 con 0x561627176e00 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717e7b0 con 0x561627176e00 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717f490 con 0x7fa33806d020 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 zone default found 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 4 Realm: () 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 zonegroup default 2024-09-13T19:06:46.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162717feb0 con 0x7fa33c0dc040 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561627181890 con 0x56162717b7f0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561627181d10 con 0x56162717b7f0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:46.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 started sync module instance, tier type = 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.751+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627180d30 con 0x7fa33806d020 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94653145157920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627180990 con 0x7fa33806d020 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627182c40 con 0x561627176e00 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94653145157920] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94653145163664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627183060 con 0x561627176e00 2024-09-13T19:06:46.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.755+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627183930 con 0x56162717b7f0 2024-09-13T19:06:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94653145166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271841d0 con 0x56162717b7f0 2024-09-13T19:06:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627184bf0 con 0x7fa33806d020 2024-09-13T19:06:46.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94653145163664] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94653145171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627184fe0 con 0x7fa33806d020 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.759+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271859a0 con 0x561627176e00 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.763+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94653145166224] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.763+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94653145171680] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.763+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.763+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94653145164720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271854f0 con 0x561627176e00 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.763+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627186240 con 0x7fa33c0dc040 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94653145164720] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94653145169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271854f0 con 0x7fa33c0dc040 2024-09-13T19:06:46.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627186710 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94653145178624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627186b80 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627187620 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.767+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94653145169184] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94653145182480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271875e0 con 0x7fa33c0dc040 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=0 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=1 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=2 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=3 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=4 2024-09-13T19:06:46.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=5 2024-09-13T19:06:46.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94653145178624] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=6 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94653145182480] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 20 add_watcher() i=7 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.771+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616271866d0 con 0x561627176e00 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94653145179856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627187a40 con 0x561627176e00 2024-09-13T19:06:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94653145179856] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa347b04980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa347b04980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:46.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.775+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627192df0 con 0x561627176e00 2024-09-13T19:06:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.779+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.779+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627193440 con 0x7fa33c0dc040 2024-09-13T19:06:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.779+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.779+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271938a0 con 0x56162717b7f0 2024-09-13T19:06:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627193850 con 0x561627176e00 2024-09-13T19:06:46.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627193d00 con 0x7fa33806d020 2024-09-13T19:06:46.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.783+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627190ca0 con 0x56162717b7f0 2024-09-13T19:06:46.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.787+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.787+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627190ca0 con 0x561627176e00 2024-09-13T19:06:46.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.787+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.787+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627190d60 con 0x7fa33c0dc040 2024-09-13T19:06:46.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.791+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.791+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627190d60 con 0x7fa33806d020 2024-09-13T19:06:46.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271948b0 con 0x56162717b7f0 2024-09-13T19:06:46.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271948b0 con 0x7fa33806d020 2024-09-13T19:06:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.795+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627194e20 con 0x7fa33c0dc040 2024-09-13T19:06:46.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.799+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.799+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627194e20 con 0x7fa33806d020 2024-09-13T19:06:46.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.799+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.799+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627195040 con 0x7fa33c0dc040 2024-09-13T19:06:46.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.803+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.803+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627195040 con 0x561627176e00 2024-09-13T19:06:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.803+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.803+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627195040 con 0x56162717b7f0 2024-09-13T19:06:46.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627195040 con 0x7fa33806d020 2024-09-13T19:06:46.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.807+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x561627176e00 2024-09-13T19:06:46.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.811+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.811+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x561627176e00 2024-09-13T19:06:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.811+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.811+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x7fa33806d020 2024-09-13T19:06:46.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.815+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.819+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.823+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.823+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.823+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.823+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.827+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.827+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x56162717b7f0 2024-09-13T19:06:46.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.827+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.827+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.831+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.831+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271950d0 con 0x7fa33806d020 2024-09-13T19:06:46.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa1fa7e4640 20 reqs_thread_entry: start 2024-09-13T19:06:46.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:46.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 20 Filter name: none 2024-09-13T19:06:46.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa16bfff640 20 reqs_thread_entry: start 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 20 rados->read ofs=0 len=0 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561627190180 con 0x7fa33c0dc040 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:06:46.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:06:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56162718fbf0 con 0x7fa33c0dc040 2024-09-13T19:06:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.835+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.839 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:06:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa1fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:46.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94653145179856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56162718ca90 con 0x561627176e00 2024-09-13T19:06:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94653145179856] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94653145157920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271866d0 con 0x7fa33806d020 2024-09-13T19:06:46.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94653145157920] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa347b04980 20 remove_watcher() i=0 2024-09-13T19:06:46.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa347b04980 2 removed watcher, disabling cache 2024-09-13T19:06:46.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.839+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94653145163664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627181120 con 0x561627176e00 2024-09-13T19:06:46.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.843+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94653145163664] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.843+0000 7fa347b04980 20 remove_watcher() i=1 2024-09-13T19:06:46.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.843+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94653145166224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627181120 con 0x56162717b7f0 2024-09-13T19:06:46.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa345614640 1 -- 172.21.15.151:0/3639138947 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94653145166224] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa338008030 con 0x56162717b7f0 2024-09-13T19:06:46.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 20 remove_watcher() i=2 2024-09-13T19:06:46.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94653145171680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627181120 con 0x7fa33806d020 2024-09-13T19:06:46.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa344e13640 1 -- 172.21.15.151:0/3639138947 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94653145171680] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa33c0c9030 con 0x7fa33806d020 2024-09-13T19:06:46.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 20 remove_watcher() i=3 2024-09-13T19:06:46.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94653145164720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271846e0 con 0x561627176e00 2024-09-13T19:06:46.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94653145164720] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x561627176e00 2024-09-13T19:06:46.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 20 remove_watcher() i=4 2024-09-13T19:06:46.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.847+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94653145169184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616271846e0 con 0x7fa33c0dc040 2024-09-13T19:06:46.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.851+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94653145169184] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.851+0000 7fa347b04980 20 remove_watcher() i=5 2024-09-13T19:06:46.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.851+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94653145178624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627183d20 con 0x7fa33c0dc040 2024-09-13T19:06:46.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94653145178624] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 20 remove_watcher() i=6 2024-09-13T19:06:46.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94653145182480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561627183d20 con 0x7fa33c0dc040 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94653145182480] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa34000a4d0 con 0x7fa33c0dc040 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 20 remove_watcher() i=7 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa33c0dc040 msgr2=0x7fa33c0ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa33c0dc040 0x7fa33c0ce430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561627176e00 msgr2=0x5616271792c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561627176e00 0x5616271792c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa33806d020 msgr2=0x7fa33804e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa33806d020 0x7fa33804e5c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56162717b7f0 msgr2=0x56162717dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56162717b7f0 0x56162717dbe0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa210034650 msgr2=0x7fa210036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa210034650 0x7fa210036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0abaa0 tx=0x7fa33c0b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 reap_dead start 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 msgr2=0x56162716bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/3639138947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56162716b900 0x56162716bd20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa338041d30 tx=0x7fa33804e500 comp rx=0 tx=0).stop 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa345e15640 1 -- 172.21.15.151:0/3639138947 reap_dead start 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 shutdown_connections 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 >> 172.21.15.151:0/3639138947 conn(0x561627160940 msgr2=0x56162715ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 shutdown_connections 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/3639138947 wait complete. 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 msgr2=0x7fa21c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 0x7fa21c036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa33c01b2c0 tx=0x7fa33c005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:46.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 msgr2=0x561627158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa338048560 tx=0x7fa3380303b0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 shutdown_connections 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa21c034650 0x7fa21c036b10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 --2- 172.21.15.151:0/2935725627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561627157c60 0x561627158080 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 >> 172.21.15.151:0/2935725627 conn(0x56162714cdb0 msgr2=0x56162714f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 shutdown_connections 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.855+0000 7fa347b04980 1 -- 172.21.15.151:0/2935725627 wait complete. 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56162704bc60 msgr2=0x561627140da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56162704bc60 0x561627140da0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561627147630 msgr2=0x561627149a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561627147630 0x561627149a20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561627143730 msgr2=0x561627145b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561627143730 0x561627145b20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa22c034650 msgr2=0x7fa22c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa22c034650 0x7fa22c036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0ad000 tx=0x7fa33c0a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 msgr2=0x561627139dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 --2- 172.21.15.151:0/355662860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616270478e0 0x561627139dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x561627133c00 tx=0x7fa338000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa345e15640 1 -- 172.21.15.151:0/355662860 reap_dead start 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 shutdown_connections 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 >> 172.21.15.151:0/355662860 conn(0x561626fbb230 msgr2=0x56162712d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 shutdown_connections 2024-09-13T19:06:46.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.859+0000 7fa347b04980 1 -- 172.21.15.151:0/355662860 wait complete. 2024-09-13T19:06:46.872 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:06:46.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:06:46.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-13T19:06:46.873 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-13T19:06:46.954 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:46.955 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.951+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.951+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.951+0000 7f5362502980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c0128716a0 0x55c012871a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.951+0000 7f5362502980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0126f9ae0 con 0x55c012871ff0 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.951+0000 7f5362502980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55c01271de30 con 0x55c0128716a0 2024-09-13T19:06:46.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c0128716a0 0x55c012871a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c0128716a0 0x55c012871a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57450/0 (socket says 172.21.15.151:57450) 2024-09-13T19:06:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 -- 172.21.15.151:0/879167083 learned_addr learned my addr 172.21.15.151:0/879167083 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 -- 172.21.15.151:0/879167083 >> v1:172.21.15.12:6789/0 conn(0x55c012871ff0 legacy=0x55c012876a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 -- 172.21.15.151:0/879167083 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012879270 con 0x55c0128716a0 2024-09-13T19:06:46.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f5360012640 1 --2- 172.21.15.151:0/879167083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012871a80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f535000a4e0 tx=0x7f535001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5fd8409d613b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f535f010640 1 -- 172.21.15.151:0/879167083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500aa540 con 0x55c0128716a0 2024-09-13T19:06:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f535f010640 1 -- 172.21.15.151:0/879167083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500aa6e0 con 0x55c0128716a0 2024-09-13T19:06:46.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.955+0000 7f535f010640 1 -- 172.21.15.151:0/879167083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500aaa40 con 0x55c0128716a0 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 -- 172.21.15.151:0/879167083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 msgr2=0x55c012871a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 --2- 172.21.15.151:0/879167083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012871a80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f535000a4e0 tx=0x7f535001b090 comp rx=0 tx=0).stop 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 -- 172.21.15.151:0/879167083 shutdown_connections 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 --2- 172.21.15.151:0/879167083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012871a80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 -- 172.21.15.151:0/879167083 >> 172.21.15.151:0/879167083 conn(0x55c01286d1c0 msgr2=0x55c01286f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 -- 172.21.15.151:0/879167083 shutdown_connections 2024-09-13T19:06:46.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.959+0000 7f5362502980 1 -- 172.21.15.151:0/879167083 wait complete. 2024-09-13T19:06:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5362502980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5362502980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c01271f200 con 0x55c0128716a0 2024-09-13T19:06:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57452/0 (socket says 172.21.15.151:57452) 2024-09-13T19:06:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.971+0000 7f5360012640 1 -- 172.21.15.151:0/3081656236 learned_addr learned my addr 172.21.15.151:0/3081656236 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 -- 172.21.15.151:0/3081656236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c01295cfb0 con 0x55c0128716a0 2024-09-13T19:06:46.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 --2- 172.21.15.151:0/3081656236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5350017ca0 tx=0x7f53500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9980436704ff58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524e60c640 1 -- 172.21.15.151:0/3081656236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500b9030 con 0x55c0128716a0 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524e60c640 1 -- 172.21.15.151:0/3081656236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500aaac0 con 0x55c0128716a0 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524e60c640 1 -- 172.21.15.151:0/3081656236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500aada0 con 0x55c0128716a0 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/3081656236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 msgr2=0x55c01295c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 --2- 172.21.15.151:0/3081656236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5350017ca0 tx=0x7f53500033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/3081656236 shutdown_connections 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 --2- 172.21.15.151:0/3081656236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c01295c9e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/3081656236 >> 172.21.15.151:0/3081656236 conn(0x55c01286d1c0 msgr2=0x55c012958610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/3081656236 shutdown_connections 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/3081656236 wait complete. 2024-09-13T19:06:46.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012963bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c012878cb0 con 0x55c0128716a0 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012963bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012963bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57466/0 (socket says 172.21.15.151:57466) 2024-09-13T19:06:46.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 -- 172.21.15.151:0/2307883644 learned_addr learned my addr 172.21.15.151:0/2307883644 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012964130 con 0x55c0128716a0 2024-09-13T19:06:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5360012640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012963bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5350005cc0 tx=0x7f5350017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524ce09640 1 -- 172.21.15.151:0/2307883644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500b9030 con 0x55c0128716a0 2024-09-13T19:06:46.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0129643c0 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524ce09640 1 -- 172.21.15.151:0/2307883644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500c3070 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.975+0000 7f524ce09640 1 -- 172.21.15.151:0/2307883644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500bf750 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0129670a0 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f524ce09640 1 -- 172.21.15.151:0/2307883644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53500c5030 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f524ce09640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5248034650 0x7f5248036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f524ce09640 1 -- 172.21.15.151:0/2307883644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f53500ba070 con 0x55c0128716a0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f535f811640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5248034650 0x7f5248036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c012871ff0 0x55c01296ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c01296b1a0 con 0x55c012871ff0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360813640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c012871ff0 0x55c01296ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f535f811640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5248034650 0x7f5248036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5354000f70 tx=0x7f5354001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360813640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c012871ff0 0x55c01296ab80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360813640 1 -- 172.21.15.151:0/2307883644 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c012871ff0 2024-09-13T19:06:46.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c01296bad0 con 0x55c012871ff0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360813640 1 -- 172.21.15.151:0/2307883644 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x55c012871ff0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c01296d3e0 0x55c01296f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c012970010 con 0x55c01296d3e0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360012640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c01296d3e0 0x55c01296f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360012640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c01296d3e0 0x55c01296f880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5360012640 1 -- 172.21.15.151:0/2307883644 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f53500ce070 con 0x55c01296d3e0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.979+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c01296c320 con 0x55c012871ff0 2024-09-13T19:06:46.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360813640 1 -- 172.21.15.151:0/2307883644 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x55c012871ff0 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c012971470 0x55c012973860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c012973fa0 con 0x55c012971470 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f535f811640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c012971470 0x55c012973860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f535f811640 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c012971470 0x55c012973860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f535f811640 1 -- 172.21.15.151:0/2307883644 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f535400d040 con 0x55c012971470 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c012778800 con 0x55c012981a70 2024-09-13T19:06:46.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57482/0 (socket says 172.21.15.151:57482) 2024-09-13T19:06:46.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360012640 1 -- 172.21.15.151:0/218203291 learned_addr learned my addr 172.21.15.151:0/218203291 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360012640 1 -- 172.21.15.151:0/218203291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0129823d0 con 0x55c012981a70 2024-09-13T19:06:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5360012640 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5350008030 tx=0x7f53500e2190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5245ffb640 1 -- 172.21.15.151:0/218203291 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500a9a60 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5245ffb640 1 -- 172.21.15.151:0/218203291 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500c63c0 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c012982600 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5245ffb640 1 -- 172.21.15.151:0/218203291 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500c66a0 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.983+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c012985280 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5245ffb640 1 -- 172.21.15.151:0/218203291 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53500b3040 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5245ffb640 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 0x7f5238036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5245ffb640 1 -- 172.21.15.151:0/218203291 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f53500d7070 con 0x55c012981a70 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f535f811640 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 0x7f5238036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f535f811640 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 0x7f5238036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55c01296c6c0 tx=0x7f5354006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c01295d270 con 0x55c01298e3f0 2024-09-13T19:06:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57490/0 (socket says 172.21.15.151:57490) 2024-09-13T19:06:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5360012640 1 -- 172.21.15.151:0/905372849 learned_addr learned my addr 172.21.15.151:0/905372849 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5360012640 1 -- 172.21.15.151:0/905372849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c01298edc0 con 0x55c01298e3f0 2024-09-13T19:06:46.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5360012640 1 --2- 172.21.15.151:0/905372849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53500e08a0 tx=0x7f53500e06a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e138c1132896aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f523f7fe640 1 -- 172.21.15.151:0/905372849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500c9e00 con 0x55c01298e3f0 2024-09-13T19:06:46.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f523f7fe640 1 -- 172.21.15.151:0/905372849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500d1870 con 0x55c01298e3f0 2024-09-13T19:06:46.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f523f7fe640 1 -- 172.21.15.151:0/905372849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500e8cf0 con 0x55c01298e3f0 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- 172.21.15.151:0/905372849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 msgr2=0x55c01298e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 --2- 172.21.15.151:0/905372849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f53500e08a0 tx=0x7f53500e06a0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- 172.21.15.151:0/905372849 shutdown_connections 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 --2- 172.21.15.151:0/905372849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c01298e7f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- 172.21.15.151:0/905372849 >> 172.21.15.151:0/905372849 conn(0x55c01298a770 msgr2=0x55c012988870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- 172.21.15.151:0/905372849 shutdown_connections 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- 172.21.15.151:0/905372849 wait complete. 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 Processor -- start 2024-09-13T19:06:46.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.987+0000 7f5362502980 1 -- start start 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c01298f180 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360012640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57494/0 (socket says 172.21.15.151:57494) 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 learned_addr learned my addr 172.21.15.151:0/4264994677 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c012995ab0 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360012640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53500bcff0 tx=0x7f53500bcf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 -- 172.21.15.151:0/4264994677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500dcb50 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c012995ab0 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 -- 172.21.15.151:0/4264994677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53500bf9c0 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 -- 172.21.15.151:0/4264994677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53500dccf0 con 0x55c01298e3f0 2024-09-13T19:06:46.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c012995f20 con 0x55c01298e3f0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 -- 172.21.15.151:0/4264994677 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53500e8400 con 0x55c01298e3f0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5230034650 0x7f5230036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f523dffb640 1 -- 172.21.15.151:0/4264994677 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f53500f6c80 con 0x55c01298e3f0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f535f811640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5230034650 0x7f5230036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c0129a04e0 0x55c0129a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a30d0 con 0x55c0129a04e0 2024-09-13T19:06:47.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.991+0000 7f5360813640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c0129a04e0 0x55c0129a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5230034650 0x7f5230036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55c0129743a0 tx=0x7f5354011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c0129a04e0 0x55c0129a2980 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 realm 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a34e0 con 0x55c0129a04e0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a3d80 con 0x55c0129a04e0 2024-09-13T19:06:47.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c0129a4e80 0x55c0129a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a7910 con 0x55c0129a4e80 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c0129a4e80 0x55c0129a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c0129a4e80 0x55c0129a7270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:47.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 20 searching for the correct realm 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a9170 con 0x55c0129a4e80 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f53500da020 0x7f53500f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a9170 con 0x7f53500da020 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f53500da020 0x7f53500f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f53500da020 0x7f53500f5940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f535400f3d0 0x7f535400f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a9170 con 0x7f535400f3d0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.995+0000 7f5360813640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f535400f3d0 0x7f535400f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f535400f3d0 0x7f535400f7f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f53500da020 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:46.999+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f53500da020 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.003+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f53500da020 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f53500da020 2024-09-13T19:06:47.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a4e80 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f535400f3d0 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x55c0129a04e0 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a4120 con 0x7f53500da020 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:47.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.007+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a8290 con 0x55c0129a04e0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a8ae0 con 0x55c0129a04e0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a7ef0 con 0x7f53500da020 2024-09-13T19:06:47.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 zone default found 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 4 Realm: () 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 zonegroup default 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129a95a0 con 0x7f535400f3d0 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aafe0 con 0x55c0129a4e80 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ab4d0 con 0x55c0129a4e80 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 started sync module instance, tier type = 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aa420 con 0x7f53500da020 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283434207248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aa080 con 0x7f53500da020 2024-09-13T19:06:47.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.011+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ac400 con 0x55c0129a04e0 2024-09-13T19:06:47.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283434207248] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283434213200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ac820 con 0x55c0129a04e0 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ad0f0 con 0x55c0129a4e80 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283434213200] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.015+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283434214528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ad4e0 con 0x55c0129a4e80 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129adea0 con 0x7f53500da020 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283434220320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ae740 con 0x7f53500da020 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129af140 con 0x55c0129a04e0 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283434214528] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283434220320] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283434215712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129ae290 con 0x55c0129a04e0 2024-09-13T19:06:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.019+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129af9e0 con 0x7f535400f3d0 2024-09-13T19:06:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.023+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283434215712] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.023+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.023+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283434224720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129af700 con 0x7f535400f3d0 2024-09-13T19:06:47.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.023+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aff50 con 0x7f535400f3d0 2024-09-13T19:06:47.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283434227728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129b02a0 con 0x7f535400f3d0 2024-09-13T19:06:47.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129b0dc0 con 0x7f535400f3d0 2024-09-13T19:06:47.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283434224720] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283434231952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129b0d80 con 0x7f535400f3d0 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=0 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=1 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=2 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=3 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=4 2024-09-13T19:06:47.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.027+0000 7f5362502980 20 add_watcher() i=5 2024-09-13T19:06:47.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283434227728] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 add_watcher() i=6 2024-09-13T19:06:47.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283434231952] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 add_watcher() i=7 2024-09-13T19:06:47.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:47.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129afd30 con 0x55c0129a04e0 2024-09-13T19:06:47.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283434228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129b11b0 con 0x55c0129a04e0 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283434228976] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 5 note: GC not initialized 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5215fe3640 20 reqs_thread_entry: start 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 Filter name: none 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f520effd640 20 reqs_thread_entry: start 2024-09-13T19:06:47.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:47.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.031+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129d9520 con 0x7f535400f3d0 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129db600 con 0x7f53500da020 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv22 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129dce80 con 0x55c0129a4e80 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:47.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:47.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.035+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129de3d0 con 0x7f535400f3d0 2024-09-13T19:06:47.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129de7d0 con 0x7f53500da020 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv22 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129e43c0 con 0x7f53500da020 2024-09-13T19:06:47.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:06:47.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.039+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94283434426064 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c0129e17f0 con 0x7f535400f3d0 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== watch-notify(notify (1) cookie 94283434227728 notify 137438953478 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f535803b040 con 0x7f535400f3d0 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f523f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94283434227728 notifier 4512 bl.length()=338 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(68 notify.6 [notify cookie 94283434426064 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f523f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f523f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f523f7fe640 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5224003eb0 con 0x7f535400f3d0 2024-09-13T19:06:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== watch-notify(notify_complete (2) cookie 94283434426064 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5358010040 con 0x7f535400f3d0 2024-09-13T19:06:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283434228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129d7350 con 0x55c0129a04e0 2024-09-13T19:06:47.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94283434228976] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.043+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283434207248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129d7350 con 0x7f53500da020 2024-09-13T19:06:47.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94283434207248] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5362502980 20 remove_watcher() i=0 2024-09-13T19:06:47.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5362502980 2 removed watcher, disabling cache 2024-09-13T19:06:47.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283434213200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aa810 con 0x55c0129a04e0 2024-09-13T19:06:47.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94283434213200] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5362502980 20 remove_watcher() i=1 2024-09-13T19:06:47.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.047+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283434214528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129d7350 con 0x55c0129a4e80 2024-09-13T19:06:47.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5360012640 1 -- 172.21.15.151:0/4264994677 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94283434214528] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535010c020 con 0x55c0129a4e80 2024-09-13T19:06:47.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 20 remove_watcher() i=2 2024-09-13T19:06:47.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283434220320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129abf50 con 0x7f53500da020 2024-09-13T19:06:47.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f535f811640 1 -- 172.21.15.151:0/4264994677 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94283434220320] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354036040 con 0x7f53500da020 2024-09-13T19:06:47.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 20 remove_watcher() i=3 2024-09-13T19:06:47.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283434215712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129aa810 con 0x55c0129a04e0 2024-09-13T19:06:47.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94283434215712] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x55c0129a04e0 2024-09-13T19:06:47.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 20 remove_watcher() i=4 2024-09-13T19:06:47.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.051+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283434224720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129d7350 con 0x7f535400f3d0 2024-09-13T19:06:47.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.055+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94283434224720] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.055+0000 7f5362502980 20 remove_watcher() i=5 2024-09-13T19:06:47.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.055+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283434227728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129adb20 con 0x7f535400f3d0 2024-09-13T19:06:47.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94283434227728] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 20 remove_watcher() i=6 2024-09-13T19:06:47.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283434231952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c0129abf50 con 0x7f535400f3d0 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94283434231952] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53580083f0 con 0x7f535400f3d0 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 20 remove_watcher() i=7 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f535400f3d0 msgr2=0x7f535400f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f535400f3d0 0x7f535400f7f0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c0129a04e0 msgr2=0x55c0129a2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c0129a04e0 0x55c0129a2980 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f53500da020 msgr2=0x7f53500f5940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f53500da020 0x7f53500f5940 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c0129a4e80 msgr2=0x55c0129a7270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c0129a4e80 0x55c0129a7270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5230034650 msgr2=0x7f5230036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5230034650 0x7f5230036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55c0129743a0 tx=0x7f5354011000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5360813640 1 -- 172.21.15.151:0/4264994677 reap_dead start 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 msgr2=0x55c012995570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53500bcff0 tx=0x7f53500bcf80 comp rx=0 tx=0).stop 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 shutdown_connections 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/4264994677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c01298e3f0 0x55c012995570 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 >> 172.21.15.151:0/4264994677 conn(0x55c01298a770 msgr2=0x55c012988840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 shutdown_connections 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/4264994677 wait complete. 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 msgr2=0x7f5238036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 0x7f5238036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55c01296c6c0 tx=0x7f5354006000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 msgr2=0x55c012981e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5350008030 tx=0x7f53500e2190 comp rx=0 tx=0).stop 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 shutdown_connections 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5238034650 0x7f5238036b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/218203291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c012981a70 0x55c012981e90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 >> 172.21.15.151:0/218203291 conn(0x55c012976bc0 msgr2=0x55c012979640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 shutdown_connections 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/218203291 wait complete. 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c012871ff0 msgr2=0x55c01296ab80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c012871ff0 0x55c01296ab80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c012971470 msgr2=0x55c012973860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c012971470 0x55c012973860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c01296d3e0 msgr2=0x55c01296f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c01296d3e0 0x55c01296f880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5248034650 msgr2=0x7f5248036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5248034650 0x7f5248036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5354000f70 tx=0x7f5354001420 comp rx=0 tx=0).stop 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 msgr2=0x55c012963bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 --2- 172.21.15.151:0/2307883644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c0128716a0 0x55c012963bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5350005cc0 tx=0x7f5350017e30 comp rx=0 tx=0).stop 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5360813640 1 -- 172.21.15.151:0/2307883644 reap_dead start 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 shutdown_connections 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 >> 172.21.15.151:0/2307883644 conn(0x55c01286d1c0 msgr2=0x55c012957190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 shutdown_connections 2024-09-13T19:06:47.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.059+0000 7f5362502980 1 -- 172.21.15.151:0/2307883644 wait complete. 2024-09-13T19:06:47.073 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1'] 2024-09-13T19:06:47.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1'] 2024-09-13T19:06:47.073 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:47.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42765b4980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559c8806b630 0x559c8806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42765b4980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c87ef3ae0 con 0x559c8806bf80 2024-09-13T19:06:47.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42765b4980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559c87f17e30 con 0x559c8806b630 2024-09-13T19:06:47.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42740c4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559c8806b630 0x559c8806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42740c4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559c8806b630 0x559c8806ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57504/0 (socket says 172.21.15.151:57504) 2024-09-13T19:06:47.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42740c4640 1 -- 172.21.15.151:0/2918354085 learned_addr learned my addr 172.21.15.151:0/2918354085 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42740c4640 1 -- 172.21.15.151:0/2918354085 >> v1:172.21.15.12:6789/0 conn(0x559c8806bf80 legacy=0x559c880709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.151+0000 7f42740c4640 1 -- 172.21.15.151:0/2918354085 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c88073200 con 0x559c8806b630 2024-09-13T19:06:47.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42740c4640 1 --2- 172.21.15.151:0/2918354085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8806ba10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f426400a5c0 tx=0x7f426401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c406f37fb89ffaeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42730c2640 1 -- 172.21.15.151:0/2918354085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640a6070 con 0x559c8806b630 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42730c2640 1 -- 172.21.15.151:0/2918354085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640af070 con 0x559c8806b630 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42730c2640 1 -- 172.21.15.151:0/2918354085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640aa5c0 con 0x559c8806b630 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 -- 172.21.15.151:0/2918354085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 msgr2=0x559c8806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 --2- 172.21.15.151:0/2918354085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8806ba10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f426400a5c0 tx=0x7f426401b340 comp rx=0 tx=0).stop 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 -- 172.21.15.151:0/2918354085 shutdown_connections 2024-09-13T19:06:47.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 --2- 172.21.15.151:0/2918354085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8806ba10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 -- 172.21.15.151:0/2918354085 >> 172.21.15.151:0/2918354085 conn(0x559c88067150 msgr2=0x559c88069570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 -- 172.21.15.151:0/2918354085 shutdown_connections 2024-09-13T19:06:47.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.155+0000 7f42765b4980 1 -- 172.21.15.151:0/2918354085 wait complete. 2024-09-13T19:06:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42765b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42765b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c87f19200 con 0x559c8806b630 2024-09-13T19:06:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57508/0 (socket says 172.21.15.151:57508) 2024-09-13T19:06:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42740c4640 1 -- 172.21.15.151:0/3502060100 learned_addr learned my addr 172.21.15.151:0/3502060100 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.167+0000 7f42740c4640 1 -- 172.21.15.151:0/3502060100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c88157040 con 0x559c8806b630 2024-09-13T19:06:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 --2- 172.21.15.151:0/3502060100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42640199f0 tx=0x7f4264003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0f354b1aae7b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f416260c640 1 -- 172.21.15.151:0/3502060100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640aaa00 con 0x559c8806b630 2024-09-13T19:06:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f416260c640 1 -- 172.21.15.151:0/3502060100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640aaba0 con 0x559c8806b630 2024-09-13T19:06:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f416260c640 1 -- 172.21.15.151:0/3502060100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640bd3f0 con 0x559c8806b630 2024-09-13T19:06:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/3502060100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 msgr2=0x559c88156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 --2- 172.21.15.151:0/3502060100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42640199f0 tx=0x7f4264003030 comp rx=0 tx=0).stop 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/3502060100 shutdown_connections 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 --2- 172.21.15.151:0/3502060100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c88156a70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/3502060100 >> 172.21.15.151:0/3502060100 conn(0x559c88067150 msgr2=0x559c881526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/3502060100 shutdown_connections 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/3502060100 wait complete. 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c88072c40 con 0x559c8806b630 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8815dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57516/0 (socket says 172.21.15.151:57516) 2024-09-13T19:06:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 -- 172.21.15.151:0/2585805001 learned_addr learned my addr 172.21.15.151:0/2585805001 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8815e230 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42740c4640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8815dcf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f42640199f0 tx=0x7f42640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f4160e09640 1 -- 172.21.15.151:0/2585805001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640bd7c0 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f4160e09640 1 -- 172.21.15.151:0/2585805001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640bd960 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8815e4c0 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f4160e09640 1 -- 172.21.15.151:0/2585805001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640bdc40 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.171+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c881611a0 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f4160e09640 1 -- 172.21.15.151:0/2585805001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42640ce020 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f4160e09640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f415c0346a0 0x7f415c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f4160e09640 1 -- 172.21.15.151:0/2585805001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42640cc020 con 0x559c8806b630 2024-09-13T19:06:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42738c3640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f415c0346a0 0x7f415c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8806bf80 0x559c88164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c88165330 con 0x559c8806bf80 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42748c5640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8806bf80 0x559c88164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42738c3640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f415c0346a0 0x7f415c036b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4268001e20 tx=0x7f42680013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42748c5640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8806bf80 0x559c88164cc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42748c5640 1 -- 172.21.15.151:0/2585805001 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8806bf80 2024-09-13T19:06:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881623c0 con 0x559c8806bf80 2024-09-13T19:06:47.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42748c5640 1 -- 172.21.15.151:0/2585805001 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8806bf80 2024-09-13T19:06:47.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c88167680 0x559c88169a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8816a140 con 0x559c88167680 2024-09-13T19:06:47.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42740c4640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c88167680 0x559c88169a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42740c4640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c88167680 0x559c88169a70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42740c4640 1 -- 172.21.15.151:0/2585805001 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42640c53e0 con 0x559c88167680 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c88166520 con 0x559c8806bf80 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42748c5640 1 -- 172.21.15.151:0/2585805001 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8806bf80 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559c8816b5a0 0x559c8816d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8816e090 con 0x559c8816b5a0 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42738c3640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559c8816b5a0 0x559c8816d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.175+0000 7f42738c3640 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559c8816b5a0 0x559c8816d990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42738c3640 1 -- 172.21.15.151:0/2585805001 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f426800d040 con 0x559c8816b5a0 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c87f72800 con 0x559c8817bb60 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57528/0 (socket says 172.21.15.151:57528) 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42740c4640 1 -- 172.21.15.151:0/2964603941 learned_addr learned my addr 172.21.15.151:0/2964603941 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42740c4640 1 -- 172.21.15.151:0/2964603941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8817c4c0 con 0x559c8817bb60 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42740c4640 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f42640cf900 tx=0x7f42640e3c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 -- 172.21.15.151:0/2964603941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640cfe20 con 0x559c8817bb60 2024-09-13T19:06:47.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 -- 172.21.15.151:0/2964603941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640e32d0 con 0x559c8817bb60 2024-09-13T19:06:47.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8817c750 con 0x559c8817bb60 2024-09-13T19:06:47.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 -- 172.21.15.151:0/2964603941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640e35b0 con 0x559c8817bb60 2024-09-13T19:06:47.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8817f3d0 con 0x559c8817bb60 2024-09-13T19:06:47.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 -- 172.21.15.151:0/2964603941 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42640c6480 con 0x559c8817bb60 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 0x7f414c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f4159ffb640 1 -- 172.21.15.151:0/2964603941 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42640eec50 con 0x559c8817bb60 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.179+0000 7f42738c3640 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 0x7f414c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42738c3640 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 0x7f414c036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x559c88165c30 tx=0x7f4268006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c88157300 con 0x559c88188430 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57538/0 (socket says 172.21.15.151:57538) 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 -- 172.21.15.151:0/1521087874 learned_addr learned my addr 172.21.15.151:0/1521087874 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 -- 172.21.15.151:0/1521087874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c88188e00 con 0x559c88188430 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 --2- 172.21.15.151:0/1521087874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42640c9fc0 tx=0x7f42640b5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d252072e4566472b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f41537fe640 1 -- 172.21.15.151:0/1521087874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640e3750 con 0x559c88188430 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f41537fe640 1 -- 172.21.15.151:0/1521087874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42640e5c90 con 0x559c88188430 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f41537fe640 1 -- 172.21.15.151:0/1521087874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640bc4d0 con 0x559c88188430 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- 172.21.15.151:0/1521087874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 msgr2=0x559c88188830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 --2- 172.21.15.151:0/1521087874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f42640c9fc0 tx=0x7f42640b5f50 comp rx=0 tx=0).stop 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- 172.21.15.151:0/1521087874 shutdown_connections 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 --2- 172.21.15.151:0/1521087874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c88188830 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- 172.21.15.151:0/1521087874 >> 172.21.15.151:0/1521087874 conn(0x559c88184860 msgr2=0x559c88182960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- 172.21.15.151:0/1521087874 shutdown_connections 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- 172.21.15.151:0/1521087874 wait complete. 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 Processor -- start 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- start start 2024-09-13T19:06:47.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42765b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559c881892d0 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:57544/0 (socket says 172.21.15.151:57544) 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.183+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 learned_addr learned my addr 172.21.15.151:0/2787130805 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c8818fb70 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42740c4640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42640db830 tx=0x7f42640e5e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 -- 172.21.15.151:0/2787130805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640a8bc0 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c8818fb70 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 -- 172.21.15.151:0/2787130805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4264110070 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 -- 172.21.15.151:0/2787130805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42640e3750 con 0x559c88188430 2024-09-13T19:06:47.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c8818ffe0 con 0x559c88188430 2024-09-13T19:06:47.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 -- 172.21.15.151:0/2787130805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42640c95b0 con 0x559c88188430 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4144034650 0x7f4144036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f4151ffb640 1 -- 172.21.15.151:0/2787130805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f42640b9cf0 con 0x559c88188430 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42738c3640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4144034650 0x7f4144036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8819a650 0x559c8819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8819d240 con 0x559c8819a650 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8819a650 0x559c8819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42738c3640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4144034650 0x7f4144036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x559c8816e490 tx=0x7f4268011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8819a650 0x559c8819caf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 realm 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8819d650 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8819def0 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c8819eff0 0x559c881a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a1a30 con 0x559c8819eff0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.187+0000 7f42740c4640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c8819eff0 0x559c881a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42740c4640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c8819eff0 0x559c881a13e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42765b4980 20 searching for the correct realm 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c881a3290 con 0x559c8819eff0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42740c4640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4264009040 0x7f42640b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c881a3290 con 0x7f4264009040 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42738c3640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4264009040 0x7f42640b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42738c3640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4264009040 0x7f42640b1310 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42738c3640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f426800f3d0 0x7f426800f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c881a3290 con 0x7f426800f3d0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f426800f3d0 0x7f426800f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f426800f3d0 0x7f426800f7f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.191+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f4264009040 2024-09-13T19:06:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f4264009040 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.195+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f4264009040 2024-09-13T19:06:47.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.199+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f4264009040 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819eff0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f426800f3d0 2024-09-13T19:06:47.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x559c8819a650 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c8819e290 con 0x7f4264009040 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a23b0 con 0x559c8819a650 2024-09-13T19:06:47.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a2c00 con 0x559c8819a650 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a2750 con 0x7f4264009040 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 zone default found 2024-09-13T19:06:47.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 4 Realm: () 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 zonegroup default 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a36c0 con 0x7f426800f3d0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a5130 con 0x559c8819eff0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881a5620 con 0x559c8819eff0 2024-09-13T19:06:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 started sync module instance, tier type = 2024-09-13T19:06:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.203+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a4540 con 0x7f4264009040 2024-09-13T19:06:47.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94130786683184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a4d50 con 0x7f4264009040 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a6550 con 0x559c8819a650 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94130786683184] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94130786689184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a6970 con 0x559c8819a650 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.207+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a7240 con 0x559c8819eff0 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94130786691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a7ae0 con 0x559c8819eff0 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94130786689184] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a8500 con 0x7f4264009040 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94130786690240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a8da0 con 0x7f4264009040 2024-09-13T19:06:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a9630 con 0x559c8819a650 2024-09-13T19:06:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94130786691744] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.211+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94130786690240] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.215+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.215+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94130786694704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a8da0 con 0x559c8819a650 2024-09-13T19:06:47.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.215+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a9ed0 con 0x7f426800f3d0 2024-09-13T19:06:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.219+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94130786694704] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.219+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.219+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94130786699504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a8d10 con 0x7f426800f3d0 2024-09-13T19:06:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.219+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881aa3a0 con 0x7f426800f3d0 2024-09-13T19:06:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.223+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.223+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94130786705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881aa7c0 con 0x7f426800f3d0 2024-09-13T19:06:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.223+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94130786699504] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.223+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881ab2c0 con 0x7f426800f3d0 2024-09-13T19:06:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94130786708912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881ab280 con 0x7f426800f3d0 2024-09-13T19:06:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=0 2024-09-13T19:06:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=1 2024-09-13T19:06:47.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=2 2024-09-13T19:06:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=3 2024-09-13T19:06:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=4 2024-09-13T19:06:47.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.227+0000 7f42765b4980 20 add_watcher() i=5 2024-09-13T19:06:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94130786705072] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42765b4980 20 add_watcher() i=6 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94130786708912] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42765b4980 20 add_watcher() i=7 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42765b4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881aa2d0 con 0x559c8819a650 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.231+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94130786706128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881ab6e0 con 0x559c8819a650 2024-09-13T19:06:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94130786706128] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f412a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:47.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 5 note: GC not initialized 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f41297e2640 20 reqs_thread_entry: start 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 Filter name: none 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f409affd640 20 reqs_thread_entry: start 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881d18c0 con 0x559c8819a650 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:47.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881d1410 con 0x7f4264009040 2024-09-13T19:06:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881d5580 con 0x559c8819eff0 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:47.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:47.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:47.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.235+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881d97e0 con 0x7f426800f3d0 2024-09-13T19:06:47.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881df6a0 con 0x559c8819eff0 2024-09-13T19:06:47.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:47.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:47.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94130786882800 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881d9c10 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== watch-notify(notify (1) cookie 94130786705072 notify 137438953479 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f426c02d040 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f41537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94130786705072 notifier 4519 bl.length()=752 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f41537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f41537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f41537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f41537fe640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4138003eb0 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(67 notify.6 [notify cookie 94130786882800 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== watch-notify(notify_complete (2) cookie 94130786882800 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f426c01e040 con 0x7f426800f3d0 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:47.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:47.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:47.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:47.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.239+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881d54f0 con 0x7f4264009040 2024-09-13T19:06:47.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.243+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(69 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.243+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881d54f0 con 0x7f4264009040 2024-09-13T19:06:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'25 uv25 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42765b4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42765b4980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42765b4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:47.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94130786882800 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c881de3b0 con 0x7f426800f3d0 2024-09-13T19:06:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== watch-notify(notify (1) cookie 94130786705072 notify 137438953480 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f426c0279d0 con 0x7f426800f3d0 2024-09-13T19:06:47.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f4152ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94130786705072 notifier 4519 bl.length()=314 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f4152ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f4152ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f4152ffd640 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f40a8003410 con 0x7f426800f3d0 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(71 notify.6 [notify cookie 94130786882800 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== watch-notify(notify_complete (2) cookie 94130786882800 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f426c027cb0 con 0x7f426800f3d0 2024-09-13T19:06:47.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f412a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.247+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94130786706128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x559c8819a650 2024-09-13T19:06:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94130786706128] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94130786683184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x7f4264009040 2024-09-13T19:06:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94130786683184] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 20 remove_watcher() i=0 2024-09-13T19:06:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 2 removed watcher, disabling cache 2024-09-13T19:06:47.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94130786689184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x559c8819a650 2024-09-13T19:06:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94130786689184] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 20 remove_watcher() i=1 2024-09-13T19:06:47.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.251+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94130786691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a60a0 con 0x559c8819eff0 2024-09-13T19:06:47.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42740c4640 1 -- 172.21.15.151:0/2787130805 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94130786691744] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42640f4070 con 0x559c8819eff0 2024-09-13T19:06:47.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 20 remove_watcher() i=2 2024-09-13T19:06:47.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94130786690240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x7f4264009040 2024-09-13T19:06:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42738c3640 1 -- 172.21.15.151:0/2787130805 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94130786690240] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4268036040 con 0x7f4264009040 2024-09-13T19:06:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 20 remove_watcher() i=3 2024-09-13T19:06:47.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94130786694704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x559c8819a650 2024-09-13T19:06:47.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94130786694704] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x559c8819a650 2024-09-13T19:06:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 20 remove_watcher() i=4 2024-09-13T19:06:47.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.255+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94130786699504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x7f426800f3d0 2024-09-13T19:06:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.259+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94130786699504] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.259+0000 7f42765b4980 20 remove_watcher() i=5 2024-09-13T19:06:47.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.259+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94130786705072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881a88f0 con 0x7f426800f3d0 2024-09-13T19:06:47.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94130786705072] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 20 remove_watcher() i=6 2024-09-13T19:06:47.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94130786708912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c881cf6f0 con 0x7f426800f3d0 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94130786708912] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f426c00a4d0 con 0x7f426800f3d0 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 20 remove_watcher() i=7 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f426800f3d0 msgr2=0x7f426800f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f426800f3d0 0x7f426800f7f0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8819a650 msgr2=0x559c8819caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8819a650 0x559c8819caf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4264009040 msgr2=0x7f42640b1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4264009040 0x7f42640b1310 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c8819eff0 msgr2=0x559c881a13e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c8819eff0 0x559c881a13e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4144034650 msgr2=0x7f4144036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4144034650 0x7f4144036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x559c8816e490 tx=0x7f4268011000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 msgr2=0x559c8818f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42748c5640 1 -- 172.21.15.151:0/2787130805 reap_dead start 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f42640db830 tx=0x7f42640e5e80 comp rx=0 tx=0).stop 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 shutdown_connections 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2787130805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c88188430 0x559c8818f630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 >> 172.21.15.151:0/2787130805 conn(0x559c88184860 msgr2=0x559c88182930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 shutdown_connections 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2787130805 wait complete. 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 msgr2=0x7f414c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 0x7f414c036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x559c88165c30 tx=0x7f4268006000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 msgr2=0x559c8817bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f42640cf900 tx=0x7f42640e3c20 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 shutdown_connections 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f414c034650 0x7f414c036b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2964603941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8817bb60 0x559c8817bf80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 >> 172.21.15.151:0/2964603941 conn(0x559c88170cb0 msgr2=0x559c88173730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 shutdown_connections 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2964603941 wait complete. 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8806bf80 msgr2=0x559c88164cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559c8806bf80 0x559c88164cc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559c8816b5a0 msgr2=0x559c8816d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559c8816b5a0 0x559c8816d990 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c88167680 msgr2=0x559c88169a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559c88167680 0x559c88169a70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f415c0346a0 msgr2=0x7f415c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f415c0346a0 0x7f415c036b60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4268001e20 tx=0x7f42680013a0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 msgr2=0x559c8815dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 --2- 172.21.15.151:0/2585805001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559c8806b630 0x559c8815dcf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f42640199f0 tx=0x7f42640180e0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42748c5640 1 -- 172.21.15.151:0/2585805001 reap_dead start 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 shutdown_connections 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 >> 172.21.15.151:0/2585805001 conn(0x559c88067150 msgr2=0x559c88151220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 shutdown_connections 2024-09-13T19:06:47.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.263+0000 7f42765b4980 1 -- 172.21.15.151:0/2585805001 wait complete. 2024-09-13T19:06:47.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:47.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-13T19:06:47.278 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-13T19:06:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:47.354 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47f8b4980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55fbc4232a10 0x55fbc4234e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47f8b4980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbc40b6ae0 con 0x55fbc422e690 2024-09-13T19:06:47.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47f8b4980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55fbc40dae30 con 0x55fbc4232a10 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47cbc3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55fbc4232a10 0x55fbc4234e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47d3c4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55fbc422e690 0x55fbc422ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33292/0 (socket says 172.21.15.151:33292) 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.351+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1178017587 learned_addr learned my addr 172.21.15.151:0/1178017587 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc477fff640 1 -- 172.21.15.151:0/1178017587 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298610080 0 0) 0x55fbc40b6ae0 con 0x55fbc422e690 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc477fff640 1 -- 172.21.15.151:0/1178017587 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc460001e20 con 0x55fbc422e690 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1178017587 >> v1:172.21.15.12:6789/0 conn(0x55fbc422e690 legacy=0x55fbc422ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1178017587 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc4236350 con 0x55fbc4232a10 2024-09-13T19:06:47.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1178017587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc4232a10 0x55fbc4234e00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc47000a480 tx=0x7fc47001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ab2a6ca8328b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc477fff640 1 -- 172.21.15.151:0/1178017587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4700b0070 con 0x55fbc4232a10 2024-09-13T19:06:47.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc477fff640 1 -- 172.21.15.151:0/1178017587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4700ab540 con 0x55fbc4232a10 2024-09-13T19:06:47.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc477fff640 1 -- 172.21.15.151:0/1178017587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4700ab820 con 0x55fbc4232a10 2024-09-13T19:06:47.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1178017587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc4232a10 msgr2=0x55fbc4234e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1178017587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc4232a10 0x55fbc4234e00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc47000a480 tx=0x7fc47001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1178017587 shutdown_connections 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1178017587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc4232a10 0x55fbc4234e00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1178017587 >> 172.21.15.151:0/1178017587 conn(0x55fbc422a1b0 msgr2=0x55fbc422c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1178017587 shutdown_connections 2024-09-13T19:06:47.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.355+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1178017587 wait complete. 2024-09-13T19:06:47.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc40dc200 con 0x55fbc422e690 2024-09-13T19:06:47.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33266/0 (socket says 172.21.15.151:33266) 2024-09-13T19:06:47.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1713855327 learned_addr learned my addr 172.21.15.151:0/1713855327 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1713855327 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc4319e00 con 0x55fbc422e690 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/1713855327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc468001dc0 tx=0x7fc46800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeb4b97f7b6ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc36a614640 1 -- 172.21.15.151:0/1713855327 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468012020 con 0x55fbc422e690 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc36a614640 1 -- 172.21.15.151:0/1713855327 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46800e7c0 con 0x55fbc422e690 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc36a614640 1 -- 172.21.15.151:0/1713855327 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc46800eb40 con 0x55fbc422e690 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1713855327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 msgr2=0x55fbc4319830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1713855327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc468001dc0 tx=0x7fc46800b6d0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1713855327 shutdown_connections 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1713855327 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4319830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1713855327 >> 172.21.15.151:0/1713855327 conn(0x55fbc422a1b0 msgr2=0x55fbc4315460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1713855327 shutdown_connections 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1713855327 wait complete. 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.371+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4320ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4235e50 con 0x55fbc422e690 2024-09-13T19:06:47.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4320ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4320ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33268/0 (socket says 172.21.15.151:33268) 2024-09-13T19:06:47.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47d3c4640 1 -- 172.21.15.151:0/567519326 learned_addr learned my addr 172.21.15.151:0/567519326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47d3c4640 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc43210e0 con 0x55fbc422e690 2024-09-13T19:06:47.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4320ba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55fbc431aa10 tx=0x7fc468000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 -- 172.21.15.151:0/567519326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468012030 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc4321370 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 -- 172.21.15.151:0/567519326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc468001440 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 -- 172.21.15.151:0/567519326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc46801aaf0 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc4324050 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 -- 172.21.15.151:0/567519326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc468015020 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc364034650 0x7fc364036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc368e11640 1 -- 172.21.15.151:0/567519326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc468020030 con 0x55fbc422e690 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc364034650 0x7fc364036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc4232a10 0x55fbc4327ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4328220 con 0x55fbc4232a10 2024-09-13T19:06:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc4232a10 0x55fbc4327ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc364034650 0x7fc364036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4700ad000 tx=0x7fc4700a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.375+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc4232a10 0x55fbc4327ca0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47dbc5640 1 -- 172.21.15.151:0/567519326 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc4232a10 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4325270 con 0x55fbc4232a10 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47dbc5640 1 -- 172.21.15.151:0/567519326 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc4232a10 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc432a530 0x55fbc432c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc432cff0 con 0x55fbc432a530 2024-09-13T19:06:47.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc432a530 0x55fbc432c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc432a530 0x55fbc432c920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 -- 172.21.15.151:0/567519326 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc468008030 con 0x55fbc432a530 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43293d0 con 0x55fbc4232a10 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47dbc5640 1 -- 172.21.15.151:0/567519326 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc4232a10 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fbc432e450 0x55fbc4330840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4330f80 con 0x55fbc432e450 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fbc432e450 0x55fbc4330840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fbc432e450 0x55fbc4330840 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47cbc3640 1 -- 172.21.15.151:0/567519326 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4700b3040 con 0x55fbc432e450 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47f8b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc4135800 con 0x55fbc433ea00 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33274/0 (socket says 172.21.15.151:33274) 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 -- 172.21.15.151:0/2901827887 learned_addr learned my addr 172.21.15.151:0/2901827887 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.379+0000 7fc47d3c4640 1 -- 172.21.15.151:0/2901827887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc433f360 con 0x55fbc433ea00 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc468048540 tx=0x7fc46800deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 -- 172.21.15.151:0/2901827887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468018560 con 0x55fbc433ea00 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 -- 172.21.15.151:0/2901827887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc468018700 con 0x55fbc433ea00 2024-09-13T19:06:47.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 -- 172.21.15.151:0/2901827887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468041ba0 con 0x55fbc433ea00 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc433f5f0 con 0x55fbc433ea00 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc433f5f0 con 0x55fbc433ea00 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 -- 172.21.15.151:0/2901827887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc468009070 con 0x55fbc433ea00 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 0x7fc354036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc361ffb640 1 -- 172.21.15.151:0/2901827887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc468005050 con 0x55fbc433ea00 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 0x7fc354036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 0x7fc354036b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55fbc4328ae0 tx=0x7fc470005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47f8b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc431a180 con 0x55fbc41a3bd0 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33288/0 (socket says 172.21.15.151:33288) 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 -- 172.21.15.151:0/4294874588 learned_addr learned my addr 172.21.15.151:0/4294874588 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 -- 172.21.15.151:0/4294874588 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc41a4580 con 0x55fbc41a3bd0 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.383+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/4294874588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc46804c940 tx=0x7fc4680244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e89e48763e978b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc3537fe640 1 -- 172.21.15.151:0/4294874588 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc46802d9a0 con 0x55fbc41a3bd0 2024-09-13T19:06:47.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc3537fe640 1 -- 172.21.15.151:0/4294874588 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc46805d030 con 0x55fbc41a3bd0 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc3537fe640 1 -- 172.21.15.151:0/4294874588 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468039580 con 0x55fbc41a3bd0 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/4294874588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 msgr2=0x55fbc41a3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/4294874588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc46804c940 tx=0x7fc4680244e0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/4294874588 shutdown_connections 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/4294874588 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc41a3fb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/4294874588 >> 172.21.15.151:0/4294874588 conn(0x55fbc4347630 msgr2=0x55fbc4345730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/4294874588 shutdown_connections 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/4294874588 wait complete. 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 Processor -- start 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- start start 2024-09-13T19:06:47.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbc41a4bd0 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47d3c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33300/0 (socket says 172.21.15.151:33300) 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 learned_addr learned my addr 172.21.15.151:0/1210672549 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbc4354b60 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc468051f90 tx=0x7fc468051f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc351ffb640 1 -- 172.21.15.151:0/1210672549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc468041d40 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbc4354b60 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc351ffb640 1 -- 172.21.15.151:0/1210672549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc468041ee0 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc351ffb640 1 -- 172.21.15.151:0/1210672549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc46804ca40 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbc4354fd0 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.387+0000 7fc351ffb640 1 -- 172.21.15.151:0/1210672549 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc46804cbe0 con 0x55fbc41a3bd0 2024-09-13T19:06:47.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc351ffb640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc344034650 0x7fc344036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc351ffb640 1 -- 172.21.15.151:0/1210672549 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc46806a070 con 0x55fbc41a3bd0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc435f740 0x55fbc4361be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4362330 con 0x55fbc435f740 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc344034650 0x7fc344036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc435f740 0x55fbc4361be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc435f740 0x55fbc4361be0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc344034650 0x7fc344036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc4700acfd0 tx=0x7fc4700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 realm 2024-09-13T19:06:47.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4362740 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4362fe0 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc43640e0 0x55fbc43664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4366b20 con 0x55fbc43640e0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc43640e0 0x55fbc43664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc43640e0 0x55fbc43664d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 20 searching for the correct realm 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4368380 con 0x55fbc43640e0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc468059040 0x7fc468069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4368380 con 0x7fc468059040 2024-09-13T19:06:47.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc468059040 0x7fc468069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc468059040 0x7fc468069930 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc4700dd040 0x7fc4700cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.391+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4368380 con 0x7fc4700dd040 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc4700dd040 0x7fc4700cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc4700dd040 0x7fc4700cf430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc468059040 2024-09-13T19:06:47.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.395+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc468059040 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.399+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc468059040 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc468059040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc43640e0 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc4700dd040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x55fbc435f740 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4363380 con 0x7fc468059040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:47.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4367470 con 0x55fbc435f740 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.403+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4367cc0 con 0x55fbc435f740 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43670b0 con 0x7fc468059040 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 zone default found 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 4 Realm: () 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 zonegroup default 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43687b0 con 0x7fc4700dd040 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436a190 con 0x55fbc43640e0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436a6b0 con 0x55fbc43640e0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 started sync module instance, tier type = 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4369630 con 0x7fc468059040 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539817064992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4369290 con 0x7fc468059040 2024-09-13T19:06:47.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436b5e0 con 0x55fbc435f740 2024-09-13T19:06:47.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.407+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539817064992] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539817070896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436ba00 con 0x55fbc435f740 2024-09-13T19:06:47.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436c290 con 0x55fbc43640e0 2024-09-13T19:06:47.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539817070896] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539817071952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436be20 con 0x55fbc43640e0 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.411+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436cca0 con 0x7fc468059040 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539817076720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436d4f0 con 0x7fc468059040 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436def0 con 0x55fbc435f740 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539817076720] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539817071952] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539817073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436d040 con 0x55fbc435f740 2024-09-13T19:06:47.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.415+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436e790 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539817083184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436ea00 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f250 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539817073008] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539817085440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f2d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436fc90 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.419+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539817083184] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539817085440] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539817086496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f240 con 0x7fc4700dd040 2024-09-13T19:06:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=0 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=1 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=2 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=3 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=4 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=5 2024-09-13T19:06:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=6 2024-09-13T19:06:47.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539817086496] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 20 add_watcher() i=7 2024-09-13T19:06:47.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:47.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4372cc0 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.423+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539817088992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43700b0 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539817088992] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc3327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47f8b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47f8b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437b460 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.427+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437ba90 con 0x7fc4700dd040 2024-09-13T19:06:47.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437bef0 con 0x55fbc43640e0 2024-09-13T19:06:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437bf30 con 0x55fbc435f740 2024-09-13T19:06:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.431+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437c3e0 con 0x7fc468059040 2024-09-13T19:06:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437c7a0 con 0x55fbc43640e0 2024-09-13T19:06:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437c7a0 con 0x55fbc435f740 2024-09-13T19:06:47.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.435+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437c8b0 con 0x7fc4700dd040 2024-09-13T19:06:47.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.439+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.439+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437c8b0 con 0x7fc468059040 2024-09-13T19:06:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.439+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.439+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437cf60 con 0x55fbc43640e0 2024-09-13T19:06:47.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437cf60 con 0x7fc468059040 2024-09-13T19:06:47.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.443+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d4d0 con 0x7fc468059040 2024-09-13T19:06:47.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.449 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d760 con 0x7fc4700dd040 2024-09-13T19:06:47.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d760 con 0x55fbc435f740 2024-09-13T19:06:47.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.447+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x55fbc43640e0 2024-09-13T19:06:47.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x7fc468059040 2024-09-13T19:06:47.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x55fbc43640e0 2024-09-13T19:06:47.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.456 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.451+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x55fbc435f740 2024-09-13T19:06:47.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.455+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.455+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc435f740 2024-09-13T19:06:47.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.455+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.455+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc43640e0 2024-09-13T19:06:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x7fc468059040 2024-09-13T19:06:47.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc43640e0 2024-09-13T19:06:47.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.459+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc43640e0 2024-09-13T19:06:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc43640e0 2024-09-13T19:06:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x55fbc43640e0 2024-09-13T19:06:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.463+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d840 con 0x7fc4700dd040 2024-09-13T19:06:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.467+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.467+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x55fbc43640e0 2024-09-13T19:06:47.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.467+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.467+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437d670 con 0x7fc4700dd040 2024-09-13T19:06:47.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.471+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.471+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437dca0 con 0x55fbc43640e0 2024-09-13T19:06:47.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.475+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.475+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437dca0 con 0x7fc4700dd040 2024-09-13T19:06:47.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.475+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.475+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc437dca0 con 0x7fc468059040 2024-09-13T19:06:47.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc3317e2640 20 reqs_thread_entry: start 2024-09-13T19:06:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 20 Filter name: none 2024-09-13T19:06:47.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc2a2ffd640 20 reqs_thread_entry: start 2024-09-13T19:06:47.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:06:47.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4379880 con 0x7fc4700dd040 2024-09-13T19:06:47.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:06:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:06:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:06:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.479+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4379310 con 0x7fc4700dd040 2024-09-13T19:06:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:06:47.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4399380 con 0x7fc4700dd040 2024-09-13T19:06:47.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:47.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94539817258624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43992a0 con 0x55fbc43640e0 2024-09-13T19:06:47.487 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== watch-notify(notify (1) cookie 94539817071952 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55fbc437cf60 con 0x55fbc43640e0 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc3537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94539817071952 notifier 4526 bl.length()=170 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc3537fe640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc340003d70 con 0x55fbc43640e0 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(97 notify.2 [notify cookie 94539817258624 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== watch-notify(notify_complete (2) cookie 94539817258624 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc468033070 con 0x55fbc43640e0 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 10 removing email index: 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 10 removing user buckets index 2024-09-13T19:06:47.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.483+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4399770 con 0x7fc4700dd040 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47f8b4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94539817258624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc43992a0 con 0x7fc4700dd040 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== watch-notify(notify (1) cookie 94539817085440 notify 137438953481 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55fbc437c1e0 con 0x7fc4700dd040 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc352ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94539817085440 notifier 4526 bl.length()=160 2024-09-13T19:06:47.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(100 notify.6 [notify cookie 94539817258624 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc352ffd640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2b00032d0 con 0x7fc4700dd040 2024-09-13T19:06:47.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== watch-notify(notify_complete (2) cookie 94539817258624 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fbc437b630 con 0x7fc4700dd040 2024-09-13T19:06:47.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47f8b4980 10 removing user index: fud 2024-09-13T19:06:47.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.487+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc439d7b0 con 0x7fc4700dd040 2024-09-13T19:06:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(102 fud [call,call,delete] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47f8b4980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:06:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47f8b4980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:06:47.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94539817258976 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fbc439ac30 con 0x7fc4700dd040 2024-09-13T19:06:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== watch-notify(notify (1) cookie 94539817083184 notify 137438953482 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55fbc437b630 con 0x7fc4700dd040 2024-09-13T19:06:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc3537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94539817083184 notifier 4526 bl.length()=152 2024-09-13T19:06:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(103 notify.5 [notify cookie 94539817258976 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.491+0000 7fc3537fe640 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc340003d70 con 0x7fc4700dd040 2024-09-13T19:06:47.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== watch-notify(notify_complete (2) cookie 94539817258976 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55fbc437b420 con 0x7fc4700dd040 2024-09-13T19:06:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc3327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539817088992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc4398fe0 con 0x55fbc435f740 2024-09-13T19:06:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94539817088992] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.495+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539817064992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f7e0 con 0x7fc468059040 2024-09-13T19:06:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94539817064992] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47f8b4980 20 remove_watcher() i=0 2024-09-13T19:06:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47f8b4980 2 removed watcher, disabling cache 2024-09-13T19:06:47.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539817070896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f7e0 con 0x55fbc435f740 2024-09-13T19:06:47.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94539817070896] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47f8b4980 20 remove_watcher() i=1 2024-09-13T19:06:47.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.499+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539817071952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436b130 con 0x55fbc43640e0 2024-09-13T19:06:47.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47d3c4640 1 -- 172.21.15.151:0/1210672549 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94539817071952] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc468074020 con 0x55fbc43640e0 2024-09-13T19:06:47.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 20 remove_watcher() i=2 2024-09-13T19:06:47.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539817076720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f7e0 con 0x7fc468059040 2024-09-13T19:06:47.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47cbc3640 1 -- 172.21.15.151:0/1210672549 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94539817076720] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4700ca030 con 0x7fc468059040 2024-09-13T19:06:47.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 20 remove_watcher() i=3 2024-09-13T19:06:47.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539817073008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436c7f0 con 0x55fbc435f740 2024-09-13T19:06:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94539817073008] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x55fbc435f740 2024-09-13T19:06:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 20 remove_watcher() i=4 2024-09-13T19:06:47.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.503+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539817083184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436f7e0 con 0x7fc4700dd040 2024-09-13T19:06:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.507+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94539817083184] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.507+0000 7fc47f8b4980 20 remove_watcher() i=5 2024-09-13T19:06:47.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.507+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539817085440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436c7f0 con 0x7fc4700dd040 2024-09-13T19:06:47.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94539817085440] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 20 remove_watcher() i=6 2024-09-13T19:06:47.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539817086496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fbc436e130 con 0x7fc4700dd040 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94539817086496] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc47800a4d0 con 0x7fc4700dd040 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 20 remove_watcher() i=7 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc4700dd040 msgr2=0x7fc4700cf430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc4700dd040 0x7fc4700cf430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc435f740 msgr2=0x55fbc4361be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc435f740 0x55fbc4361be0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc468059040 msgr2=0x7fc468069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc468059040 0x7fc468069930 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc43640e0 msgr2=0x55fbc43664d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc43640e0 0x55fbc43664d0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc344034650 msgr2=0x7fc344036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc344034650 0x7fc344036b10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc4700acfd0 tx=0x7fc4700a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47dbc5640 1 -- 172.21.15.151:0/1210672549 reap_dead start 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 msgr2=0x55fbc4354620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc468051f90 tx=0x7fc468051f20 comp rx=0 tx=0).stop 2024-09-13T19:06:47.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 shutdown_connections 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/1210672549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc41a3bd0 0x55fbc4354620 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 >> 172.21.15.151:0/1210672549 conn(0x55fbc4347630 msgr2=0x55fbc4345700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 shutdown_connections 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/1210672549 wait complete. 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 msgr2=0x7fc354036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 0x7fc354036b60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55fbc4328ae0 tx=0x7fc470005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:47.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 msgr2=0x55fbc433ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc468048540 tx=0x7fc46800deb0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 shutdown_connections 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc3540346a0 0x7fc354036b60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/2901827887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc433ea00 0x55fbc433ee20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 >> 172.21.15.151:0/2901827887 conn(0x55fbc4333b50 msgr2=0x55fbc43365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 shutdown_connections 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.511+0000 7fc47f8b4980 1 -- 172.21.15.151:0/2901827887 wait complete. 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc4232a10 msgr2=0x55fbc4327ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55fbc4232a10 0x55fbc4327ca0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fbc432e450 msgr2=0x55fbc4330840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55fbc432e450 0x55fbc4330840 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc432a530 msgr2=0x55fbc432c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55fbc432a530 0x55fbc432c920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc364034650 msgr2=0x7fc364036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc364034650 0x7fc364036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4700ad000 tx=0x7fc4700a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 msgr2=0x55fbc4320ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 --2- 172.21.15.151:0/567519326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbc422e690 0x55fbc4320ba0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x55fbc431aa10 tx=0x7fc468000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47dbc5640 1 -- 172.21.15.151:0/567519326 reap_dead start 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 shutdown_connections 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 >> 172.21.15.151:0/567519326 conn(0x55fbc422a1b0 msgr2=0x55fbc4313fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 shutdown_connections 2024-09-13T19:06:47.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.515+0000 7fc47f8b4980 1 -- 172.21.15.151:0/567519326 wait complete. 2024-09-13T19:06:47.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:06:47.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-13T19:06:47.527 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-13T19:06:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdff0ea980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560e4dbdaaa0 0x560e4dc6b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdff0ea980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e4daeeae0 con 0x560e4dc6bc10 2024-09-13T19:06:47.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdff0ea980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x560e4db12e30 con 0x560e4dbdaaa0 2024-09-13T19:06:47.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdfcbfa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560e4dbdaaa0 0x560e4dc6b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdfc3f9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x560e4dc6bc10 0x560e4dc6e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33296/0 (socket says 172.21.15.151:33296) 2024-09-13T19:06:47.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdfc3f9640 1 -- 172.21.15.151:0/1461629498 learned_addr learned my addr 172.21.15.151:0/1461629498 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1461629498 >> v1:172.21.15.12:6789/0 conn(0x560e4dc6bc10 legacy=0x560e4dc6e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.611+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1461629498 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dbdae80 con 0x560e4dbdaaa0 2024-09-13T19:06:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/1461629498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dc6b6d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a420 tx=0x7efdf401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4c4b4df898764a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdfbbf8640 1 -- 172.21.15.151:0/1461629498 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40af070 con 0x560e4dbdaaa0 2024-09-13T19:06:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdfbbf8640 1 -- 172.21.15.151:0/1461629498 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40aa530 con 0x560e4dbdaaa0 2024-09-13T19:06:47.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdfbbf8640 1 -- 172.21.15.151:0/1461629498 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40aa850 con 0x560e4dbdaaa0 2024-09-13T19:06:47.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 -- 172.21.15.151:0/1461629498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 msgr2=0x560e4dc6b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1461629498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dc6b6d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a420 tx=0x7efdf401afd0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 -- 172.21.15.151:0/1461629498 shutdown_connections 2024-09-13T19:06:47.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1461629498 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dc6b6d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 -- 172.21.15.151:0/1461629498 >> 172.21.15.151:0/1461629498 conn(0x560e4dc61000 msgr2=0x560e4dc63420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 -- 172.21.15.151:0/1461629498 shutdown_connections 2024-09-13T19:06:47.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.615+0000 7efdff0ea980 1 -- 172.21.15.151:0/1461629498 wait complete. 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.627+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.627+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.627+0000 7efdff0ea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.627+0000 7efdff0ea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560e4db14200 con 0x560e4dbdaaa0 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33332/0 (socket says 172.21.15.151:33332) 2024-09-13T19:06:47.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1952397880 learned_addr learned my addr 172.21.15.151:0/1952397880 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1952397880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dd541e0 con 0x560e4dbdaaa0 2024-09-13T19:06:47.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/1952397880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a420 tx=0x7efdf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bcbb2a4a55e124 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efceae0d640 1 -- 172.21.15.151:0/1952397880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40af040 con 0x560e4dbdaaa0 2024-09-13T19:06:47.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efceae0d640 1 -- 172.21.15.151:0/1952397880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40aab30 con 0x560e4dbdaaa0 2024-09-13T19:06:47.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efceae0d640 1 -- 172.21.15.151:0/1952397880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40aae10 con 0x560e4dbdaaa0 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- 172.21.15.151:0/1952397880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 msgr2=0x560e4dd53c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1952397880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efdf400a420 tx=0x7efdf40033b0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- 172.21.15.151:0/1952397880 shutdown_connections 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1952397880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd53c10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- 172.21.15.151:0/1952397880 >> 172.21.15.151:0/1952397880 conn(0x560e4dc61000 msgr2=0x560e4dd4f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- 172.21.15.151:0/1952397880 shutdown_connections 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- 172.21.15.151:0/1952397880 wait complete. 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd5ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdff0ea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560e4dc721b0 con 0x560e4dbdaaa0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd5ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd5ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33336/0 (socket says 172.21.15.151:33336) 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 -- 172.21.15.151:0/3991401755 learned_addr learned my addr 172.21.15.151:0/3991401755 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.631+0000 7efdfcbfa640 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dd5b3d0 con 0x560e4dbdaaa0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd5ae90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efdf401b870 tx=0x7efdf4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 -- 172.21.15.151:0/3991401755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40c5070 con 0x560e4dbdaaa0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 -- 172.21.15.151:0/3991401755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40b5910 con 0x560e4dbdaaa0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 -- 172.21.15.151:0/3991401755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40b5c30 con 0x560e4dbdaaa0 2024-09-13T19:06:47.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e4dd5b660 con 0x560e4dbdaaa0 2024-09-13T19:06:47.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4dd5e340 con 0x560e4dbdaaa0 2024-09-13T19:06:47.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 -- 172.21.15.151:0/3991401755 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdf40c1480 con 0x560e4dbdaaa0 2024-09-13T19:06:47.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efce4034650 0x7efce4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efce960a640 1 -- 172.21.15.151:0/3991401755 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdf40bb070 con 0x560e4dbdaaa0 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efce4034650 0x7efce4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dc6bc10 0x560e4dd61f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd624d0 con 0x560e4dc6bc10 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dc6bc10 0x560e4dd61f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efce4034650 0x7efce4036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdf0001da0 tx=0x7efdf0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dc6bc10 0x560e4dd61f90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfd3fb640 1 -- 172.21.15.151:0/3991401755 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dc6bc10 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd5f560 con 0x560e4dc6bc10 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfd3fb640 1 -- 172.21.15.151:0/3991401755 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dc6bc10 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd647e0 0x560e4dd66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd672a0 con 0x560e4dd647e0 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd647e0 0x560e4dd66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.635+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd647e0 0x560e4dd66bd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 -- 172.21.15.151:0/3991401755 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd647e0 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd63680 con 0x560e4dc6bc10 2024-09-13T19:06:47.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfd3fb640 1 -- 172.21.15.151:0/3991401755 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dc6bc10 2024-09-13T19:06:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560e4dd686e0 0x560e4dd6aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd6b260 con 0x560e4dd686e0 2024-09-13T19:06:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560e4dd686e0 0x560e4dd6aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560e4dd686e0 0x560e4dd6aad0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfc3f9640 1 -- 172.21.15.151:0/3991401755 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efdf000e6c0 con 0x560e4dd686e0 2024-09-13T19:06:47.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560e4db6d800 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33350/0 (socket says 172.21.15.151:33350) 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1685640522 learned_addr learned my addr 172.21.15.151:0/1685640522 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 -- 172.21.15.151:0/1685640522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dd79650 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efdf40e4010 tx=0x7efdf40c1f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efce27fc640 1 -- 172.21.15.151:0/1685640522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40e4870 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efce27fc640 1 -- 172.21.15.151:0/1685640522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40e4a10 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e4dd798e0 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efce27fc640 1 -- 172.21.15.151:0/1685640522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40e4d10 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.639+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4dd7c560 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efce27fc640 1 -- 172.21.15.151:0/1685640522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdf40e1020 con 0x560e4dd78cf0 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efce27fc640 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 0x7efcd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efce27fc640 1 -- 172.21.15.151:0/1685640522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdf40dd070 con 0x560e4dd78cf0 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 0x7efcd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 0x7efcd4036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560e4dd6b660 tx=0x7efdf000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560e4dd544a0 con 0x560e4dd85600 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33354/0 (socket says 172.21.15.151:33354) 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfcbfa640 1 -- 172.21.15.151:0/375295917 learned_addr learned my addr 172.21.15.151:0/375295917 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfcbfa640 1 -- 172.21.15.151:0/375295917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dd85fb0 con 0x560e4dd85600 2024-09-13T19:06:47.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/375295917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efdf40a6fd0 tx=0x7efdf40b6ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4388d5220a9f4db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efcd3fff640 1 -- 172.21.15.151:0/375295917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40b6420 con 0x560e4dd85600 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efcd3fff640 1 -- 172.21.15.151:0/375295917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40b39a0 con 0x560e4dd85600 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efcd3fff640 1 -- 172.21.15.151:0/375295917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40e6080 con 0x560e4dd85600 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- 172.21.15.151:0/375295917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 msgr2=0x560e4dd859e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 --2- 172.21.15.151:0/375295917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efdf40a6fd0 tx=0x7efdf40b6ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- 172.21.15.151:0/375295917 shutdown_connections 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 --2- 172.21.15.151:0/375295917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd859e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- 172.21.15.151:0/375295917 >> 172.21.15.151:0/375295917 conn(0x560e4dd819e0 msgr2=0x560e4dd7fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- 172.21.15.151:0/375295917 shutdown_connections 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 -- 172.21.15.151:0/375295917 wait complete. 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.643+0000 7efdff0ea980 1 Processor -- start 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 -- start start 2024-09-13T19:06:47.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560e4dd86450 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfcbfa640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33358/0 (socket says 172.21.15.151:33358) 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 learned_addr learned my addr 172.21.15.151:0/4185844240 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e4dd8cd10 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efdf40b6b10 tx=0x7efdf40dcf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 -- 172.21.15.151:0/4185844240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf4107070 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 -- 172.21.15.151:0/4185844240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf40ac2a0 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e4dd8cd10 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 -- 172.21.15.151:0/4185844240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdf40b3580 con 0x560e4dd85600 2024-09-13T19:06:47.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e4dd8d180 con 0x560e4dd85600 2024-09-13T19:06:47.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 -- 172.21.15.151:0/4185844240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdf4100040 con 0x560e4dd85600 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcc8034650 0x7efcc8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efcd27fc640 1 -- 172.21.15.151:0/4185844240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7efdf40fc1c0 con 0x560e4dd85600 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcc8034650 0x7efcc8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dd978b0 0x560e4dd99d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9a4c0 con 0x560e4dd978b0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.647+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dd978b0 0x560e4dd99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcc8034650 0x7efcc8036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdf000bb60 tx=0x7efdf0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dd978b0 0x560e4dd99d70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 realm 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9a8d0 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b170 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd9c270 0x560e4dd9e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9ed00 con 0x560e4dd9c270 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd9c270 0x560e4dd9e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd9c270 0x560e4dd9e660 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 20 searching for the correct realm 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda0560 con 0x560e4dd9c270 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdf4103040 0x7efdf4103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda0560 con 0x7efdf4103040 2024-09-13T19:06:47.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdf4103040 0x7efdf4103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdf4103040 0x7efdf4103880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdf0037040 0x7efdf0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda0560 con 0x7efdf0037040 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.651+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdf0037040 0x7efdf0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdf0037040 0x7efdf0036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf4103040 2024-09-13T19:06:47.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.655+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf4103040 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.659+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf4103040 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf4103040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd9c270 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.663+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf0037040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x560e4dd978b0 2024-09-13T19:06:47.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9b510 con 0x7efdf4103040 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9f680 con 0x560e4dd978b0 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9fed0 con 0x560e4dd978b0 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dd9f2e0 con 0x7efdf4103040 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 zone default found 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 4 Realm: () 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:47.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 zonegroup default 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda0990 con 0x7efdf0037040 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda2400 con 0x560e4dd9c270 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda2920 con 0x560e4dd9c270 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 started sync module instance, tier type = 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.667+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda1810 con 0x7efdf4103040 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94619435668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda2d80 con 0x7efdf4103040 2024-09-13T19:06:47.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda35d0 con 0x560e4dd978b0 2024-09-13T19:06:47.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94619435668320] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94619435670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda3630 con 0x560e4dd978b0 2024-09-13T19:06:47.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.671+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda4140 con 0x560e4dd9c270 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94619435670576] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94619435678704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda4100 con 0x560e4dd9c270 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda4b50 con 0x7efdf4103040 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94619435681440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda53a0 con 0x7efdf4103040 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda5dc0 con 0x560e4dd978b0 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94619435678704] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.675+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94619435681440] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94619435686064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda4ef0 con 0x560e4dd978b0 2024-09-13T19:06:47.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda6660 con 0x7efdf0037040 2024-09-13T19:06:47.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94619435686064] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94619435675936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda4ef0 con 0x7efdf0037040 2024-09-13T19:06:47.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.679+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda6af0 con 0x7efdf0037040 2024-09-13T19:06:47.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94619435689472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda6f50 con 0x7efdf0037040 2024-09-13T19:06:47.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda7a70 con 0x7efdf0037040 2024-09-13T19:06:47.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94619435675936] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94619435689472] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94619435690528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda5f90 con 0x7efdf0037040 2024-09-13T19:06:47.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=0 2024-09-13T19:06:47.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=1 2024-09-13T19:06:47.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=2 2024-09-13T19:06:47.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=3 2024-09-13T19:06:47.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=4 2024-09-13T19:06:47.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=5 2024-09-13T19:06:47.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.683+0000 7efdff0ea980 20 add_watcher() i=6 2024-09-13T19:06:47.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94619435690528] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 add_watcher() i=7 2024-09-13T19:06:47.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:47.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddaaa60 con 0x560e4dd978b0 2024-09-13T19:06:47.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94619435693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda7ee0 con 0x560e4dd978b0 2024-09-13T19:06:47.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94619435693376] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efcb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 5 note: GC not initialized 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efcb1fe3640 20 reqs_thread_entry: start 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 Filter name: none 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efc237fe640 20 reqs_thread_entry: start 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.687+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddce1c0 con 0x7efdf0037040 2024-09-13T19:06:47.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-13T19:06:47.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:06:47.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcc8b0 con 0x7efdf0037040 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:06:47.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.691+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddd0ed0 con 0x7efdf0037040 2024-09-13T19:06:47.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:06:47.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:06:47.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:06:47.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94619435862160 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddd1a40 con 0x7efdf4103040 2024-09-13T19:06:47.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== watch-notify(notify (1) cookie 94619435681440 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x560e4daeeae0 con 0x7efdf4103040 2024-09-13T19:06:47.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efcd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94619435681440 notifier 4533 bl.length()=610 2024-09-13T19:06:47.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.3 [notify cookie 94619435862160 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efcd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-13T19:06:47.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efcd3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:06:47.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efcd3fff640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efcc0003eb0 con 0x7efdf4103040 2024-09-13T19:06:47.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== watch-notify(notify_complete (2) cookie 94619435862160 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efdf0036c40 con 0x7efdf4103040 2024-09-13T19:06:47.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddd0860 con 0x7efdf0037040 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.695+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94619435862064 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcfda0 con 0x560e4dd9c270 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 94619435678704 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x560e4dd798e0 con 0x560e4dd9c270 2024-09-13T19:06:47.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efcd3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94619435678704 notifier 4533 bl.length()=192 2024-09-13T19:06:47.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efcd3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:06:47.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efcd3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:06:47.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efcd3fff640 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7efcc0003eb0 con 0x560e4dd9c270 2024-09-13T19:06:47.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [notify cookie 94619435862064 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== watch-notify(notify_complete (2) cookie 94619435862064 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560e4dd79650 con 0x560e4dd9c270 2024-09-13T19:06:47.702 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:06:47.693722Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:47.693709Z","tags":[],"group_ids":[]} 2024-09-13T19:06:47.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efcb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94619435693376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcbdc0 con 0x560e4dd978b0 2024-09-13T19:06:47.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94619435693376] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.699+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94619435668320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcbdc0 con 0x7efdf4103040 2024-09-13T19:06:47.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94619435668320] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdff0ea980 20 remove_watcher() i=0 2024-09-13T19:06:47.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdff0ea980 2 removed watcher, disabling cache 2024-09-13T19:06:47.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94619435670576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda1360 con 0x560e4dd978b0 2024-09-13T19:06:47.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94619435670576] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdff0ea980 20 remove_watcher() i=1 2024-09-13T19:06:47.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.703+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94619435678704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcbdc0 con 0x560e4dd9c270 2024-09-13T19:06:47.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdfcbfa640 1 -- 172.21.15.151:0/4185844240 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94619435678704] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf40b2040 con 0x560e4dd9c270 2024-09-13T19:06:47.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 20 remove_watcher() i=2 2024-09-13T19:06:47.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94619435681440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda1360 con 0x7efdf4103040 2024-09-13T19:06:47.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdfc3f9640 1 -- 172.21.15.151:0/4185844240 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94619435681440] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdf000e6c0 con 0x7efdf4103040 2024-09-13T19:06:47.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 20 remove_watcher() i=3 2024-09-13T19:06:47.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94619435686064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda3bf0 con 0x560e4dd978b0 2024-09-13T19:06:47.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94619435686064] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x560e4dd978b0 2024-09-13T19:06:47.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 20 remove_watcher() i=4 2024-09-13T19:06:47.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.707+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94619435675936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4ddcbdc0 con 0x7efdf0037040 2024-09-13T19:06:47.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.711+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94619435675936] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.711+0000 7efdff0ea980 20 remove_watcher() i=5 2024-09-13T19:06:47.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.711+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94619435689472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda1360 con 0x7efdf0037040 2024-09-13T19:06:47.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94619435689472] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 20 remove_watcher() i=6 2024-09-13T19:06:47.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94619435690528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560e4dda58b0 con 0x7efdf0037040 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94619435690528] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdec00a510 con 0x7efdf0037040 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 20 remove_watcher() i=7 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdf0037040 msgr2=0x7efdf0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdf0037040 0x7efdf0036410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dd978b0 msgr2=0x560e4dd99d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dd978b0 0x560e4dd99d70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdf4103040 msgr2=0x7efdf4103880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdf4103040 0x7efdf4103880 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd9c270 msgr2=0x560e4dd9e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd9c270 0x560e4dd9e660 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcc8034650 msgr2=0x7efcc8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcc8034650 0x7efcc8036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efdf000bb60 tx=0x7efdf0010000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdfd3fb640 1 -- 172.21.15.151:0/4185844240 reap_dead start 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 msgr2=0x560e4dd8c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7efdf40b6b10 tx=0x7efdf40dcf70 comp rx=0 tx=0).stop 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 shutdown_connections 2024-09-13T19:06:47.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/4185844240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd85600 0x560e4dd8c7d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 >> 172.21.15.151:0/4185844240 conn(0x560e4dd819e0 msgr2=0x560e4dd7fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 shutdown_connections 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/4185844240 wait complete. 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 msgr2=0x7efcd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 0x7efcd4036b60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x560e4dd6b660 tx=0x7efdf000f000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 msgr2=0x560e4dd79110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.719+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efdf40e4010 tx=0x7efdf40c1f80 comp rx=0 tx=0).stop 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 shutdown_connections 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcd40346a0 0x7efcd4036b60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/1685640522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dd78cf0 0x560e4dd79110 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 >> 172.21.15.151:0/1685640522 conn(0x560e4dd6de40 msgr2=0x560e4dd708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 shutdown_connections 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/1685640522 wait complete. 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dc6bc10 msgr2=0x560e4dd61f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560e4dc6bc10 0x560e4dd61f90 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560e4dd686e0 msgr2=0x560e4dd6aad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560e4dd686e0 0x560e4dd6aad0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd647e0 msgr2=0x560e4dd66bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560e4dd647e0 0x560e4dd66bd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efce4034650 msgr2=0x7efce4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efce4034650 0x7efce4036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efdf0001da0 tx=0x7efdf0001300 comp rx=0 tx=0).stop 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 msgr2=0x560e4dd5ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 --2- 172.21.15.151:0/3991401755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560e4dbdaaa0 0x560e4dd5ae90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efdf401b870 tx=0x7efdf4017d70 comp rx=0 tx=0).stop 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdfd3fb640 1 -- 172.21.15.151:0/3991401755 reap_dead start 2024-09-13T19:06:47.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 shutdown_connections 2024-09-13T19:06:47.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 >> 172.21.15.151:0/3991401755 conn(0x560e4dc61000 msgr2=0x560e4dd4e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 shutdown_connections 2024-09-13T19:06:47.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.723+0000 7efdff0ea980 1 -- 172.21.15.151:0/3991401755 wait complete. 2024-09-13T19:06:47.736 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:06:47.693722Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:47.693709Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:47.736 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:06:47.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:06:47.736 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-13T19:06:47.820 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:47.820 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5ff8b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55acd958a810 0x55acd958cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5ff8b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acd9410ae0 con 0x55acd94fd270 2024-09-13T19:06:47.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5ff8b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55acd9434e30 con 0x55acd958a810 2024-09-13T19:06:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5d29a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55acd958a810 0x55acd958cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5da9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55acd94fd270 0x55acd95890f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33306/0 (socket says 172.21.15.151:33306) 2024-09-13T19:06:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5da9b640 1 -- 172.21.15.151:0/1961313696 learned_addr learned my addr 172.21.15.151:0/1961313696 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5d29a640 1 -- 172.21.15.151:0/1961313696 >> v1:172.21.15.12:6789/0 conn(0x55acd94fd270 legacy=0x55acd95890f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.819+0000 7f0c5d29a640 1 -- 172.21.15.151:0/1961313696 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd958d170 con 0x55acd958a810 2024-09-13T19:06:47.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/1961313696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd958a810 0x55acd958cc30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400a480 tx=0x7f0c5401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626225ee29c96df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ca99640 1 -- 172.21.15.151:0/1961313696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c540af070 con 0x55acd958a810 2024-09-13T19:06:47.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ca99640 1 -- 172.21.15.151:0/1961313696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c540a3e50 con 0x55acd958a810 2024-09-13T19:06:47.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ca99640 1 -- 172.21.15.151:0/1961313696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c540aa680 con 0x55acd958a810 2024-09-13T19:06:47.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1961313696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd958a810 msgr2=0x55acd958cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1961313696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd958a810 0x55acd958cc30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400a480 tx=0x7f0c5401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1961313696 shutdown_connections 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1961313696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd958a810 0x55acd958cc30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1961313696 >> 172.21.15.151:0/1961313696 conn(0x55acd9583030 msgr2=0x55acd9585450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1961313696 shutdown_connections 2024-09-13T19:06:47.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.823+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1961313696 wait complete. 2024-09-13T19:06:47.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5ff8b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5ff8b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55acd9436200 con 0x55acd94fd270 2024-09-13T19:06:47.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33364/0 (socket says 172.21.15.151:33364) 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5da9b640 1 -- 172.21.15.151:0/1831234268 learned_addr learned my addr 172.21.15.151:0/1831234268 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5da9b640 1 -- 172.21.15.151:0/1831234268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd967a9d0 con 0x55acd94fd270 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/1831234268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e20 tx=0x7f0c5000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf13f1db108a5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0b4be07640 1 -- 172.21.15.151:0/1831234268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50012020 con 0x55acd94fd270 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0b4be07640 1 -- 172.21.15.151:0/1831234268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5000e7c0 con 0x55acd94fd270 2024-09-13T19:06:47.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.839+0000 7f0b4be07640 1 -- 172.21.15.151:0/1831234268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5000eb00 con 0x55acd94fd270 2024-09-13T19:06:47.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1831234268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 msgr2=0x55acd967a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1831234268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e20 tx=0x7f0c5000b790 comp rx=0 tx=0).stop 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1831234268 shutdown_connections 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1831234268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd967a400 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1831234268 >> 172.21.15.151:0/1831234268 conn(0x55acd9583030 msgr2=0x55acd9676030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1831234268 shutdown_connections 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1831234268 wait complete. 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd96817d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55acd95989a0 con 0x55acd94fd270 2024-09-13T19:06:47.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd96817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd96817d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33384/0 (socket says 172.21.15.151:33384) 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3287094386 learned_addr learned my addr 172.21.15.151:0/3287094386 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd9681d10 con 0x55acd94fd270 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd96817d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e20 tx=0x7f0c50000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 -- 172.21.15.151:0/3287094386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50012030 con 0x55acd94fd270 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd9681fa0 con 0x55acd94fd270 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 -- 172.21.15.151:0/3287094386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c50001480 con 0x55acd94fd270 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 -- 172.21.15.151:0/3287094386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5001a940 con 0x55acd94fd270 2024-09-13T19:06:47.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd9684c80 con 0x55acd94fd270 2024-09-13T19:06:47.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 -- 172.21.15.151:0/3287094386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c50015020 con 0x55acd94fd270 2024-09-13T19:06:47.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b44034650 0x7f0b44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.843+0000 7f0b4a604640 1 -- 172.21.15.151:0/3287094386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0c50020030 con 0x55acd94fd270 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b44034650 0x7f0b44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd958a810 0x55acd9688780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd9688df0 con 0x55acd958a810 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd958a810 0x55acd9688780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd958a810 0x55acd9688780 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b44034650 0x7f0b44036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ac000 tx=0x7f0c540a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3287094386 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd958a810 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd9685e80 con 0x55acd958a810 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3287094386 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd958a810 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd968b120 0x55acd968d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd968dbe0 con 0x55acd968b120 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd968b120 0x55acd968d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd968b120 0x55acd968d510 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3287094386 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c50008030 con 0x55acd968b120 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd9689fc0 con 0x55acd958a810 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3287094386 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd958a810 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55acd968f040 0x55acd9691430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd9691b30 con 0x55acd968f040 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55acd968f040 0x55acd9691430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55acd968f040 0x55acd9691430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3287094386 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0c540b2040 con 0x55acd968f040 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.847+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55acd948f800 con 0x55acd969f5d0 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33386/0 (socket says 172.21.15.151:33386) 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5da9b640 1 -- 172.21.15.151:0/2378991573 learned_addr learned my addr 172.21.15.151:0/2378991573 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5da9b640 1 -- 172.21.15.151:0/2378991573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd969ff30 con 0x55acd969f5d0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d010 tx=0x7f0c50016680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 -- 172.21.15.151:0/2378991573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50042130 con 0x55acd969f5d0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 -- 172.21.15.151:0/2378991573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5000c580 con 0x55acd969f5d0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd96a01c0 con 0x55acd969f5d0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 -- 172.21.15.151:0/2378991573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5000c8a0 con 0x55acd969f5d0 2024-09-13T19:06:47.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd96a2e40 con 0x55acd969f5d0 2024-09-13T19:06:47.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 -- 172.21.15.151:0/2378991573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c50009070 con 0x55acd969f5d0 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 0x7f0b38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0b437fe640 1 -- 172.21.15.151:0/2378991573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0c50005050 con 0x55acd969f5d0 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 0x7f0b38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 0x7f0b38036b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55acd96896d0 tx=0x7f0c54005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.851+0000 7f0c5ff8b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55acd967ad50 con 0x55acd96abf80 2024-09-13T19:06:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33388/0 (socket says 172.21.15.151:33388) 2024-09-13T19:06:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 -- 172.21.15.151:0/1512419833 learned_addr learned my addr 172.21.15.151:0/1512419833 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 -- 172.21.15.151:0/1512419833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd96ac950 con 0x55acd96abf80 2024-09-13T19:06:47.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/1512419833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c50017fb0 tx=0x7f0c500244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712ee367b627e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0b417fa640 1 -- 172.21.15.151:0/1512419833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c5002da20 con 0x55acd96abf80 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0b417fa640 1 -- 172.21.15.151:0/1512419833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c5005b070 con 0x55acd96abf80 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0b417fa640 1 -- 172.21.15.151:0/1512419833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c500419b0 con 0x55acd96abf80 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1512419833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 msgr2=0x55acd96ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1512419833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0c50017fb0 tx=0x7f0c500244e0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1512419833 shutdown_connections 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/1512419833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96ac380 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1512419833 >> 172.21.15.151:0/1512419833 conn(0x55acd96a82b0 msgr2=0x55acd96a63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1512419833 shutdown_connections 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/1512419833 wait complete. 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 Processor -- start 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- start start 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5ff8b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55acd96ace40 con 0x55acd96abf80 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33390/0 (socket says 172.21.15.151:33390) 2024-09-13T19:06:47.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 learned_addr learned my addr 172.21.15.151:0/3644092287 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.855+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd96b3600 con 0x55acd96abf80 2024-09-13T19:06:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c50024eb0 tx=0x7f0c5001b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 -- 172.21.15.151:0/3644092287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50024600 con 0x55acd96abf80 2024-09-13T19:06:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd96b3600 con 0x55acd96abf80 2024-09-13T19:06:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 -- 172.21.15.151:0/3644092287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c500247a0 con 0x55acd96abf80 2024-09-13T19:06:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 -- 172.21.15.151:0/3644092287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c50048a20 con 0x55acd96abf80 2024-09-13T19:06:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd96b3600 con 0x55acd96abf80 2024-09-13T19:06:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 -- 172.21.15.151:0/3644092287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0c50070060 con 0x55acd96abf80 2024-09-13T19:06:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b280346a0 0x7f0b28036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0b2f7fe640 1 -- 172.21.15.151:0/3644092287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0c5006ac90 con 0x55acd96abf80 2024-09-13T19:06:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b280346a0 0x7f0b28036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd96be240 0x55acd96c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c0e50 con 0x55acd96be240 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd96be240 0x55acd96c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b280346a0 0x7f0b28036b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000c10 tx=0x7f0c540b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd96be240 0x55acd96c0700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 realm 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1260 con 0x55acd96be240 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1b30 con 0x55acd96be240 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.859+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd96c2c30 0x55acd96c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c5630 con 0x55acd96c2c30 2024-09-13T19:06:47.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd96c2c30 0x55acd96c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd96c2c30 0x55acd96c5020 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 20 searching for the correct realm 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6f00 con 0x55acd96c2c30 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0c50072070 0x7f0c500121d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6f00 con 0x7f0c50072070 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0c50072070 0x7f0c500121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0c50072070 0x7f0c500121d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5d29a640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0c540cc040 0x7f0c540d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6f00 con 0x7f0c540cc040 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0c540cc040 0x7f0c540d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5e29c640 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0c540cc040 0x7f0c540d9410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.863+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c50072070 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c50072070 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.867+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c50072070 2024-09-13T19:06:47.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.871+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c50072070 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96c2c30 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c540cc040 2024-09-13T19:06:47.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x55acd96be240 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c1ed0 con 0x7f0c50072070 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.875+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c5f80 con 0x55acd96be240 2024-09-13T19:06:47.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6820 con 0x55acd96be240 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6370 con 0x7f0c50072070 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 zone default found 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 4 Realm: () 2024-09-13T19:06:47.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 zonegroup default 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c6830 con 0x7f0c540cc040 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c8d90 con 0x55acd96c2c30 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c91a0 con 0x55acd96c2c30 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 started sync module instance, tier type = 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:47.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c8230 con 0x7f0c50072070 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200870501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c9600 con 0x7f0c50072070 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.879+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96c9e50 con 0x55acd96be240 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.883+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200870501760] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.883+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.883+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200870508960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ca270 con 0x55acd96be240 2024-09-13T19:06:47.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.883+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96caac0 con 0x55acd96c2c30 2024-09-13T19:06:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200870508960] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200870510288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ca8e0 con 0x55acd96c2c30 2024-09-13T19:06:47.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cb4d0 con 0x7f0c50072070 2024-09-13T19:06:47.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200870514720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cbd20 con 0x7f0c50072070 2024-09-13T19:06:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cc720 con 0x55acd96be240 2024-09-13T19:06:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200870510288] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200870514720] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200870511408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cb870 con 0x55acd96be240 2024-09-13T19:06:47.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.887+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ccfc0 con 0x7f0c540cc040 2024-09-13T19:06:47.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200870511408] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200870519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cb870 con 0x7f0c540cc040 2024-09-13T19:06:47.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cd4f0 con 0x7f0c540cc040 2024-09-13T19:06:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200870522848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cd960 con 0x7f0c540cc040 2024-09-13T19:06:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.891+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ce420 con 0x7f0c540cc040 2024-09-13T19:06:47.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200870519344] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200870522848] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200870526704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96cc910 con 0x7f0c540cc040 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=0 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=1 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=2 2024-09-13T19:06:47.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=3 2024-09-13T19:06:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=4 2024-09-13T19:06:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=5 2024-09-13T19:06:47.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.895+0000 7f0c5ff8b980 20 add_watcher() i=6 2024-09-13T19:06:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200870526704] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 add_watcher() i=7 2024-09-13T19:06:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:47.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96d1410 con 0x55acd96be240 2024-09-13T19:06:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200870524080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ce890 con 0x55acd96be240 2024-09-13T19:06:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200870524080] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0b0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:47.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 5 note: GC not initialized 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0b0e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 Filter name: none 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0a7ffff640 20 reqs_thread_entry: start 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:06:47.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96f4ae0 con 0x7f0c540cc040 2024-09-13T19:06:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.899+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:06:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:06:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:06:47.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96f4530 con 0x7f0c50072070 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv25 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96f8310 con 0x55acd96c2c30 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:47.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96fc520 con 0x7f0c50072070 2024-09-13T19:06:47.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.903+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:66 8.1a 8:5956cbeb:root::.bucket.meta.testx%3amyfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ffe10 con 0x7f0c540cc040 2024-09-13T19:06:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [create,call,writefull 0~412,setxattr (203)] v32'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5ff8b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x7 2024-09-13T19:06:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5ff8b980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5ff8b980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:06:47.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5ff8b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94200870722624 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff840 con 0x7f0c540cc040 2024-09-13T19:06:47.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== watch-notify(notify (1) cookie 94200870519344 notify 137438953483 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55acd97001b0 con 0x7f0c540cc040 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0b417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94200870519344 notifier 4540 bl.length()=847 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0b417fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x7 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0b417fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0b417fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0b417fa640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b20003eb0 con 0x7f0c540cc040 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(67 notify.5 [notify cookie 94200870722624 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.907+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== watch-notify(notify_complete (2) cookie 94200870722624 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55acd96fc300 con 0x7f0c540cc040 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 20 handle_bi_update(): bucket=testx:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 20 handle_bi_update(): bucket=testx:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 20 handle_bi_update(): bucket=testx:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 20 handle_bi_update(): bucket=testx:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:47.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff960 con 0x55acd96be240 2024-09-13T19:06:47.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff960 con 0x55acd96be240 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94200870728880 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff8d0 con 0x55acd96be240 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94200870511408 notify 137438953489 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55acd96ffd00 con 0x55acd96be240 2024-09-13T19:06:47.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0b40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94200870511408 notifier 4540 bl.length()=348 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0b40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0b40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(71 notify.4 [notify cookie 94200870728880 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0b40ff9640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0a88003410 con 0x55acd96be240 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94200870728880 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55acd96fec50 con 0x55acd96be240 2024-09-13T19:06:47.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.911+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff960 con 0x7f0c50072070 2024-09-13T19:06:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(73 myfoo [call,delete] v32'27 uv27 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5ff8b980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:06:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5ff8b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:47.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94200870728880 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff8d0 con 0x7f0c540cc040 2024-09-13T19:06:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== watch-notify(notify (1) cookie 94200870522848 notify 137438953484 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55acd96fec50 con 0x7f0c540cc040 2024-09-13T19:06:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(74 notify.6 [notify cookie 94200870728880 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0b417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94200870522848 notifier 4540 bl.length()=149 2024-09-13T19:06:47.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0b417fa640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b20003eb0 con 0x7f0c540cc040 2024-09-13T19:06:47.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.915+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== watch-notify(notify_complete (2) cookie 94200870728880 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55acd96fc300 con 0x7f0c540cc040 2024-09-13T19:06:47.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:76 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff960 con 0x55acd96c2c30 2024-09-13T19:06:47.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(76 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5ff8b980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 from cache 2024-09-13T19:06:47.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5ff8b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:47.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94200870699648 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55acd96ff960 con 0x7f0c540cc040 2024-09-13T19:06:47.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== watch-notify(notify (1) cookie 94200870522848 notify 137438953485 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55acd96fc300 con 0x7f0c540cc040 2024-09-13T19:06:47.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(77 notify.6 [notify cookie 94200870699648 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0b417fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94200870522848 notifier 4540 bl.length()=206 2024-09-13T19:06:47.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0b417fa640 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0b20003eb0 con 0x7f0c540cc040 2024-09-13T19:06:47.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.919+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== watch-notify(notify_complete (2) cookie 94200870699648 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0c5802d040 con 0x7f0c540cc040 2024-09-13T19:06:47.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0b0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:47.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200870524080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x55acd96be240 2024-09-13T19:06:47.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94200870524080] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200870501760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x7f0c50072070 2024-09-13T19:06:47.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94200870501760] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5ff8b980 20 remove_watcher() i=0 2024-09-13T19:06:47.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5ff8b980 2 removed watcher, disabling cache 2024-09-13T19:06:47.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.923+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200870508960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x55acd96be240 2024-09-13T19:06:47.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94200870508960] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5ff8b980 20 remove_watcher() i=1 2024-09-13T19:06:47.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200870510288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x55acd96c2c30 2024-09-13T19:06:47.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5da9b640 1 -- 172.21.15.151:0/3644092287 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94200870510288] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c50008030 con 0x55acd96c2c30 2024-09-13T19:06:47.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5ff8b980 20 remove_watcher() i=2 2024-09-13T19:06:47.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.927+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200870514720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x7f0c50072070 2024-09-13T19:06:47.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5d29a640 1 -- 172.21.15.151:0/3644092287 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94200870514720] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c540d7070 con 0x7f0c50072070 2024-09-13T19:06:47.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5ff8b980 20 remove_watcher() i=3 2024-09-13T19:06:47.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200870511408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x55acd96be240 2024-09-13T19:06:47.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94200870511408] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x55acd96be240 2024-09-13T19:06:47.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5ff8b980 20 remove_watcher() i=4 2024-09-13T19:06:47.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.931+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200870519344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x7f0c540cc040 2024-09-13T19:06:47.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94200870519344] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5ff8b980 20 remove_watcher() i=5 2024-09-13T19:06:47.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200870522848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x7f0c540cc040 2024-09-13T19:06:47.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94200870522848] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5ff8b980 20 remove_watcher() i=6 2024-09-13T19:06:47.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.935+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200870526704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55acd96e5420 con 0x7f0c540cc040 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94200870526704] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0c5800a4d0 con 0x7f0c540cc040 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 20 remove_watcher() i=7 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0c540cc040 msgr2=0x7f0c540d9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0c540cc040 0x7f0c540d9410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd96be240 msgr2=0x55acd96c0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd96be240 0x55acd96c0700 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0c50072070 msgr2=0x7f0c500121d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0c50072070 0x7f0c500121d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd96c2c30 msgr2=0x55acd96c5020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd96c2c30 0x55acd96c5020 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b280346a0 msgr2=0x7f0b28036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b280346a0 0x7f0b28036b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0c54000c10 tx=0x7f0c540b8040 comp rx=0 tx=0).stop 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3644092287 reap_dead start 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 msgr2=0x55acd96b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c50024eb0 tx=0x7f0c5001b470 comp rx=0 tx=0).stop 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 shutdown_connections 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3644092287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd96abf80 0x55acd96b30c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 >> 172.21.15.151:0/3644092287 conn(0x55acd96a82b0 msgr2=0x55acd96a6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 shutdown_connections 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3644092287 wait complete. 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 msgr2=0x7f0b38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 0x7f0b38036b60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55acd96896d0 tx=0x7f0c54005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:47.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 msgr2=0x55acd969f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d010 tx=0x7f0c50016680 comp rx=0 tx=0).stop 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 shutdown_connections 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b380346a0 0x7f0b38036b60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/2378991573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd969f5d0 0x55acd969f9f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 >> 172.21.15.151:0/2378991573 conn(0x55acd9694750 msgr2=0x55acd96971d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 shutdown_connections 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/2378991573 wait complete. 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd958a810 msgr2=0x55acd9688780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55acd958a810 0x55acd9688780 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55acd968f040 msgr2=0x55acd9691430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55acd968f040 0x55acd9691430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd968b120 msgr2=0x55acd968d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55acd968b120 0x55acd968d510 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b44034650 msgr2=0x7f0b44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0b44034650 0x7f0b44036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ac000 tx=0x7f0c540a5000 comp rx=0 tx=0).stop 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 msgr2=0x55acd96817d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 --2- 172.21.15.151:0/3287094386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55acd94fd270 0x55acd96817d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0c50001e20 tx=0x7f0c50000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5e29c640 1 -- 172.21.15.151:0/3287094386 reap_dead start 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 shutdown_connections 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 >> 172.21.15.151:0/3287094386 conn(0x55acd9583030 msgr2=0x55acd9674bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 shutdown_connections 2024-09-13T19:06:47.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:47.939+0000 7f0c5ff8b980 1 -- 172.21.15.151:0/3287094386 wait complete. 2024-09-13T19:06:47.954 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:06:47.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-13T19:06:47.954 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-13T19:06:48.031 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4d638980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5650e69fba90 0x5650e69fde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4d638980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650e687fae0 con 0x5650e696bac0 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4d638980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5650e68a3e30 con 0x5650e69fba90 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4a947640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5650e69fba90 0x5650e69fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4b148640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5650e696bac0 0x5650e69fa370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33310/0 (socket says 172.21.15.151:33310) 2024-09-13T19:06:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4b148640 1 -- 172.21.15.151:0/2504478349 learned_addr learned my addr 172.21.15.151:0/2504478349 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:48.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4a947640 1 -- 172.21.15.151:0/2504478349 >> v1:172.21.15.12:6789/0 conn(0x5650e696bac0 legacy=0x5650e69fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.031+0000 7f5b4a947640 1 -- 172.21.15.151:0/2504478349 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e69ff3d0 con 0x5650e69fba90 2024-09-13T19:06:48.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4a947640 1 --2- 172.21.15.151:0/2504478349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e69fba90 0x5650e69fde80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00a480 tx=0x7f5b3c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff743996513d88f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4a146640 1 -- 172.21.15.151:0/2504478349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c0b0070 con 0x5650e69fba90 2024-09-13T19:06:48.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4a146640 1 -- 172.21.15.151:0/2504478349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3c0ab540 con 0x5650e69fba90 2024-09-13T19:06:48.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4a146640 1 -- 172.21.15.151:0/2504478349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3c0ab840 con 0x5650e69fba90 2024-09-13T19:06:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 -- 172.21.15.151:0/2504478349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e69fba90 msgr2=0x5650e69fde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2504478349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e69fba90 0x5650e69fde80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00a480 tx=0x7f5b3c01b280 comp rx=0 tx=0).stop 2024-09-13T19:06:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 -- 172.21.15.151:0/2504478349 shutdown_connections 2024-09-13T19:06:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2504478349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e69fba90 0x5650e69fde80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 -- 172.21.15.151:0/2504478349 >> 172.21.15.151:0/2504478349 conn(0x5650e69f2060 msgr2=0x5650e69f4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 -- 172.21.15.151:0/2504478349 shutdown_connections 2024-09-13T19:06:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.035+0000 7f5b4d638980 1 -- 172.21.15.151:0/2504478349 wait complete. 2024-09-13T19:06:48.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4d638980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4d638980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5650e68a5200 con 0x5650e696bac0 2024-09-13T19:06:48.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33400/0 (socket says 172.21.15.151:33400) 2024-09-13T19:06:48.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4b148640 1 -- 172.21.15.151:0/633252114 learned_addr learned my addr 172.21.15.151:0/633252114 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4b148640 1 -- 172.21.15.151:0/633252114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e6ae3110 con 0x5650e696bac0 2024-09-13T19:06:48.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5b4b148640 1 --2- 172.21.15.151:0/633252114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5b340017b0 tx=0x7f5b34001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26f6c6578b1003e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5a3960a640 1 -- 172.21.15.151:0/633252114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34016070 con 0x5650e696bac0 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5a3960a640 1 -- 172.21.15.151:0/633252114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34004530 con 0x5650e696bac0 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.051+0000 7f5a3960a640 1 -- 172.21.15.151:0/633252114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34004870 con 0x5650e696bac0 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/633252114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 msgr2=0x5650e6ae2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 --2- 172.21.15.151:0/633252114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f5b340017b0 tx=0x7f5b34001c70 comp rx=0 tx=0).stop 2024-09-13T19:06:48.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/633252114 shutdown_connections 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 --2- 172.21.15.151:0/633252114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae2b40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/633252114 >> 172.21.15.151:0/633252114 conn(0x5650e69f2060 msgr2=0x5650e6ade770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/633252114 shutdown_connections 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/633252114 wait complete. 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5650e69fee10 con 0x5650e696bac0 2024-09-13T19:06:48.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33408/0 (socket says 172.21.15.151:33408) 2024-09-13T19:06:48.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4b148640 1 -- 172.21.15.151:0/1216100475 learned_addr learned my addr 172.21.15.151:0/1216100475 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4b148640 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e6aea410 con 0x5650e696bac0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4b148640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae9ed0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f90 tx=0x7f5b34001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5a37e07640 1 -- 172.21.15.151:0/1216100475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34020070 con 0x5650e696bac0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650e6aea6a0 con 0x5650e696bac0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5a37e07640 1 -- 172.21.15.151:0/1216100475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34011400 con 0x5650e696bac0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5a37e07640 1 -- 172.21.15.151:0/1216100475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34016040 con 0x5650e696bac0 2024-09-13T19:06:48.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.055+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e6aed380 con 0x5650e696bac0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5a37e07640 1 -- 172.21.15.151:0/1216100475 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b34023070 con 0x5650e696bac0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5a37e07640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a300346a0 0x7f5a30036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5a37e07640 1 -- 172.21.15.151:0/1216100475 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b34049230 con 0x5650e696bac0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4a947640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a300346a0 0x7f5a30036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e69fba90 0x5650e6af0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6af1510 con 0x5650e69fba90 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b949640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e69fba90 0x5650e6af0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4a947640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a300346a0 0x7f5a30036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0ad000 tx=0x7f5b3c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b949640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e69fba90 0x5650e6af0fd0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b949640 1 -- 172.21.15.151:0/1216100475 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e69fba90 2024-09-13T19:06:48.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6aee580 con 0x5650e69fba90 2024-09-13T19:06:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b949640 1 -- 172.21.15.151:0/1216100475 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e69fba90 2024-09-13T19:06:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6af3830 0x5650e6af5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6af62f0 con 0x5650e6af3830 2024-09-13T19:06:48.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b148640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6af3830 0x5650e6af5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b148640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6af3830 0x5650e6af5c20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b148640 1 -- 172.21.15.151:0/1216100475 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6af3830 2024-09-13T19:06:48.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6af26a0 con 0x5650e69fba90 2024-09-13T19:06:48.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4b949640 1 -- 172.21.15.151:0/1216100475 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e69fba90 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5650e6af7750 0x5650e6af9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6afa230 con 0x5650e6af7750 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4a947640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5650e6af7750 0x5650e6af9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.059+0000 7f5b4a947640 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5650e6af7750 0x5650e6af9b40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4a947640 1 -- 172.21.15.151:0/1216100475 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b3c0b3040 con 0x5650e6af7750 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5650e68fe800 con 0x5650e6b07c80 2024-09-13T19:06:48.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33422/0 (socket says 172.21.15.151:33422) 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4b148640 1 -- 172.21.15.151:0/2076814235 learned_addr learned my addr 172.21.15.151:0/2076814235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4b148640 1 -- 172.21.15.151:0/2076814235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e6b085e0 con 0x5650e6b07c80 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4b148640 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5b340475c0 tx=0x7f5b34023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 -- 172.21.15.151:0/2076814235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3402a040 con 0x5650e6b07c80 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 -- 172.21.15.151:0/2076814235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b340116e0 con 0x5650e6b07c80 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 -- 172.21.15.151:0/2076814235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3402a420 con 0x5650e6b07c80 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650e6b08870 con 0x5650e6b07c80 2024-09-13T19:06:48.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e6b0b4f0 con 0x5650e6b07c80 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 -- 172.21.15.151:0/2076814235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b340119c0 con 0x5650e6b07c80 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 0x7f5a24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5a35602640 1 -- 172.21.15.151:0/2076814235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b34036070 con 0x5650e6b07c80 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.063+0000 7f5b4a947640 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 0x7f5a24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4a947640 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 0x7f5a24036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5650e6af1de0 tx=0x7f5b3c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5650e6ae3490 con 0x5650e6b14660 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33434/0 (socket says 172.21.15.151:33434) 2024-09-13T19:06:48.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 -- 172.21.15.151:0/1808882648 learned_addr learned my addr 172.21.15.151:0/1808882648 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 -- 172.21.15.151:0/1808882648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e6b15030 con 0x5650e6b14660 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 --2- 172.21.15.151:0/1808882648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b34006830 tx=0x7f5b34049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69154dd446fdaf50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5a2effd640 1 -- 172.21.15.151:0/1808882648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3405d070 con 0x5650e6b14660 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5a2effd640 1 -- 172.21.15.151:0/1808882648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3402dd50 con 0x5650e6b14660 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5a2effd640 1 -- 172.21.15.151:0/1808882648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34054040 con 0x5650e6b14660 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- 172.21.15.151:0/1808882648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 msgr2=0x5650e6b14a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1808882648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5b34006830 tx=0x7f5b34049000 comp rx=0 tx=0).stop 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- 172.21.15.151:0/1808882648 shutdown_connections 2024-09-13T19:06:48.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1808882648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b14a60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- 172.21.15.151:0/1808882648 >> 172.21.15.151:0/1808882648 conn(0x5650e6b10990 msgr2=0x5650e6b0ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- 172.21.15.151:0/1808882648 shutdown_connections 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- 172.21.15.151:0/1808882648 wait complete. 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 Processor -- start 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- start start 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4d638980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5650e6b15520 con 0x5650e6b14660 2024-09-13T19:06:48.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33436/0 (socket says 172.21.15.151:33436) 2024-09-13T19:06:48.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.067+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 learned_addr learned my addr 172.21.15.151:0/3792042997 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650e6b1bc80 con 0x5650e6b14660 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4b148640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5b34046390 tx=0x7f5b3402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 -- 172.21.15.151:0/3792042997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34065020 con 0x5650e6b14660 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 -- 172.21.15.151:0/3792042997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34040d20 con 0x5650e6b14660 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650e6b1bc80 con 0x5650e6b14660 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 -- 172.21.15.151:0/3792042997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3405d040 con 0x5650e6b14660 2024-09-13T19:06:48.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650e6b1c0f0 con 0x5650e6b14660 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 -- 172.21.15.151:0/3792042997 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b34068020 con 0x5650e6b14660 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a140346a0 0x7f5a14036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5a2d7fa640 1 -- 172.21.15.151:0/3792042997 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5b3406bc60 con 0x5650e6b14660 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4a947640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a140346a0 0x7f5a14036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e6b26870 0x5650e6b28d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b29480 con 0x5650e6b26870 2024-09-13T19:06:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4b949640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e6b26870 0x5650e6b28d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4a947640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a140346a0 0x7f5a14036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c10 tx=0x7f5b3c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.071+0000 7f5b4b949640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e6b26870 0x5650e6b28d30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 realm 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b29890 con 0x5650e6b26870 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a130 con 0x5650e6b26870 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6b2b230 0x5650e6b2d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2dba0 con 0x5650e6b2b230 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6b2b230 0x5650e6b2d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6b2b230 0x5650e6b2d620 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 20 searching for the correct realm 2024-09-13T19:06:48.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2f400 con 0x5650e6b2b230 2024-09-13T19:06:48.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5b3406a020 0x7f5b3402f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2f400 con 0x7f5b3406a020 2024-09-13T19:06:48.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4a947640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5b3406a020 0x7f5b3402f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4a947640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5b3406a020 0x7f5b3402f8a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4a947640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5b3c0dc040 0x7f5b3c0dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2f400 con 0x7f5b3c0dc040 2024-09-13T19:06:48.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.075+0000 7f5b4b949640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5b3c0dc040 0x7f5b3c0dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5b3c0dc040 0x7f5b3c0dd430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3406a020 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.079+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3406a020 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.083+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3406a020 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3406a020 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b2b230 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.087+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x5650e6b26870 2024-09-13T19:06:48.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2a4d0 con 0x7f5b3406a020 2024-09-13T19:06:48.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2e4f0 con 0x5650e6b26870 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2ed90 con 0x5650e6b26870 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2e130 con 0x7f5b3406a020 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 zone default found 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 4 Realm: () 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 zonegroup default 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b2ed90 con 0x7f5b3c0dc040 2024-09-13T19:06:48.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b312b0 con 0x5650e6b2b230 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b31650 con 0x5650e6b2b230 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 started sync module instance, tier type = 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:48.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.091+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b30750 con 0x7f5b3406a020 2024-09-13T19:06:48.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905467865920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b31ea0 con 0x7f5b3406a020 2024-09-13T19:06:48.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b326f0 con 0x5650e6b26870 2024-09-13T19:06:48.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905467865920] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905467869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b326f0 con 0x5650e6b26870 2024-09-13T19:06:48.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.095+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b33170 con 0x5650e6b2b230 2024-09-13T19:06:48.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905467874400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b33a40 con 0x5650e6b2b230 2024-09-13T19:06:48.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b34440 con 0x7f5b3406a020 2024-09-13T19:06:48.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905467869680] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905467871808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b34ce0 con 0x7f5b3406a020 2024-09-13T19:06:48.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b35570 con 0x5650e6b26870 2024-09-13T19:06:48.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905467874400] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.099+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905467871808] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905467876752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b34ce0 con 0x5650e6b26870 2024-09-13T19:06:48.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b35e10 con 0x7f5b3c0dc040 2024-09-13T19:06:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905467876752] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905467881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b34c50 con 0x7f5b3c0dc040 2024-09-13T19:06:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.103+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36350 con 0x7f5b3c0dc040 2024-09-13T19:06:48.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905467881520] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905467887136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36310 con 0x7f5b3c0dc040 2024-09-13T19:06:48.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36d30 con 0x7f5b3c0dc040 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905467889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b371a0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=0 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=1 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=2 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=3 2024-09-13T19:06:48.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=4 2024-09-13T19:06:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=5 2024-09-13T19:06:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905467887136] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.107+0000 7f5b4d638980 20 add_watcher() i=6 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905467889696] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 add_watcher() i=7 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b371a0 con 0x5650e6b26870 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905467890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b37110 con 0x5650e6b26870 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905467890928] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5a01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 5 note: GC not initialized 2024-09-13T19:06:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5a00fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 Filter name: none 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f597a7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.111+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b5d280 con 0x5650e6b26870 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:06:48.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5a01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905467890928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b5b1d0 con 0x5650e6b26870 2024-09-13T19:06:48.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94905467890928] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905467865920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36cf0 con 0x7f5b3406a020 2024-09-13T19:06:48.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94905467865920] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 20 remove_watcher() i=0 2024-09-13T19:06:48.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 2 removed watcher, disabling cache 2024-09-13T19:06:48.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.115+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905467869680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36cf0 con 0x5650e6b26870 2024-09-13T19:06:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.119+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94905467869680] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.119+0000 7f5b4d638980 20 remove_watcher() i=1 2024-09-13T19:06:48.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.119+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905467874400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b36cf0 con 0x5650e6b2b230 2024-09-13T19:06:48.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4b148640 1 -- 172.21.15.151:0/3792042997 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94905467874400] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3402c070 con 0x5650e6b2b230 2024-09-13T19:06:48.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 20 remove_watcher() i=2 2024-09-13T19:06:48.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905467871808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b319f0 con 0x7f5b3406a020 2024-09-13T19:06:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4a947640 1 -- 172.21.15.151:0/3792042997 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94905467871808] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b3c0c9030 con 0x7f5b3406a020 2024-09-13T19:06:48.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 20 remove_watcher() i=3 2024-09-13T19:06:48.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905467876752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b32240 con 0x5650e6b26870 2024-09-13T19:06:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94905467876752] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x5650e6b26870 2024-09-13T19:06:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 20 remove_watcher() i=4 2024-09-13T19:06:48.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.123+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905467881520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b32240 con 0x7f5b3c0dc040 2024-09-13T19:06:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.127+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94905467881520] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.127+0000 7f5b4d638980 20 remove_watcher() i=5 2024-09-13T19:06:48.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.127+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905467887136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b32240 con 0x7f5b3c0dc040 2024-09-13T19:06:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94905467887136] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 20 remove_watcher() i=6 2024-09-13T19:06:48.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905467889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5650e6b35e20 con 0x7f5b3c0dc040 2024-09-13T19:06:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94905467889696] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b440083f0 con 0x7f5b3c0dc040 2024-09-13T19:06:48.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 20 remove_watcher() i=7 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5b3c0dc040 msgr2=0x7f5b3c0dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5b3c0dc040 0x7f5b3c0dd430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e6b26870 msgr2=0x5650e6b28d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e6b26870 0x5650e6b28d30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5b3406a020 msgr2=0x7f5b3402f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5b3406a020 0x7f5b3402f8a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6b2b230 msgr2=0x5650e6b2d620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6b2b230 0x5650e6b2d620 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a140346a0 msgr2=0x7f5a14036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a140346a0 0x7f5a14036b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c10 tx=0x7f5b3c0b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 msgr2=0x5650e6b1b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5b34046390 tx=0x7f5b3402bf60 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4b949640 1 -- 172.21.15.151:0/3792042997 reap_dead start 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 shutdown_connections 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/3792042997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b14660 0x5650e6b1b740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 >> 172.21.15.151:0/3792042997 conn(0x5650e6b10990 msgr2=0x5650e6b0ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 shutdown_connections 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/3792042997 wait complete. 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 msgr2=0x7f5a24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 0x7f5a24036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5650e6af1de0 tx=0x7f5b3c005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 msgr2=0x5650e6b080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5b340475c0 tx=0x7f5b34023ac0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 shutdown_connections 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a24034650 0x7f5a24036b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 --2- 172.21.15.151:0/2076814235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e6b07c80 0x5650e6b080a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 >> 172.21.15.151:0/2076814235 conn(0x5650e6afcdd0 msgr2=0x5650e6aff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 shutdown_connections 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.131+0000 7f5b4d638980 1 -- 172.21.15.151:0/2076814235 wait complete. 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e69fba90 msgr2=0x5650e6af0fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5650e69fba90 0x5650e6af0fd0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5650e6af7750 msgr2=0x5650e6af9b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5650e6af7750 0x5650e6af9b40 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6af3830 msgr2=0x5650e6af5c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5650e6af3830 0x5650e6af5c20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a300346a0 msgr2=0x7f5a30036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f5a300346a0 0x7f5a30036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c0ad000 tx=0x7f5b3c0a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 msgr2=0x5650e6ae9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 --2- 172.21.15.151:0/1216100475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5650e696bac0 0x5650e6ae9ed0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f90 tx=0x7f5b34001260 comp rx=0 tx=0).stop 2024-09-13T19:06:48.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4b949640 1 -- 172.21.15.151:0/1216100475 reap_dead start 2024-09-13T19:06:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 shutdown_connections 2024-09-13T19:06:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 >> 172.21.15.151:0/1216100475 conn(0x5650e69f2060 msgr2=0x5650e6add2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 shutdown_connections 2024-09-13T19:06:48.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.135+0000 7f5b4d638980 1 -- 172.21.15.151:0/1216100475 wait complete. 2024-09-13T19:06:48.147 INFO:teuthology.orchestra.run.smithi151.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"Zy7ICxSRkQEjIT0Ce3DeElJV","ver":2},"mtime":"2024-09-13T19:06:47.914459Z","data":{"bucket":{"name":"myfoo","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","bucket_id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-13T19:06:44.212931Z","linked":true,"has_bucket_info":false}} 2024-09-13T19:06:48.147 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'Zy7ICxSRkQEjIT0Ce3DeElJV', 'ver': 2}, 'mtime': '2024-09-13T19:06:47.914459Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'bucket_id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-13T19:06:44.212931Z', 'linked': True, 'has_bucket_info': False}} 2024-09-13T19:06:48.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:06:48.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-13T19:06:48.148 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-13T19:06:48.225 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:48.226 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:48.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc3020df980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557f5c9dbad0 0x557f5c9ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc3020df980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f5c85fae0 con 0x557f5c94c2a0 2024-09-13T19:06:48.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc3020df980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x557f5c883e30 con 0x557f5c9dbad0 2024-09-13T19:06:48.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc2ff3ee640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557f5c9dbad0 0x557f5c9ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc2ffbef640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x557f5c94c2a0 0x557f5c9da3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33322/0 (socket says 172.21.15.151:33322) 2024-09-13T19:06:48.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.223+0000 7fc2ffbef640 1 -- 172.21.15.151:0/1889441680 learned_addr learned my addr 172.21.15.151:0/1889441680 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:48.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/1889441680 >> v1:172.21.15.12:6789/0 conn(0x557f5c94c2a0 legacy=0x557f5c9da3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/1889441680 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5c94c830 con 0x557f5c9dbad0 2024-09-13T19:06:48.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/1889441680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c9dbad0 0x557f5c9ddec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800a480 tx=0x7fc2e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8b3618c8ed7fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2febed640 1 -- 172.21.15.151:0/1889441680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e80b0070 con 0x557f5c9dbad0 2024-09-13T19:06:48.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2febed640 1 -- 172.21.15.151:0/1889441680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e80ab540 con 0x557f5c9dbad0 2024-09-13T19:06:48.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc2febed640 1 -- 172.21.15.151:0/1889441680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2e80ab840 con 0x557f5c9dbad0 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 -- 172.21.15.151:0/1889441680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c9dbad0 msgr2=0x557f5c9ddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 --2- 172.21.15.151:0/1889441680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c9dbad0 0x557f5c9ddec0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800a480 tx=0x7fc2e801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 -- 172.21.15.151:0/1889441680 shutdown_connections 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 --2- 172.21.15.151:0/1889441680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c9dbad0 0x557f5c9ddec0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 -- 172.21.15.151:0/1889441680 >> 172.21.15.151:0/1889441680 conn(0x557f5c9d20a0 msgr2=0x557f5c9d44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 -- 172.21.15.151:0/1889441680 shutdown_connections 2024-09-13T19:06:48.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.227+0000 7fc3020df980 1 -- 172.21.15.151:0/1889441680 wait complete. 2024-09-13T19:06:48.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc3020df980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc3020df980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f5c885200 con 0x557f5c94c2a0 2024-09-13T19:06:48.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33464/0 (socket says 172.21.15.151:33464) 2024-09-13T19:06:48.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.243+0000 7fc2ffbef640 1 -- 172.21.15.151:0/1732268455 learned_addr learned my addr 172.21.15.151:0/1732268455 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 -- 172.21.15.151:0/1732268455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5cac2fe0 con 0x557f5c94c2a0 2024-09-13T19:06:48.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/1732268455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80015f0 tx=0x7fc2f8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56846d35462b514f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc1ede0b640 1 -- 172.21.15.151:0/1732268455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8004530 con 0x557f5c94c2a0 2024-09-13T19:06:48.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc1ede0b640 1 -- 172.21.15.151:0/1732268455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f80046f0 con 0x557f5c94c2a0 2024-09-13T19:06:48.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc1ede0b640 1 -- 172.21.15.151:0/1732268455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8004a90 con 0x557f5c94c2a0 2024-09-13T19:06:48.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- 172.21.15.151:0/1732268455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 msgr2=0x557f5cac2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 --2- 172.21.15.151:0/1732268455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80015f0 tx=0x7fc2f8001ab0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- 172.21.15.151:0/1732268455 shutdown_connections 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 --2- 172.21.15.151:0/1732268455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac2a10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- 172.21.15.151:0/1732268455 >> 172.21.15.151:0/1732268455 conn(0x557f5c9d20a0 msgr2=0x557f5cabe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- 172.21.15.151:0/1732268455 shutdown_connections 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- 172.21.15.151:0/1732268455 wait complete. 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc3020df980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f5c9def10 con 0x557f5c94c2a0 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33472/0 (socket says 172.21.15.151:33472) 2024-09-13T19:06:48.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 -- 172.21.15.151:0/3869231783 learned_addr learned my addr 172.21.15.151:0/3869231783 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5caca310 con 0x557f5c94c2a0 2024-09-13T19:06:48.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.247+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac9dd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8001af0 tx=0x7fc2f8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 -- 172.21.15.151:0/3869231783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8013630 con 0x557f5c94c2a0 2024-09-13T19:06:48.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5caca5a0 con 0x557f5c94c2a0 2024-09-13T19:06:48.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 -- 172.21.15.151:0/3869231783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f80137d0 con 0x557f5c94c2a0 2024-09-13T19:06:48.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 -- 172.21.15.151:0/3869231783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8013ad0 con 0x557f5c94c2a0 2024-09-13T19:06:48.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5cacd280 con 0x557f5c94c2a0 2024-09-13T19:06:48.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 -- 172.21.15.151:0/3869231783 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2f8010070 con 0x557f5c94c2a0 2024-09-13T19:06:48.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1e80346a0 0x7fc1e8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc1e7fff640 1 -- 172.21.15.151:0/3869231783 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f8018070 con 0x557f5c94c2a0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1e80346a0 0x7fc1e8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5c9dbad0 0x557f5cad0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cad13e0 con 0x557f5c9dbad0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3003f0640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5c9dbad0 0x557f5cad0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1e80346a0 0x7fc1e8036b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ad000 tx=0x7fc2e80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3003f0640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5c9dbad0 0x557f5cad0da0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3003f0640 1 -- 172.21.15.151:0/3869231783 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5c9dbad0 2024-09-13T19:06:48.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cace4a0 con 0x557f5c9dbad0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3003f0640 1 -- 172.21.15.151:0/3869231783 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5c9dbad0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cad3730 0x557f5cad5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cad61f0 con 0x557f5cad3730 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cad3730 0x557f5cad5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cad3730 0x557f5cad5b20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.251+0000 7fc2ffbef640 1 -- 172.21.15.151:0/3869231783 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2f801b030 con 0x557f5cad3730 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cad25d0 con 0x557f5c9dbad0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3003f0640 1 -- 172.21.15.151:0/3869231783 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5c9dbad0 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f5cad7630 0x557f5cad9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cada1b0 con 0x557f5cad7630 2024-09-13T19:06:48.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f5cad7630 0x557f5cad9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f5cad7630 0x557f5cad9a20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/3869231783 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2e80b3040 con 0x557f5cad7630 2024-09-13T19:06:48.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f5c8de800 con 0x557f5cae7c40 2024-09-13T19:06:48.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33476/0 (socket says 172.21.15.151:33476) 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ffbef640 1 -- 172.21.15.151:0/3761834363 learned_addr learned my addr 172.21.15.151:0/3761834363 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ffbef640 1 -- 172.21.15.151:0/3761834363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5cae85a0 con 0x557f5cae7c40 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80066a0 tx=0x7fc2f8010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc1e57fa640 1 -- 172.21.15.151:0/3761834363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8041da0 con 0x557f5cae7c40 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc1e57fa640 1 -- 172.21.15.151:0/3761834363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8041f40 con 0x557f5cae7c40 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5cae8830 con 0x557f5cae7c40 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc1e57fa640 1 -- 172.21.15.151:0/3761834363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f80285f0 con 0x557f5cae7c40 2024-09-13T19:06:48.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.255+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5cae8830 con 0x557f5cae7c40 2024-09-13T19:06:48.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1e57fa640 1 -- 172.21.15.151:0/3761834363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2f8028790 con 0x557f5cae7c40 2024-09-13T19:06:48.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1e57fa640 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 0x7fc1d8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1e57fa640 1 -- 172.21.15.151:0/3761834363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f803b070 con 0x557f5cae7c40 2024-09-13T19:06:48.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 0x7fc1d8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 0x7fc1d8036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae040 tx=0x7fc2e8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f5cac3360 con 0x557f5caf4360 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33488/0 (socket says 172.21.15.151:33488) 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ffbef640 1 -- 172.21.15.151:0/2980174594 learned_addr learned my addr 172.21.15.151:0/2980174594 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ffbef640 1 -- 172.21.15.151:0/2980174594 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5caf4d10 con 0x557f5caf4360 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/2980174594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8042110 tx=0x7fc2f8050480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66386ca86c14de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1deffd640 1 -- 172.21.15.151:0/2980174594 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8060070 con 0x557f5caf4360 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1deffd640 1 -- 172.21.15.151:0/2980174594 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f80508a0 con 0x557f5caf4360 2024-09-13T19:06:48.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc1deffd640 1 -- 172.21.15.151:0/2980174594 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f80415e0 con 0x557f5caf4360 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- 172.21.15.151:0/2980174594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 msgr2=0x557f5caf4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 --2- 172.21.15.151:0/2980174594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8042110 tx=0x7fc2f8050480 comp rx=0 tx=0).stop 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- 172.21.15.151:0/2980174594 shutdown_connections 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 --2- 172.21.15.151:0/2980174594 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5caf4740 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- 172.21.15.151:0/2980174594 >> 172.21.15.151:0/2980174594 conn(0x557f5caf0740 msgr2=0x557f5caee840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- 172.21.15.151:0/2980174594 shutdown_connections 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.259+0000 7fc3020df980 1 -- 172.21.15.151:0/2980174594 wait complete. 2024-09-13T19:06:48.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 Processor -- start 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 -- start start 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5cafb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f5caf51b0 con 0x557f5caf4360 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5cafb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ffbef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5cafb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33490/0 (socket says 172.21.15.151:33490) 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 learned_addr learned my addr 172.21.15.151:0/828453118 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5cafb990 con 0x557f5caf4360 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5cafb450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80046c0 tx=0x7fc2f8023fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 -- 172.21.15.151:0/828453118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f806a070 con 0x557f5caf4360 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f5cafb990 con 0x557f5caf4360 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 -- 172.21.15.151:0/828453118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8011400 con 0x557f5caf4360 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 -- 172.21.15.151:0/828453118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f8060040 con 0x557f5caf4360 2024-09-13T19:06:48.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5cafbe00 con 0x557f5caf4360 2024-09-13T19:06:48.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 -- 172.21.15.151:0/828453118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc2f8059070 con 0x557f5caf4360 2024-09-13T19:06:48.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1c8034650 0x7fc1c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc1dd7fa640 1 -- 172.21.15.151:0/828453118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f8067c50 con 0x557f5caf4360 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1c8034650 0x7fc1c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.263+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5cb06570 0x557f5cb08a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb09180 con 0x557f5cb06570 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5cb06570 0x557f5cb08a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1c8034650 0x7fc1c8036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8017e90 tx=0x7fc2e80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5cb06570 0x557f5cb08a30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 realm 2024-09-13T19:06:48.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb09590 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb09e60 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cb0af60 0x557f5cb0d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0d960 con 0x557f5cb0af60 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cb0af60 0x557f5cb0d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cb0af60 0x557f5cb0d350 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 20 searching for the correct realm 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0f230 con 0x557f5cb0af60 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc2f805bb70 0x7fc2f802d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0f230 con 0x7fc2f805bb70 2024-09-13T19:06:48.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc2f805bb70 0x7fc2f802d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc2f805bb70 0x7fc2f802d160 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc2e80dc040 0x7fc2e80dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.267+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0f230 con 0x7fc2e80dc040 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc2e80dc040 0x7fc2e80dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc2e80dc040 0x7fc2e80dd430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2f805bb70 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.271+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2f805bb70 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.275+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2f805bb70 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2f805bb70 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb0af60 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.279+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2e80dc040 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x557f5cb06570 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0a200 con 0x7fc2f805bb70 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:48.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0e320 con 0x557f5cb06570 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0df60 con 0x557f5cb06570 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0ec40 con 0x7fc2f805bb70 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 zone default found 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 4 Realm: () 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 zonegroup default 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb0f660 con 0x7fc2e80dc040 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb11040 con 0x557f5cb0af60 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb11520 con 0x557f5cb0af60 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 started sync module instance, tier type = 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.283+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb104e0 con 0x7fc2f805bb70 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94005504313552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb11e30 con 0x7fc2f805bb70 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb12680 con 0x557f5cb06570 2024-09-13T19:06:48.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94005504313552] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94005504317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb12680 con 0x557f5cb06570 2024-09-13T19:06:48.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.287+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb130f0 con 0x557f5cb0af60 2024-09-13T19:06:48.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94005504322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb13990 con 0x557f5cb0af60 2024-09-13T19:06:48.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94005504317824] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb121d0 con 0x7fc2f805bb70 2024-09-13T19:06:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94005504327328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb14770 con 0x7fc2f805bb70 2024-09-13T19:06:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb15130 con 0x557f5cb06570 2024-09-13T19:06:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.291+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94005504322496] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94005504327328] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94005504328384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb146e0 con 0x557f5cb06570 2024-09-13T19:06:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb155e0 con 0x7fc2e80dc040 2024-09-13T19:06:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94005504328384] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94005504330880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb15550 con 0x7fc2e80dc040 2024-09-13T19:06:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.295+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb15f10 con 0x7fc2e80dc040 2024-09-13T19:06:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.299+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.299+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94005504330880] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.299+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94005504334432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb16330 con 0x7fc2e80dc040 2024-09-13T19:06:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.299+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb150e0 con 0x7fc2e80dc040 2024-09-13T19:06:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94005504334432] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94005504335488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb162a0 con 0x7fc2e80dc040 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=0 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=1 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=2 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=3 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=4 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=5 2024-09-13T19:06:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=6 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94005504335488] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 20 add_watcher() i=7 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb19d50 con 0x557f5cb06570 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.303+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94005504338032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb17170 con 0x557f5cb06570 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94005504338032] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc1b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 5 note: GC not initialized 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc1b4fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 Filter name: none 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc12e7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb3d2e0 con 0x557f5cb06570 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb3ce30 con 0x557f5cb06570 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=193 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-13T19:06:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-13T19:06:48.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:48.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.1a 8:5956cbeb:root::.bucket.meta.testx%3amyfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb40fb0 con 0x7fc2e80dc040 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 20 rados_obj.operate() r=0 bl.length=412 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-13T19:06:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.307+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb45650 con 0x557f5cb06570 2024-09-13T19:06:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb48f60 con 0x557f5cb0af60 2024-09-13T19:06:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [create,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x7 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94005504535808 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb48a00 con 0x7fc2e80dc040 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== watch-notify(notify (1) cookie 94005504334432 notify 137438953486 ret 0) ==== 770+0+0 (crc 0 0 0) 0x557f5cb413a0 con 0x7fc2e80dc040 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc1deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94005504334432 notifier 4554 bl.length()=728 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc1deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x7 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc1deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc1deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc1deffd640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc1c4003eb0 con 0x7fc2e80dc040 2024-09-13T19:06:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(67 notify.6 [notify cookie 94005504535808 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== watch-notify(notify_complete (2) cookie 94005504535808 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557f5cb405d0 con 0x7fc2e80dc040 2024-09-13T19:06:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.311+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb445d0 con 0x7fc2f805bb70 2024-09-13T19:06:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.315+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(69 foo.buckets [call] v32'28 uv28 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.315+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb445d0 con 0x7fc2f805bb70 2024-09-13T19:06:48.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'29 uv29 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:48.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:48.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:06:48.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94005504527216 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb445d0 con 0x7fc2e80dc040 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== watch-notify(notify (1) cookie 94005504334432 notify 137438953487 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fc2f003b040 con 0x7fc2e80dc040 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94005504334432 notifier 4554 bl.length()=314 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(71 notify.6 [notify cookie 94005504527216 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:48.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc134003410 con 0x7fc2e80dc040 2024-09-13T19:06:48.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== watch-notify(notify_complete (2) cookie 94005504527216 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2f0010040 con 0x7fc2e80dc040 2024-09-13T19:06:48.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb445d0 con 0x557f5cb06570 2024-09-13T19:06:48.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94005504527216 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb445d0 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify (1) cookie 94005504328384 notify 137438953490 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7fc2f0010040 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(74 notify.4 [notify cookie 94005504527216 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94005504328384 notifier 4554 bl.length()=155 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc1de7fc640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc134003410 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== watch-notify(notify_complete (2) cookie 94005504527216 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2f003f7a0 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.319+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 8.1a 8:5956cbeb:root::.bucket.meta.testx%3amyfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2e80dc040 2024-09-13T19:06:48.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3020df980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 from cache 2024-09-13T19:06:48.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3020df980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:48.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94005504527216 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2e80dc040 2024-09-13T19:06:48.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== watch-notify(notify (1) cookie 94005504330880 notify 137438953488 ret 0) ==== 254+0+0 (crc 0 0 0) 0x7fc2f003f7a0 con 0x7fc2e80dc040 2024-09-13T19:06:48.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc1de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94005504330880 notifier 4554 bl.length()=212 2024-09-13T19:06:48.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc1de7fc640 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc134003460 con 0x7fc2e80dc040 2024-09-13T19:06:48.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(77 notify.5 [notify cookie 94005504527216 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.323+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== watch-notify(notify_complete (2) cookie 94005504527216 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2f003f9b0 con 0x7fc2e80dc040 2024-09-13T19:06:48.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc1b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94005504338032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x557f5cb06570 2024-09-13T19:06:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94005504338032] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94005504313552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2f805bb70 2024-09-13T19:06:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94005504313552] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3020df980 20 remove_watcher() i=0 2024-09-13T19:06:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3020df980 2 removed watcher, disabling cache 2024-09-13T19:06:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.327+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94005504317824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x557f5cb06570 2024-09-13T19:06:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94005504317824] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc3020df980 20 remove_watcher() i=1 2024-09-13T19:06:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94005504322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x557f5cb0af60 2024-09-13T19:06:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc2ffbef640 1 -- 172.21.15.151:0/828453118 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94005504322496] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8075070 con 0x557f5cb0af60 2024-09-13T19:06:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc3020df980 20 remove_watcher() i=2 2024-09-13T19:06:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.331+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94005504327328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2f805bb70 2024-09-13T19:06:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc2ff3ee640 1 -- 172.21.15.151:0/828453118 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94005504327328] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2e80c9030 con 0x7fc2f805bb70 2024-09-13T19:06:48.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc3020df980 20 remove_watcher() i=3 2024-09-13T19:06:48.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94005504328384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x557f5cb06570 2024-09-13T19:06:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94005504328384] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x557f5cb06570 2024-09-13T19:06:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc3020df980 20 remove_watcher() i=4 2024-09-13T19:06:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.335+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94005504330880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2e80dc040 2024-09-13T19:06:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94005504330880] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3020df980 20 remove_watcher() i=5 2024-09-13T19:06:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94005504334432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2e80dc040 2024-09-13T19:06:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94005504334432] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3020df980 20 remove_watcher() i=6 2024-09-13T19:06:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.339+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94005504335488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5cb44120 con 0x7fc2e80dc040 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94005504335488] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f00083f0 con 0x7fc2e80dc040 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 20 remove_watcher() i=7 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc2e80dc040 msgr2=0x7fc2e80dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fc2e80dc040 0x7fc2e80dd430 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5cb06570 msgr2=0x557f5cb08a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5cb06570 0x557f5cb08a30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc2f805bb70 msgr2=0x7fc2f802d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fc2f805bb70 0x7fc2f802d160 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cb0af60 msgr2=0x557f5cb0d350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cb0af60 0x557f5cb0d350 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1c8034650 msgr2=0x7fc1c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1c8034650 0x7fc1c8036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8017e90 tx=0x7fc2e80b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 msgr2=0x557f5cafb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/828453118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5caf4360 0x557f5cafb450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80046c0 tx=0x7fc2f8023fc0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 reap_dead start 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3003f0640 1 -- 172.21.15.151:0/828453118 reap_dead start 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 shutdown_connections 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 >> 172.21.15.151:0/828453118 conn(0x557f5caf0740 msgr2=0x557f5caee810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 shutdown_connections 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/828453118 wait complete. 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 msgr2=0x7fc1d8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 0x7fc1d8036b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae040 tx=0x7fc2e8005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:48.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 msgr2=0x557f5cae8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80066a0 tx=0x7fc2f8010960 comp rx=0 tx=0).stop 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 shutdown_connections 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1d80346a0 0x7fc1d8036b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3761834363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5cae7c40 0x557f5cae8060 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 >> 172.21.15.151:0/3761834363 conn(0x557f5cadcd90 msgr2=0x557f5cadf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 shutdown_connections 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3761834363 wait complete. 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5c9dbad0 msgr2=0x557f5cad0da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f5c9dbad0 0x557f5cad0da0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f5cad7630 msgr2=0x557f5cad9a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f5cad7630 0x557f5cad9a20 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cad3730 msgr2=0x557f5cad5b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f5cad3730 0x557f5cad5b20 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1e80346a0 msgr2=0x7fc1e8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc1e80346a0 0x7fc1e8036b60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ad000 tx=0x7fc2e80a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 msgr2=0x557f5cac9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 --2- 172.21.15.151:0/3869231783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f5c94c2a0 0x557f5cac9dd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8001af0 tx=0x7fc2f8000f50 comp rx=0 tx=0).stop 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3003f0640 1 -- 172.21.15.151:0/3869231783 reap_dead start 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 shutdown_connections 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 >> 172.21.15.151:0/3869231783 conn(0x557f5c9d20a0 msgr2=0x557f5cabd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 shutdown_connections 2024-09-13T19:06:48.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.343+0000 7fc3020df980 1 -- 172.21.15.151:0/3869231783 wait complete. 2024-09-13T19:06:48.359 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:06:48.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-13T19:06:48.359 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-13T19:06:48.440 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:48.440 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:48.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3cc4b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5622e7c56ad0 0x5622e7c58ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3cc4b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622e7adaae0 con 0x5622e7bc72a0 2024-09-13T19:06:48.441 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3cc4b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5622e7afee30 con 0x5622e7c56ad0 2024-09-13T19:06:48.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef39f5a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5622e7c56ad0 0x5622e7c58ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3a75b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5622e7bc72a0 0x5622e7c553b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33338/0 (socket says 172.21.15.151:33338) 2024-09-13T19:06:48.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef3a75b640 1 -- 172.21.15.151:0/910663702 learned_addr learned my addr 172.21.15.151:0/910663702 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:48.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef39f5a640 1 -- 172.21.15.151:0/910663702 >> v1:172.21.15.12:6789/0 conn(0x5622e7bc72a0 legacy=0x5622e7c553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.439+0000 7fef39f5a640 1 -- 172.21.15.151:0/910663702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7bc7830 con 0x5622e7c56ad0 2024-09-13T19:06:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef39f5a640 1 --2- 172.21.15.151:0/910663702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7c56ad0 0x5622e7c58ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef2400a480 tx=0x7fef2401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7217c4a924bdcaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef39759640 1 -- 172.21.15.151:0/910663702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef240b0070 con 0x5622e7c56ad0 2024-09-13T19:06:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef39759640 1 -- 172.21.15.151:0/910663702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef240ab540 con 0x5622e7c56ad0 2024-09-13T19:06:48.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef39759640 1 -- 172.21.15.151:0/910663702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef240ab840 con 0x5622e7c56ad0 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 -- 172.21.15.151:0/910663702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7c56ad0 msgr2=0x5622e7c58ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/910663702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7c56ad0 0x5622e7c58ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef2400a480 tx=0x7fef2401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 -- 172.21.15.151:0/910663702 shutdown_connections 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/910663702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7c56ad0 0x5622e7c58ec0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 -- 172.21.15.151:0/910663702 >> 172.21.15.151:0/910663702 conn(0x5622e7c4d0a0 msgr2=0x5622e7c4f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 -- 172.21.15.151:0/910663702 shutdown_connections 2024-09-13T19:06:48.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.443+0000 7fef3cc4b980 1 -- 172.21.15.151:0/910663702 wait complete. 2024-09-13T19:06:48.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3cc4b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3cc4b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5622e7b00200 con 0x5622e7bc72a0 2024-09-13T19:06:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33504/0 (socket says 172.21.15.151:33504) 2024-09-13T19:06:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3a75b640 1 -- 172.21.15.151:0/2540484139 learned_addr learned my addr 172.21.15.151:0/2540484139 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3a75b640 1 -- 172.21.15.151:0/2540484139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7d3be40 con 0x5622e7bc72a0 2024-09-13T19:06:48.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fef3a75b640 1 --2- 172.21.15.151:0/2540484139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0017b0 tx=0x7fef2c001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c72a708e521e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fee28608640 1 -- 172.21.15.151:0/2540484139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c016070 con 0x5622e7bc72a0 2024-09-13T19:06:48.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fee28608640 1 -- 172.21.15.151:0/2540484139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c004530 con 0x5622e7bc72a0 2024-09-13T19:06:48.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.459+0000 7fee28608640 1 -- 172.21.15.151:0/2540484139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c004870 con 0x5622e7bc72a0 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2540484139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 msgr2=0x5622e7d3b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2540484139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0017b0 tx=0x7fef2c001c70 comp rx=0 tx=0).stop 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2540484139 shutdown_connections 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2540484139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d3b870 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2540484139 >> 172.21.15.151:0/2540484139 conn(0x5622e7c4d0a0 msgr2=0x5622e7d374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2540484139 shutdown_connections 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2540484139 wait complete. 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d42ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5622e7c59f10 con 0x5622e7bc72a0 2024-09-13T19:06:48.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d42ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d42ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33518/0 (socket says 172.21.15.151:33518) 2024-09-13T19:06:48.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3a75b640 1 -- 172.21.15.151:0/244062839 learned_addr learned my addr 172.21.15.151:0/244062839 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3a75b640 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7d430e0 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3a75b640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d42ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef2c000f90 tx=0x7fef2c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fee26e05640 1 -- 172.21.15.151:0/244062839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c020070 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fee26e05640 1 -- 172.21.15.151:0/244062839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c011400 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622e7d43370 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fee26e05640 1 -- 172.21.15.151:0/244062839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c016040 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.463+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e7d46050 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fee26e05640 1 -- 172.21.15.151:0/244062839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef2c023070 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fee26e05640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee20034650 0x7fee20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fee26e05640 1 -- 172.21.15.151:0/244062839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef2c049230 con 0x5622e7bc72a0 2024-09-13T19:06:48.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef39f5a640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee20034650 0x7fee20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7c56ad0 0x5622e7d49ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d4a1e0 con 0x5622e7c56ad0 2024-09-13T19:06:48.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3af5c640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7c56ad0 0x5622e7d49ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef39f5a640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee20034650 0x7fee20036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef240ad000 tx=0x7fef240a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3af5c640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7c56ad0 0x5622e7d49ca0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3af5c640 1 -- 172.21.15.151:0/244062839 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7c56ad0 2024-09-13T19:06:48.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d47250 con 0x5622e7c56ad0 2024-09-13T19:06:48.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3af5c640 1 -- 172.21.15.151:0/244062839 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7c56ad0 2024-09-13T19:06:48.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d4c4b0 0x5622e7d4e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d4ef70 con 0x5622e7d4c4b0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3a75b640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d4c4b0 0x5622e7d4e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3a75b640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d4c4b0 0x5622e7d4e8a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3a75b640 1 -- 172.21.15.151:0/244062839 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d4c4b0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d4b320 con 0x5622e7c56ad0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3af5c640 1 -- 172.21.15.151:0/244062839 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7c56ad0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5622e7d503d0 0x5622e7d527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d52eb0 con 0x5622e7d503d0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef39f5a640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5622e7d503d0 0x5622e7d527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef39f5a640 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5622e7d503d0 0x5622e7d527c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.467+0000 7fef39f5a640 1 -- 172.21.15.151:0/244062839 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef240b3040 con 0x5622e7d503d0 2024-09-13T19:06:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5622e7b59800 con 0x5622e7d60960 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33534/0 (socket says 172.21.15.151:33534) 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3a75b640 1 -- 172.21.15.151:0/2787394320 learned_addr learned my addr 172.21.15.151:0/2787394320 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3a75b640 1 -- 172.21.15.151:0/2787394320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7d612c0 con 0x5622e7d60960 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3a75b640 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0475c0 tx=0x7fef2c023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 -- 172.21.15.151:0/2787394320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c02a040 con 0x5622e7d60960 2024-09-13T19:06:48.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 -- 172.21.15.151:0/2787394320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c023db0 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622e7d61550 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 -- 172.21.15.151:0/2787394320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c02a420 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e7d641d0 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 -- 172.21.15.151:0/2787394320 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef2c011850 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 0x7fee14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fee1ffff640 1 -- 172.21.15.151:0/2787394320 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef2c036070 con 0x5622e7d60960 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.471+0000 7fef39f5a640 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 0x7fee14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef39f5a640 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 0x7fee14036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5622e7d4aa60 tx=0x7fef24005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5622e7d3c1c0 con 0x5622e7d6d340 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33538/0 (socket says 172.21.15.151:33538) 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 -- 172.21.15.151:0/1438236460 learned_addr learned my addr 172.21.15.151:0/1438236460 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 -- 172.21.15.151:0/1438236460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7d6dd10 con 0x5622e7d6d340 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 --2- 172.21.15.151:0/1438236460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef2c006830 tx=0x7fef2c0257b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d6a57970ba614b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fee1dffb640 1 -- 172.21.15.151:0/1438236460 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c040670 con 0x5622e7d6d340 2024-09-13T19:06:48.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fee1dffb640 1 -- 172.21.15.151:0/1438236460 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c040930 con 0x5622e7d6d340 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fee1dffb640 1 -- 172.21.15.151:0/1438236460 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c040bf0 con 0x5622e7d6d340 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- 172.21.15.151:0/1438236460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 msgr2=0x5622e7d6d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/1438236460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fef2c006830 tx=0x7fef2c0257b0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- 172.21.15.151:0/1438236460 shutdown_connections 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/1438236460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d6d740 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- 172.21.15.151:0/1438236460 >> 172.21.15.151:0/1438236460 conn(0x5622e7d69670 msgr2=0x5622e7d67770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- 172.21.15.151:0/1438236460 shutdown_connections 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- 172.21.15.151:0/1438236460 wait complete. 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 Processor -- start 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- start start 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3cc4b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5622e7d6e080 con 0x5622e7d6d340 2024-09-13T19:06:48.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33550/0 (socket says 172.21.15.151:33550) 2024-09-13T19:06:48.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.475+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 learned_addr learned my addr 172.21.15.151:0/466674155 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e7d74930 con 0x5622e7d6d340 2024-09-13T19:06:48.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3a75b640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02b000 tx=0x7fef2c052000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 -- 172.21.15.151:0/466674155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c02a6f0 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5622e7d74930 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 -- 172.21.15.151:0/466674155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c063070 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 -- 172.21.15.151:0/466674155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c040d20 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e7d74930 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 -- 172.21.15.151:0/466674155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef2c05a040 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee040345b0 0x7fee04036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fee0bfff640 1 -- 172.21.15.151:0/466674155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fef2c058020 con 0x5622e7d6d340 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef39f5a640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee040345b0 0x7fee04036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7d7f580 0x5622e7d81a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d82190 con 0x5622e7d7f580 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3af5c640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7d7f580 0x5622e7d81a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef39f5a640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee040345b0 0x7fee04036a70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c10 tx=0x7fef240b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3af5c640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7d7f580 0x5622e7d81a40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 20 realm 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.479+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d825a0 con 0x5622e7d7f580 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:48.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d82e70 con 0x5622e7d7f580 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d83f70 0x5622e7d86360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d869b0 con 0x5622e7d83f70 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d83f70 0x5622e7d86360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d83f70 0x5622e7d86360 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 20 searching for the correct realm 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d88210 con 0x5622e7d83f70 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fef2c053070 0x7fef2c053450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d88210 con 0x7fef2c053070 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef39f5a640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fef2c053070 0x7fef2c053450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef39f5a640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fef2c053070 0x7fef2c053450 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef39f5a640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fef240dc040 0x7fef240dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d88210 con 0x7fef240dc040 2024-09-13T19:06:48.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3af5c640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fef240dc040 0x7fef240dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.483+0000 7fef3af5c640 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fef240dc040 0x7fef240dd430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef2c053070 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.487+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef2c053070 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.491+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef2c053070 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef2c053070 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d83f70 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x5622e7d7f580 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.495+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d83210 con 0x7fef2c053070 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d87300 con 0x5622e7d7f580 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d87b50 con 0x5622e7d7f580 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d86f60 con 0x7fef2c053070 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 zone default found 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 4 Realm: () 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:48.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 zonegroup default 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d87b50 con 0x7fef240dc040 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8a0d0 con 0x5622e7d83f70 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8a4f0 con 0x5622e7d83f70 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 started sync module instance, tier type = 2024-09-13T19:06:48.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:48.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d89570 con 0x7fef2c053070 2024-09-13T19:06:48.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94707918608784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8ae00 con 0x7fef2c053070 2024-09-13T19:06:48.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.499+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8b650 con 0x5622e7d7f580 2024-09-13T19:06:48.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.503+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94707918608784] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.503+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.503+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94707918612816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8b650 con 0x5622e7d7f580 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.503+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8c050 con 0x5622e7d83f70 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94707918612816] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94707918617440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8c920 con 0x5622e7d83f70 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8ce30 con 0x7fef2c053070 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94707918623264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8daf0 con 0x7fef2c053070 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8e4b0 con 0x5622e7d7f580 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94707918617440] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94707918623264] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94707918626816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8daf0 con 0x5622e7d7f580 2024-09-13T19:06:48.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.507+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8e420 con 0x7fef240dc040 2024-09-13T19:06:48.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.511+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94707918626816] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.511+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.511+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94707918624592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8e8d0 con 0x7fef240dc040 2024-09-13T19:06:48.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.511+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8f290 con 0x7fef240dc040 2024-09-13T19:06:48.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94707918624592] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94707918628144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8f290 con 0x7fef240dc040 2024-09-13T19:06:48.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8fc50 con 0x7fef240dc040 2024-09-13T19:06:48.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94707918628144] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94707918630848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8fc50 con 0x7fef240dc040 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=0 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=1 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=2 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=3 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=4 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=5 2024-09-13T19:06:48.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.515+0000 7fef3cc4b980 20 add_watcher() i=6 2024-09-13T19:06:48.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94707918630848] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 20 add_watcher() i=7 2024-09-13T19:06:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d92fb0 con 0x5622e7d7f580 2024-09-13T19:06:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94707918645680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8fdc0 con 0x5622e7d7f580 2024-09-13T19:06:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94707918645680] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fedf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:48.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.519+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d922b0 con 0x5622e7d7f580 2024-09-13T19:06:48.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9c070 con 0x7fef240dc040 2024-09-13T19:06:48.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9c070 con 0x5622e7d83f70 2024-09-13T19:06:48.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.523+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9c520 con 0x5622e7d7f580 2024-09-13T19:06:48.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9c6f0 con 0x7fef2c053070 2024-09-13T19:06:48.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9cce0 con 0x5622e7d83f70 2024-09-13T19:06:48.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.527+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9cd70 con 0x5622e7d7f580 2024-09-13T19:06:48.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.531+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.531+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9ce00 con 0x7fef240dc040 2024-09-13T19:06:48.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.531+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.531+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9ce90 con 0x7fef2c053070 2024-09-13T19:06:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.535+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.535+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9d400 con 0x5622e7d83f70 2024-09-13T19:06:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.535+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.535+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9d400 con 0x7fef2c053070 2024-09-13T19:06:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.539+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.539+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9d970 con 0x7fef240dc040 2024-09-13T19:06:48.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.539+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.539+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9d970 con 0x7fef2c053070 2024-09-13T19:06:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9db10 con 0x7fef240dc040 2024-09-13T19:06:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9db10 con 0x5622e7d7f580 2024-09-13T19:06:48.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.543+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9db10 con 0x5622e7d83f70 2024-09-13T19:06:48.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.547+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.547+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9db10 con 0x7fef2c053070 2024-09-13T19:06:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.547+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.547+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9db10 con 0x5622e7d83f70 2024-09-13T19:06:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.551+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.551+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d7f580 2024-09-13T19:06:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.551+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.551+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d7f580 2024-09-13T19:06:48.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.555+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.555+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d83f70 2024-09-13T19:06:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.555+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.555+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x7fef2c053070 2024-09-13T19:06:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d83f70 2024-09-13T19:06:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d83f70 2024-09-13T19:06:48.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.559+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d83f70 2024-09-13T19:06:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.563+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.563+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x5622e7d83f70 2024-09-13T19:06:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.563+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.563+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dba0 con 0x7fef240dc040 2024-09-13T19:06:48.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.567+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.567+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dc20 con 0x5622e7d83f70 2024-09-13T19:06:48.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.567+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.567+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dc20 con 0x7fef240dc040 2024-09-13T19:06:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.571+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.571+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dc20 con 0x5622e7d83f70 2024-09-13T19:06:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.571+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.571+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dc20 con 0x7fef240dc040 2024-09-13T19:06:48.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d9dc20 con 0x7fef2c053070 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fed6b7fe640 20 reqs_thread_entry: start 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 20 Filter name: none 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fed697fa640 20 reqs_thread_entry: start 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.575+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7db92a0 con 0x7fef240dc040 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 20 rados_obj.operate() r=0 bl.length=419 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:48.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dbb770 con 0x5622e7d7f580 2024-09-13T19:06:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:06:48.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7db9750 con 0x7fef240dc040 2024-09-13T19:06:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:06:48.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94707918807728 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dbbdb0 con 0x5622e7d83f70 2024-09-13T19:06:48.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== watch-notify(notify (1) cookie 94707918617440 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5622e7d9ce90 con 0x5622e7d83f70 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fee1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94707918617440 notifier 4561 bl.length()=170 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(97 notify.2 [notify cookie 94707918807728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.579+0000 7fee1dffb640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fee00003d70 con 0x5622e7d83f70 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== watch-notify(notify_complete (2) cookie 94707918807728 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622e7d612c0 con 0x5622e7d83f70 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 10 removing email index: 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 10 removing user buckets index 2024-09-13T19:06:48.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dbbd30 con 0x5622e7d7f580 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94707918813152 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dbbd30 con 0x5622e7d7f580 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== watch-notify(notify (1) cookie 94707918626816 notify 137438953491 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5622e7d9d400 con 0x5622e7d7f580 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fee1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94707918626816 notifier 4561 bl.length()=175 2024-09-13T19:06:48.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fee1dffb640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fee00003d70 con 0x5622e7d7f580 2024-09-13T19:06:48.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(100 notify.4 [notify cookie 94707918813152 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== watch-notify(notify_complete (2) cookie 94707918813152 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622e7d92440 con 0x5622e7d7f580 2024-09-13T19:06:48.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 10 removing user index: testx$tenanteduser 2024-09-13T19:06:48.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.583+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dbb2c0 con 0x7fef240dc040 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef3cc4b980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef3cc4b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94707918813152 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5622e7dba760 con 0x7fef2c053070 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== watch-notify(notify (1) cookie 94707918623264 notify 137438953485 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5622e7d9c460 con 0x7fef2c053070 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fee1d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94707918623264 notifier 4561 bl.length()=167 2024-09-13T19:06:48.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(103 notify.3 [notify cookie 94707918813152 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fee1d7fa640 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fed700032d0 con 0x7fef2c053070 2024-09-13T19:06:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== watch-notify(notify_complete (2) cookie 94707918813152 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5622e7d9c290 con 0x7fef2c053070 2024-09-13T19:06:48.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fedf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.587+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94707918645680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d98b00 con 0x5622e7d7f580 2024-09-13T19:06:48.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94707918645680] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94707918608784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d98b00 con 0x7fef2c053070 2024-09-13T19:06:48.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94707918608784] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 20 remove_watcher() i=0 2024-09-13T19:06:48.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 2 removed watcher, disabling cache 2024-09-13T19:06:48.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94707918612816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d89990 con 0x5622e7d7f580 2024-09-13T19:06:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94707918612816] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 20 remove_watcher() i=1 2024-09-13T19:06:48.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.591+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94707918617440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d89990 con 0x5622e7d83f70 2024-09-13T19:06:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef3a75b640 1 -- 172.21.15.151:0/466674155 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94707918617440] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef2c02c070 con 0x5622e7d83f70 2024-09-13T19:06:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef3cc4b980 20 remove_watcher() i=2 2024-09-13T19:06:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94707918623264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d89990 con 0x7fef2c053070 2024-09-13T19:06:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef39f5a640 1 -- 172.21.15.151:0/466674155 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94707918623264] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef240c9030 con 0x7fef2c053070 2024-09-13T19:06:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef3cc4b980 20 remove_watcher() i=3 2024-09-13T19:06:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.595+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94707918626816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8d220 con 0x5622e7d7f580 2024-09-13T19:06:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94707918626816] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x5622e7d7f580 2024-09-13T19:06:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3cc4b980 20 remove_watcher() i=4 2024-09-13T19:06:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94707918624592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d89990 con 0x7fef240dc040 2024-09-13T19:06:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94707918624592] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3cc4b980 20 remove_watcher() i=5 2024-09-13T19:06:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.599+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94707918628144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8e000 con 0x7fef240dc040 2024-09-13T19:06:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94707918628144] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 20 remove_watcher() i=6 2024-09-13T19:06:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94707918630848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5622e7d8d220 con 0x7fef240dc040 2024-09-13T19:06:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94707918630848] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef340083f0 con 0x7fef240dc040 2024-09-13T19:06:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 20 remove_watcher() i=7 2024-09-13T19:06:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fef240dc040 msgr2=0x7fef240dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fef240dc040 0x7fef240dd430 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7d7f580 msgr2=0x5622e7d81a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7d7f580 0x5622e7d81a40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fef2c053070 msgr2=0x7fef2c053450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fef2c053070 0x7fef2c053450 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d83f70 msgr2=0x5622e7d86360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d83f70 0x5622e7d86360 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee040345b0 msgr2=0x7fee04036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee040345b0 0x7fee04036a70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c10 tx=0x7fef240b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 msgr2=0x5622e7d743f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3af5c640 1 -- 172.21.15.151:0/466674155 reap_dead start 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fef2c02b000 tx=0x7fef2c052000 comp rx=0 tx=0).stop 2024-09-13T19:06:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 shutdown_connections 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/466674155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d6d340 0x5622e7d743f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 >> 172.21.15.151:0/466674155 conn(0x5622e7d69670 msgr2=0x5622e7d67740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 shutdown_connections 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.603+0000 7fef3cc4b980 1 -- 172.21.15.151:0/466674155 wait complete. 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 msgr2=0x7fee14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 0x7fee14036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x5622e7d4aa60 tx=0x7fef24005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 msgr2=0x5622e7d60d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0475c0 tx=0x7fef2c023ac0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 shutdown_connections 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee14034650 0x7fee14036b10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/2787394320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7d60960 0x5622e7d60d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 >> 172.21.15.151:0/2787394320 conn(0x5622e7d55ab0 msgr2=0x5622e7d58530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 shutdown_connections 2024-09-13T19:06:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/2787394320 wait complete. 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7c56ad0 msgr2=0x5622e7d49ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5622e7c56ad0 0x5622e7d49ca0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5622e7d503d0 msgr2=0x5622e7d527c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5622e7d503d0 0x5622e7d527c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d4c4b0 msgr2=0x5622e7d4e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5622e7d4c4b0 0x5622e7d4e8a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee20034650 msgr2=0x7fee20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee20034650 0x7fee20036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef240ad000 tx=0x7fef240a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 msgr2=0x5622e7d42ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 --2- 172.21.15.151:0/244062839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5622e7bc72a0 0x5622e7d42ba0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fef2c000f90 tx=0x7fef2c001260 comp rx=0 tx=0).stop 2024-09-13T19:06:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3af5c640 1 -- 172.21.15.151:0/244062839 reap_dead start 2024-09-13T19:06:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 shutdown_connections 2024-09-13T19:06:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 >> 172.21.15.151:0/244062839 conn(0x5622e7c4d0a0 msgr2=0x5622e7d36020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 shutdown_connections 2024-09-13T19:06:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.607+0000 7fef3cc4b980 1 -- 172.21.15.151:0/244062839 wait complete. 2024-09-13T19:06:48.631 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:06:48.635 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-13T19:06:48.681 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:06:48.681 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:06:48.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-13T19:06:48.682 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-13T19:06:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:48.721 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da782f980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a822a31c70 0x55a822a34060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da782f980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8228b3ae0 con 0x55a822a2d8f0 2024-09-13T19:06:48.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da782f980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55a8228d7e30 con 0x55a822a31c70 2024-09-13T19:06:48.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8d9ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a822a31c70 0x55a822a34060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da533f640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55a822a2d8f0 0x55a822a2dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33354/0 (socket says 172.21.15.151:33354) 2024-09-13T19:06:48.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8da533f640 1 -- 172.21.15.151:0/2650033401 learned_addr learned my addr 172.21.15.151:0/2650033401 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:48.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2650033401 >> v1:172.21.15.12:6789/0 conn(0x55a822a2d8f0 legacy=0x55a822a2dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.719+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2650033401 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822a355b0 con 0x55a822a31c70 2024-09-13T19:06:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2650033401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822a34060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000a480 tx=0x7f8d9001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884f7cc413d4b405 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da4b3e640 1 -- 172.21.15.151:0/2650033401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d900b0070 con 0x55a822a31c70 2024-09-13T19:06:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da4b3e640 1 -- 172.21.15.151:0/2650033401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d900ab540 con 0x55a822a31c70 2024-09-13T19:06:48.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da4b3e640 1 -- 172.21.15.151:0/2650033401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d900ab840 con 0x55a822a31c70 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 -- 172.21.15.151:0/2650033401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 msgr2=0x55a822a34060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 --2- 172.21.15.151:0/2650033401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822a34060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000a480 tx=0x7f8d9001b280 comp rx=0 tx=0).stop 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 -- 172.21.15.151:0/2650033401 shutdown_connections 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 --2- 172.21.15.151:0/2650033401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822a34060 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 -- 172.21.15.151:0/2650033401 >> 172.21.15.151:0/2650033401 conn(0x55a8229a1240 msgr2=0x55a8229a1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 -- 172.21.15.151:0/2650033401 shutdown_connections 2024-09-13T19:06:48.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.723+0000 7f8da782f980 1 -- 172.21.15.151:0/2650033401 wait complete. 2024-09-13T19:06:48.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da782f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da782f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a8228d9200 con 0x55a822a2d8f0 2024-09-13T19:06:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33556/0 (socket says 172.21.15.151:33556) 2024-09-13T19:06:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da533f640 1 -- 172.21.15.151:0/3175153673 learned_addr learned my addr 172.21.15.151:0/3175153673 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.739+0000 7f8da533f640 1 -- 172.21.15.151:0/3175153673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822b19220 con 0x55a822a2d8f0 2024-09-13T19:06:48.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 --2- 172.21.15.151:0/3175153673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001e20 tx=0x7f8d9800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b50de5d4747b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c93606640 1 -- 172.21.15.151:0/3175153673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98012020 con 0x55a822a2d8f0 2024-09-13T19:06:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c93606640 1 -- 172.21.15.151:0/3175153673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9800e7c0 con 0x55a822a2d8f0 2024-09-13T19:06:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c93606640 1 -- 172.21.15.151:0/3175153673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d9800eb00 con 0x55a822a2d8f0 2024-09-13T19:06:48.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/3175153673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 msgr2=0x55a822b18c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 --2- 172.21.15.151:0/3175153673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001e20 tx=0x7f8d9800b790 comp rx=0 tx=0).stop 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/3175153673 shutdown_connections 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 --2- 172.21.15.151:0/3175153673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a2d8f0 0x55a822b18c50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/3175153673 >> 172.21.15.151:0/3175153673 conn(0x55a8229a1240 msgr2=0x55a822b14880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/3175153673 shutdown_connections 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/3175153673 wait complete. 2024-09-13T19:06:48.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822b20240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a822a350b0 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822b20240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822b20240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33560/0 (socket says 172.21.15.151:33560) 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 -- 172.21.15.151:0/1753787444 learned_addr learned my addr 172.21.15.151:0/1753787444 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822b20780 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da533f640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822b20240 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001e20 tx=0x7f8d98000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c91e03640 1 -- 172.21.15.151:0/1753787444 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98012030 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a822b20a10 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c91e03640 1 -- 172.21.15.151:0/1753787444 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d98001480 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8c91e03640 1 -- 172.21.15.151:0/1753787444 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d9801a870 con 0x55a822a31c70 2024-09-13T19:06:48.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.743+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a822b236f0 con 0x55a822a31c70 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8c91e03640 1 -- 172.21.15.151:0/1753787444 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d98015020 con 0x55a822a31c70 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8c91e03640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c8c0346a0 0x7f8c8c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8c91e03640 1 -- 172.21.15.151:0/1753787444 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d98020030 con 0x55a822a31c70 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c8c0346a0 0x7f8c8c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b25330 0x55a822b27720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b27c60 con 0x55a822b25330 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da5b40640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b25330 0x55a822b27720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c8c0346a0 0x7f8c8c036b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d900ad000 tx=0x7f8d900a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da5b40640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b25330 0x55a822b27720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da5b40640 1 -- 172.21.15.151:0/1753787444 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b25330 2024-09-13T19:06:48.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b248f0 con 0x55a822b25330 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da5b40640 1 -- 172.21.15.151:0/1753787444 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b25330 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b29f00 0x55a822b2c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b2c9c0 con 0x55a822b29f00 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da533f640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b29f00 0x55a822b2c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da533f640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b29f00 0x55a822b2c2f0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da533f640 1 -- 172.21.15.151:0/1753787444 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b29f00 2024-09-13T19:06:48.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.747+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b28da0 con 0x55a822b25330 2024-09-13T19:06:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da5b40640 1 -- 172.21.15.151:0/1753787444 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b25330 2024-09-13T19:06:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a822b2de00 0x55a822b301f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b30980 con 0x55a822b2de00 2024-09-13T19:06:48.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a822b2de00 0x55a822b301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a822b2de00 0x55a822b301f0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8d9ffff640 1 -- 172.21.15.151:0/1753787444 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8d900b3040 con 0x55a822b2de00 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a822932800 con 0x55a822b3e410 2024-09-13T19:06:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33570/0 (socket says 172.21.15.151:33570) 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da533f640 1 -- 172.21.15.151:0/2521174048 learned_addr learned my addr 172.21.15.151:0/2521174048 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da533f640 1 -- 172.21.15.151:0/2521174048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822b3ed70 con 0x55a822b3e410 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da533f640 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8d98048250 tx=0x7f8d9800d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8c8affd640 1 -- 172.21.15.151:0/2521174048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98046040 con 0x55a822b3e410 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a822b3efa0 con 0x55a822b3e410 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8c8affd640 1 -- 172.21.15.151:0/2521174048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9800ae40 con 0x55a822b3e410 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8c8affd640 1 -- 172.21.15.151:0/2521174048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98041980 con 0x55a822b3e410 2024-09-13T19:06:48.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.751+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a822b3efa0 con 0x55a822b3e410 2024-09-13T19:06:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c8affd640 1 -- 172.21.15.151:0/2521174048 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d9803d030 con 0x55a822b3e410 2024-09-13T19:06:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c8affd640 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 0x7f8c7c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c8affd640 1 -- 172.21.15.151:0/2521174048 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d9803b070 con 0x55a822b3e410 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 0x7f8c7c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 0x7f8c7c036b60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000a480 tx=0x7f8d90005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da782f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da782f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a822b195a0 con 0x55a822b4a9f0 2024-09-13T19:06:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33572/0 (socket says 172.21.15.151:33572) 2024-09-13T19:06:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da533f640 1 -- 172.21.15.151:0/2776144338 learned_addr learned my addr 172.21.15.151:0/2776144338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da533f640 1 -- 172.21.15.151:0/2776144338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822b4b3c0 con 0x55a822b4a9f0 2024-09-13T19:06:48.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8da533f640 1 --2- 172.21.15.151:0/2776144338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d98031010 tx=0x7f8d98048b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19075705fda7950f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c88ff9640 1 -- 172.21.15.151:0/2776144338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98061070 con 0x55a822b4a9f0 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c88ff9640 1 -- 172.21.15.151:0/2776144338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9800a2f0 con 0x55a822b4a9f0 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.755+0000 7f8c88ff9640 1 -- 172.21.15.151:0/2776144338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98058040 con 0x55a822b4a9f0 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2776144338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 msgr2=0x55a822b4adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 --2- 172.21.15.151:0/2776144338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8d98031010 tx=0x7f8d98048b20 comp rx=0 tx=0).stop 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2776144338 shutdown_connections 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 --2- 172.21.15.151:0/2776144338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b4adf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2776144338 >> 172.21.15.151:0/2776144338 conn(0x55a822b46dd0 msgr2=0x55a822b44ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2776144338 shutdown_connections 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2776144338 wait complete. 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 Processor -- start 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- start start 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a822b4b7e0 con 0x55a822b4a9f0 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da533f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33584/0 (socket says 172.21.15.151:33584) 2024-09-13T19:06:48.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 learned_addr learned my addr 172.21.15.151:0/2044374238 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a822b52170 con 0x55a822b4a9f0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da533f640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8d98030d50 tx=0x7f8d98014e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8c7affd640 1 -- 172.21.15.151:0/2044374238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98069020 con 0x55a822b4a9f0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a822b52170 con 0x55a822b4a9f0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8c7affd640 1 -- 172.21.15.151:0/2044374238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d98048560 con 0x55a822b4a9f0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8c7affd640 1 -- 172.21.15.151:0/2044374238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d98061040 con 0x55a822b4a9f0 2024-09-13T19:06:48.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a822b525e0 con 0x55a822b4a9f0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.759+0000 7f8c7affd640 1 -- 172.21.15.151:0/2044374238 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8d9806c020 con 0x55a822b4a9f0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8c7affd640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c70034650 0x7f8c70036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8c7affd640 1 -- 172.21.15.151:0/2044374238 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8d98005050 con 0x55a822b4a9f0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c70034650 0x7f8c70036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b5cc50 0x55a822b5f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b5f840 con 0x55a822b5cc50 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b5cc50 0x55a822b5f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c70034650 0x7f8c70036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d900ae040 tx=0x7f8d900b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b5cc50 0x55a822b5f0f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 realm 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b5fc50 con 0x55a822b5cc50 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b604f0 con 0x55a822b5cc50 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b615f0 0x55a822b639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b64030 con 0x55a822b615f0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b615f0 0x55a822b639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b615f0 0x55a822b639e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 20 searching for the correct realm 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b65890 con 0x55a822b615f0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d9806e020 0x7f8d980156a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b65890 con 0x7f8d9806e020 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.763+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d9806e020 0x7f8d980156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d9806e020 0x7f8d980156a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8d9ffff640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d900dc040 0x7f8d900dd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b65890 con 0x7f8d900dc040 2024-09-13T19:06:48.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d900dc040 0x7f8d900dd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d900dc040 0x7f8d900dd430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.767+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d9806e020 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d9806e020 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.771+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d9806e020 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.775+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d9806e020 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b615f0 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d900dc040 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x55a822b5cc50 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a822b60890 con 0x7f8d9806e020 2024-09-13T19:06:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:48.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b64980 con 0x55a822b5cc50 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b651d0 con 0x55a822b5cc50 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b64d20 con 0x7f8d9806e020 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 zone default found 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 4 Realm: () 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 zonegroup default 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b65cf0 con 0x7f8d900dc040 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.779+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b676d0 con 0x55a822b615f0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b67bc0 con 0x55a822b615f0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 started sync module instance, tier type = 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:48.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66b70 con 0x7f8d9806e020 2024-09-13T19:06:48.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94180625248096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b684d0 con 0x7f8d9806e020 2024-09-13T19:06:48.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b68d20 con 0x55a822b5cc50 2024-09-13T19:06:48.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.783+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94180625248096] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94180625252384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b68d20 con 0x55a822b5cc50 2024-09-13T19:06:48.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b697e0 con 0x55a822b615f0 2024-09-13T19:06:48.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94180625252384] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94180625254512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b68c90 con 0x55a822b615f0 2024-09-13T19:06:48.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.787+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6a530 con 0x7f8d9806e020 2024-09-13T19:06:48.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94180625262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6b1f0 con 0x7f8d9806e020 2024-09-13T19:06:48.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6bbb0 con 0x55a822b5cc50 2024-09-13T19:06:48.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94180625254512] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94180625262880] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94180625266432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6b1f0 con 0x55a822b5cc50 2024-09-13T19:06:48.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.791+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6bb20 con 0x7f8d900dc040 2024-09-13T19:06:48.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94180625266432] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94180625263936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6b160 con 0x7f8d900dc040 2024-09-13T19:06:48.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6c9e0 con 0x7f8d900dc040 2024-09-13T19:06:48.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94180625263936] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94180625268416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6c9e0 con 0x7f8d900dc040 2024-09-13T19:06:48.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.795+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6d3a0 con 0x7f8d900dc040 2024-09-13T19:06:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94180625268416] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94180625270544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6d3a0 con 0x7f8d900dc040 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=0 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=1 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=2 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=3 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=4 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=5 2024-09-13T19:06:48.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=6 2024-09-13T19:06:48.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94180625270544] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 20 add_watcher() i=7 2024-09-13T19:06:48.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:48.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.799+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b707d0 con 0x55a822b5cc50 2024-09-13T19:06:48.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94180625273024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6dcc0 con 0x55a822b5cc50 2024-09-13T19:06:48.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94180625273024] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8c5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da782f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:48.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da782f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:48.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b70430 con 0x55a822b5cc50 2024-09-13T19:06:48.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.803+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b79800 con 0x7f8d900dc040 2024-09-13T19:06:48.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.807+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.807+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b79cb0 con 0x55a822b615f0 2024-09-13T19:06:48.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.807+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.807+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b79dd0 con 0x55a822b5cc50 2024-09-13T19:06:48.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7a380 con 0x7f8d9806e020 2024-09-13T19:06:48.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7a830 con 0x55a822b615f0 2024-09-13T19:06:48.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.811+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7a830 con 0x55a822b5cc50 2024-09-13T19:06:48.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.815+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.815+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7a830 con 0x7f8d900dc040 2024-09-13T19:06:48.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.815+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.815+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7a830 con 0x7f8d9806e020 2024-09-13T19:06:48.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.819+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.819+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7ada0 con 0x55a822b615f0 2024-09-13T19:06:48.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.819+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.819+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7ada0 con 0x7f8d9806e020 2024-09-13T19:06:48.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b310 con 0x7f8d900dc040 2024-09-13T19:06:48.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b310 con 0x7f8d9806e020 2024-09-13T19:06:48.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.823+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d900dc040 2024-09-13T19:06:48.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.827+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.827+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b5cc50 2024-09-13T19:06:48.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.827+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.827+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d9806e020 2024-09-13T19:06:48.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.831+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b5cc50 2024-09-13T19:06:48.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.835+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.835+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b5cc50 2024-09-13T19:06:48.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.835+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.835+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d9806e020 2024-09-13T19:06:48.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.839+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.843+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d900dc040 2024-09-13T19:06:48.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.847+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.847+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.847+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.847+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d900dc040 2024-09-13T19:06:48.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.851+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.851+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x55a822b615f0 2024-09-13T19:06:48.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.851+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.851+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d900dc040 2024-09-13T19:06:48.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.855+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.855+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b7b8c0 con 0x7f8d9806e020 2024-09-13T19:06:48.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.855+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8c5a7e4640 20 reqs_thread_entry: start 2024-09-13T19:06:48.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:48.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 Filter name: none 2024-09-13T19:06:48.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8bcbfff640 20 reqs_thread_entry: start 2024-09-13T19:06:48.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:48.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b968f0 con 0x7f8d9806e020 2024-09-13T19:06:48.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:48.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:06:48.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 rados->read ofs=0 len=0 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:95 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b98360 con 0x55a822b615f0 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(95 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 get_obj_state: octx=0x7f8d900ab890 obj=myfoo:four state=0x55a822b990f8 s->prefetch_data=0 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:96 3.2cs0 3:37e75eac:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9a190 con 0x55a822b615f0 2024-09-13T19:06:48.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(96 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 10 manifest: total_size = 4 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.14939585654894795047 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 get_obj_state: octx=0x7f8d900ab890 obj=myfoo:four state=0x55a822b990f8 s->prefetch_data=0 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 prepare_atomic_modification: state is not atomic. state=0x55a822b990f8 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 2024-09-13T19:06:48.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.859+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:97 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9eb90 con 0x7f8d900dc040 2024-09-13T19:06:48.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.863+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(97 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.863+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 3.2cs0 3:37e75eac:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9eb90 con 0x55a822b615f0 2024-09-13T19:06:48.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.863+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(98 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.863+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9f620 con 0x7f8d900dc040 2024-09-13T19:06:48.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8c5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:48.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94180625273024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9f620 con 0x55a822b5cc50 2024-09-13T19:06:48.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(99 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8c88ff9640 20 handle_completion(): completion ok for obj=four 2024-09-13T19:06:48.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94180625273024] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.867+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94180625248096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b9f620 con 0x7f8d9806e020 2024-09-13T19:06:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94180625248096] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da782f980 20 remove_watcher() i=0 2024-09-13T19:06:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da782f980 2 removed watcher, disabling cache 2024-09-13T19:06:48.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94180625252384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66f60 con 0x55a822b5cc50 2024-09-13T19:06:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94180625252384] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da782f980 20 remove_watcher() i=1 2024-09-13T19:06:48.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.871+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94180625254512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66f60 con 0x55a822b615f0 2024-09-13T19:06:48.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da533f640 1 -- 172.21.15.151:0/2044374238 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94180625254512] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d98008030 con 0x55a822b615f0 2024-09-13T19:06:48.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 20 remove_watcher() i=2 2024-09-13T19:06:48.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94180625262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66f60 con 0x7f8d9806e020 2024-09-13T19:06:48.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8d9ffff640 1 -- 172.21.15.151:0/2044374238 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94180625262880] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8d900c9030 con 0x7f8d9806e020 2024-09-13T19:06:48.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 20 remove_watcher() i=3 2024-09-13T19:06:48.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94180625266432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6a920 con 0x55a822b5cc50 2024-09-13T19:06:48.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94180625266432] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x55a822b5cc50 2024-09-13T19:06:48.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 20 remove_watcher() i=4 2024-09-13T19:06:48.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.875+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94180625263936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66f60 con 0x7f8d900dc040 2024-09-13T19:06:48.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.879+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94180625263936] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.879+0000 7f8da782f980 20 remove_watcher() i=5 2024-09-13T19:06:48.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.879+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94180625268416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b6b700 con 0x7f8d900dc040 2024-09-13T19:06:48.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94180625268416] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 20 remove_watcher() i=6 2024-09-13T19:06:48.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94180625270544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a822b66f60 con 0x7f8d900dc040 2024-09-13T19:06:48.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94180625270544] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8da000a4d0 con 0x7f8d900dc040 2024-09-13T19:06:48.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 20 remove_watcher() i=7 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d900dc040 msgr2=0x7f8d900dd430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8d900dc040 0x7f8d900dd430 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b5cc50 msgr2=0x55a822b5f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b5cc50 0x55a822b5f0f0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d9806e020 msgr2=0x7f8d980156a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8d9806e020 0x7f8d980156a0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b615f0 msgr2=0x55a822b639e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b615f0 0x55a822b639e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c70034650 msgr2=0x7f8c70036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c70034650 0x7f8c70036b10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d900ae040 tx=0x7f8d900b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 msgr2=0x55a822b51c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da5b40640 1 -- 172.21.15.151:0/2044374238 reap_dead start 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8d98030d50 tx=0x7f8d98014e90 comp rx=0 tx=0).stop 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 shutdown_connections 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2044374238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b4a9f0 0x55a822b51c30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 >> 172.21.15.151:0/2044374238 conn(0x55a822b46dd0 msgr2=0x55a822b44ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 shutdown_connections 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2044374238 wait complete. 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 msgr2=0x7f8c7c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 0x7f8c7c036b60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000a480 tx=0x7f8d90005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 msgr2=0x55a822b3e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8d98048250 tx=0x7f8d9800d610 comp rx=0 tx=0).stop 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 shutdown_connections 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c7c0346a0 0x7f8c7c036b60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 --2- 172.21.15.151:0/2521174048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822b3e410 0x55a822b3e830 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 >> 172.21.15.151:0/2521174048 conn(0x55a822b33560 msgr2=0x55a822b35fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 shutdown_connections 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.883+0000 7f8da782f980 1 -- 172.21.15.151:0/2521174048 wait complete. 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b25330 msgr2=0x55a822b27720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a822b25330 0x55a822b27720 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a822b2de00 msgr2=0x55a822b301f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a822b2de00 0x55a822b301f0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b29f00 msgr2=0x55a822b2c2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a822b29f00 0x55a822b2c2f0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c8c0346a0 msgr2=0x7f8c8c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8c8c0346a0 0x7f8c8c036b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d900ad000 tx=0x7f8d900a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 msgr2=0x55a822b20240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 --2- 172.21.15.151:0/1753787444 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a822a31c70 0x55a822b20240 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8d98001e20 tx=0x7f8d98000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da5b40640 1 -- 172.21.15.151:0/1753787444 reap_dead start 2024-09-13T19:06:48.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 shutdown_connections 2024-09-13T19:06:48.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 >> 172.21.15.151:0/1753787444 conn(0x55a8229a1240 msgr2=0x55a822b13400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 shutdown_connections 2024-09-13T19:06:48.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.887+0000 7f8da782f980 1 -- 172.21.15.151:0/1753787444 wait complete. 2024-09-13T19:06:48.900 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:48.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-13T19:06:48.900 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-13T19:06:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:48.981 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:48.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:48.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:48.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4d34a980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56536d0f7910 0x56536d0f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:48.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4d34a980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56536cf7cae0 con 0x56536d0f3540 2024-09-13T19:06:48.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4d34a980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56536cfa0e30 con 0x56536d0f7910 2024-09-13T19:06:48.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4a659640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56536d0f7910 0x56536d0f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:48.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4ae5a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x56536d0f3540 0x56536d0f3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33364/0 (socket says 172.21.15.151:33364) 2024-09-13T19:06:48.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4a659640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56536d0f7910 0x56536d0f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33586/0 (socket says 172.21.15.151:33586) 2024-09-13T19:06:48.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4ae5a640 1 -- 172.21.15.151:0/2224502529 learned_addr learned my addr 172.21.15.151:0/2224502529 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:48.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4a659640 1 -- 172.21.15.151:0/2224502529 >> v1:172.21.15.12:6789/0 conn(0x56536d0f3540 legacy=0x56536d0f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.979+0000 7fde4a659640 1 -- 172.21.15.151:0/2224502529 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d0fb250 con 0x56536d0f7910 2024-09-13T19:06:48.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4a659640 1 --2- 172.21.15.151:0/2224502529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f7910 0x56536d0f9d00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a480 tx=0x7fde3401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaeef455b0269ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:48.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde49e58640 1 -- 172.21.15.151:0/2224502529 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde340b0070 con 0x56536d0f7910 2024-09-13T19:06:48.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde49e58640 1 -- 172.21.15.151:0/2224502529 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde340ab540 con 0x56536d0f7910 2024-09-13T19:06:48.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde49e58640 1 -- 172.21.15.151:0/2224502529 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde340ab840 con 0x56536d0f7910 2024-09-13T19:06:48.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 -- 172.21.15.151:0/2224502529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f7910 msgr2=0x56536d0f9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:48.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 --2- 172.21.15.151:0/2224502529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f7910 0x56536d0f9d00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fde3400a480 tx=0x7fde3401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:48.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 -- 172.21.15.151:0/2224502529 shutdown_connections 2024-09-13T19:06:48.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 --2- 172.21.15.151:0/2224502529 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f7910 0x56536d0f9d00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:48.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 -- 172.21.15.151:0/2224502529 >> 172.21.15.151:0/2224502529 conn(0x56536d0ef060 msgr2=0x56536d0f1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:48.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 -- 172.21.15.151:0/2224502529 shutdown_connections 2024-09-13T19:06:48.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.983+0000 7fde4d34a980 1 -- 172.21.15.151:0/2224502529 wait complete. 2024-09-13T19:06:49.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:49.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:49.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4d34a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4d34a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56536cfa2200 con 0x56536d0f3540 2024-09-13T19:06:49.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33590/0 (socket says 172.21.15.151:33590) 2024-09-13T19:06:49.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:48.999+0000 7fde4ae5a640 1 -- 172.21.15.151:0/1272723422 learned_addr learned my addr 172.21.15.151:0/1272723422 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 -- 172.21.15.151:0/1272723422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d0689b0 con 0x56536d0f3540 2024-09-13T19:06:49.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/1272723422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fde44001d90 tx=0x7fde44001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a6341cbab743c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fdd38e09640 1 -- 172.21.15.151:0/1272723422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde44013030 con 0x56536d0f3540 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fdd38e09640 1 -- 172.21.15.151:0/1272723422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4400e690 con 0x56536d0f3540 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fdd38e09640 1 -- 172.21.15.151:0/1272723422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4400ea10 con 0x56536d0f3540 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- 172.21.15.151:0/1272723422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 msgr2=0x56536d0683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1272723422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fde44001d90 tx=0x7fde44001e80 comp rx=0 tx=0).stop 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- 172.21.15.151:0/1272723422 shutdown_connections 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1272723422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d0683e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- 172.21.15.151:0/1272723422 >> 172.21.15.151:0/1272723422 conn(0x56536d0ef060 msgr2=0x56536d1da590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- 172.21.15.151:0/1272723422 shutdown_connections 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- 172.21.15.151:0/1272723422 wait complete. 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:49.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:49.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d1e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4d34a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56536d0fad50 con 0x56536d0f3540 2024-09-13T19:06:49.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d1e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d1e6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33596/0 (socket says 172.21.15.151:33596) 2024-09-13T19:06:49.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 -- 172.21.15.151:0/1170437311 learned_addr learned my addr 172.21.15.151:0/1170437311 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d1e7330 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.003+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d1e6df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x56536d1e0c60 tx=0x7fde44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 -- 172.21.15.151:0/1170437311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde44027070 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536d1e75c0 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 -- 172.21.15.151:0/1170437311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde44019900 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 -- 172.21.15.151:0/1170437311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde44019c20 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536d1ea2a0 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 -- 172.21.15.151:0/1170437311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde4402a070 con 0x56536d0f3540 2024-09-13T19:06:49.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd30034650 0x7fdd30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fdd37606640 1 -- 172.21.15.151:0/1170437311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fde4401f070 con 0x56536d0f3540 2024-09-13T19:06:49.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4a659640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd30034650 0x7fdd30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d0f7910 0x56536d1edef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d1ee470 con 0x56536d0f7910 2024-09-13T19:06:49.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4b65b640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d0f7910 0x56536d1edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4a659640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd30034650 0x7fdd30036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde340ad000 tx=0x7fde340a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4b65b640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d0f7910 0x56536d1edef0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4b65b640 1 -- 172.21.15.151:0/1170437311 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d0f7910 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d1eb4c0 con 0x56536d0f7910 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4b65b640 1 -- 172.21.15.151:0/1170437311 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d0f7910 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d1f0780 0x56536d1f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d1f3240 con 0x56536d1f0780 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.007+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d1f0780 0x56536d1f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d1f0780 0x56536d1f2b70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 -- 172.21.15.151:0/1170437311 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde44029030 con 0x56536d1f0780 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d1ef620 con 0x56536d0f7910 2024-09-13T19:06:49.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4b65b640 1 -- 172.21.15.151:0/1170437311 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d0f7910 2024-09-13T19:06:49.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56536d1f46a0 0x56536d1f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d1f7180 con 0x56536d1f46a0 2024-09-13T19:06:49.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4a659640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56536d1f46a0 0x56536d1f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4a659640 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56536d1f46a0 0x56536d1f6a90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4a659640 1 -- 172.21.15.151:0/1170437311 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde340b3040 con 0x56536d1f46a0 2024-09-13T19:06:49.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:49.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4d34a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56536cffb800 con 0x56536d204c30 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33598/0 (socket says 172.21.15.151:33598) 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 -- 172.21.15.151:0/4147199136 learned_addr learned my addr 172.21.15.151:0/4147199136 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 -- 172.21.15.151:0/4147199136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d205590 con 0x56536d204c30 2024-09-13T19:06:49.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.011+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fde44048460 tx=0x7fde44041e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 -- 172.21.15.151:0/4147199136 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4402abe0 con 0x56536d204c30 2024-09-13T19:06:49.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 -- 172.21.15.151:0/4147199136 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4402ad80 con 0x56536d204c30 2024-09-13T19:06:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536d205820 con 0x56536d204c30 2024-09-13T19:06:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 -- 172.21.15.151:0/4147199136 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde44048670 con 0x56536d204c30 2024-09-13T19:06:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536d208490 con 0x56536d204c30 2024-09-13T19:06:49.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 -- 172.21.15.151:0/4147199136 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde44036040 con 0x56536d204c30 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 0x7fdd24036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fdd34e01640 1 -- 172.21.15.151:0/4147199136 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fde44014070 con 0x56536d204c30 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4a659640 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 0x7fdd24036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4a659640 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 0x7fdd24036b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x56536d1ef5f0 tx=0x7fde34005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4d34a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56536d068d30 con 0x56536d2115e0 2024-09-13T19:06:49.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33600/0 (socket says 172.21.15.151:33600) 2024-09-13T19:06:49.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4ae5a640 1 -- 172.21.15.151:0/2308558176 learned_addr learned my addr 172.21.15.151:0/2308558176 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.015+0000 7fde4ae5a640 1 -- 172.21.15.151:0/2308558176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d211f90 con 0x56536d2115e0 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/2308558176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde44016670 tx=0x7fde4402c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d392b4fd6892f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2e7fc640 1 -- 172.21.15.151:0/2308558176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde44048940 con 0x56536d2115e0 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2e7fc640 1 -- 172.21.15.151:0/2308558176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde44060070 con 0x56536d2115e0 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2e7fc640 1 -- 172.21.15.151:0/2308558176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4402c590 con 0x56536d2115e0 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/2308558176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 msgr2=0x56536d2119c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 --2- 172.21.15.151:0/2308558176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fde44016670 tx=0x7fde4402c880 comp rx=0 tx=0).stop 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/2308558176 shutdown_connections 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 --2- 172.21.15.151:0/2308558176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2119c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/2308558176 >> 172.21.15.151:0/2308558176 conn(0x56536d20d9c0 msgr2=0x56536d20bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/2308558176 shutdown_connections 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/2308558176 wait complete. 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 Processor -- start 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- start start 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56536d212430 con 0x56536d2115e0 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33604/0 (socket says 172.21.15.151:33604) 2024-09-13T19:06:49.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 learned_addr learned my addr 172.21.15.151:0/3232229105 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56536d218d30 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde44049430 tx=0x7fde44025f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2cff9640 1 -- 172.21.15.151:0/3232229105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4402b4e0 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56536d218d30 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2cff9640 1 -- 172.21.15.151:0/3232229105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4402cc00 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fdd2cff9640 1 -- 172.21.15.151:0/3232229105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde440415e0 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.019+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56536d2191a0 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fdd2cff9640 1 -- 172.21.15.151:0/3232229105 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde44016070 con 0x56536d2115e0 2024-09-13T19:06:49.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fdd2cff9640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd14034650 0x7fdd14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fdd2cff9640 1 -- 172.21.15.151:0/3232229105 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fde44005050 con 0x56536d2115e0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4a659640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd14034650 0x7fdd14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d223800 0x56536d225ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2263f0 con 0x56536d223800 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d223800 0x56536d225ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4a659640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd14034650 0x7fdd14036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde3401b2c0 tx=0x7fde340b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d223800 0x56536d225ca0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 realm 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d226800 con 0x56536d223800 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2270a0 con 0x56536d223800 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d227f70 0x56536d22a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22aaa0 con 0x56536d227f70 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d227f70 0x56536d22a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.023+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d227f70 0x56536d22a360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4d34a980 20 searching for the correct realm 2024-09-13T19:06:49.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d22c370 con 0x56536d227f70 2024-09-13T19:06:49.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4ae5a640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fde44067040 0x7fde4405b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d22c370 con 0x7fde44067040 2024-09-13T19:06:49.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4a659640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fde44067040 0x7fde4405b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4a659640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fde44067040 0x7fde4405b8e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4a659640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fde340dc040 0x7fde340ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d22c370 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fde340dc040 0x7fde340ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fde340dc040 0x7fde340ce430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.027+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde44067040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde44067040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.031+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde44067040 2024-09-13T19:06:49.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.035+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde44067040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d227f70 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde340dc040 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x56536d223800 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56536d227440 con 0x7fde44067040 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:49.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22b460 con 0x56536d223800 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22bd00 con 0x56536d223800 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.039+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22b0a0 con 0x7fde44067040 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 zone default found 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 4 Realm: () 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 zonegroup default 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22bd00 con 0x7fde340dc040 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22e200 con 0x56536d227f70 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d22e5a0 con 0x56536d227f70 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 started sync module instance, tier type = 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:49.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d22d6a0 con 0x7fde44067040 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94916313275072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d22edf0 con 0x7fde44067040 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.043+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d22f640 con 0x56536d223800 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.047+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94916313275072] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.047+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.047+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94916313278784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d22f640 con 0x56536d223800 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.047+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d230110 con 0x56536d227f70 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.047+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94916313278784] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94916313283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d22f640 con 0x56536d227f70 2024-09-13T19:06:49.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d230b20 con 0x7fde44067040 2024-09-13T19:06:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94916313286256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d231370 con 0x7fde44067040 2024-09-13T19:06:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d231db0 con 0x56536d223800 2024-09-13T19:06:49.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94916313283584] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94916313286256] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94916313290880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d230ec0 con 0x56536d223800 2024-09-13T19:06:49.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.051+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d232650 con 0x7fde340dc040 2024-09-13T19:06:49.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94916313290880] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94916313280912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d230ec0 con 0x7fde340dc040 2024-09-13T19:06:49.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d232b40 con 0x7fde340dc040 2024-09-13T19:06:49.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94916313280912] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.055+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94916313294352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d232b00 con 0x7fde340dc040 2024-09-13T19:06:49.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d233500 con 0x7fde340dc040 2024-09-13T19:06:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94916313294352] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94916313296912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d233430 con 0x7fde340dc040 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=0 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=1 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=2 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=3 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=4 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=5 2024-09-13T19:06:49.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.059+0000 7fde4d34a980 20 add_watcher() i=6 2024-09-13T19:06:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94916313296912] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 add_watcher() i=7 2024-09-13T19:06:49.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2369a0 con 0x56536d223800 2024-09-13T19:06:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94916313292784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d233e90 con 0x56536d223800 2024-09-13T19:06:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94916313292784] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.066 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fdd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:49.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:49.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 5 note: GC not initialized 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fdd00fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 Filter name: none 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fdcf9ffb640 20 reqs_thread_entry: start 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d25a000 con 0x7fde44067040 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:49.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.063+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d25a890 con 0x56536d227f70 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(63 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d25aa40 con 0x7fde44067040 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2593a0 con 0x56536d227f70 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(65 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:49.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 4.38 4:1ff120aa:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d25d3b0 con 0x56536d223800 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 4.1d 4:bae4f2e0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d25fd80 con 0x56536d227f70 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 4.30 4:0fd070c2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2626e0 con 0x56536d227f70 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 4.37 4:ee587ea9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d2650d0 con 0x7fde340dc040 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 4.38 4:1fbd4d3b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d267940 con 0x56536d223800 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 4.36 4:6c04294d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d26a520 con 0x56536d223800 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 4.23 4:c650489f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d26cf80 con 0x7fde340dc040 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 4.3b 4:df1c5111:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d26cf80 con 0x56536d227f70 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 4.7 4:e3c8d61b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d272080 con 0x7fde340dc040 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 4.33 4:cdf112e2:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d274f80 con 0x7fde340dc040 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(68 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 4.36 4:6cd87e9b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56536d272080 con 0x56536d223800 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(66 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(70 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.4 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(71 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.5 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(69 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(75 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.067+0000 7fdd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94916313292784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d272080 con 0x56536d223800 2024-09-13T19:06:49.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94916313292784] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94916313275072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x7fde44067040 2024-09-13T19:06:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94916313275072] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340c9030 con 0x7fde44067040 2024-09-13T19:06:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4d34a980 20 remove_watcher() i=0 2024-09-13T19:06:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4d34a980 2 removed watcher, disabling cache 2024-09-13T19:06:49.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.071+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94916313278784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x56536d223800 2024-09-13T19:06:49.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94916313278784] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 20 remove_watcher() i=1 2024-09-13T19:06:49.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94916313283584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x56536d227f70 2024-09-13T19:06:49.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4ae5a640 1 -- 172.21.15.151:0/3232229105 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94916313283584] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde44058040 con 0x56536d227f70 2024-09-13T19:06:49.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 20 remove_watcher() i=2 2024-09-13T19:06:49.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94916313286256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x7fde44067040 2024-09-13T19:06:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4a659640 1 -- 172.21.15.151:0/3232229105 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94916313286256] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde340f4040 con 0x7fde44067040 2024-09-13T19:06:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 20 remove_watcher() i=3 2024-09-13T19:06:49.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.075+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94916313290880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x56536d223800 2024-09-13T19:06:49.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.079+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94916313290880] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x56536d223800 2024-09-13T19:06:49.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.079+0000 7fde4d34a980 20 remove_watcher() i=4 2024-09-13T19:06:49.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.079+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94916313280912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x7fde340dc040 2024-09-13T19:06:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94916313280912] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4d34a980 20 remove_watcher() i=5 2024-09-13T19:06:49.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94916313294352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x7fde340dc040 2024-09-13T19:06:49.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94916313294352] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4d34a980 20 remove_watcher() i=6 2024-09-13T19:06:49.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.083+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94916313296912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56536d2579b0 con 0x7fde340dc040 2024-09-13T19:06:49.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94916313296912] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde3c00a4d0 con 0x7fde340dc040 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 20 remove_watcher() i=7 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fde340dc040 msgr2=0x7fde340ce430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fde340dc040 0x7fde340ce430 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d223800 msgr2=0x56536d225ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d223800 0x56536d225ca0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fde44067040 msgr2=0x7fde4405b8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fde44067040 0x7fde4405b8e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d227f70 msgr2=0x56536d22a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d227f70 0x56536d22a360 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd14034650 msgr2=0x7fdd14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd14034650 0x7fdd14036b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fde3401b2c0 tx=0x7fde340b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 msgr2=0x56536d2187f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4b65b640 1 -- 172.21.15.151:0/3232229105 reap_dead start 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fde44049430 tx=0x7fde44025f10 comp rx=0 tx=0).stop 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 shutdown_connections 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/3232229105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d2115e0 0x56536d2187f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 >> 172.21.15.151:0/3232229105 conn(0x56536d20d9c0 msgr2=0x56536d20ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 shutdown_connections 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/3232229105 wait complete. 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 msgr2=0x7fdd24036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 0x7fdd24036b60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x56536d1ef5f0 tx=0x7fde34005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 msgr2=0x56536d205050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fde44048460 tx=0x7fde44041e60 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 shutdown_connections 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd240346a0 0x7fdd24036b60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/4147199136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d204c30 0x56536d205050 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 >> 172.21.15.151:0/4147199136 conn(0x56536d1f9d80 msgr2=0x56536d1fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 shutdown_connections 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/4147199136 wait complete. 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d0f7910 msgr2=0x56536d1edef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56536d0f7910 0x56536d1edef0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56536d1f46a0 msgr2=0x56536d1f6a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56536d1f46a0 0x56536d1f6a90 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d1f0780 msgr2=0x56536d1f2b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56536d1f0780 0x56536d1f2b70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd30034650 msgr2=0x7fdd30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdd30034650 0x7fdd30036b10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde340ad000 tx=0x7fde340a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 msgr2=0x56536d1e6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 --2- 172.21.15.151:0/1170437311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56536d0f3540 0x56536d1e6df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x56536d1e0c60 tx=0x7fde44000bd0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4b65b640 1 -- 172.21.15.151:0/1170437311 reap_dead start 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 shutdown_connections 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 >> 172.21.15.151:0/1170437311 conn(0x56536d0ef060 msgr2=0x56536d1d9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 shutdown_connections 2024-09-13T19:06:49.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.087+0000 7fde4d34a980 1 -- 172.21.15.151:0/1170437311 wait complete. 2024-09-13T19:06:49.101 INFO:teuthology.orchestra.run.smithi151.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"ef9ca8b0-9ae4-481e-ba9d-bc0942310d85","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","marker":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-13T19:06:48.313401Z","creation_time":"2024-09-13T19:06:44.212931Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-13T19:06:49.102 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:06:48.313401Z', 'creation_time': '2024-09-13T19:06:44.212931Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:06:49.102 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-13T19:06:49.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-13T19:06:49.102 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-13T19:06:49.173 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:49.174 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:49.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfd81c980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5598bbc2ec50 0x5598bbc31040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfd81c980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598bbab0ae0 con 0x5598bbc2a8d0 2024-09-13T19:06:49.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfd81c980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5598bbad4e30 con 0x5598bbc2ec50 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfab2b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5598bbc2ec50 0x5598bbc31040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfab2b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5598bbc2ec50 0x5598bbc31040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33618/0 (socket says 172.21.15.151:33618) 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfab2b640 1 -- 172.21.15.151:0/1315392765 learned_addr learned my addr 172.21.15.151:0/1315392765 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.171+0000 7fdcfb32c640 1 --1- 172.21.15.151:0/1315392765 >> v1:172.21.15.12:6789/0 conn(0x5598bbc2a8d0 0x5598bbc2acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33380/0 (socket says 172.21.15.151:33380) 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfab2b640 1 -- 172.21.15.151:0/1315392765 >> v1:172.21.15.12:6789/0 conn(0x5598bbc2a8d0 legacy=0x5598bbc2acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfab2b640 1 -- 172.21.15.151:0/1315392765 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbc32590 con 0x5598bbc2ec50 2024-09-13T19:06:49.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/1315392765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2ec50 0x5598bbc31040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000a5c0 tx=0x7fdcf001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b425555d3056e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfa32a640 1 -- 172.21.15.151:0/1315392765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf00a6070 con 0x5598bbc2ec50 2024-09-13T19:06:49.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfa32a640 1 -- 172.21.15.151:0/1315392765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf00af070 con 0x5598bbc2ec50 2024-09-13T19:06:49.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfa32a640 1 -- 172.21.15.151:0/1315392765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf00aa5c0 con 0x5598bbc2ec50 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1315392765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2ec50 msgr2=0x5598bbc31040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/1315392765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2ec50 0x5598bbc31040 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000a5c0 tx=0x7fdcf001b340 comp rx=0 tx=0).stop 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1315392765 shutdown_connections 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/1315392765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2ec50 0x5598bbc31040 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1315392765 >> 172.21.15.151:0/1315392765 conn(0x5598bbb9e220 msgr2=0x5598bbb9e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1315392765 shutdown_connections 2024-09-13T19:06:49.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.175+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1315392765 wait complete. 2024-09-13T19:06:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598bbad6200 con 0x5598bbc2a8d0 2024-09-13T19:06:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33634/0 (socket says 172.21.15.151:33634) 2024-09-13T19:06:49.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfb32c640 1 -- 172.21.15.151:0/1597780791 learned_addr learned my addr 172.21.15.151:0/1597780791 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfb32c640 1 -- 172.21.15.151:0/1597780791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbd161f0 con 0x5598bbc2a8d0 2024-09-13T19:06:49.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/1597780791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00b240 tx=0x7fdcec00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e74884cef7034be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdbe960a640 1 -- 172.21.15.151:0/1597780791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec00e700 con 0x5598bbc2a8d0 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdbe960a640 1 -- 172.21.15.151:0/1597780791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec00e8a0 con 0x5598bbc2a8d0 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdbe960a640 1 -- 172.21.15.151:0/1597780791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec00eb80 con 0x5598bbc2a8d0 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1597780791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 msgr2=0x5598bbd15c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/1597780791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00b240 tx=0x7fdcec00b700 comp rx=0 tx=0).stop 2024-09-13T19:06:49.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1597780791 shutdown_connections 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/1597780791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd15c20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1597780791 >> 172.21.15.151:0/1597780791 conn(0x5598bbb9e220 msgr2=0x5598bbd11850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1597780791 shutdown_connections 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- 172.21.15.151:0/1597780791 wait complete. 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd1cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.195+0000 7fdcfd81c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598bbc32090 con 0x5598bbc2a8d0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd1cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd1cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33648/0 (socket says 172.21.15.151:33648) 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfb32c640 1 -- 172.21.15.151:0/4014461710 learned_addr learned my addr 172.21.15.151:0/4014461710 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfb32c640 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbd1d4d0 con 0x5598bbc2a8d0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd1cf90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000c10 tx=0x7fdcec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 -- 172.21.15.151:0/4014461710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec00fa90 con 0x5598bbc2a8d0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 -- 172.21.15.151:0/4014461710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec00fc50 con 0x5598bbc2a8d0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bbd1d760 con 0x5598bbc2a8d0 2024-09-13T19:06:49.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 -- 172.21.15.151:0/4014461710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec01a480 con 0x5598bbc2a8d0 2024-09-13T19:06:49.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bbd20440 con 0x5598bbc2a8d0 2024-09-13T19:06:49.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 -- 172.21.15.151:0/4014461710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcec017070 con 0x5598bbc2a8d0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbe00346a0 0x7fdbe0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdbe7e07640 1 -- 172.21.15.151:0/4014461710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcec015020 con 0x5598bbc2a8d0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbe00346a0 0x7fdbe0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbc2ec50 0x5598bbd24090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd245d0 con 0x5598bbc2ec50 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbc2ec50 0x5598bbd24090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbe00346a0 0x7fdbe0036b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00ae000 tx=0x7fdcf00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.199+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbc2ec50 0x5598bbd24090 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/4014461710 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbc2ec50 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd21660 con 0x5598bbc2ec50 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/4014461710 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbc2ec50 2024-09-13T19:06:49.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd26910 0x5598bbd28d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd293d0 con 0x5598bbd26910 2024-09-13T19:06:49.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd26910 0x5598bbd28d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd26910 0x5598bbd28d00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 -- 172.21.15.151:0/4014461710 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcec02e070 con 0x5598bbd26910 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd257b0 con 0x5598bbc2ec50 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/4014461710 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbc2ec50 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598bbd2a830 0x5598bbd2cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd2d320 con 0x5598bbd2a830 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598bbd2a830 0x5598bbd2cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598bbd2a830 0x5598bbd2cc20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfab2b640 1 -- 172.21.15.151:0/4014461710 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcf00aaad0 con 0x5598bbd2a830 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfd81c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598bbb2f800 con 0x5598bbd3adb0 2024-09-13T19:06:49.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33650/0 (socket says 172.21.15.151:33650) 2024-09-13T19:06:49.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.203+0000 7fdcfb32c640 1 -- 172.21.15.151:0/3199952955 learned_addr learned my addr 172.21.15.151:0/3199952955 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 -- 172.21.15.151:0/3199952955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbd3b710 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcec049180 tx=0x7fdcec017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 -- 172.21.15.151:0/3199952955 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec01a960 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 -- 172.21.15.151:0/3199952955 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec036070 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bbd3b9a0 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 -- 172.21.15.151:0/3199952955 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec0424f0 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bbd3b9a0 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 -- 172.21.15.151:0/3199952955 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcec04abd0 con 0x5598bbd3adb0 2024-09-13T19:06:49.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdbe5602640 1 -- 172.21.15.151:0/3199952955 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcec03ed00 con 0x5598bbd3adb0 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5598bbd24ec0 tx=0x7fdcf0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfd81c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598bbd16570 con 0x5598bbd47520 2024-09-13T19:06:49.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33654/0 (socket says 172.21.15.151:33654) 2024-09-13T19:06:49.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 -- 172.21.15.151:0/4198087422 learned_addr learned my addr 172.21.15.151:0/4198087422 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.207+0000 7fdcfb32c640 1 -- 172.21.15.151:0/4198087422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbd47ed0 con 0x5598bbd47520 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/4198087422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdcec01e0c0 tx=0x7fdcec047bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f789ed3d22692d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdeffd640 1 -- 172.21.15.151:0/4198087422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec046870 con 0x5598bbd47520 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdeffd640 1 -- 172.21.15.151:0/4198087422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec059070 con 0x5598bbd47520 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdeffd640 1 -- 172.21.15.151:0/4198087422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec042210 con 0x5598bbd47520 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4198087422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 msgr2=0x5598bbd47900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4198087422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdcec01e0c0 tx=0x7fdcec047bb0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4198087422 shutdown_connections 2024-09-13T19:06:49.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4198087422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd47900 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4198087422 >> 172.21.15.151:0/4198087422 conn(0x5598bbd43900 msgr2=0x5598bbd41a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4198087422 shutdown_connections 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4198087422 wait complete. 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 Processor -- start 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- start start 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5598bbd48370 con 0x5598bbd47520 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33670/0 (socket says 172.21.15.151:33670) 2024-09-13T19:06:49.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 learned_addr learned my addr 172.21.15.151:0/77229002 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bbd4ec40 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdcec03c5a0 tx=0x7fdcec01e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdd7fa640 1 -- 172.21.15.151:0/77229002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec06d070 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bbd4ec40 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdd7fa640 1 -- 172.21.15.151:0/77229002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcec04a660 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdbdd7fa640 1 -- 172.21.15.151:0/77229002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcec0464a0 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.211+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bbd4f0b0 con 0x5598bbd47520 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdbdd7fa640 1 -- 172.21.15.151:0/77229002 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcec070070 con 0x5598bbd47520 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdbdd7fa640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbc4034650 0x7fdbc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdbdd7fa640 1 -- 172.21.15.151:0/77229002 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcec065070 con 0x5598bbd47520 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbc4034650 0x7fdbc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbd59820 0x5598bbd5bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5c430 con 0x5598bbd59820 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbd59820 0x5598bbd5bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbc4034650 0x7fdbc4036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0000c10 tx=0x7fdcf00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbd59820 0x5598bbd5bce0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 realm 2024-09-13T19:06:49.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5c840 con 0x5598bbd59820 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d0e0 con 0x5598bbd59820 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd5e1e0 0x5598bbd605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd60b50 con 0x5598bbd5e1e0 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd5e1e0 0x5598bbd605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.215+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd5e1e0 0x5598bbd605d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfd81c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:49.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfd81c980 20 searching for the correct realm 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd623b0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfb32c640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fdcec072060 0x7fdcec05e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd623b0 con 0x7fdcec072060 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fdcec072060 0x7fdcec05e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fdcec072060 0x7fdcec05e8f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfab2b640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fdcf00e0040 0x7fdcf00e0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd623b0 con 0x7fdcf00e0040 2024-09-13T19:06:49.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fdcf00e0040 0x7fdcf00e0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fdcf00e0040 0x7fdcf00e0420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.219+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcec072060 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcec072060 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.223+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcec072060 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.227+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcec072060 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd5e1e0 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcf00e0040 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x5598bbd59820 2024-09-13T19:06:49.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd5d480 con 0x7fdcec072060 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd614d0 con 0x5598bbd59820 2024-09-13T19:06:49.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd61d70 con 0x5598bbd59820 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.231+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd61110 con 0x7fdcec072060 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 zone default found 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 4 Realm: () 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:49.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 zonegroup default 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd61d70 con 0x7fdcf00e0040 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd64260 con 0x5598bbd5e1e0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd64600 con 0x5598bbd5e1e0 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 started sync module instance, tier type = 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd63700 con 0x7fdcec072060 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114474769056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd63ec0 con 0x7fdcec072060 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.235+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd650d0 con 0x5598bbd59820 2024-09-13T19:06:49.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114474769056] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114474773536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd654f0 con 0x5598bbd59820 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd65d80 con 0x5598bbd5e1e0 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114474773536] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114474774592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd65910 con 0x5598bbd5e1e0 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.239+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114474779408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd67010 con 0x7fdcec072060 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd67a30 con 0x5598bbd59820 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114474774592] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114474779408] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114474784032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd66b60 con 0x5598bbd59820 2024-09-13T19:06:49.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.243+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd682d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114474785904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68540 con 0x7fdcf00e0040 2024-09-13T19:06:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68d90 con 0x7fdcf00e0040 2024-09-13T19:06:49.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114474784032] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114474785904] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114474786960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68960 con 0x7fdcf00e0040 2024-09-13T19:06:49.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.247+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd69630 con 0x7fdcf00e0040 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114474786960] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114474791296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68960 con 0x7fdcf00e0040 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=0 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=1 2024-09-13T19:06:49.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=2 2024-09-13T19:06:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=3 2024-09-13T19:06:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=4 2024-09-13T19:06:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=5 2024-09-13T19:06:49.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.251+0000 7fdcfd81c980 20 add_watcher() i=6 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114474791296] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 20 add_watcher() i=7 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd6c5d0 con 0x5598bbd59820 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114474788768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd69b20 con 0x5598bbd59820 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114474788768] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdbb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 5 note: GC not initialized 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdbb0fe1640 20 reqs_thread_entry: start 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 20 Filter name: none 2024-09-13T19:06:49.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdb2a7fc640 20 reqs_thread_entry: start 2024-09-13T19:06:49.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.255+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd8f280 con 0x7fdcf00e0040 2024-09-13T19:06:49.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'35 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd614d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd614d0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd64260 con 0x7fdcf00e0040 2024-09-13T19:06:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd64260 con 0x5598bbd59820 2024-09-13T19:06:49.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd64260 con 0x7fdcec072060 2024-09-13T19:06:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.259+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd59820 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd59820 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.263+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd59820 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd59820 2024-09-13T19:06:49.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcf00e0040 2024-09-13T19:06:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcf00e0040 2024-09-13T19:06:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.267+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x5598bbd59820 2024-09-13T19:06:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcec072060 2024-09-13T19:06:49.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd667c0 con 0x7fdcf00e0040 2024-09-13T19:06:49.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.271+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.275 INFO:teuthology.orchestra.run.smithi151.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-13T19:06:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdbb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114474788768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd8f240 con 0x5598bbd59820 2024-09-13T19:06:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94114474788768] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114474769056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd8f240 con 0x7fdcec072060 2024-09-13T19:06:49.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94114474769056] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfd81c980 20 remove_watcher() i=0 2024-09-13T19:06:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfd81c980 2 removed watcher, disabling cache 2024-09-13T19:06:49.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.275+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114474773536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd63aa0 con 0x5598bbd59820 2024-09-13T19:06:49.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94114474773536] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfd81c980 20 remove_watcher() i=1 2024-09-13T19:06:49.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114474774592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd63aa0 con 0x5598bbd5e1e0 2024-09-13T19:06:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfb32c640 1 -- 172.21.15.151:0/77229002 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94114474774592] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcec06f030 con 0x5598bbd5e1e0 2024-09-13T19:06:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfd81c980 20 remove_watcher() i=2 2024-09-13T19:06:49.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.279+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114474779408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68770 con 0x7fdcec072060 2024-09-13T19:06:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfab2b640 1 -- 172.21.15.151:0/77229002 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94114474779408] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf00aaad0 con 0x7fdcec072060 2024-09-13T19:06:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfd81c980 20 remove_watcher() i=3 2024-09-13T19:06:49.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114474784032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd68770 con 0x5598bbd59820 2024-09-13T19:06:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94114474784032] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x5598bbd59820 2024-09-13T19:06:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfd81c980 20 remove_watcher() i=4 2024-09-13T19:06:49.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.283+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114474785904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd67520 con 0x7fdcf00e0040 2024-09-13T19:06:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94114474785904] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfd81c980 20 remove_watcher() i=5 2024-09-13T19:06:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114474786960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd67520 con 0x7fdcf00e0040 2024-09-13T19:06:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94114474786960] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfd81c980 20 remove_watcher() i=6 2024-09-13T19:06:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.287+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114474791296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bbd67520 con 0x7fdcf00e0040 2024-09-13T19:06:49.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94114474791296] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf400a4d0 con 0x7fdcf00e0040 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 20 remove_watcher() i=7 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fdcf00e0040 msgr2=0x7fdcf00e0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fdcf00e0040 0x7fdcf00e0420 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbd59820 msgr2=0x5598bbd5bce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbd59820 0x5598bbd5bce0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fdcec072060 msgr2=0x7fdcec05e8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fdcec072060 0x7fdcec05e8f0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd5e1e0 msgr2=0x5598bbd605d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd5e1e0 0x5598bbd605d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbc4034650 msgr2=0x7fdbc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbc4034650 0x7fdbc4036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0000c10 tx=0x7fdcf00c1040 comp rx=0 tx=0).stop 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 msgr2=0x5598bbd4e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/77229002 reap_dead start 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdcec03c5a0 tx=0x7fdcec01e0f0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 shutdown_connections 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/77229002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd47520 0x5598bbd4e700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 >> 172.21.15.151:0/77229002 conn(0x5598bbd43900 msgr2=0x5598bbd419d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 shutdown_connections 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/77229002 wait complete. 2024-09-13T19:06:49.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 msgr2=0x7fdbd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5598bbd24ec0 tx=0x7fdcf0005ad0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 msgr2=0x5598bbd3b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcec049180 tx=0x7fdcec017f50 comp rx=0 tx=0).stop 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 shutdown_connections 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/3199952955 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbd3adb0 0x5598bbd3b1d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 >> 172.21.15.151:0/3199952955 conn(0x5598bbd2ff00 msgr2=0x5598bbd32980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 shutdown_connections 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/3199952955 wait complete. 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbc2ec50 msgr2=0x5598bbd24090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5598bbc2ec50 0x5598bbd24090 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598bbd2a830 msgr2=0x5598bbd2cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5598bbd2a830 0x5598bbd2cc20 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd26910 msgr2=0x5598bbd28d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5598bbd26910 0x5598bbd28d00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbe00346a0 msgr2=0x7fdbe0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdbe00346a0 0x7fdbe0036b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00ae000 tx=0x7fdcf00a6000 comp rx=0 tx=0).stop 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 msgr2=0x5598bbd1cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 --2- 172.21.15.151:0/4014461710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5598bbc2a8d0 0x5598bbd1cf90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdcec000c10 tx=0x7fdcec000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfbb2d640 1 -- 172.21.15.151:0/4014461710 reap_dead start 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 shutdown_connections 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 >> 172.21.15.151:0/4014461710 conn(0x5598bbb9e220 msgr2=0x5598bbd103d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 shutdown_connections 2024-09-13T19:06:49.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.291+0000 7fdcfd81c980 1 -- 172.21.15.151:0/4014461710 wait complete. 2024-09-13T19:06:49.306 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-13T19:06:49.307 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-13T19:06:49.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-13T19:06:49.307 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-13T19:06:49.381 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:49.381 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:49.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f9ddd980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f98f905540 0x55f98f905920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f9ddd980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f98f78eae0 con 0x55f98f905e90 2024-09-13T19:06:49.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f9ddd980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55f98f7b2e30 con 0x55f98f905540 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f78ed640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f98f905540 0x55f98f905920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f70ec640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55f98f905e90 0x55f98f90a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33384/0 (socket says 172.21.15.151:33384) 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f70ec640 1 -- 172.21.15.151:0/501398138 learned_addr learned my addr 172.21.15.151:0/501398138 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f68eb640 1 -- 172.21.15.151:0/501398138 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605314683 0 0) 0x55f98f78eae0 con 0x55f98f905e90 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f68eb640 1 -- 172.21.15.151:0/501398138 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e0001e20 con 0x55f98f905e90 2024-09-13T19:06:49.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f78ed640 1 -- 172.21.15.151:0/501398138 >> v1:172.21.15.12:6789/0 conn(0x55f98f905e90 legacy=0x55f98f90a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.379+0000 7ff1f78ed640 1 -- 172.21.15.151:0/501398138 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98f87a0c0 con 0x55f98f905540 2024-09-13T19:06:49.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/501398138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f905920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a480 tx=0x7ff1e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d7577fb0083b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f68eb640 1 -- 172.21.15.151:0/501398138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80b0070 con 0x55f98f905540 2024-09-13T19:06:49.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f68eb640 1 -- 172.21.15.151:0/501398138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80ab540 con 0x55f98f905540 2024-09-13T19:06:49.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f68eb640 1 -- 172.21.15.151:0/501398138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80ab820 con 0x55f98f905540 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/501398138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 msgr2=0x55f98f905920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/501398138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f905920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a480 tx=0x7ff1e801b280 comp rx=0 tx=0).stop 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/501398138 shutdown_connections 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/501398138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f905920 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/501398138 >> 172.21.15.151:0/501398138 conn(0x55f98f901060 msgr2=0x55f98f903480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/501398138 shutdown_connections 2024-09-13T19:06:49.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.383+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/501398138 wait complete. 2024-09-13T19:06:49.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f9ddd980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f9ddd980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f98f7b4200 con 0x55f98f905540 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33674/0 (socket says 172.21.15.151:33674) 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f78ed640 1 -- 172.21.15.151:0/119027528 learned_addr learned my addr 172.21.15.151:0/119027528 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.399+0000 7ff1f78ed640 1 -- 172.21.15.151:0/119027528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98f90f0b0 con 0x55f98f905540 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/119027528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8017e90 tx=0x7ff1e8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f11de88827069 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0e5e0b640 1 -- 172.21.15.151:0/119027528 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80b0040 con 0x55f98f905540 2024-09-13T19:06:49.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0e5e0b640 1 -- 172.21.15.151:0/119027528 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80aca40 con 0x55f98f905540 2024-09-13T19:06:49.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0e5e0b640 1 -- 172.21.15.151:0/119027528 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80acd20 con 0x55f98f905540 2024-09-13T19:06:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/119027528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 msgr2=0x55f98f90eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/119027528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8017e90 tx=0x7ff1e8003030 comp rx=0 tx=0).stop 2024-09-13T19:06:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/119027528 shutdown_connections 2024-09-13T19:06:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/119027528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f90eae0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/119027528 >> 172.21.15.151:0/119027528 conn(0x55f98f901060 msgr2=0x55f98f9ed470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/119027528 shutdown_connections 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/119027528 wait complete. 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f9fad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f98f87ae60 con 0x55f98f905540 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f9fad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f9fad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33684/0 (socket says 172.21.15.151:33684) 2024-09-13T19:06:49.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 -- 172.21.15.151:0/286276104 learned_addr learned my addr 172.21.15.151:0/286276104 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98f9fb280 con 0x55f98f905540 2024-09-13T19:06:49.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f9fad40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b9040 tx=0x7ff1e8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0dffff640 1 -- 172.21.15.151:0/286276104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80c5030 con 0x55f98f905540 2024-09-13T19:06:49.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0dffff640 1 -- 172.21.15.151:0/286276104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80b6b50 con 0x55f98f905540 2024-09-13T19:06:49.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f98f9fb510 con 0x55f98f905540 2024-09-13T19:06:49.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff0dffff640 1 -- 172.21.15.151:0/286276104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80b0070 con 0x55f98f905540 2024-09-13T19:06:49.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.403+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98f9fe1f0 con 0x55f98f905540 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff0dffff640 1 -- 172.21.15.151:0/286276104 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e80c8070 con 0x55f98f905540 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff0dffff640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0e00346f0 0x7ff0e0036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff0dffff640 1 -- 172.21.15.151:0/286276104 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1e80c6070 con 0x55f98f905540 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0e00346f0 0x7ff0e0036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98f905e90 0x55f98fa01e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa02380 con 0x55f98f905e90 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98f905e90 0x55f98fa01e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0e00346f0 0x7ff0e0036bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001dc0 tx=0x7ff1ec001360 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98f905e90 0x55f98fa01e40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f80ee640 1 -- 172.21.15.151:0/286276104 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98f905e90 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98f9ff3e0 con 0x55f98f905e90 2024-09-13T19:06:49.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f80ee640 1 -- 172.21.15.151:0/286276104 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98f905e90 2024-09-13T19:06:49.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa04670 0x55f98fa06a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa07150 con 0x55f98fa04670 2024-09-13T19:06:49.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa04670 0x55f98fa06a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa04670 0x55f98fa06a60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f78ed640 1 -- 172.21.15.151:0/286276104 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1e80b3040 con 0x55f98fa04670 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.407+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa03540 con 0x55f98f905e90 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f80ee640 1 -- 172.21.15.151:0/286276104 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98f905e90 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f98fa085b0 0x55f98fa0a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa0b090 con 0x55f98fa085b0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f98fa085b0 0x55f98fa0a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f98fa085b0 0x55f98fa0a9a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f70ec640 1 -- 172.21.15.151:0/286276104 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x55f98fa085b0 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.414 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f98f80d800 con 0x55f98fa18b10 2024-09-13T19:06:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33694/0 (socket says 172.21.15.151:33694) 2024-09-13T19:06:49.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f78ed640 1 -- 172.21.15.151:0/523139091 learned_addr learned my addr 172.21.15.151:0/523139091 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f78ed640 1 -- 172.21.15.151:0/523139091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98fa19470 con 0x55f98fa18b10 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80e3070 tx=0x7ff1e80b4d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff0dd7fa640 1 -- 172.21.15.151:0/523139091 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80c9dc0 con 0x55f98fa18b10 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff0dd7fa640 1 -- 172.21.15.151:0/523139091 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80e4040 con 0x55f98fa18b10 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f98fa19700 con 0x55f98fa18b10 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.411+0000 7ff0dd7fa640 1 -- 172.21.15.151:0/523139091 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80b7550 con 0x55f98fa18b10 2024-09-13T19:06:49.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98fa1c380 con 0x55f98fa18b10 2024-09-13T19:06:49.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0dd7fa640 1 -- 172.21.15.151:0/523139091 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e80b76f0 con 0x55f98fa18b10 2024-09-13T19:06:49.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0dd7fa640 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0dd7fa640 1 -- 172.21.15.151:0/523139091 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1e80bc070 con 0x55f98fa18b10 2024-09-13T19:06:49.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 0x7ff0d0036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00bfe0 tx=0x7ff1ec00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f9ddd980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f9ddd980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f98f90d210 con 0x55f98fa254e0 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33708/0 (socket says 172.21.15.151:33708) 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1304432914 learned_addr learned my addr 172.21.15.151:0/1304432914 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1304432914 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98fa25eb0 con 0x55f98fa254e0 2024-09-13T19:06:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/1304432914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c9fe0 tx=0x7ff1e80d4540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb342677ccc65a7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0d6ffd640 1 -- 172.21.15.151:0/1304432914 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80ff070 con 0x55f98fa254e0 2024-09-13T19:06:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0d6ffd640 1 -- 172.21.15.151:0/1304432914 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e80b5d70 con 0x55f98fa254e0 2024-09-13T19:06:49.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.415+0000 7ff0d6ffd640 1 -- 172.21.15.151:0/1304432914 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80c4170 con 0x55f98fa254e0 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1304432914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 msgr2=0x55f98fa258e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1304432914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80c9fe0 tx=0x7ff1e80d4540 comp rx=0 tx=0).stop 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1304432914 shutdown_connections 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1304432914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa258e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1304432914 >> 172.21.15.151:0/1304432914 conn(0x55f98fa21810 msgr2=0x55f98fa1f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1304432914 shutdown_connections 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1304432914 wait complete. 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 Processor -- start 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- start start 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa2c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f98fa26220 con 0x55f98fa254e0 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa2c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f78ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa2c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33722/0 (socket says 172.21.15.151:33722) 2024-09-13T19:06:49.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 learned_addr learned my addr 172.21.15.151:0/1570120078 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98fa2c9e0 con 0x55f98fa254e0 2024-09-13T19:06:49.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa2c4a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80d5ba0 tx=0x7ff1e80aef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff0d57fa640 1 -- 172.21.15.151:0/1570120078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80ff050 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f98fa2c9e0 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff0d57fa640 1 -- 172.21.15.151:0/1570120078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e8100040 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff0d57fa640 1 -- 172.21.15.151:0/1570120078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80d02a0 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.419+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98fa2ce50 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff0d57fa640 1 -- 172.21.15.151:0/1570120078 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e810d020 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff0d57fa640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0c0034650 0x7ff0c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff0d57fa640 1 -- 172.21.15.151:0/1570120078 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1e810b020 con 0x55f98fa254e0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0c0034650 0x7ff0c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98fa373b0 0x55f98fa39850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa39fa0 con 0x55f98fa373b0 2024-09-13T19:06:49.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98fa373b0 0x55f98fa39850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0c0034650 0x7ff0c0036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f98f9ff300 tx=0x7ff1ec010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98fa373b0 0x55f98fa39850 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 realm 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3a3b0 con 0x55f98fa373b0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.430 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3ac50 con 0x55f98fa373b0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa3bd50 0x55f98fa3e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3e790 con 0x55f98fa3bd50 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa3bd50 0x55f98fa3e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa3bd50 0x55f98fa3e140 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 20 searching for the correct realm 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3fff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff1e8106070 0x7ff1e80fa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3fff0 con 0x7ff1e8106070 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.423+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff1e8106070 0x7ff1e80fa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff1e8106070 0x7ff1e80fa810 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f70ec640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff1ec037040 0x7ff1ec036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3fff0 con 0x7ff1ec037040 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff1ec037040 0x7ff1ec036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff1ec037040 0x7ff1ec036410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.437 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.427+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1e8106070 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.438 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1e8106070 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.431+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1e8106070 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.435+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1e8106070 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa3bd50 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1ec037040 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x55f98fa373b0 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3aff0 con 0x7ff1e8106070 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3f110 con 0x55f98fa373b0 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3f960 con 0x55f98fa373b0 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3ed70 con 0x7ff1e8106070 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 zone default found 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 4 Realm: () 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:49.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 zonegroup default 2024-09-13T19:06:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.439+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa40420 con 0x7ff1ec037040 2024-09-13T19:06:49.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa3f5f0 con 0x55f98fa3bd50 2024-09-13T19:06:49.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa42380 con 0x55f98fa3bd50 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 started sync module instance, tier type = 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa41740 con 0x7ff1e8106070 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94530345114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa413a0 con 0x7ff1e8106070 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.443+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa432b0 con 0x55f98fa373b0 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94530345114416] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94530345119232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa436d0 con 0x55f98fa373b0 2024-09-13T19:06:49.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa43f60 con 0x55f98fa3bd50 2024-09-13T19:06:49.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94530345119232] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94530345120288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa43af0 con 0x55f98fa3bd50 2024-09-13T19:06:49.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.447+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa44970 con 0x7ff1e8106070 2024-09-13T19:06:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94530345125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa451c0 con 0x7ff1e8106070 2024-09-13T19:06:49.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa45bc0 con 0x55f98fa373b0 2024-09-13T19:06:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94530345120288] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.454 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94530345125056] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94530345121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa44d10 con 0x55f98fa373b0 2024-09-13T19:06:49.455 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.451+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa46460 con 0x7ff1ec037040 2024-09-13T19:06:49.457 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.455+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.455+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94530345131536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa466e0 con 0x7ff1ec037040 2024-09-13T19:06:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.455+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94530345121344] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.455+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa46f30 con 0x7ff1ec037040 2024-09-13T19:06:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94530345131536] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94530345133792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa46b00 con 0x7ff1ec037040 2024-09-13T19:06:49.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa47350 con 0x7ff1ec037040 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94530345133792] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94530345134848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa473d0 con 0x7ff1ec037040 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=0 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=1 2024-09-13T19:06:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=2 2024-09-13T19:06:49.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=3 2024-09-13T19:06:49.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=4 2024-09-13T19:06:49.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=5 2024-09-13T19:06:49.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.459+0000 7ff1f9ddd980 20 add_watcher() i=6 2024-09-13T19:06:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94530345134848] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 add_watcher() i=7 2024-09-13T19:06:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa4a6d0 con 0x55f98fa373b0 2024-09-13T19:06:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94530345136272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa47960 con 0x55f98fa373b0 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94530345136272] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 5 note: GC not initialized 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff0acfe1640 20 reqs_thread_entry: start 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:49.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 Filter name: none 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff0267fc640 20 reqs_thread_entry: start 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.463+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6dda0 con 0x55f98fa373b0 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:49.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa70830 con 0x7ff1e8106070 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 disabling bucket name=myfoo 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6e810 con 0x7ff1e8106070 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa71180 con 0x55f98fa3bd50 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(65 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:49.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa78860 con 0x55f98fa3bd50 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.467+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94530345308400 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa73f10 con 0x7ff1ec037040 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== watch-notify(notify (1) cookie 94530345133792 notify 137438953489 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7ff1f002d040 con 0x7ff1ec037040 2024-09-13T19:06:49.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94530345133792 notifier 4589 bl.length()=752 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d6ffd640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff0bc003eb0 con 0x7ff1ec037040 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(67 notify.6 [notify cookie 94530345308400 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify_complete (2) cookie 94530345308400 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff1f001e040 con 0x7ff1ec037040 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:49.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa710f0 con 0x55f98fa373b0 2024-09-13T19:06:49.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94530345327760 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa763c0 con 0x55f98fa373b0 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94530345121344 notify 137438953492 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff1f001e040 con 0x55f98fa373b0 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94530345121344 notifier 4589 bl.length()=567 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(70 notify.4 [notify cookie 94530345327760 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff0d67fc640 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff02c003440 con 0x55f98fa373b0 2024-09-13T19:06:49.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify_complete (2) cookie 94530345327760 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff1f0027c30 con 0x55f98fa373b0 2024-09-13T19:06:49.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.471+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.478 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.475+0000 7ff0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.475+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94530345136272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6bbd0 con 0x55f98fa373b0 2024-09-13T19:06:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.475+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94530345136272] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.475+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94530345114416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6bbd0 con 0x7ff1e8106070 2024-09-13T19:06:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.475+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94530345114416] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f9ddd980 20 remove_watcher() i=0 2024-09-13T19:06:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f9ddd980 2 removed watcher, disabling cache 2024-09-13T19:06:49.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94530345119232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa41b30 con 0x55f98fa373b0 2024-09-13T19:06:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94530345119232] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f9ddd980 20 remove_watcher() i=1 2024-09-13T19:06:49.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.479+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94530345120288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6bbd0 con 0x55f98fa3bd50 2024-09-13T19:06:49.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f78ed640 1 -- 172.21.15.151:0/1570120078 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94530345120288] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8102070 con 0x55f98fa3bd50 2024-09-13T19:06:49.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 20 remove_watcher() i=2 2024-09-13T19:06:49.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94530345125056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa41b30 con 0x7ff1e8106070 2024-09-13T19:06:49.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f70ec640 1 -- 172.21.15.151:0/1570120078 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94530345125056] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec00e6e0 con 0x7ff1e8106070 2024-09-13T19:06:49.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 20 remove_watcher() i=3 2024-09-13T19:06:49.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94530345121344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6bbd0 con 0x55f98fa373b0 2024-09-13T19:06:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94530345121344] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f98fa373b0 2024-09-13T19:06:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 20 remove_watcher() i=4 2024-09-13T19:06:49.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.483+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94530345131536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa41b30 con 0x7ff1ec037040 2024-09-13T19:06:49.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.487+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94530345131536] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.487+0000 7ff1f9ddd980 20 remove_watcher() i=5 2024-09-13T19:06:49.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.487+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94530345133792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa6bbd0 con 0x7ff1ec037040 2024-09-13T19:06:49.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94530345133792] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 20 remove_watcher() i=6 2024-09-13T19:06:49.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94530345134848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f98fa41b30 con 0x7ff1ec037040 2024-09-13T19:06:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94530345134848] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1ec037040 2024-09-13T19:06:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 20 remove_watcher() i=7 2024-09-13T19:06:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff1ec037040 msgr2=0x7ff1ec036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff1ec037040 0x7ff1ec036410 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98fa373b0 msgr2=0x55f98fa39850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98fa373b0 0x55f98fa39850 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff1e8106070 msgr2=0x7ff1e80fa810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff1e8106070 0x7ff1e80fa810 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa3bd50 msgr2=0x55f98fa3e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa3bd50 0x55f98fa3e140 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0c0034650 msgr2=0x7ff0c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0c0034650 0x7ff0c0036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f98f9ff300 tx=0x7ff1ec010000 comp rx=0 tx=0).stop 2024-09-13T19:06:49.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 msgr2=0x55f98fa2c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/1570120078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa254e0 0x55f98fa2c4a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80d5ba0 tx=0x7ff1e80aef30 comp rx=0 tx=0).stop 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 reap_dead start 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f80ee640 1 -- 172.21.15.151:0/1570120078 reap_dead start 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 shutdown_connections 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 >> 172.21.15.151:0/1570120078 conn(0x55f98fa21810 msgr2=0x55f98fa1f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 shutdown_connections 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.491+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/1570120078 wait complete. 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 msgr2=0x7ff0d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 0x7ff0d0036b10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00bfe0 tx=0x7ff1ec00f000 comp rx=0 tx=0).stop 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 msgr2=0x55f98fa18f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80e3070 tx=0x7ff1e80b4d60 comp rx=0 tx=0).stop 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 shutdown_connections 2024-09-13T19:06:49.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/523139091 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98fa18b10 0x55f98fa18f30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 >> 172.21.15.151:0/523139091 conn(0x55f98fa0dc60 msgr2=0x55f98fa106e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 shutdown_connections 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/523139091 wait complete. 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98f905e90 msgr2=0x55f98fa01e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f98f905e90 0x55f98fa01e40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f98fa085b0 msgr2=0x55f98fa0a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f98fa085b0 0x55f98fa0a9a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa04670 msgr2=0x55f98fa06a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f98fa04670 0x55f98fa06a60 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0e00346f0 msgr2=0x7ff0e0036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0e00346f0 0x7ff0e0036bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec001dc0 tx=0x7ff1ec001360 comp rx=0 tx=0).stop 2024-09-13T19:06:49.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 msgr2=0x55f98f9fad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 --2- 172.21.15.151:0/286276104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f98f905540 0x55f98f9fad40 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80b9040 tx=0x7ff1e8018020 comp rx=0 tx=0).stop 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f80ee640 1 -- 172.21.15.151:0/286276104 reap_dead start 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 shutdown_connections 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 >> 172.21.15.151:0/286276104 conn(0x55f98f901060 msgr2=0x55f98f90d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 shutdown_connections 2024-09-13T19:06:49.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.495+0000 7ff1f9ddd980 1 -- 172.21.15.151:0/286276104 wait complete. 2024-09-13T19:06:49.509 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:49.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-13T19:06:49.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-13T19:06:49.511 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-13T19:06:49.584 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:06:49.584 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:06:49.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4673386980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556594064a90 0x556594066e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4673386980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556593ee8ae0 con 0x556593fd4ac0 2024-09-13T19:06:49.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4673386980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x556593f0ce30 con 0x556594064a90 2024-09-13T19:06:49.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4670e96640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x556593fd4ac0 0x556594063370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:33390/0 (socket says 172.21.15.151:33390) 2024-09-13T19:06:49.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4670e96640 1 -- 172.21.15.151:0/4226528677 learned_addr learned my addr 172.21.15.151:0/4226528677 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:06:49.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4670695640 1 --2- 172.21.15.151:0/4226528677 >> v2:172.21.15.12:3300/0 conn(0x556594064a90 0x556594066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f466fe94640 1 -- 172.21.15.151:0/4226528677 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959830914 0 0) 0x556593ee8ae0 con 0x556593fd4ac0 2024-09-13T19:06:49.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f466fe94640 1 -- 172.21.15.151:0/4226528677 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4658001e20 con 0x556593fd4ac0 2024-09-13T19:06:49.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4670695640 1 -- 172.21.15.151:0/4226528677 >> v1:172.21.15.12:6789/0 conn(0x556593fd4ac0 legacy=0x556594063370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.583+0000 7f4670695640 1 -- 172.21.15.151:0/4226528677 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565940683d0 con 0x556594064a90 2024-09-13T19:06:49.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4670695640 1 --2- 172.21.15.151:0/4226528677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594064a90 0x556594066e80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f466400a480 tx=0x7f466401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fe7170dd9a5338 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f466fe94640 1 -- 172.21.15.151:0/4226528677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46640b0070 con 0x556594064a90 2024-09-13T19:06:49.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f466fe94640 1 -- 172.21.15.151:0/4226528677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46640ab540 con 0x556594064a90 2024-09-13T19:06:49.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f466fe94640 1 -- 172.21.15.151:0/4226528677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46640ab840 con 0x556594064a90 2024-09-13T19:06:49.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 -- 172.21.15.151:0/4226528677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594064a90 msgr2=0x556594066e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 --2- 172.21.15.151:0/4226528677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594064a90 0x556594066e80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f466400a480 tx=0x7f466401b280 comp rx=0 tx=0).stop 2024-09-13T19:06:49.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 -- 172.21.15.151:0/4226528677 shutdown_connections 2024-09-13T19:06:49.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 --2- 172.21.15.151:0/4226528677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594064a90 0x556594066e80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 -- 172.21.15.151:0/4226528677 >> 172.21.15.151:0/4226528677 conn(0x55659405b060 msgr2=0x55659405d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 -- 172.21.15.151:0/4226528677 shutdown_connections 2024-09-13T19:06:49.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.587+0000 7f4673386980 1 -- 172.21.15.151:0/4226528677 wait complete. 2024-09-13T19:06:49.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4673386980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4673386980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556593f0e200 con 0x556593fd4ac0 2024-09-13T19:06:49.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33738/0 (socket says 172.21.15.151:33738) 2024-09-13T19:06:49.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4670e96640 1 -- 172.21.15.151:0/3567931057 learned_addr learned my addr 172.21.15.151:0/3567931057 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4670e96640 1 -- 172.21.15.151:0/3567931057 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565940610a0 con 0x556593fd4ac0 2024-09-13T19:06:49.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f4670e96640 1 --2- 172.21.15.151:0/3567931057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4660001e40 tx=0x7f466000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d8ccc90f79d649 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f455ee0d640 1 -- 172.21.15.151:0/3567931057 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660012020 con 0x556593fd4ac0 2024-09-13T19:06:49.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f455ee0d640 1 -- 172.21.15.151:0/3567931057 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f466000e7c0 con 0x556593fd4ac0 2024-09-13T19:06:49.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.603+0000 7f455ee0d640 1 -- 172.21.15.151:0/3567931057 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466000eb00 con 0x556593fd4ac0 2024-09-13T19:06:49.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3567931057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 msgr2=0x556594060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 --2- 172.21.15.151:0/3567931057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4660001e40 tx=0x7f466000b790 comp rx=0 tx=0).stop 2024-09-13T19:06:49.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3567931057 shutdown_connections 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 --2- 172.21.15.151:0/3567931057 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594060ad0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3567931057 >> 172.21.15.151:0/3567931057 conn(0x55659405b060 msgr2=0x5565941474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3567931057 shutdown_connections 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3567931057 wait complete. 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556594067e10 con 0x556593fd4ac0 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594154e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33748/0 (socket says 172.21.15.151:33748) 2024-09-13T19:06:49.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4670e96640 1 -- 172.21.15.151:0/3446524878 learned_addr learned my addr 172.21.15.151:0/3446524878 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4670e96640 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565941553c0 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4670e96640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594154e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f466000b7d0 tx=0x7f4660000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f455d60a640 1 -- 172.21.15.151:0/3446524878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660012030 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556594155650 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f455d60a640 1 -- 172.21.15.151:0/3446524878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46600014a0 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f455d60a640 1 -- 172.21.15.151:0/3446524878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466001aaf0 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.607+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556594158330 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f455d60a640 1 -- 172.21.15.151:0/3446524878 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4660015020 con 0x556593fd4ac0 2024-09-13T19:06:49.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f455d60a640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4558034650 0x7f4558036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f455d60a640 1 -- 172.21.15.151:0/3446524878 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4660020030 con 0x556593fd4ac0 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670695640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4558034650 0x7f4558036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594064a90 0x55659415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55659415c4b0 con 0x556594064a90 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4671697640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594064a90 0x55659415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670695640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4558034650 0x7f4558036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46640ad000 tx=0x7f46640a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4671697640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594064a90 0x55659415be70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4671697640 1 -- 172.21.15.151:0/3446524878 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594064a90 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594159530 con 0x556594064a90 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4671697640 1 -- 172.21.15.151:0/3446524878 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f466800a4d0 con 0x556594064a90 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55659415e7e0 0x556594160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941612a0 con 0x55659415e7e0 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670e96640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55659415e7e0 0x556594160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670e96640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55659415e7e0 0x556594160bd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670e96640 1 -- 172.21.15.151:0/3446524878 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4660008030 con 0x55659415e7e0 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55659415d680 con 0x556594064a90 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4671697640 1 -- 172.21.15.151:0/3446524878 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f466800a4d0 con 0x556594064a90 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565941626e0 0x556594164ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594165260 con 0x5565941626e0 2024-09-13T19:06:49.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670695640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565941626e0 0x556594164ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670695640 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565941626e0 0x556594164ad0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.611+0000 7f4670695640 1 -- 172.21.15.151:0/3446524878 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46640b3040 con 0x5565941626e0 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556593f67800 con 0x556594172cf0 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33762/0 (socket says 172.21.15.151:33762) 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670e96640 1 -- 172.21.15.151:0/1251401098 learned_addr learned my addr 172.21.15.151:0/1251401098 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670e96640 1 -- 172.21.15.151:0/1251401098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556594173650 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670e96640 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4660048460 tx=0x7f466000d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 -- 172.21.15.151:0/1251401098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660017e60 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 -- 172.21.15.151:0/1251401098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660041350 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565941738e0 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 -- 172.21.15.151:0/1251401098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660041630 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565941738e0 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 -- 172.21.15.151:0/1251401098 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4660009070 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 0x7f4548036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f45567fc640 1 -- 172.21.15.151:0/1251401098 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4660005050 con 0x556594172cf0 2024-09-13T19:06:49.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4670695640 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 0x7f4548036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.615+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670695640 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 0x7f4548036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4664000c10 tx=0x7f4664005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55659405f2c0 con 0x55659417f4d0 2024-09-13T19:06:49.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33766/0 (socket says 172.21.15.151:33766) 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 -- 172.21.15.151:0/3302507326 learned_addr learned my addr 172.21.15.151:0/3302507326 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 -- 172.21.15.151:0/3302507326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659417fea0 con 0x55659417f4d0 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 --2- 172.21.15.151:0/3302507326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4660031010 tx=0x7f466004d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800b10d82cd3b552 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4547fff640 1 -- 172.21.15.151:0/3302507326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660060020 con 0x55659417f4d0 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4547fff640 1 -- 172.21.15.151:0/3302507326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4660048e20 con 0x55659417f4d0 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4547fff640 1 -- 172.21.15.151:0/3302507326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660041900 con 0x55659417f4d0 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- 172.21.15.151:0/3302507326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 msgr2=0x55659417f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 --2- 172.21.15.151:0/3302507326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4660031010 tx=0x7f466004d500 comp rx=0 tx=0).stop 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- 172.21.15.151:0/3302507326 shutdown_connections 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 --2- 172.21.15.151:0/3302507326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x55659417f8d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- 172.21.15.151:0/3302507326 >> 172.21.15.151:0/3302507326 conn(0x55659417b800 msgr2=0x556594179900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- 172.21.15.151:0/3302507326 shutdown_connections 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- 172.21.15.151:0/3302507326 wait complete. 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 Processor -- start 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- start start 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4673386980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556594180390 con 0x55659417f4d0 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:33770/0 (socket says 172.21.15.151:33770) 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.619+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 learned_addr learned my addr 172.21.15.151:0/3468103567 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556594186af0 con 0x55659417f4d0 2024-09-13T19:06:49.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4670e96640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f466004d540 tx=0x7f466005b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 -- 172.21.15.151:0/3468103567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4660074070 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 -- 172.21.15.151:0/3468103567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46600165e0 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556594186af0 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 -- 172.21.15.151:0/3468103567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f466004d600 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556594186af0 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 -- 172.21.15.151:0/3468103567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4660077070 con 0x55659417f4d0 2024-09-13T19:06:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f453c034650 0x7f453c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f45467fc640 1 -- 172.21.15.151:0/3468103567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f466006c070 con 0x55659417f4d0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4670695640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f453c034650 0x7f453c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594191740 0x556594193c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594194350 con 0x556594191740 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4671697640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594191740 0x556594193c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4670695640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f453c034650 0x7f453c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46640ab510 tx=0x7f46640b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4671697640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594191740 0x556594193c00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 20 realm 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594194760 con 0x556594191740 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.623+0000 7f4673386980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594195030 con 0x556594191740 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556594196130 0x556594198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594198af0 con 0x556594196130 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556594196130 0x556594198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556594196130 0x556594198520 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 20 searching for the correct realm 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55659419a3c0 con 0x556594196130 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4660079060 0x7f466000c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55659419a3c0 con 0x7f4660079060 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670695640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4660079060 0x7f466000c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670695640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4660079060 0x7f466000c7d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670695640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f46640cd040 0x7f46640b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55659419a3c0 con 0x7f46640cd040 2024-09-13T19:06:49.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4671697640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f46640cd040 0x7f46640b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:06:49.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.627+0000 7f4671697640 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f46640cd040 0x7f46640b7420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f4660079060 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.631+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f4660079060 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.635+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f4660079060 2024-09-13T19:06:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f4660079060 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594196130 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f46640cd040 2024-09-13T19:06:49.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x556594191740 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.639+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5565941953d0 con 0x7f4660079060 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:06:49.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941994e0 con 0x556594191740 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556594199d80 con 0x556594191740 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941998d0 con 0x7f4660079060 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:06:49.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 zone default found 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 4 Realm: () 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 zonegroup default 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55659419a7f0 con 0x7f46640cd040 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55659419c1d0 con 0x556594196130 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55659419c6c0 con 0x556594196130 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 started sync module instance, tier type = 2024-09-13T19:06:49.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:06:49.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.643+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419b670 con 0x7f4660079060 2024-09-13T19:06:49.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93894764771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419be30 con 0x7f4660079060 2024-09-13T19:06:49.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419d5f0 con 0x556594191740 2024-09-13T19:06:49.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93894764771856] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93894764777792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419da10 con 0x556594191740 2024-09-13T19:06:49.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.647+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419e2e0 con 0x556594196130 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93894764777792] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93894764778848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419de30 con 0x556594196130 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419ecf0 con 0x7f4660079060 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93894764783680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419f590 con 0x7f4660079060 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419ffb0 con 0x556594191740 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93894764778848] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.651+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93894764783680] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93894764788384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419f0e0 con 0x556594191740 2024-09-13T19:06:49.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a0850 con 0x7f46640cd040 2024-09-13T19:06:49.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93894764788384] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93894764779904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419f0e0 con 0x7f46640cd040 2024-09-13T19:06:49.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.655+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a0d00 con 0x7f46640cd040 2024-09-13T19:06:49.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93894764791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a1140 con 0x7f46640cd040 2024-09-13T19:06:49.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a1c60 con 0x7f46640cd040 2024-09-13T19:06:49.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93894764779904] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93894764795696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a1c20 con 0x7f46640cd040 2024-09-13T19:06:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=0 2024-09-13T19:06:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=1 2024-09-13T19:06:49.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=2 2024-09-13T19:06:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=3 2024-09-13T19:06:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=4 2024-09-13T19:06:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=5 2024-09-13T19:06:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93894764791824] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.659+0000 7f4673386980 20 add_watcher() i=6 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93894764795696] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 add_watcher() i=7 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 2 all 8 watchers are set, enabling cache 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941a0c30 con 0x556594191740 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93894764792880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a2070 con 0x556594191740 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93894764792880] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 5 note: GC not initialized 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4525fe3640 20 reqs_thread_entry: start 2024-09-13T19:06:49.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 init_complete bucket index max shards: 11 2024-09-13T19:06:49.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 Filter name: none 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f44977fe640 20 reqs_thread_entry: start 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.663+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941c8220 con 0x556594191740 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:06:49.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941c7d00 con 0x7f4660079060 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 enabling bucket name=myfoo 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941c8c90 con 0x7f4660079060 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv29 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:06:49.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 : miss 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 rados->read ofs=0 len=0 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941ca570 con 0x556594196130 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(65 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 2024-09-13T19:06:49.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 8.16 8:6836addc:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941d2bd0 con 0x556594196130 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1, ofs0, ns] 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.667+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93894764962112 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941cd1d0 con 0x7f46640cd040 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== watch-notify(notify (1) cookie 93894764791824 notify 137438953490 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f466802d040 con 0x7f46640cd040 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(67 notify.6 [notify cookie 93894764962112 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 93894764791824 notifier 4596 bl.length()=752 2024-09-13T19:06:49.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 info.flags=0x17 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1 to cache LRU end 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4534003eb0 con 0x7f46640cd040 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify_complete (2) cookie 93894764962112 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f466801e040 con 0x7f46640cd040 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_sources= new_sources= 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential sources added=[] removed=[] 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): orig_dests= new_dests= 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 20 handle_bi_update(): bucket=:myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1]): potential dests added=[] removed=[] 2024-09-13T19:06:49.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941cbd10 con 0x556594191740 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93894764947840 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5565941c7250 con 0x556594191740 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 93894764788384 notify 137438953493 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f466801e040 con 0x556594191740 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 93894764788384 notifier 4596 bl.length()=567 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(70 notify.4 [notify cookie 93894764947840 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4547fff640 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4534003eb0 con 0x556594191740 2024-09-13T19:06:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify_complete (2) cookie 93894764947840 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4668027c30 con 0x556594191740 2024-09-13T19:06:49.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.671+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.678 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:06:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:06:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93894764792880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941c6050 con 0x556594191740 2024-09-13T19:06:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93894764792880] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93894764771856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941c6050 con 0x7f4660079060 2024-09-13T19:06:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93894764771856] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4673386980 20 remove_watcher() i=0 2024-09-13T19:06:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4673386980 2 removed watcher, disabling cache 2024-09-13T19:06:49.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.675+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93894764777792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941c6050 con 0x556594191740 2024-09-13T19:06:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93894764777792] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4673386980 20 remove_watcher() i=1 2024-09-13T19:06:49.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93894764778848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419d140 con 0x556594196130 2024-09-13T19:06:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4670e96640 1 -- 172.21.15.151:0/3468103567 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93894764778848] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4660076030 con 0x556594196130 2024-09-13T19:06:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4673386980 20 remove_watcher() i=2 2024-09-13T19:06:49.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.679+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93894764783680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941c6050 con 0x7f4660079060 2024-09-13T19:06:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4670695640 1 -- 172.21.15.151:0/3468103567 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93894764783680] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46640d8070 con 0x7f4660079060 2024-09-13T19:06:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4673386980 20 remove_watcher() i=3 2024-09-13T19:06:49.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93894764788384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419e840 con 0x556594191740 2024-09-13T19:06:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93894764788384] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x556594191740 2024-09-13T19:06:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4673386980 20 remove_watcher() i=4 2024-09-13T19:06:49.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.683+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93894764779904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941c6050 con 0x7f46640cd040 2024-09-13T19:06:49.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93894764779904] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4673386980 20 remove_watcher() i=5 2024-09-13T19:06:49.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93894764791824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55659419e840 con 0x7f46640cd040 2024-09-13T19:06:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93894764791824] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4673386980 20 remove_watcher() i=6 2024-09-13T19:06:49.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.687+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93894764795696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5565941a0cc0 con 0x7f46640cd040 2024-09-13T19:06:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93894764795696] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f466800a4d0 con 0x7f46640cd040 2024-09-13T19:06:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 20 remove_watcher() i=7 2024-09-13T19:06:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f46640cd040 msgr2=0x7f46640b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f46640cd040 0x7f46640b7420 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594191740 msgr2=0x556594193c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594191740 0x556594193c00 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4660079060 msgr2=0x7f466000c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f4660079060 0x7f466000c7d0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556594196130 msgr2=0x556594198520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556594196130 0x556594198520 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f453c034650 msgr2=0x7f453c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f453c034650 0x7f453c036b10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46640ab510 tx=0x7f46640b9040 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 msgr2=0x5565941865b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4671697640 1 -- 172.21.15.151:0/3468103567 reap_dead start 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f466004d540 tx=0x7f466005b000 comp rx=0 tx=0).stop 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 shutdown_connections 2024-09-13T19:06:49.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3468103567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55659417f4d0 0x5565941865b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 >> 172.21.15.151:0/3468103567 conn(0x55659417b800 msgr2=0x5565941798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 shutdown_connections 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3468103567 wait complete. 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 msgr2=0x7f4548036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 0x7f4548036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4664000c10 tx=0x7f4664005a10 comp rx=0 tx=0).stop 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 msgr2=0x556594173110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4660048460 tx=0x7f466000d6b0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 shutdown_connections 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4548034650 0x7f4548036b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/1251401098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556594172cf0 0x556594173110 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 >> 172.21.15.151:0/1251401098 conn(0x556594167e40 msgr2=0x55659416a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 shutdown_connections 2024-09-13T19:06:49.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/1251401098 wait complete. 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594064a90 msgr2=0x55659415be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556594064a90 0x55659415be70 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565941626e0 msgr2=0x556594164ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565941626e0 0x556594164ad0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55659415e7e0 msgr2=0x556594160bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55659415e7e0 0x556594160bd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4558034650 msgr2=0x7f4558036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4558034650 0x7f4558036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f46640ad000 tx=0x7f46640a5040 comp rx=0 tx=0).stop 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 msgr2=0x556594154e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 --2- 172.21.15.151:0/3446524878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556593fd4ac0 0x556594154e80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f466000b7d0 tx=0x7f4660000ee0 comp rx=0 tx=0).stop 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4671697640 1 -- 172.21.15.151:0/3446524878 reap_dead start 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 shutdown_connections 2024-09-13T19:06:49.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 >> 172.21.15.151:0/3446524878 conn(0x55659405b060 msgr2=0x556594147120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:06:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 shutdown_connections 2024-09-13T19:06:49.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:06:49.691+0000 7f4673386980 1 -- 172.21.15.151:0/3446524878 wait complete. 2024-09-13T19:06:49.707 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:06:49.741 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:06:50.078 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-13T19:06:50.091 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:05.093 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:07:05.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:07:05.093 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:07:05.132 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:05.133 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:05.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09705c980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556408c08290 0x556408c987a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09705c980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556408b1bae0 con 0x556408c98ce0 2024-09-13T19:07:05.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09705c980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x556408b3fe30 con 0x556408c08290 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff094b6c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556408c08290 0x556408c987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff094b6c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x556408c08290 0x556408c987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50722/0 (socket says 172.21.15.151:50722) 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff09436b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x556408c98ce0 0x556408c9b0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39618/0 (socket says 172.21.15.151:39618) 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff094b6c640 1 -- 172.21.15.151:0/718359244 learned_addr learned my addr 172.21.15.151:0/718359244 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff094b6c640 1 -- 172.21.15.151:0/718359244 >> v1:172.21.15.12:6789/0 conn(0x556408c98ce0 legacy=0x556408c9b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.131+0000 7ff094b6c640 1 -- 172.21.15.151:0/718359244 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408c08670 con 0x556408c08290 2024-09-13T19:07:05.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff094b6c640 1 --2- 172.21.15.151:0/718359244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408c987a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff08400a4e0 tx=0x7ff08401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3205edd0fe696806 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff093b6a640 1 -- 172.21.15.151:0/718359244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840aa540 con 0x556408c08290 2024-09-13T19:07:05.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff093b6a640 1 -- 172.21.15.151:0/718359244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840aa6e0 con 0x556408c08290 2024-09-13T19:07:05.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff093b6a640 1 -- 172.21.15.151:0/718359244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840aaa40 con 0x556408c08290 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 -- 172.21.15.151:0/718359244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 msgr2=0x556408c987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 --2- 172.21.15.151:0/718359244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408c987a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff08400a4e0 tx=0x7ff08401b090 comp rx=0 tx=0).stop 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 -- 172.21.15.151:0/718359244 shutdown_connections 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 --2- 172.21.15.151:0/718359244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408c987a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 -- 172.21.15.151:0/718359244 >> 172.21.15.151:0/718359244 conn(0x556408c8e090 msgr2=0x556408c904b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 -- 172.21.15.151:0/718359244 shutdown_connections 2024-09-13T19:07:05.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.135+0000 7ff09705c980 1 -- 172.21.15.151:0/718359244 wait complete. 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff09705c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff09705c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556408b41200 con 0x556408c08290 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50738/0 (socket says 172.21.15.151:50738) 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.151+0000 7ff094b6c640 1 -- 172.21.15.151:0/1032442627 learned_addr learned my addr 172.21.15.151:0/1032442627 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 -- 172.21.15.151:0/1032442627 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408d81240 con 0x556408c08290 2024-09-13T19:07:05.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 --2- 172.21.15.151:0/1032442627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff084018cc0 tx=0x7ff0840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370699dbc8a4c956 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7fef82e0d640 1 -- 172.21.15.151:0/1032442627 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840b9030 con 0x556408c08290 2024-09-13T19:07:05.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7fef82e0d640 1 -- 172.21.15.151:0/1032442627 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840aaa80 con 0x556408c08290 2024-09-13T19:07:05.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7fef82e0d640 1 -- 172.21.15.151:0/1032442627 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840aad80 con 0x556408c08290 2024-09-13T19:07:05.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- 172.21.15.151:0/1032442627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 msgr2=0x556408d80c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 --2- 172.21.15.151:0/1032442627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff084018cc0 tx=0x7ff0840033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- 172.21.15.151:0/1032442627 shutdown_connections 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 --2- 172.21.15.151:0/1032442627 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d80c70 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- 172.21.15.151:0/1032442627 >> 172.21.15.151:0/1032442627 conn(0x556408c8e090 msgr2=0x556408d7c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- 172.21.15.151:0/1032442627 shutdown_connections 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- 172.21.15.151:0/1032442627 wait complete. 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d87e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff09705c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556408c9f220 con 0x556408c08290 2024-09-13T19:07:05.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d87e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50744/0 (socket says 172.21.15.151:50744) 2024-09-13T19:07:05.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 -- 172.21.15.151:0/523442699 learned_addr learned my addr 172.21.15.151:0/523442699 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408d88340 con 0x556408c08290 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.155+0000 7ff094b6c640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d87e00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b7040 tx=0x7ff084017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 -- 172.21.15.151:0/523442699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840b9070 con 0x556408c08290 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 -- 172.21.15.151:0/523442699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840c3030 con 0x556408c08290 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 -- 172.21.15.151:0/523442699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840bf770 con 0x556408c08290 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556408d885d0 con 0x556408c08290 2024-09-13T19:07:05.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556408d8b2b0 con 0x556408c08290 2024-09-13T19:07:05.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 -- 172.21.15.151:0/523442699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0840b3040 con 0x556408c08290 2024-09-13T19:07:05.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef7c0346f0 0x7fef7c036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7fef8160a640 1 -- 172.21.15.151:0/523442699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff0840ba070 con 0x556408c08290 2024-09-13T19:07:05.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09436b640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef7c0346f0 0x7fef7c036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408c98ce0 0x556408d8ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408d8f3d0 con 0x556408c98ce0 2024-09-13T19:07:05.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09536d640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408c98ce0 0x556408d8ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09436b640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef7c0346f0 0x7fef7c036bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001e50 tx=0x7ff07c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09536d640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408c98ce0 0x556408d8ed90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09536d640 1 -- 172.21.15.151:0/523442699 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408c98ce0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408d8fc70 con 0x556408c98ce0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.159+0000 7ff09536d640 1 -- 172.21.15.151:0/523442699 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408c98ce0 2024-09-13T19:07:05.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408d91580 0x556408d93a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408d941b0 con 0x556408d91580 2024-09-13T19:07:05.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408d91580 0x556408d93a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408d91580 0x556408d93a20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 -- 172.21.15.151:0/523442699 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0840cf070 con 0x556408d91580 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408d904c0 con 0x556408c98ce0 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09536d640 1 -- 172.21.15.151:0/523442699 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408c98ce0 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556408d95610 0x556408d97a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408d98140 con 0x556408d95610 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09436b640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556408d95610 0x556408d97a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09436b640 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556408d95610 0x556408d97a00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09436b640 1 -- 172.21.15.151:0/523442699 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff07c00f700 con 0x556408d95610 2024-09-13T19:07:05.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff09705c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556408b9a800 con 0x556408da5bf0 2024-09-13T19:07:05.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50746/0 (socket says 172.21.15.151:50746) 2024-09-13T19:07:05.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 -- 172.21.15.151:0/1015604023 learned_addr learned my addr 172.21.15.151:0/1015604023 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.163+0000 7ff094b6c640 1 -- 172.21.15.151:0/1015604023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408da6550 con 0x556408da5bf0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff0840bc930 tx=0x7ff0840bd5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 -- 172.21.15.151:0/1015604023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840e2070 con 0x556408da5bf0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 -- 172.21.15.151:0/1015604023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840072b0 con 0x556408da5bf0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556408da67e0 con 0x556408da5bf0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 -- 172.21.15.151:0/1015604023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840bcd20 con 0x556408da5bf0 2024-09-13T19:07:05.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556408da9460 con 0x556408da5bf0 2024-09-13T19:07:05.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 -- 172.21.15.151:0/1015604023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0840dc070 con 0x556408da5bf0 2024-09-13T19:07:05.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 0x7fef6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7fef7a7fc640 1 -- 172.21.15.151:0/1015604023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff0840d4040 con 0x556408da5bf0 2024-09-13T19:07:05.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09436b640 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 0x7fef6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09436b640 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 0x7fef6c036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x556408d94550 tx=0x7ff07c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff09705c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556408d81500 con 0x556408db2490 2024-09-13T19:07:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50750/0 (socket says 172.21.15.151:50750) 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 -- 172.21.15.151:0/2670310716 learned_addr learned my addr 172.21.15.151:0/2670310716 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 -- 172.21.15.151:0/2670310716 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408db2e40 con 0x556408db2490 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.167+0000 7ff094b6c640 1 --2- 172.21.15.151:0/2670310716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b5c90 tx=0x7ff0840c8dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1b2048b5989f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6bfff640 1 -- 172.21.15.151:0/2670310716 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840ea030 con 0x556408db2490 2024-09-13T19:07:05.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6bfff640 1 -- 172.21.15.151:0/2670310716 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840d3640 con 0x556408db2490 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6bfff640 1 -- 172.21.15.151:0/2670310716 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840c85a0 con 0x556408db2490 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/2670310716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 msgr2=0x556408db2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 --2- 172.21.15.151:0/2670310716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b5c90 tx=0x7ff0840c8dc0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/2670310716 shutdown_connections 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 --2- 172.21.15.151:0/2670310716 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db2870 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/2670310716 >> 172.21.15.151:0/2670310716 conn(0x556408dae870 msgr2=0x556408dac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/2670310716 shutdown_connections 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/2670310716 wait complete. 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 Processor -- start 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- start start 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556408db32e0 con 0x556408db2490 2024-09-13T19:07:05.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff094b6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50764/0 (socket says 172.21.15.151:50764) 2024-09-13T19:07:05.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 learned_addr learned my addr 172.21.15.151:0/886522534 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556408db9b10 con 0x556408db2490 2024-09-13T19:07:05.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff094b6c640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db95d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0840e2720 tx=0x7ff084009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6a7fc640 1 -- 172.21.15.151:0/886522534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff084108070 con 0x556408db2490 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6a7fc640 1 -- 172.21.15.151:0/886522534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840d3a60 con 0x556408db2490 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556408db9b10 con 0x556408db2490 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7fef6a7fc640 1 -- 172.21.15.151:0/886522534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0840b43a0 con 0x556408db2490 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.171+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556408db9b10 con 0x556408db2490 2024-09-13T19:07:05.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7fef6a7fc640 1 -- 172.21.15.151:0/886522534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff08410b070 con 0x556408db2490 2024-09-13T19:07:05.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7fef6a7fc640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef600346a0 0x7fef60036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7fef6a7fc640 1 -- 172.21.15.151:0/886522534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff084100070 con 0x556408db2490 2024-09-13T19:07:05.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09436b640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef600346a0 0x7fef60036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408dc46d0 0x556408dc6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dc72e0 con 0x556408dc46d0 2024-09-13T19:07:05.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408dc46d0 0x556408dc6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09436b640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef600346a0 0x7fef60036b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556408d98520 tx=0x7ff07c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408dc46d0 0x556408dc6b90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 realm 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dc7740 con 0x556408dc46d0 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dc7fe0 con 0x556408dc46d0 2024-09-13T19:07:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408dc90e0 0x556408dcb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dcba50 con 0x556408dc90e0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff094b6c640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408dc90e0 0x556408dcb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff094b6c640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408dc90e0 0x556408dcb4d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 20 searching for the correct realm 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.175+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dcd2f0 con 0x556408dc90e0 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff094b6c640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff08410d060 0x7ff0840ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dcd2f0 con 0x7ff08410d060 2024-09-13T19:07:05.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff08410d060 0x7ff0840ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff08410d060 0x7ff0840ef480 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dcd2f0 con 0x7ff08410d060 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dcd2f0 con 0x556408dc46d0 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff08c008790 0x7ff08c018410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff08c008790 0x7ff08c018410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff08c008790 0x7ff08c018410 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x7ff08c008790 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.179+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x7ff08c008790 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08410d060 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x7ff08c008790 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08410d060 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.183+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x7ff08c008790 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x7ff08c008790 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08410d060 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c0083f0 con 0x556408dc46d0 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.187+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08410d060 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc90e0 2024-09-13T19:07:05.220 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x7ff08c008790 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff08c03b040 con 0x7ff08410d060 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:05.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dc8380 con 0x556408dc46d0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dcc2a0 con 0x556408dc46d0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dcc2a0 con 0x7ff08410d060 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 zone default found 2024-09-13T19:07:05.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 4 Realm: () 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 zonegroup default 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.191+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dccb70 con 0x7ff08c008790 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dccb70 con 0x556408dc90e0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dcf1a0 con 0x556408dc90e0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 started sync module instance, tier type = 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dce640 con 0x7ff08410d060 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93888133786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dce2a0 con 0x7ff08410d060 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.195+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd0010 con 0x556408dc46d0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93888133786208] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93888133790560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd0430 con 0x556408dc46d0 2024-09-13T19:07:05.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd0df0 con 0x556408dc90e0 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93888133790560] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93888133791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd03a0 con 0x556408dc90e0 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.199+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd1b30 con 0x7ff08410d060 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93888133799712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd27f0 con 0x7ff08410d060 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd31b0 con 0x556408dc46d0 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93888133791616] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93888133799712] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93888133796240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd2450 con 0x556408dc46d0 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.203+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd31b0 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.207+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93888133796240] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.207+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.207+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93888133805968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd31b0 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.207+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd4330 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93888133805968] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93888133803536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd4330 con 0x7ff08c008790 2024-09-13T19:07:05.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd4cf0 con 0x7ff08c008790 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93888133803536] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93888133810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd5110 con 0x7ff08c008790 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=0 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=1 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=2 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=3 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=4 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=5 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.211+0000 7ff09705c980 20 add_watcher() i=6 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93888133810240] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 20 add_watcher() i=7 2024-09-13T19:07:05.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dd5110 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93888133811296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408dd5080 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93888133811296] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7fef4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.215+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de06a0 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.219+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.219+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de0c90 con 0x7ff08c008790 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.219+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.219+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1090 con 0x556408dc90e0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1020 con 0x556408dc46d0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1630 con 0x7ff08410d060 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.223+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1ba0 con 0x556408dc90e0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.227+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.227+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1ba0 con 0x556408dc46d0 2024-09-13T19:07:05.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.227+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.227+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1ba0 con 0x7ff08c008790 2024-09-13T19:07:05.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.231+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.231+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de1c50 con 0x7ff08410d060 2024-09-13T19:07:05.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2340 con 0x556408dc90e0 2024-09-13T19:07:05.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de23d0 con 0x7ff08410d060 2024-09-13T19:07:05.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.235+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x7ff08c008790 2024-09-13T19:07:05.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.239+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.239+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x7ff08410d060 2024-09-13T19:07:05.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.239+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.239+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x7ff08c008790 2024-09-13T19:07:05.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.243+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.246 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.243+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc46d0 2024-09-13T19:07:05.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.243+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.243+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc90e0 2024-09-13T19:07:05.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.247+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.247+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x7ff08410d060 2024-09-13T19:07:05.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.247+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.247+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc90e0 2024-09-13T19:07:05.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.251+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.251+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc46d0 2024-09-13T19:07:05.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.251+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.251+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc46d0 2024-09-13T19:07:05.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x556408dc90e0 2024-09-13T19:07:05.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de27f0 con 0x7ff08410d060 2024-09-13T19:07:05.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.255+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.259+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.259+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.259+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.259+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.263+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.263+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.263+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.263+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x7ff08c008790 2024-09-13T19:07:05.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.267+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.268 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.267+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.267+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.267+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x7ff08c008790 2024-09-13T19:07:05.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.271+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.271+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x556408dc90e0 2024-09-13T19:07:05.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.271+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.271+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x7ff08c008790 2024-09-13T19:07:05.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.275+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.275+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408de2880 con 0x7ff08410d060 2024-09-13T19:07:05.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7fef4a7e4640 20 reqs_thread_entry: start 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 20 Filter name: none 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7fef43fff640 20 reqs_thread_entry: start 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfe410 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408ddde30 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408ddde30 con 0x7ff08c008790 2024-09-13T19:07:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.279+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408ddde30 con 0x7ff08c008790 2024-09-13T19:07:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.283+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.287+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.291+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.295+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c037040 con 0x7ff08410d060 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.299+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.303+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.307+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08410d060 2024-09-13T19:07:05.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.311+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.315+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.318+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dde2e0 con 0x7ff08c008790 2024-09-13T19:07:05.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(180 gc.28 [call out=1701b] v0'0 uv29 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x556408dc90e0 2024-09-13T19:07:05.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfdf60 con 0x556408dc90e0 2024-09-13T19:07:05.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x556408dc90e0 2024-09-13T19:07:05.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x7ff08c008790 2024-09-13T19:07:05.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.322+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfdf60 con 0x7ff08c008790 2024-09-13T19:07:05.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x7ff08c008790 2024-09-13T19:07:05.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x7ff08410d060 2024-09-13T19:07:05.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfdf60 con 0x7ff08410d060 2024-09-13T19:07:05.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556408dfef70 con 0x7ff08410d060 2024-09-13T19:07:05.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.326+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7fef4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:05.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93888133811296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x556408dc46d0 2024-09-13T19:07:05.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93888133811296] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93888133786208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x7ff08410d060 2024-09-13T19:07:05.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93888133786208] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09705c980 20 remove_watcher() i=0 2024-09-13T19:07:05.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09705c980 2 removed watcher, disabling cache 2024-09-13T19:07:05.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.330+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93888133790560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x556408dc46d0 2024-09-13T19:07:05.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.334+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93888133790560] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.334+0000 7ff09705c980 20 remove_watcher() i=1 2024-09-13T19:07:05.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.334+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93888133791616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x556408dc90e0 2024-09-13T19:07:05.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff094b6c640 1 -- 172.21.15.151:0/886522534 <== osd.3 v2:172.21.15.151:6800/3085220080 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93888133791616] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08410a030 con 0x556408dc90e0 2024-09-13T19:07:05.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff09705c980 20 remove_watcher() i=2 2024-09-13T19:07:05.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93888133799712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x7ff08410d060 2024-09-13T19:07:05.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff09436b640 1 -- 172.21.15.151:0/886522534 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93888133799712] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff07c053040 con 0x7ff08410d060 2024-09-13T19:07:05.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff09705c980 20 remove_watcher() i=3 2024-09-13T19:07:05.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.338+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93888133796240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x556408dc46d0 2024-09-13T19:07:05.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93888133796240] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x556408dc46d0 2024-09-13T19:07:05.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09705c980 20 remove_watcher() i=4 2024-09-13T19:07:05.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93888133805968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x7ff08c008790 2024-09-13T19:07:05.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93888133805968] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09705c980 20 remove_watcher() i=5 2024-09-13T19:07:05.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.342+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93888133803536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x7ff08c008790 2024-09-13T19:07:05.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93888133803536] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 20 remove_watcher() i=6 2024-09-13T19:07:05.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93888133810240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556408ddda40 con 0x7ff08c008790 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93888133810240] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff08c036040 con 0x7ff08c008790 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 20 remove_watcher() i=7 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff08c008790 msgr2=0x7ff08c018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff08c008790 0x7ff08c018410 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408dc46d0 msgr2=0x556408dc6b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408dc46d0 0x556408dc6b90 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff08410d060 msgr2=0x7ff0840ef480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff08410d060 0x7ff0840ef480 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408dc90e0 msgr2=0x556408dcb4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408dc90e0 0x556408dcb4d0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef600346a0 msgr2=0x7fef60036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef600346a0 0x7fef60036b60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556408d98520 tx=0x7ff07c010000 comp rx=0 tx=0).stop 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 msgr2=0x556408db95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 --2- 172.21.15.151:0/886522534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408db2490 0x556408db95d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0840e2720 tx=0x7ff084009eb0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09536d640 1 -- 172.21.15.151:0/886522534 reap_dead start 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 shutdown_connections 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.346+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 >> 172.21.15.151:0/886522534 conn(0x556408dae870 msgr2=0x556408dac940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 shutdown_connections 2024-09-13T19:07:05.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/886522534 wait complete. 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 msgr2=0x7fef6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 0x7fef6c036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x556408d94550 tx=0x7ff07c00f000 comp rx=0 tx=0).stop 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 msgr2=0x556408da6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff0840bc930 tx=0x7ff0840bd5c0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 shutdown_connections 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef6c034650 0x7fef6c036b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/1015604023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408da5bf0 0x556408da6010 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 >> 172.21.15.151:0/1015604023 conn(0x556408d9ad40 msgr2=0x556408d9d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 shutdown_connections 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/1015604023 wait complete. 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408c98ce0 msgr2=0x556408d8ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556408c98ce0 0x556408d8ed90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556408d95610 msgr2=0x556408d97a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556408d95610 0x556408d97a00 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408d91580 msgr2=0x556408d93a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x556408d91580 0x556408d93a20 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef7c0346f0 msgr2=0x7fef7c036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fef7c0346f0 0x7fef7c036bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff07c001e50 tx=0x7ff07c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 msgr2=0x556408d87e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 --2- 172.21.15.151:0/523442699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556408c08290 0x556408d87e00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b7040 tx=0x7ff084017e30 comp rx=0 tx=0).stop 2024-09-13T19:07:05.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09536d640 1 -- 172.21.15.151:0/523442699 reap_dead start 2024-09-13T19:07:05.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 shutdown_connections 2024-09-13T19:07:05.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 >> 172.21.15.151:0/523442699 conn(0x556408c8e090 msgr2=0x556408d7b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 shutdown_connections 2024-09-13T19:07:05.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.350+0000 7ff09705c980 1 -- 172.21.15.151:0/523442699 wait complete. 2024-09-13T19:07:05.365 INFO:teuthology.orchestra.run.smithi151.stdout:[{"tag":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.2502004158533297994\u0000","time":"2024-09-13T19:07:05.083877+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_7","key":"","instance":""}]}] 2024-09-13T19:07:05.365 DEBUG:tasks.util.rgw: json result: [{'tag': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.2502004158533297994\x00', 'time': '2024-09-13T19:07:05.083877+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_7', 'key': '', 'instance': ''}]}] 2024-09-13T19:07:05.365 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-13T19:07:05.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-13T19:07:05.366 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-13T19:07:05.443 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:05.444 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:05.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d7293980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5634ba137460 0x5634ba13ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d7293980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5634b9fc0ae0 con 0x5634ba136880 2024-09-13T19:07:05.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d7293980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5634b9fe4e30 con 0x5634ba137460 2024-09-13T19:07:05.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d45a2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5634ba137460 0x5634ba13ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d4da3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5634ba136880 0x5634ba136c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39622/0 (socket says 172.21.15.151:39622) 2024-09-13T19:07:05.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d4da3640 1 -- 172.21.15.151:0/104382842 learned_addr learned my addr 172.21.15.151:0/104382842 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:05.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d45a2640 1 -- 172.21.15.151:0/104382842 >> v1:172.21.15.12:6789/0 conn(0x5634ba136880 legacy=0x5634ba136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.442+0000 7fa7d45a2640 1 -- 172.21.15.151:0/104382842 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba140240 con 0x5634ba137460 2024-09-13T19:07:05.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/104382842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba137460 0x5634ba13ebd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800a480 tx=0x7fa7c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0989519206aad27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d3da1640 1 -- 172.21.15.151:0/104382842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c80b0070 con 0x5634ba137460 2024-09-13T19:07:05.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d3da1640 1 -- 172.21.15.151:0/104382842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c80ab540 con 0x5634ba137460 2024-09-13T19:07:05.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d3da1640 1 -- 172.21.15.151:0/104382842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c80ab840 con 0x5634ba137460 2024-09-13T19:07:05.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 -- 172.21.15.151:0/104382842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba137460 msgr2=0x5634ba13ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 --2- 172.21.15.151:0/104382842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba137460 0x5634ba13ebd0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800a480 tx=0x7fa7c801b280 comp rx=0 tx=0).stop 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 -- 172.21.15.151:0/104382842 shutdown_connections 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 --2- 172.21.15.151:0/104382842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba137460 0x5634ba13ebd0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 -- 172.21.15.151:0/104382842 >> 172.21.15.151:0/104382842 conn(0x5634ba132790 msgr2=0x5634ba134bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 -- 172.21.15.151:0/104382842 shutdown_connections 2024-09-13T19:07:05.451 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.446+0000 7fa7d7293980 1 -- 172.21.15.151:0/104382842 wait complete. 2024-09-13T19:07:05.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d7293980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d7293980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5634b9fe6200 con 0x5634ba136880 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50782/0 (socket says 172.21.15.151:50782) 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d4da3640 1 -- 172.21.15.151:0/296726544 learned_addr learned my addr 172.21.15.151:0/296726544 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d4da3640 1 -- 172.21.15.151:0/296726544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba224030 con 0x5634ba136880 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/296726544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4001d90 tx=0x7fa7c4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff85f11e671e268e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa6c2e0d640 1 -- 172.21.15.151:0/296726544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c4013030 con 0x5634ba136880 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa6c2e0d640 1 -- 172.21.15.151:0/296726544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c400e690 con 0x5634ba136880 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.462+0000 7fa6c2e0d640 1 -- 172.21.15.151:0/296726544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c400ea10 con 0x5634ba136880 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/296726544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 msgr2=0x5634ba223a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 --2- 172.21.15.151:0/296726544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4001d90 tx=0x7fa7c4001e80 comp rx=0 tx=0).stop 2024-09-13T19:07:05.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/296726544 shutdown_connections 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 --2- 172.21.15.151:0/296726544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba223a60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/296726544 >> 172.21.15.151:0/296726544 conn(0x5634ba132790 msgr2=0x5634ba21f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/296726544 shutdown_connections 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/296726544 wait complete. 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba22ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5634ba13fd10 con 0x5634ba136880 2024-09-13T19:07:05.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba22ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba22ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50790/0 (socket says 172.21.15.151:50790) 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d4da3640 1 -- 172.21.15.151:0/3554083631 learned_addr learned my addr 172.21.15.151:0/3554083631 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d4da3640 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba22b350 con 0x5634ba136880 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba22ae10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x5634ba224c40 tx=0x7fa7c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa6c160a640 1 -- 172.21.15.151:0/3554083631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c4027070 con 0x5634ba136880 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa6c160a640 1 -- 172.21.15.151:0/3554083631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4019900 con 0x5634ba136880 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ba22b5e0 con 0x5634ba136880 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa6c160a640 1 -- 172.21.15.151:0/3554083631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c4019c20 con 0x5634ba136880 2024-09-13T19:07:05.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.466+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ba22e2c0 con 0x5634ba136880 2024-09-13T19:07:05.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa6c160a640 1 -- 172.21.15.151:0/3554083631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7c402a070 con 0x5634ba136880 2024-09-13T19:07:05.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa6c160a640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6bc034650 0x7fa6bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa6c160a640 1 -- 172.21.15.151:0/3554083631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa7c401f070 con 0x5634ba136880 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6bc034650 0x7fa6bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba137460 0x5634ba231de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba232430 con 0x5634ba137460 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba137460 0x5634ba231de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6bc034650 0x7fa6bc036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80ad000 tx=0x7fa7c80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba137460 0x5634ba231de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d55a4640 1 -- 172.21.15.151:0/3554083631 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba137460 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba22f4e0 con 0x5634ba137460 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d55a4640 1 -- 172.21.15.151:0/3554083631 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba137460 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba234780 0x5634ba236b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba237240 con 0x5634ba234780 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba234780 0x5634ba236b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba234780 0x5634ba236b70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d4da3640 1 -- 172.21.15.151:0/3554083631 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa7c4029030 con 0x5634ba234780 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba233620 con 0x5634ba137460 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d55a4640 1 -- 172.21.15.151:0/3554083631 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba137460 2024-09-13T19:07:05.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5634ba2386a0 0x5634ba23aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba23b190 con 0x5634ba2386a0 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5634ba2386a0 0x5634ba23aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.470+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5634ba2386a0 0x5634ba23aa90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d45a2640 1 -- 172.21.15.151:0/3554083631 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa7c80abd10 con 0x5634ba2386a0 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5634ba03f800 con 0x5634ba248c60 2024-09-13T19:07:05.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50796/0 (socket says 172.21.15.151:50796) 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d4da3640 1 -- 172.21.15.151:0/1665950709 learned_addr learned my addr 172.21.15.151:0/1665950709 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d4da3640 1 -- 172.21.15.151:0/1665950709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba2495c0 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4017fd0 tx=0x7fa7c400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 -- 172.21.15.151:0/1665950709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c403c070 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 -- 172.21.15.151:0/1665950709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c402aa40 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ba249850 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 -- 172.21.15.151:0/1665950709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c402b3b0 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ba24c4d0 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 -- 172.21.15.151:0/1665950709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7c404b020 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 0x7fa6ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa6ba7fc640 1 -- 172.21.15.151:0/1665950709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa7c4014070 con 0x5634ba248c60 2024-09-13T19:07:05.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.474+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 0x7fa6ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 0x7fa6ac036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5634ba232d30 tx=0x7fa7c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5634ba2243b0 con 0x5634ba2555b0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50804/0 (socket says 172.21.15.151:50804) 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 -- 172.21.15.151:0/3653636579 learned_addr learned my addr 172.21.15.151:0/3653636579 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 -- 172.21.15.151:0/3653636579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba255f60 con 0x5634ba2555b0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/3653636579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4021f20 tx=0x7fa7c402c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322264121726d9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa6abfff640 1 -- 172.21.15.151:0/3653636579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c405c020 con 0x5634ba2555b0 2024-09-13T19:07:05.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa6abfff640 1 -- 172.21.15.151:0/3653636579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c402ba70 con 0x5634ba2555b0 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa6abfff640 1 -- 172.21.15.151:0/3653636579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c402b550 con 0x5634ba2555b0 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- 172.21.15.151:0/3653636579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 msgr2=0x5634ba255990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3653636579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4021f20 tx=0x7fa7c402c570 comp rx=0 tx=0).stop 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- 172.21.15.151:0/3653636579 shutdown_connections 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3653636579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba255990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- 172.21.15.151:0/3653636579 >> 172.21.15.151:0/3653636579 conn(0x5634ba251990 msgr2=0x5634ba24fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- 172.21.15.151:0/3653636579 shutdown_connections 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- 172.21.15.151:0/3653636579 wait complete. 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 Processor -- start 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- start start 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba25c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d7293980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5634ba256400 con 0x5634ba2555b0 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba25c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba25c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50820/0 (socket says 172.21.15.151:50820) 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.478+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 learned_addr learned my addr 172.21.15.151:0/840933356 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ba25cd20 con 0x5634ba2555b0 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba25c7e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40484f0 tx=0x7fa7c4026fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 -- 172.21.15.151:0/840933356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c4071070 con 0x5634ba2555b0 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 -- 172.21.15.151:0/840933356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c40225f0 con 0x5634ba2555b0 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5634ba25cd20 con 0x5634ba2555b0 2024-09-13T19:07:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 -- 172.21.15.151:0/840933356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa7c4041450 con 0x5634ba2555b0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ba25cd20 con 0x5634ba2555b0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 -- 172.21.15.151:0/840933356 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa7c4074070 con 0x5634ba2555b0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6a00346a0 0x7fa6a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa6aa7fc640 1 -- 172.21.15.151:0/840933356 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa7c4068030 con 0x5634ba2555b0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6a00346a0 0x7fa6a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba267860 0x5634ba269d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26a470 con 0x5634ba267860 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba267860 0x5634ba269d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6a00346a0 0x7fa6a0036b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80c2010 tx=0x7fa7c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba267860 0x5634ba269d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.482+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 realm 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26a880 con 0x5634ba267860 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b120 con 0x5634ba267860 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba26c220 0x5634ba26e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26ec60 con 0x5634ba26c220 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba26c220 0x5634ba26e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba26c220 0x5634ba26e610 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:05.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 20 searching for the correct realm 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2704c0 con 0x5634ba26c220 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa7c4076060 0x7fa7c40588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2704c0 con 0x7fa7c4076060 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa7c4076060 0x7fa7c40588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa7c4076060 0x7fa7c40588c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2704c0 con 0x7fa7c4076060 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2704c0 con 0x5634ba267860 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa7cc016440 0x7fa7cc0168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.486+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa7cc016440 0x7fa7cc0168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa7cc016440 0x7fa7cc0168c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7c4076060 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.490+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7c4076060 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.494+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7c4076060 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7c4076060 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba26c220 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7cc016440 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x5634ba267860 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.498+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26b4c0 con 0x7fa7c4076060 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26f5b0 con 0x5634ba267860 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26f1c0 con 0x5634ba267860 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:05.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba26fe50 con 0x7fa7c4076060 2024-09-13T19:07:05.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:05.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 zone default found 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 4 Realm: () 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 zonegroup default 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba270920 con 0x7fa7cc016440 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba272300 con 0x5634ba26c220 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba272720 con 0x5634ba26c220 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 started sync module instance, tier type = 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.502+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2717a0 con 0x7fa7c4076060 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94784461413264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba273030 con 0x7fa7c4076060 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba273880 con 0x5634ba267860 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94784461413264] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94784461417344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba273880 con 0x5634ba267860 2024-09-13T19:07:05.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.506+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba274360 con 0x5634ba26c220 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94784461417344] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94784461422192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba274360 con 0x5634ba26c220 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2733d0 con 0x7fa7c4076060 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94784461426032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba275640 con 0x7fa7c4076060 2024-09-13T19:07:05.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba276000 con 0x5634ba267860 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94784461422192] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.510+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94784461426032] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94784461427088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2755b0 con 0x5634ba267860 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2764b0 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94784461427088] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94784461429584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba276420 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.514+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba276de0 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94784461429584] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94784461430912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba276de0 con 0x7fa7cc016440 2024-09-13T19:07:05.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2777a0 con 0x7fa7cc016440 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94784461435632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba277bc0 con 0x7fa7cc016440 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=0 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=1 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=2 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=3 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=4 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=5 2024-09-13T19:07:05.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94784461430912] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.518+0000 7fa7d7293980 20 add_watcher() i=6 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94784461435632] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 20 add_watcher() i=7 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba277bc0 con 0x5634ba267860 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94784461436688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba277b30 con 0x5634ba267860 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94784461436688] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.522+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba283570 con 0x5634ba267860 2024-09-13T19:07:05.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.526+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.526+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba283c40 con 0x7fa7cc016440 2024-09-13T19:07:05.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.526+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.526+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284060 con 0x5634ba26c220 2024-09-13T19:07:05.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284030 con 0x5634ba267860 2024-09-13T19:07:05.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv15 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2845a0 con 0x7fa7c4076060 2024-09-13T19:07:05.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.530+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284b10 con 0x5634ba26c220 2024-09-13T19:07:05.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.534+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.534+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284ba0 con 0x5634ba267860 2024-09-13T19:07:05.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.534+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.534+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284c30 con 0x7fa7cc016440 2024-09-13T19:07:05.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.538+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.538+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba284cc0 con 0x7fa7c4076060 2024-09-13T19:07:05.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.538+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.538+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285270 con 0x5634ba26c220 2024-09-13T19:07:05.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285270 con 0x7fa7c4076060 2024-09-13T19:07:05.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7cc016440 2024-09-13T19:07:05.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.542+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7c4076060 2024-09-13T19:07:05.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.546+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.546+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7cc016440 2024-09-13T19:07:05.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.546+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.546+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba267860 2024-09-13T19:07:05.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.550+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.550+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.550+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.550+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7c4076060 2024-09-13T19:07:05.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.554+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.554+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.554+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.554+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba267860 2024-09-13T19:07:05.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.558+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.558+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba267860 2024-09-13T19:07:05.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.558+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.558+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.558+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.562+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7c4076060 2024-09-13T19:07:05.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.562+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.562+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.562+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.562+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.566+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7cc016440 2024-09-13T19:07:05.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.570+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.570+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.570+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.570+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7cc016440 2024-09-13T19:07:05.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.574+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.574+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x5634ba26c220 2024-09-13T19:07:05.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.578+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.578+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7cc016440 2024-09-13T19:07:05.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.578+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'39 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.578+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba285720 con 0x7fa7c4076060 2024-09-13T19:07:05.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa689fe3640 20 reqs_thread_entry: start 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa7d7293980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa7d7293980 20 Filter name: none 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa5fb7fe640 20 reqs_thread_entry: start 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-13T19:07:05.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.582+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(94 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(95 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:96 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba280940 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(96 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(97 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(98 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.586+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(99 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-13T19:07:05.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:100 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(100 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:101 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(101 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:102 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(102 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:103 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(103 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:104 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(104 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.590+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:105 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(105 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:106 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(106 gc.10 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(107 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:108 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba280940 con 0x7fa7c4076060 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(108 gc.10 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:109 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(109 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:110 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(110 gc.10 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.594+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:111 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(111 gc.10 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-13T19:07:05.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:112 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(112 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:113 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(113 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.598+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:114 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(114 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:115 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(115 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:116 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(116 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.602+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:117 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(117 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-13T19:07:05.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:118 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(118 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:119 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(119 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:120 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(120 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:121 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(121 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.606+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:122 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(122 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:123 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(123 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-13T19:07:05.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.610+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:124 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(124 gc.13 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:125 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(125 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:126 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(126 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:127 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(127 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.614+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:128 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(128 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:129 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(129 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x7fa7cc016440 2024-09-13T19:07:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-13T19:07:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.618+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:130 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(130 gc.14 [call] v34'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:131 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(131 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:132 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(132 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:133 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(133 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:134 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(134 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.622+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:135 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(135 gc.14 [call] v34'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-13T19:07:05.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:136 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(136 gc.15 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:137 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(137 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.626+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:138 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(138 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(140 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(141 gc.15 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-13T19:07:05.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.630+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(142 gc.16 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(143 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(144 gc.16 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:145 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(145 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:146 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(146 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.634+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:147 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.640 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 43 ==== osd_op_reply(147 gc.16 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-13T19:07:05.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:148 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(148 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:149 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(149 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:150 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(150 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.638+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:151 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(151 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:152 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(152 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:153 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 44 ==== osd_op_reply(153 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-13T19:07:05.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.642+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:154 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(154 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:155 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(155 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:156 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(156 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:157 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(157 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc00a4d0 con 0x5634ba267860 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:158 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(158 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.646+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:159 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(159 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-13T19:07:05.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:160 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(160 gc.19 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:161 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(161 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.650+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:162 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(162 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:163 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(163 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:164 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(164 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:165 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba267860 2024-09-13T19:07:05.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(165 gc.19 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-13T19:07:05.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.654+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:166 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 45 ==== osd_op_reply(166 gc.20 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:167 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 46 ==== osd_op_reply(167 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:168 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 47 ==== osd_op_reply(168 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:169 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 48 ==== osd_op_reply(169 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:170 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 49 ==== osd_op_reply(170 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.658+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:171 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.662+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 50 ==== osd_op_reply(171 gc.20 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.662+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-13T19:07:05.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.662+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:172 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.662+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 44 ==== osd_op_reply(172 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.662+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:173 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 45 ==== osd_op_reply(173 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:174 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 46 ==== osd_op_reply(174 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:175 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 47 ==== osd_op_reply(175 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:176 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 48 ==== osd_op_reply(176 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:177 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7c4076060 2024-09-13T19:07:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 49 ==== osd_op_reply(177 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-13T19:07:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.666+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:178 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 51 ==== osd_op_reply(178 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:179 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 52 ==== osd_op_reply(179 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:180 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 53 ==== osd_op_reply(180 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:181 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 54 ==== osd_op_reply(181 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:182 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.670+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 55 ==== osd_op_reply(182 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:183 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 56 ==== osd_op_reply(183 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-13T19:07:05.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:184 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 57 ==== osd_op_reply(184 gc.23 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.674+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:185 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 58 ==== osd_op_reply(185 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:186 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 59 ==== osd_op_reply(186 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:187 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 60 ==== osd_op_reply(187 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:188 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 61 ==== osd_op_reply(188 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:189 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 62 ==== osd_op_reply(189 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-13T19:07:05.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.678+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:190 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 63 ==== osd_op_reply(190 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:191 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 64 ==== osd_op_reply(191 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:192 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 65 ==== osd_op_reply(192 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:193 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 66 ==== osd_op_reply(193 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:194 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 67 ==== osd_op_reply(194 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:195 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 68 ==== osd_op_reply(195 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.682+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:196 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 69 ==== osd_op_reply(196 gc.25 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:197 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 70 ==== osd_op_reply(197 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:198 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 71 ==== osd_op_reply(198 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:199 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 72 ==== osd_op_reply(199 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:200 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 73 ==== osd_op_reply(200 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.686+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:201 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.690+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 74 ==== osd_op_reply(201 gc.25 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.690+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-13T19:07:05.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.690+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:202 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.690+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== osd_op_reply(202 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.690+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:203 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(203 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:204 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(204 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:205 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(205 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:206 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(206 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.694+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:207 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.698+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(207 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.698+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-13T19:07:05.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.698+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:208 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.698+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 75 ==== osd_op_reply(208 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.698+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:209 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 76 ==== osd_op_reply(209 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:210 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 77 ==== osd_op_reply(210 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:211 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 78 ==== osd_op_reply(211 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:212 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 79 ==== osd_op_reply(212 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:213 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x5634ba26c220 2024-09-13T19:07:05.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 80 ==== osd_op_reply(213 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-13T19:07:05.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.702+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:214 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.706+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(214 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.706+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:215 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.706+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(215 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.706+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.706+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:216 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(216 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:217 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(217 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:218 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba281950 con 0x7fa7cc016440 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== osd_op_reply(218 gc.28 [call out=1701b] v0'0 uv34 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 20 garbage collection: RGWGC::process iterating over entry tag='56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.2502004158533297994', time=2024-09-13T19:07:05.083877+0000, chain.objs.size()=7 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_1 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:219 3.17s0 3:eb30bb3b:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2220 con 0x5634ba267860 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_2 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:220 3.22s0 3:47acd0cc:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a4d50 con 0x5634ba26c220 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_3 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:221 3.30s0 3:0e6157a7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a76d0 con 0x5634ba26c220 2024-09-13T19:07:05.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_4 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:222 3.19s0 3:9a7180e6:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2aa020 con 0x5634ba267860 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_5 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:223 3.1as0 3:5acff084:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a76d0 con 0x5634ba267860 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_6 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:224 3.30s0 3:0fbfbadf:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2af060 con 0x5634ba26c220 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_7 2024-09-13T19:07:05.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.710+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:225 3.9s0 3:92eceaf1:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.718+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(219 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.722+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(223 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.722+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(222 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.722+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 81 ==== osd_op_reply(225 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.722+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 82 ==== osd_op_reply(221 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_3 [call] v34'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.722+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 83 ==== osd_op_reply(224 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_6 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.726+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 84 ==== osd_op_reply(220 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1__shadow_.Dq-hiotj8A-m3azbwd6dnNQVnO0LVTE_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.726+0000 7fa7d7293980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:07:05.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.726+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:226 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2aefc0 con 0x7fa7cc016440 2024-09-13T19:07:05.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.730+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(226 gc.28 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.730+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:227 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2aefc0 con 0x7fa7cc016440 2024-09-13T19:07:05.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.730+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 47 ==== osd_op_reply(227 gc.28 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.730+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-13T19:07:05.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.730+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:228 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2aefc0 con 0x5634ba26c220 2024-09-13T19:07:05.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 85 ==== osd_op_reply(228 gc.29 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:229 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 86 ==== osd_op_reply(229 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:230 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 87 ==== osd_op_reply(230 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:231 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 88 ==== osd_op_reply(231 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:232 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 89 ==== osd_op_reply(232 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.734+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:233 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x5634ba26c220 2024-09-13T19:07:05.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.738+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 90 ==== osd_op_reply(233 gc.29 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.738+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-13T19:07:05.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.738+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:234 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2b1ca0 con 0x7fa7cc016440 2024-09-13T19:07:05.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 48 ==== osd_op_reply(234 gc.30 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:235 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 49 ==== osd_op_reply(235 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:236 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 50 ==== osd_op_reply(236 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:237 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 51 ==== osd_op_reply(237 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.742+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:238 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 52 ==== osd_op_reply(238 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:239 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 53 ==== osd_op_reply(239 gc.30 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-13T19:07:05.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.746+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:240 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 50 ==== osd_op_reply(240 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:241 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 51 ==== osd_op_reply(241 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:242 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 52 ==== osd_op_reply(242 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:243 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 53 ==== osd_op_reply(243 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:244 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 54 ==== osd_op_reply(244 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.750+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:245 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7c4076060 2024-09-13T19:07:05.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.754+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 55 ==== osd_op_reply(245 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.754+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-13T19:07:05.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.754+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:246 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 48 ==== osd_op_reply(246 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:247 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 49 ==== osd_op_reply(247 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:248 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 50 ==== osd_op_reply(248 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:249 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 51 ==== osd_op_reply(249 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:250 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 52 ==== osd_op_reply(250 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.758+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:251 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba267860 2024-09-13T19:07:05.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.762+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 53 ==== osd_op_reply(251 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.762+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-13T19:07:05.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.762+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:252 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 54 ==== osd_op_reply(252 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:253 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 55 ==== osd_op_reply(253 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:254 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a1210 con 0x7fa7cc016440 2024-09-13T19:07:05.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 56 ==== osd_op_reply(254 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:255 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.766+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 57 ==== osd_op_reply(255 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:256 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 58 ==== osd_op_reply(256 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:257 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x7fa7cc016440 2024-09-13T19:07:05.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 59 ==== osd_op_reply(257 gc.1 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-13T19:07:05.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.770+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:258 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba26c220 2024-09-13T19:07:05.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 91 ==== osd_op_reply(258 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:259 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a2610 con 0x5634ba26c220 2024-09-13T19:07:05.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 92 ==== osd_op_reply(259 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:260 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 93 ==== osd_op_reply(260 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.774+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:261 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 94 ==== osd_op_reply(261 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:262 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 95 ==== osd_op_reply(262 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:263 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 96 ==== osd_op_reply(263 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-13T19:07:05.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.778+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:264 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 54 ==== osd_op_reply(264 gc.3 [call] v34'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:265 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 55 ==== osd_op_reply(265 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:266 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 56 ==== osd_op_reply(266 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.782+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:267 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 57 ==== osd_op_reply(267 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:268 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 58 ==== osd_op_reply(268 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.786+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:269 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 59 ==== osd_op_reply(269 gc.3 [call] v34'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-13T19:07:05.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:270 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 56 ==== osd_op_reply(270 gc.4 [call] v34'54 uv54 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:271 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 57 ==== osd_op_reply(271 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.790+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:272 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 58 ==== osd_op_reply(272 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:273 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 59 ==== osd_op_reply(273 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:274 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 60 ==== osd_op_reply(274 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.794+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:275 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 61 ==== osd_op_reply(275 gc.4 [call] v34'55 uv55 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-13T19:07:05.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:276 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 97 ==== osd_op_reply(276 gc.5 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:277 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 98 ==== osd_op_reply(277 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.798+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:278 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 99 ==== osd_op_reply(278 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:279 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 100 ==== osd_op_reply(279 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:280 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 101 ==== osd_op_reply(280 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:281 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 102 ==== osd_op_reply(281 gc.5 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-13T19:07:05.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.802+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:282 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.806+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 60 ==== osd_op_reply(282 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.806+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:283 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.806+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 61 ==== osd_op_reply(283 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.806+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.806+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:284 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 62 ==== osd_op_reply(284 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:285 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 63 ==== osd_op_reply(285 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:286 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 64 ==== osd_op_reply(286 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.810+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:287 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.814+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 65 ==== osd_op_reply(287 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.814+0000 7fa7d7293980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-13T19:07:05.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.814+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:288 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.814+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 60 ==== osd_op_reply(288 gc.7 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.814+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:289 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 61 ==== osd_op_reply(289 gc.7 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:290 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 62 ==== osd_op_reply(290 gc.7 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:291 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 63 ==== osd_op_reply(291 gc.7 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:07:05.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:292 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 64 ==== osd_op_reply(292 gc.7 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:07:05.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.818+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:293 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7cc016440 2024-09-13T19:07:05.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.822+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 65 ==== osd_op_reply(293 gc.7 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.826+0000 7fa68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:05.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.826+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94784461436688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.826+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94784461436688] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.826+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94784461413264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x7fa7c4076060 2024-09-13T19:07:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94784461413264] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d7293980 20 remove_watcher() i=0 2024-09-13T19:07:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d7293980 2 removed watcher, disabling cache 2024-09-13T19:07:05.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94784461417344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba267860 2024-09-13T19:07:05.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94784461417344] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d7293980 20 remove_watcher() i=1 2024-09-13T19:07:05.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.830+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94784461422192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba2a25c0 con 0x5634ba26c220 2024-09-13T19:07:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d4da3640 1 -- 172.21.15.151:0/840933356 <== osd.3 v2:172.21.15.151:6800/3085220080 103 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94784461422192] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c4073030 con 0x5634ba26c220 2024-09-13T19:07:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d7293980 20 remove_watcher() i=2 2024-09-13T19:07:05.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94784461426032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba271b90 con 0x7fa7c4076060 2024-09-13T19:07:05.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d45a2640 1 -- 172.21.15.151:0/840933356 <== osd.2 v2:172.21.15.151:6808/3546065622 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94784461426032] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7c80d9070 con 0x7fa7c4076060 2024-09-13T19:07:05.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d7293980 20 remove_watcher() i=3 2024-09-13T19:07:05.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.834+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94784461427088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba272b80 con 0x5634ba267860 2024-09-13T19:07:05.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.838+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.1 v2:172.21.15.151:6816/4016279334 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94784461427088] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x5634ba267860 2024-09-13T19:07:05.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.838+0000 7fa7d7293980 20 remove_watcher() i=4 2024-09-13T19:07:05.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.838+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94784461429584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba273e70 con 0x7fa7cc016440 2024-09-13T19:07:05.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94784461429584] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d7293980 20 remove_watcher() i=5 2024-09-13T19:07:05.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94784461430912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba271b90 con 0x7fa7cc016440 2024-09-13T19:07:05.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94784461430912] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d7293980 20 remove_watcher() i=6 2024-09-13T19:07:05.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.842+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94784461435632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5634ba272b80 con 0x7fa7cc016440 2024-09-13T19:07:05.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 <== osd.0 v2:172.21.15.12:6800/3844244554 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94784461435632] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7cc050040 con 0x7fa7cc016440 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 20 remove_watcher() i=7 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa7cc016440 msgr2=0x7fa7cc0168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa7cc016440 0x7fa7cc0168c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba267860 msgr2=0x5634ba269d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba267860 0x5634ba269d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa7c4076060 msgr2=0x7fa7c40588c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa7c4076060 0x7fa7c40588c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba26c220 msgr2=0x5634ba26e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba26c220 0x5634ba26e610 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6a00346a0 msgr2=0x7fa6a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6a00346a0 0x7fa6a0036b60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80c2010 tx=0x7fa7c80a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 msgr2=0x5634ba25c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 --2- 172.21.15.151:0/840933356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba2555b0 0x5634ba25c7e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40484f0 tx=0x7fa7c4026fa0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 reap_dead start 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d55a4640 1 -- 172.21.15.151:0/840933356 reap_dead start 2024-09-13T19:07:05.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 shutdown_connections 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 >> 172.21.15.151:0/840933356 conn(0x5634ba251990 msgr2=0x5634ba24fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 shutdown_connections 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.846+0000 7fa7d7293980 1 -- 172.21.15.151:0/840933356 wait complete. 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 msgr2=0x7fa6ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 0x7fa6ac036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5634ba232d30 tx=0x7fa7c8005a10 comp rx=0 tx=0).stop 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 msgr2=0x5634ba249080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4017fd0 tx=0x7fa7c400c470 comp rx=0 tx=0).stop 2024-09-13T19:07:05.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 shutdown_connections 2024-09-13T19:07:05.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6ac034650 0x7fa6ac036b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/1665950709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba248c60 0x5634ba249080 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 >> 172.21.15.151:0/1665950709 conn(0x5634ba23ddb0 msgr2=0x5634ba240830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 shutdown_connections 2024-09-13T19:07:05.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/1665950709 wait complete. 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba137460 msgr2=0x5634ba231de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5634ba137460 0x5634ba231de0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5634ba2386a0 msgr2=0x5634ba23aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5634ba2386a0 0x5634ba23aa90 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba234780 msgr2=0x5634ba236b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5634ba234780 0x5634ba236b70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6bc034650 msgr2=0x7fa6bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa6bc034650 0x7fa6bc036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80ad000 tx=0x7fa7c80a5040 comp rx=0 tx=0).stop 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 msgr2=0x5634ba22ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 --2- 172.21.15.151:0/3554083631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5634ba136880 0x5634ba22ae10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x5634ba224c40 tx=0x7fa7c4000bd0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d55a4640 1 -- 172.21.15.151:0/3554083631 reap_dead start 2024-09-13T19:07:05.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 shutdown_connections 2024-09-13T19:07:05.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 >> 172.21.15.151:0/3554083631 conn(0x5634ba132790 msgr2=0x5634ba21e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 shutdown_connections 2024-09-13T19:07:05.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.850+0000 7fa7d7293980 1 -- 172.21.15.151:0/3554083631 wait complete. 2024-09-13T19:07:05.867 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-13T19:07:05.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-13T19:07:05.868 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-13T19:07:05.944 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:05.944 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6169ce980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561dcb0e3a50 0x561dcb0e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6169ce980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561dcaf67ae0 con 0x561dcb053b00 2024-09-13T19:07:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6169ce980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x561dcaf8be30 con 0x561dcb0e3a50 2024-09-13T19:07:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff613cdd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561dcb0e3a50 0x561dcb0e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6144de640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x561dcb053b00 0x561dcb0e2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39634/0 (socket says 172.21.15.151:39634) 2024-09-13T19:07:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff6144de640 1 -- 172.21.15.151:0/263725367 learned_addr learned my addr 172.21.15.151:0/263725367 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff613cdd640 1 -- 172.21.15.151:0/263725367 >> v1:172.21.15.12:6789/0 conn(0x561dcb053b00 legacy=0x561dcb0e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.942+0000 7ff613cdd640 1 -- 172.21.15.151:0/263725367 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb0e7390 con 0x561dcb0e3a50 2024-09-13T19:07:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff613cdd640 1 --2- 172.21.15.151:0/263725367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb0e3a50 0x561dcb0e5e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff60800a480 tx=0x7ff60801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8755eb7716564bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6134dc640 1 -- 172.21.15.151:0/263725367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6080b0070 con 0x561dcb0e3a50 2024-09-13T19:07:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6134dc640 1 -- 172.21.15.151:0/263725367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6080ab540 con 0x561dcb0e3a50 2024-09-13T19:07:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6134dc640 1 -- 172.21.15.151:0/263725367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6080ab840 con 0x561dcb0e3a50 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 -- 172.21.15.151:0/263725367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb0e3a50 msgr2=0x561dcb0e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 --2- 172.21.15.151:0/263725367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb0e3a50 0x561dcb0e5e40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff60800a480 tx=0x7ff60801b280 comp rx=0 tx=0).stop 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 -- 172.21.15.151:0/263725367 shutdown_connections 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 --2- 172.21.15.151:0/263725367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb0e3a50 0x561dcb0e5e40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 -- 172.21.15.151:0/263725367 >> 172.21.15.151:0/263725367 conn(0x561dcb0da060 msgr2=0x561dcb0dc480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 -- 172.21.15.151:0/263725367 shutdown_connections 2024-09-13T19:07:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.946+0000 7ff6169ce980 1 -- 172.21.15.151:0/263725367 wait complete. 2024-09-13T19:07:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6169ce980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6169ce980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcaf8d200 con 0x561dcb053b00 2024-09-13T19:07:05.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50828/0 (socket says 172.21.15.151:50828) 2024-09-13T19:07:05.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6144de640 1 -- 172.21.15.151:0/696995624 learned_addr learned my addr 172.21.15.151:0/696995624 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6144de640 1 -- 172.21.15.151:0/696995624 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb1cd220 con 0x561dcb053b00 2024-09-13T19:07:05.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.962+0000 7ff6144de640 1 --2- 172.21.15.151:0/696995624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff60c001d90 tx=0x7ff60c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c944d5d66755f272 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff50260c640 1 -- 172.21.15.151:0/696995624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c013030 con 0x561dcb053b00 2024-09-13T19:07:05.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff50260c640 1 -- 172.21.15.151:0/696995624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c00e690 con 0x561dcb053b00 2024-09-13T19:07:05.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff50260c640 1 -- 172.21.15.151:0/696995624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c00ea10 con 0x561dcb053b00 2024-09-13T19:07:05.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/696995624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 msgr2=0x561dcb1ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 --2- 172.21.15.151:0/696995624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff60c001d90 tx=0x7ff60c001e80 comp rx=0 tx=0).stop 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/696995624 shutdown_connections 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 --2- 172.21.15.151:0/696995624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1ccc50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/696995624 >> 172.21.15.151:0/696995624 conn(0x561dcb0da060 msgr2=0x561dcb1c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/696995624 shutdown_connections 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/696995624 wait complete. 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1d4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcb0e6e30 con 0x561dcb053b00 2024-09-13T19:07:05.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1d4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50834/0 (socket says 172.21.15.151:50834) 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6144de640 1 -- 172.21.15.151:0/3665686739 learned_addr learned my addr 172.21.15.151:0/3665686739 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6144de640 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb1d4540 con 0x561dcb053b00 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6144de640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1d4000 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x561dcb1cde30 tx=0x7ff60c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff500e09640 1 -- 172.21.15.151:0/3665686739 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c027070 con 0x561dcb053b00 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff500e09640 1 -- 172.21.15.151:0/3665686739 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c019900 con 0x561dcb053b00 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff500e09640 1 -- 172.21.15.151:0/3665686739 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c019c20 con 0x561dcb053b00 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcb1d47d0 con 0x561dcb053b00 2024-09-13T19:07:05.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.966+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcb1d74b0 con 0x561dcb053b00 2024-09-13T19:07:05.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff500e09640 1 -- 172.21.15.151:0/3665686739 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff60c02a070 con 0x561dcb053b00 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff500e09640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4fc034650 0x7ff4fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff500e09640 1 -- 172.21.15.151:0/3665686739 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff60c01f070 con 0x561dcb053b00 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4fc034650 0x7ff4fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb0e3a50 0x561dcb1daff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb1db630 con 0x561dcb0e3a50 2024-09-13T19:07:05.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb0e3a50 0x561dcb1daff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4fc034650 0x7ff4fc036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6080ad000 tx=0x7ff6080a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb0e3a50 0x561dcb1daff0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff614cdf640 1 -- 172.21.15.151:0/3665686739 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb0e3a50 2024-09-13T19:07:05.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb1d86d0 con 0x561dcb0e3a50 2024-09-13T19:07:05.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff614cdf640 1 -- 172.21.15.151:0/3665686739 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb0e3a50 2024-09-13T19:07:05.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb1dd960 0x561dcb1dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb1e0420 con 0x561dcb1dd960 2024-09-13T19:07:05.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6144de640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb1dd960 0x561dcb1dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.970+0000 7ff6144de640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb1dd960 0x561dcb1dfd50 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 -- 172.21.15.151:0/3665686739 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff60c029030 con 0x561dcb1dd960 2024-09-13T19:07:05.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb1dc800 con 0x561dcb0e3a50 2024-09-13T19:07:05.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff614cdf640 1 -- 172.21.15.151:0/3665686739 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb0e3a50 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcb1e1860 0x561dcb1e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb1e43e0 con 0x561dcb1e1860 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcb1e1860 0x561dcb1e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcb1e1860 0x561dcb1e3c50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff613cdd640 1 -- 172.21.15.151:0/3665686739 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6080b3040 con 0x561dcb1e1860 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6169ce980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcafe6800 con 0x561dcb1f1e90 2024-09-13T19:07:05.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50842/0 (socket says 172.21.15.151:50842) 2024-09-13T19:07:05.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 -- 172.21.15.151:0/3051341928 learned_addr learned my addr 172.21.15.151:0/3051341928 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 -- 172.21.15.151:0/3051341928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb1f27f0 con 0x561dcb1f1e90 2024-09-13T19:07:05.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.974+0000 7ff6144de640 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff60c017fd0 tx=0x7ff60c00c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 -- 172.21.15.151:0/3051341928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c03c070 con 0x561dcb1f1e90 2024-09-13T19:07:05.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 -- 172.21.15.151:0/3051341928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c02aa40 con 0x561dcb1f1e90 2024-09-13T19:07:05.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcb1f2a80 con 0x561dcb1f1e90 2024-09-13T19:07:05.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 -- 172.21.15.151:0/3051341928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c02b3b0 con 0x561dcb1f1e90 2024-09-13T19:07:05.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcb1f5700 con 0x561dcb1f1e90 2024-09-13T19:07:05.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 -- 172.21.15.151:0/3051341928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff60c04b020 con 0x561dcb1f1e90 2024-09-13T19:07:05.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 0x7ff4ec036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff4f9ffb640 1 -- 172.21.15.151:0/3051341928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff60c014070 con 0x561dcb1f1e90 2024-09-13T19:07:05.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 0x7ff4ec036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 0x7ff4ec036bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff60801b2c0 tx=0x7ff608005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6169ce980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcb1cd5a0 con 0x561dcb1fe7c0 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50852/0 (socket says 172.21.15.151:50852) 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6144de640 1 -- 172.21.15.151:0/166646145 learned_addr learned my addr 172.21.15.151:0/166646145 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.982+0000 7ff6144de640 1 -- 172.21.15.151:0/166646145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb1ff170 con 0x561dcb1fe7c0 2024-09-13T19:07:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 --2- 172.21.15.151:0/166646145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff60c005fd0 tx=0x7ff60c022bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd74bb217f94bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f37fe640 1 -- 172.21.15.151:0/166646145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c05c020 con 0x561dcb1fe7c0 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f37fe640 1 -- 172.21.15.151:0/166646145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c038aa0 con 0x561dcb1fe7c0 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f37fe640 1 -- 172.21.15.151:0/166646145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c02bbc0 con 0x561dcb1fe7c0 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/166646145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 msgr2=0x561dcb1feba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 --2- 172.21.15.151:0/166646145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff60c005fd0 tx=0x7ff60c022bc0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/166646145 shutdown_connections 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 --2- 172.21.15.151:0/166646145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb1feba0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/166646145 >> 172.21.15.151:0/166646145 conn(0x561dcb1faba0 msgr2=0x561dcb1f8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/166646145 shutdown_connections 2024-09-13T19:07:05.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/166646145 wait complete. 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 Processor -- start 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- start start 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcb1ff610 con 0x561dcb1fe7c0 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50854/0 (socket says 172.21.15.151:50854) 2024-09-13T19:07:05.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 learned_addr learned my addr 172.21.15.151:0/3380299434 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcb205e30 con 0x561dcb1fe7c0 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6144de640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff60c027f80 tx=0x7ff60c027ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f1ffb640 1 -- 172.21.15.151:0/3380299434 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c071070 con 0x561dcb1fe7c0 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f1ffb640 1 -- 172.21.15.151:0/3380299434 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c0481a0 con 0x561dcb1fe7c0 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcb205e30 con 0x561dcb1fe7c0 2024-09-13T19:07:05.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff4f1ffb640 1 -- 172.21.15.151:0/3380299434 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff60c022760 con 0x561dcb1fe7c0 2024-09-13T19:07:05.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.986+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcb205e30 con 0x561dcb1fe7c0 2024-09-13T19:07:05.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff4f1ffb640 1 -- 172.21.15.151:0/3380299434 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff60c074070 con 0x561dcb1fe7c0 2024-09-13T19:07:05.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff4f1ffb640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4e40346a0 0x7ff4e4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff4f1ffb640 1 -- 172.21.15.151:0/3380299434 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff60c069070 con 0x561dcb1fe7c0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4e40346a0 0x7ff4e4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb210940 0x561dcb212e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb213550 con 0x561dcb210940 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb210940 0x561dcb212e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4e40346a0 0x7ff4e4036b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6080abaa0 tx=0x7ff6080b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb210940 0x561dcb212e00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 realm 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2139b0 con 0x561dcb210940 2024-09-13T19:07:05.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb214250 con 0x561dcb210940 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb215350 0x561dcb217740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:05.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb217cc0 con 0x561dcb215350 2024-09-13T19:07:05.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6144de640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb215350 0x561dcb217740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:05.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.990+0000 7ff6144de640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb215350 0x561dcb217740 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6169ce980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6169ce980 20 searching for the correct realm 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb219520 con 0x561dcb215350 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6144de640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff60c076060 0x7ff60c058460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb219520 con 0x7ff60c076060 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff60c076060 0x7ff60c058460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff60c076060 0x7ff60c058460 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6080c9030 con 0x7ff60c076060 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb219520 con 0x7ff60c076060 2024-09-13T19:07:06.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6080c9030 con 0x7ff60c076060 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb219520 con 0x561dcb210940 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff604016440 0x7ff6040168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff604016440 0x7ff6040168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff604016440 0x7ff6040168c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.994+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff60c076060 2024-09-13T19:07:06.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff6080c9030 con 0x7ff60c076060 2024-09-13T19:07:06.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff60c076060 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff6080c9030 con 0x7ff60c076060 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:05.998+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff60c076060 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6080c9030 con 0x7ff60c076060 2024-09-13T19:07:06.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.002+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff60c076060 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb215350 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x561dcb210940 2024-09-13T19:07:06.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2145f0 con 0x7ff60c076060 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb218610 con 0x561dcb210940 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb218220 con 0x561dcb210940 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb218220 con 0x7ff60c076060 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 zone default found 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 4 Realm: () 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:06.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:06.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 zonegroup default 2024-09-13T19:07:06.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.006+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb219440 con 0x7ff604016440 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21b3b0 con 0x561dcb215350 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.017 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21b750 con 0x561dcb215350 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 started sync module instance, tier type = 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21a850 con 0x7ff60c076060 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94685962021872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21b010 con 0x7ff60c076060 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21c5c0 con 0x561dcb210940 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.010+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94685962021872] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94685962027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21c9e0 con 0x561dcb210940 2024-09-13T19:07:06.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21d270 con 0x561dcb215350 2024-09-13T19:07:06.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94685962027280] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94685962028336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21ce00 con 0x561dcb215350 2024-09-13T19:07:06.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.014+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21dc80 con 0x7ff60c076060 2024-09-13T19:07:06.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94685962033104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21e4d0 con 0x7ff60c076060 2024-09-13T19:07:06.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21eed0 con 0x561dcb210940 2024-09-13T19:07:06.021 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94685962028336] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.022 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94685962033104] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94685962029392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21e020 con 0x561dcb210940 2024-09-13T19:07:06.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.018+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21f770 con 0x7ff604016440 2024-09-13T19:07:06.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.022+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94685962029392] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.022+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.022+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94685962037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21e020 con 0x7ff604016440 2024-09-13T19:07:06.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.022+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21fd90 con 0x7ff604016440 2024-09-13T19:07:06.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.022+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94685962041568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb2201b0 con 0x7ff604016440 2024-09-13T19:07:06.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb220bf0 con 0x7ff604016440 2024-09-13T19:07:06.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94685962037728] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94685962041568] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94685962045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21fd00 con 0x7ff604016440 2024-09-13T19:07:06.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=0 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=1 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=2 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=3 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=4 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=5 2024-09-13T19:07:06.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.026+0000 7ff6169ce980 20 add_watcher() i=6 2024-09-13T19:07:06.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94685962045120] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 20 add_watcher() i=7 2024-09-13T19:07:06.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:06.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb223cf0 con 0x561dcb210940 2024-09-13T19:07:06.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94685962040000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb221170 con 0x561dcb210940 2024-09-13T19:07:06.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94685962040000] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff4ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:06.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:06.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.030+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22c100 con 0x561dcb210940 2024-09-13T19:07:06.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.034+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.034+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22c6c0 con 0x7ff604016440 2024-09-13T19:07:06.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.034+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.034+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22cc30 con 0x561dcb215350 2024-09-13T19:07:06.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.034+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22ccc0 con 0x561dcb210940 2024-09-13T19:07:06.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22d170 con 0x7ff60c076060 2024-09-13T19:07:06.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22a190 con 0x561dcb215350 2024-09-13T19:07:06.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.038+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22a190 con 0x561dcb210940 2024-09-13T19:07:06.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.042+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.042+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22a190 con 0x7ff604016440 2024-09-13T19:07:06.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.042+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.042+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22a280 con 0x7ff60c076060 2024-09-13T19:07:06.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.046+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.046+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22dea0 con 0x561dcb215350 2024-09-13T19:07:06.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.046+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.046+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22dea0 con 0x7ff60c076060 2024-09-13T19:07:06.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.050+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.050+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x7ff604016440 2024-09-13T19:07:06.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.050+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.050+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x7ff60c076060 2024-09-13T19:07:06.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.054+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.054+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x7ff604016440 2024-09-13T19:07:06.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.054+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'44 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.054+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x561dcb210940 2024-09-13T19:07:06.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x561dcb215350 2024-09-13T19:07:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x7ff60c076060 2024-09-13T19:07:06.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.058+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e350 con 0x561dcb215350 2024-09-13T19:07:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.062+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.062+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e520 con 0x561dcb210940 2024-09-13T19:07:06.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.062+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.062+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e520 con 0x561dcb210940 2024-09-13T19:07:06.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.066+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.066+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e520 con 0x561dcb215350 2024-09-13T19:07:06.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.066+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.066+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb22e520 con 0x7ff60c076060 2024-09-13T19:07:06.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.070+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.074+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.074+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.074+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.074+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x7ff604016440 2024-09-13T19:07:06.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.078+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.080 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.078+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.078+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.078+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x7ff604016440 2024-09-13T19:07:06.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.082+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.082+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x561dcb215350 2024-09-13T19:07:06.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.082+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.086 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.082+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x7ff604016440 2024-09-13T19:07:06.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'45 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb229a60 con 0x7ff60c076060 2024-09-13T19:07:06.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff4c97e2640 20 reqs_thread_entry: start 2024-09-13T19:07:06.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff6169ce980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:06.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff6169ce980 20 Filter name: none 2024-09-13T19:07:06.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff43affd640 20 reqs_thread_entry: start 2024-09-13T19:07:06.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.086+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb249f50 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb227f40 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb227a90 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb227a90 con 0x7ff604016440 2024-09-13T19:07:06.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb227a90 con 0x7ff604016440 2024-09-13T19:07:06.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.090+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228aa0 con 0x7ff604016440 2024-09-13T19:07:06.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228aa0 con 0x561dcb215350 2024-09-13T19:07:06.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228aa0 con 0x561dcb215350 2024-09-13T19:07:06.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228aa0 con 0x561dcb215350 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228aa0 con 0x561dcb210940 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv55 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv55 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.094+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.098+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.102+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.106+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.110+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.114+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.118+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.122+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.126+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.130+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.134+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb215350 2024-09-13T19:07:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff604016440 2024-09-13T19:07:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.138+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff4ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94685962040000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x561dcb210940 2024-09-13T19:07:06.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.142+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94685962040000] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.146+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94685962021872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb228f50 con 0x7ff60c076060 2024-09-13T19:07:06.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.146+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94685962021872] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.146+0000 7ff6169ce980 20 remove_watcher() i=0 2024-09-13T19:07:06.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.146+0000 7ff6169ce980 2 removed watcher, disabling cache 2024-09-13T19:07:06.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.146+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94685962027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21abf0 con 0x561dcb210940 2024-09-13T19:07:06.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94685962027280] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff6169ce980 20 remove_watcher() i=1 2024-09-13T19:07:06.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94685962028336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21c110 con 0x561dcb215350 2024-09-13T19:07:06.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff6144de640 1 -- 172.21.15.151:0/3380299434 <== osd.3 v2:172.21.15.151:6800/3085220080 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94685962028336] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c073030 con 0x561dcb215350 2024-09-13T19:07:06.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff6169ce980 20 remove_watcher() i=2 2024-09-13T19:07:06.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.150+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94685962033104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21abf0 con 0x7ff60c076060 2024-09-13T19:07:06.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff613cdd640 1 -- 172.21.15.151:0/3380299434 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94685962033104] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6080e5040 con 0x7ff60c076060 2024-09-13T19:07:06.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff6169ce980 20 remove_watcher() i=3 2024-09-13T19:07:06.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94685962029392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21abf0 con 0x561dcb210940 2024-09-13T19:07:06.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94685962029392] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x561dcb210940 2024-09-13T19:07:06.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff6169ce980 20 remove_watcher() i=4 2024-09-13T19:07:06.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.154+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94685962037728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21abf0 con 0x7ff604016440 2024-09-13T19:07:06.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94685962037728] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff6169ce980 20 remove_watcher() i=5 2024-09-13T19:07:06.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94685962041568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21e9e0 con 0x7ff604016440 2024-09-13T19:07:06.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94685962041568] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff6169ce980 20 remove_watcher() i=6 2024-09-13T19:07:06.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.158+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94685962045120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcb21abf0 con 0x7ff604016440 2024-09-13T19:07:06.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94685962045120] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60400a4d0 con 0x7ff604016440 2024-09-13T19:07:06.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 20 remove_watcher() i=7 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff604016440 msgr2=0x7ff6040168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff604016440 0x7ff6040168c0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb210940 msgr2=0x561dcb212e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb210940 0x561dcb212e00 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff60c076060 msgr2=0x7ff60c058460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff60c076060 0x7ff60c058460 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb215350 msgr2=0x561dcb217740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb215350 0x561dcb217740 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4e40346a0 msgr2=0x7ff4e4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4e40346a0 0x7ff4e4036b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff6080abaa0 tx=0x7ff6080b9040 comp rx=0 tx=0).stop 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 msgr2=0x561dcb2058f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff60c027f80 tx=0x7ff60c027ef0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff614cdf640 1 -- 172.21.15.151:0/3380299434 reap_dead start 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 shutdown_connections 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3380299434 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1fe7c0 0x561dcb2058f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 >> 172.21.15.151:0/3380299434 conn(0x561dcb1faba0 msgr2=0x561dcb1f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 shutdown_connections 2024-09-13T19:07:06.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3380299434 wait complete. 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 msgr2=0x7ff4ec036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 0x7ff4ec036bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff60801b2c0 tx=0x7ff608005a10 comp rx=0 tx=0).stop 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 msgr2=0x561dcb1f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff60c017fd0 tx=0x7ff60c00c470 comp rx=0 tx=0).stop 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 shutdown_connections 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4ec0346f0 0x7ff4ec036bb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3051341928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb1f1e90 0x561dcb1f22b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 >> 172.21.15.151:0/3051341928 conn(0x561dcb1e6fe0 msgr2=0x561dcb1e9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 shutdown_connections 2024-09-13T19:07:06.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3051341928 wait complete. 2024-09-13T19:07:06.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb0e3a50 msgr2=0x561dcb1daff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcb0e3a50 0x561dcb1daff0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcb1e1860 msgr2=0x561dcb1e3c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcb1e1860 0x561dcb1e3c50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb1dd960 msgr2=0x561dcb1dfd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.162+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcb1dd960 0x561dcb1dfd50 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4fc034650 msgr2=0x7ff4fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff4fc034650 0x7ff4fc036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6080ad000 tx=0x7ff6080a5040 comp rx=0 tx=0).stop 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 msgr2=0x561dcb1d4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 --2- 172.21.15.151:0/3665686739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcb053b00 0x561dcb1d4000 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x561dcb1cde30 tx=0x7ff60c000bd0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff614cdf640 1 -- 172.21.15.151:0/3665686739 reap_dead start 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 shutdown_connections 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 >> 172.21.15.151:0/3665686739 conn(0x561dcb0da060 msgr2=0x561dcb1c7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 shutdown_connections 2024-09-13T19:07:06.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.166+0000 7ff6169ce980 1 -- 172.21.15.151:0/3665686739 wait complete. 2024-09-13T19:07:06.182 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2024-09-13T19:07:06.183 DEBUG:tasks.util.rgw: json result: [] 2024-09-13T19:07:06.183 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:07:06.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:07:06.183 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:07:06.260 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:06.261 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:06.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0886cbe980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5595c81c4290 0x5595c82547a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0886cbe980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5595c80d7ae0 con 0x5595c8254ce0 2024-09-13T19:07:06.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0886cbe980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5595c80fbe30 con 0x5595c81c4290 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f08847ce640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5595c81c4290 0x5595c82547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f08847ce640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5595c81c4290 0x5595c82547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50866/0 (socket says 172.21.15.151:50866) 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f08847ce640 1 -- 172.21.15.151:0/344291125 learned_addr learned my addr 172.21.15.151:0/344291125 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f0883fcd640 1 --1- 172.21.15.151:0/344291125 >> v1:172.21.15.12:6789/0 conn(0x5595c8254ce0 0x5595c82570d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39640/0 (socket says 172.21.15.151:39640) 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f08847ce640 1 -- 172.21.15.151:0/344291125 >> v1:172.21.15.12:6789/0 conn(0x5595c8254ce0 legacy=0x5595c82570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.258+0000 7f08847ce640 1 -- 172.21.15.151:0/344291125 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c81c4670 con 0x5595c81c4290 2024-09-13T19:07:06.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f08847ce640 1 --2- 172.21.15.151:0/344291125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c82547a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f087400a4e0 tx=0x7f087401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acc8b656a77a62b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f08837cc640 1 -- 172.21.15.151:0/344291125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740aa540 con 0x5595c81c4290 2024-09-13T19:07:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f08837cc640 1 -- 172.21.15.151:0/344291125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740aa6e0 con 0x5595c81c4290 2024-09-13T19:07:06.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f08837cc640 1 -- 172.21.15.151:0/344291125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740aaa40 con 0x5595c81c4290 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 -- 172.21.15.151:0/344291125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 msgr2=0x5595c82547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 --2- 172.21.15.151:0/344291125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c82547a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f087400a4e0 tx=0x7f087401b090 comp rx=0 tx=0).stop 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 -- 172.21.15.151:0/344291125 shutdown_connections 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 --2- 172.21.15.151:0/344291125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c82547a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 -- 172.21.15.151:0/344291125 >> 172.21.15.151:0/344291125 conn(0x5595c824a090 msgr2=0x5595c824c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 -- 172.21.15.151:0/344291125 shutdown_connections 2024-09-13T19:07:06.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.262+0000 7f0886cbe980 1 -- 172.21.15.151:0/344291125 wait complete. 2024-09-13T19:07:06.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f0886cbe980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f0886cbe980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595c80fd200 con 0x5595c81c4290 2024-09-13T19:07:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50882/0 (socket says 172.21.15.151:50882) 2024-09-13T19:07:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f08847ce640 1 -- 172.21.15.151:0/4033966943 learned_addr learned my addr 172.21.15.151:0/4033966943 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f08847ce640 1 -- 172.21.15.151:0/4033966943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c833d240 con 0x5595c81c4290 2024-09-13T19:07:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.278+0000 7f08847ce640 1 --2- 172.21.15.151:0/4033966943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0874017ca0 tx=0x7f08740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdc6edefa74d9c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f077260c640 1 -- 172.21.15.151:0/4033966943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740b9030 con 0x5595c81c4290 2024-09-13T19:07:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f077260c640 1 -- 172.21.15.151:0/4033966943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740aaa90 con 0x5595c81c4290 2024-09-13T19:07:06.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f077260c640 1 -- 172.21.15.151:0/4033966943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740aad70 con 0x5595c81c4290 2024-09-13T19:07:06.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/4033966943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 msgr2=0x5595c833cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4033966943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0874017ca0 tx=0x7f08740033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/4033966943 shutdown_connections 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4033966943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c833cc70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/4033966943 >> 172.21.15.151:0/4033966943 conn(0x5595c824a090 msgr2=0x5595c83388a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/4033966943 shutdown_connections 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/4033966943 wait complete. 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c8343dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595c825b220 con 0x5595c81c4290 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c8343dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c8343dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50886/0 (socket says 172.21.15.151:50886) 2024-09-13T19:07:06.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f08847ce640 1 -- 172.21.15.151:0/3007316735 learned_addr learned my addr 172.21.15.151:0/3007316735 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f08847ce640 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c8344310 con 0x5595c81c4290 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f08847ce640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c8343dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0874017ca0 tx=0x7f0874017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0770e09640 1 -- 172.21.15.151:0/3007316735 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740b9070 con 0x5595c81c4290 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c83445a0 con 0x5595c81c4290 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0770e09640 1 -- 172.21.15.151:0/3007316735 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740c2030 con 0x5595c81c4290 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0770e09640 1 -- 172.21.15.151:0/3007316735 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740be740 con 0x5595c81c4290 2024-09-13T19:07:06.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.282+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c8347230 con 0x5595c81c4290 2024-09-13T19:07:06.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0770e09640 1 -- 172.21.15.151:0/3007316735 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08740b3040 con 0x5595c81c4290 2024-09-13T19:07:06.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0770e09640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f076c034650 0x7f076c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0770e09640 1 -- 172.21.15.151:0/3007316735 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f08740ba070 con 0x5595c81c4290 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0883fcd640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f076c034650 0x7f076c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8254ce0 0x5595c834ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c834b400 con 0x5595c8254ce0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0884fcf640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8254ce0 0x5595c834ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0883fcd640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f076c034650 0x7f076c036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0878000f70 tx=0x7f0878001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0884fcf640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8254ce0 0x5595c834ae80 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0884fcf640 1 -- 172.21.15.151:0/3007316735 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8254ce0 2024-09-13T19:07:06.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8348450 con 0x5595c8254ce0 2024-09-13T19:07:06.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0884fcf640 1 -- 172.21.15.151:0/3007316735 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8254ce0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c834d730 0x5595c834fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8350210 con 0x5595c834d730 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f08847ce640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c834d730 0x5595c834fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f08847ce640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c834d730 0x5595c834fb20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f08847ce640 1 -- 172.21.15.151:0/3007316735 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08740ce070 con 0x5595c834d730 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c834c5d0 con 0x5595c8254ce0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0884fcf640 1 -- 172.21.15.151:0/3007316735 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8254ce0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5595c8351670 0x5595c8353a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c83541a0 con 0x5595c8351670 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.286+0000 7f0883fcd640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5595c8351670 0x5595c8353a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0883fcd640 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5595c8351670 0x5595c8353a60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0883fcd640 1 -- 172.21.15.151:0/3007316735 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f087800f6a0 con 0x5595c8351670 2024-09-13T19:07:06.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595c8156800 con 0x5595c8361c70 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50896/0 (socket says 172.21.15.151:50896) 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f08847ce640 1 -- 172.21.15.151:0/2106637895 learned_addr learned my addr 172.21.15.151:0/2106637895 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f08847ce640 1 -- 172.21.15.151:0/2106637895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c83625d0 con 0x5595c8361c70 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f08847ce640 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f08740e34b0 tx=0x7f08740bc670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0769ffb640 1 -- 172.21.15.151:0/2106637895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740b6dc0 con 0x5595c8361c70 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c8362860 con 0x5595c8361c70 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0769ffb640 1 -- 172.21.15.151:0/2106637895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740b5e50 con 0x5595c8361c70 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0769ffb640 1 -- 172.21.15.151:0/2106637895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740beae0 con 0x5595c8361c70 2024-09-13T19:07:06.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.290+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c83654e0 con 0x5595c8361c70 2024-09-13T19:07:06.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0769ffb640 1 -- 172.21.15.151:0/2106637895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f08740bec80 con 0x5595c8361c70 2024-09-13T19:07:06.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0769ffb640 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 0x7f075c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0769ffb640 1 -- 172.21.15.151:0/2106637895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f08740e9d90 con 0x5595c8361c70 2024-09-13T19:07:06.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0883fcd640 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 0x7f075c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0883fcd640 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 0x7f075c036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5595c834b8b0 tx=0x7f087800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595c833d500 con 0x5595c836e620 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50902/0 (socket says 172.21.15.151:50902) 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 -- 172.21.15.151:0/1908105654 learned_addr learned my addr 172.21.15.151:0/1908105654 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 -- 172.21.15.151:0/1908105654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c836eff0 con 0x5595c836e620 2024-09-13T19:07:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 --2- 172.21.15.151:0/1908105654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f08740bc010 tx=0x7f08740c9450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85758bbf3a7f76a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f07637fe640 1 -- 172.21.15.151:0/1908105654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740fc070 con 0x5595c836e620 2024-09-13T19:07:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f07637fe640 1 -- 172.21.15.151:0/1908105654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740c9580 con 0x5595c836e620 2024-09-13T19:07:06.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f07637fe640 1 -- 172.21.15.151:0/1908105654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740f3040 con 0x5595c836e620 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- 172.21.15.151:0/1908105654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 msgr2=0x5595c836ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 --2- 172.21.15.151:0/1908105654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f08740bc010 tx=0x7f08740c9450 comp rx=0 tx=0).stop 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- 172.21.15.151:0/1908105654 shutdown_connections 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 --2- 172.21.15.151:0/1908105654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c836ea20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- 172.21.15.151:0/1908105654 >> 172.21.15.151:0/1908105654 conn(0x5595c836a9a0 msgr2=0x5595c8368aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- 172.21.15.151:0/1908105654 shutdown_connections 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- 172.21.15.151:0/1908105654 wait complete. 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 Processor -- start 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- start start 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f0886cbe980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595c836f3b0 con 0x5595c836e620 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50908/0 (socket says 172.21.15.151:50908) 2024-09-13T19:07:06.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.294+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 learned_addr learned my addr 172.21.15.151:0/4164406001 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c8375c70 con 0x5595c836e620 2024-09-13T19:07:06.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f08847ce640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08740defd0 tx=0x7f08740e0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 -- 172.21.15.151:0/4164406001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740fc070 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 -- 172.21.15.151:0/4164406001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08740fd040 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595c8375c70 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 -- 172.21.15.151:0/4164406001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08740e3b90 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c8375c70 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 -- 172.21.15.151:0/4164406001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0874108020 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0754034650 0x7f0754036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0761ffb640 1 -- 172.21.15.151:0/4164406001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0874106020 con 0x5595c836e620 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0883fcd640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0754034650 0x7f0754036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8380830 0x5595c8382cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8383440 con 0x5595c8380830 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0884fcf640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8380830 0x5595c8382cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0883fcd640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0754034650 0x7f0754036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f087800c010 tx=0x7f0878010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0884fcf640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8380830 0x5595c8382cf0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 20 realm 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8383850 con 0x5595c8380830 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.298+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8384120 con 0x5595c8380830 2024-09-13T19:07:06.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c8385220 0x5595c8387610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8387be0 con 0x5595c8385220 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c8385220 0x5595c8387610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c8385220 0x5595c8387610 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 20 searching for the correct realm 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83894b0 con 0x5595c8385220 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f08740f7bf0 0x7f08740c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83894b0 con 0x7f08740f7bf0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f08740f7bf0 0x7f08740c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f08740f7bf0 0x7f08740c7690 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83894b0 con 0x7f08740f7bf0 2024-09-13T19:07:06.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83894b0 con 0x5595c8380830 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f087c018410 0x7f087c018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.302+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f087c018410 0x7f087c018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f087c018410 0x7f087c018890 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x7f087c018410 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x7f087c018410 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x7f087c018410 2024-09-13T19:07:06.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.306+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x7f087c018410 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x7f087c018410 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.310+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c0083f0 con 0x5595c8380830 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8385220 2024-09-13T19:07:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x7f087c018410 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5595c83844c0 con 0x5595c8380830 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.314+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f087c03b040 con 0x7f08740f7bf0 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c83884a0 con 0x5595c8380830 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8388890 con 0x5595c8380830 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8388890 con 0x7f08740f7bf0 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 zone default found 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 4 Realm: () 2024-09-13T19:07:06.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 zonegroup default 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8389160 con 0x7f087c018410 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c838b2c0 con 0x5595c8385220 2024-09-13T19:07:06.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c838b660 con 0x5595c8385220 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 started sync module instance, tier type = 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.318+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838a760 con 0x7f08740f7bf0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94101797645136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838a3c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838c360 con 0x5595c8380830 2024-09-13T19:07:06.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94101797645136] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94101797649168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838c4a0 con 0x5595c8380830 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.322+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838cfc0 con 0x5595c8385220 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94101797649168] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94101797653136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838d3b0 con 0x5595c8385220 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838dd70 con 0x7f08740f7bf0 2024-09-13T19:07:06.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94101797658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838ea30 con 0x7f08740f7bf0 2024-09-13T19:07:06.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838f3f0 con 0x5595c8380830 2024-09-13T19:07:06.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94101797653136] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.326+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94101797658976] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94101797650224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838e690 con 0x5595c8380830 2024-09-13T19:07:06.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838f3f0 con 0x7f087c018410 2024-09-13T19:07:06.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94101797665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838f3f0 con 0x7f087c018410 2024-09-13T19:07:06.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390a50 con 0x7f087c018410 2024-09-13T19:07:06.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.330+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94101797650224] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94101797665280] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94101797662528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838f360 con 0x7f087c018410 2024-09-13T19:07:06.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390f00 con 0x7f087c018410 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94101797669456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8391320 con 0x7f087c018410 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=0 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=1 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=2 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=3 2024-09-13T19:07:06.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=4 2024-09-13T19:07:06.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=5 2024-09-13T19:07:06.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94101797662528] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.334+0000 7f0886cbe980 20 add_watcher() i=6 2024-09-13T19:07:06.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94101797669456] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 20 add_watcher() i=7 2024-09-13T19:07:06.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:06.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c8391320 con 0x5595c8380830 2024-09-13T19:07:06.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94101797670512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8391290 con 0x5595c8380830 2024-09-13T19:07:06.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94101797670512] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f073a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:06.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:06.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.338+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ccb0 con 0x5595c8380830 2024-09-13T19:07:06.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.342+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.342+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839d300 con 0x7f087c018410 2024-09-13T19:07:06.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.342+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.342+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839d760 con 0x5595c8385220 2024-09-13T19:07:06.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839d710 con 0x5595c8380830 2024-09-13T19:07:06.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839dcc0 con 0x7f08740f7bf0 2024-09-13T19:07:06.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.346+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e0e0 con 0x5595c8385220 2024-09-13T19:07:06.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.350+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.350+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e0e0 con 0x5595c8380830 2024-09-13T19:07:06.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.350+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.350+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e0e0 con 0x7f087c018410 2024-09-13T19:07:06.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.354+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.354+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e210 con 0x7f08740f7bf0 2024-09-13T19:07:06.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.354+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.354+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e8c0 con 0x5595c8385220 2024-09-13T19:07:06.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.358+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.358+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839e8c0 con 0x7f08740f7bf0 2024-09-13T19:07:06.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.358+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.358+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f087c018410 2024-09-13T19:07:06.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.362+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.362+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f08740f7bf0 2024-09-13T19:07:06.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.362+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.362+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f087c018410 2024-09-13T19:07:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.366+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'46 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.366+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8380830 2024-09-13T19:07:06.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.366+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.366+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.370+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.370+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f08740f7bf0 2024-09-13T19:07:06.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.370+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.370+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.370+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.374+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8380830 2024-09-13T19:07:06.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.374+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.374+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8380830 2024-09-13T19:07:06.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.374+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.374+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.378+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.378+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f08740f7bf0 2024-09-13T19:07:06.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.378+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.378+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.382+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.382+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.382+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.387 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.382+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.386+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.386+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.386+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.386+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f087c018410 2024-09-13T19:07:06.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.390+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.390+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.390+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.390+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f087c018410 2024-09-13T19:07:06.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.394+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.394+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x5595c8385220 2024-09-13T19:07:06.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.394+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.394+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f087c018410 2024-09-13T19:07:06.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.398+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'47 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.398+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c839ed70 con 0x7f08740f7bf0 2024-09-13T19:07:06.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f07397e2640 20 reqs_thread_entry: start 2024-09-13T19:07:06.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:06.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 20 Filter name: none 2024-09-13T19:07:06.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f06aaffd640 20 reqs_thread_entry: start 2024-09-13T19:07:06.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:07:06.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c839af60 con 0x5595c8380830 2024-09-13T19:07:06.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5595c839aa40 con 0x7f08740f7bf0 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv28 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f073a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.402+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94101797670512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c83968a0 con 0x5595c8380830 2024-09-13T19:07:06.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94101797670512] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94101797645136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390e70 con 0x7f08740f7bf0 2024-09-13T19:07:06.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94101797645136] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0886cbe980 20 remove_watcher() i=0 2024-09-13T19:07:06.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0886cbe980 2 removed watcher, disabling cache 2024-09-13T19:07:06.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.406+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94101797649168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390e70 con 0x5595c8380830 2024-09-13T19:07:06.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94101797649168] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f0886cbe980 20 remove_watcher() i=1 2024-09-13T19:07:06.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94101797653136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838bb10 con 0x5595c8385220 2024-09-13T19:07:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f08847ce640 1 -- 172.21.15.151:0/4164406001 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94101797653136] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08740ff070 con 0x5595c8385220 2024-09-13T19:07:06.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f0886cbe980 20 remove_watcher() i=2 2024-09-13T19:07:06.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.410+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94101797658976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390e70 con 0x7f08740f7bf0 2024-09-13T19:07:06.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0883fcd640 1 -- 172.21.15.151:0/4164406001 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94101797658976] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0878037040 con 0x7f08740f7bf0 2024-09-13T19:07:06.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0886cbe980 20 remove_watcher() i=3 2024-09-13T19:07:06.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94101797650224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838ca90 con 0x5595c8380830 2024-09-13T19:07:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94101797650224] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x5595c8380830 2024-09-13T19:07:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0886cbe980 20 remove_watcher() i=4 2024-09-13T19:07:06.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.414+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94101797665280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838e160 con 0x7f087c018410 2024-09-13T19:07:06.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94101797665280] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0886cbe980 20 remove_watcher() i=5 2024-09-13T19:07:06.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94101797662528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c8390e70 con 0x7f087c018410 2024-09-13T19:07:06.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94101797662528] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.423 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0886cbe980 20 remove_watcher() i=6 2024-09-13T19:07:06.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.418+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94101797669456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5595c838ca90 con 0x7f087c018410 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94101797669456] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f087c036040 con 0x7f087c018410 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 20 remove_watcher() i=7 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f087c018410 msgr2=0x7f087c018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f087c018410 0x7f087c018890 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8380830 msgr2=0x5595c8382cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8380830 0x5595c8382cf0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f08740f7bf0 msgr2=0x7f08740c7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f08740f7bf0 0x7f08740c7690 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c8385220 msgr2=0x5595c8387610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c8385220 0x5595c8387610 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0754034650 msgr2=0x7f0754036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0754034650 0x7f0754036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f087800c010 tx=0x7f0878010000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 msgr2=0x5595c8375730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0884fcf640 1 -- 172.21.15.151:0/4164406001 reap_dead start 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08740defd0 tx=0x7f08740e0f00 comp rx=0 tx=0).stop 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 shutdown_connections 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/4164406001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c836e620 0x5595c8375730 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 >> 172.21.15.151:0/4164406001 conn(0x5595c836a9a0 msgr2=0x5595c8368a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 shutdown_connections 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/4164406001 wait complete. 2024-09-13T19:07:06.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 msgr2=0x7f075c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 0x7f075c036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5595c834b8b0 tx=0x7f087800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 msgr2=0x5595c8362090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f08740e34b0 tx=0x7f08740bc670 comp rx=0 tx=0).stop 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 shutdown_connections 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f075c034650 0x7f075c036b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/2106637895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c8361c70 0x5595c8362090 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 >> 172.21.15.151:0/2106637895 conn(0x5595c8356dc0 msgr2=0x5595c8359840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 shutdown_connections 2024-09-13T19:07:06.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/2106637895 wait complete. 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8254ce0 msgr2=0x5595c834ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5595c8254ce0 0x5595c834ae80 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5595c8351670 msgr2=0x5595c8353a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5595c8351670 0x5595c8353a60 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c834d730 msgr2=0x5595c834fb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5595c834d730 0x5595c834fb20 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f076c034650 msgr2=0x7f076c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f076c034650 0x7f076c036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0878000f70 tx=0x7f0878001380 comp rx=0 tx=0).stop 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 msgr2=0x5595c8343dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 --2- 172.21.15.151:0/3007316735 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5595c81c4290 0x5595c8343dd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0874017ca0 tx=0x7f0874017e30 comp rx=0 tx=0).stop 2024-09-13T19:07:06.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0884fcf640 1 -- 172.21.15.151:0/3007316735 reap_dead start 2024-09-13T19:07:06.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 shutdown_connections 2024-09-13T19:07:06.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.422+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 >> 172.21.15.151:0/3007316735 conn(0x5595c824a090 msgr2=0x5595c8337420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.426+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 shutdown_connections 2024-09-13T19:07:06.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.426+0000 7f0886cbe980 1 -- 172.21.15.151:0/3007316735 wait complete. 2024-09-13T19:07:06.439 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:07:06.454 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-13T19:07:06.460 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:06.519 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:06.544 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:06.589 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:07:06.600 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:06.600 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:07:06.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:07:06.601 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:07:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:06.640 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:06.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86073d7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56168d5c18f0 0x56168d5c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86073d7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56168d447ae0 con 0x56168d5c2240 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86073d7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56168d46be30 con 0x56168d5c18f0 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f8604ee7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56168d5c18f0 0x56168d5c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86046e6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x56168d5c2240 0x56168d5c6c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39646/0 (socket says 172.21.15.151:39646) 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f8604ee7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56168d5c18f0 0x56168d5c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50922/0 (socket says 172.21.15.151:50922) 2024-09-13T19:07:06.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f86046e6640 1 -- 172.21.15.151:0/3025106844 learned_addr learned my addr 172.21.15.151:0/3025106844 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f8604ee7640 1 -- 172.21.15.151:0/3025106844 >> v1:172.21.15.12:6789/0 conn(0x56168d5c2240 legacy=0x56168d5c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.638+0000 7f8604ee7640 1 -- 172.21.15.151:0/3025106844 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d5c94c0 con 0x56168d5c18f0 2024-09-13T19:07:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f8604ee7640 1 --2- 172.21.15.151:0/3025106844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d5c1cd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a420 tx=0x7f85fc01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3327ce7229f7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f8603ee5640 1 -- 172.21.15.151:0/3025106844 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0af070 con 0x56168d5c18f0 2024-09-13T19:07:06.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f8603ee5640 1 -- 172.21.15.151:0/3025106844 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0aa530 con 0x56168d5c18f0 2024-09-13T19:07:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f8603ee5640 1 -- 172.21.15.151:0/3025106844 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0aa850 con 0x56168d5c18f0 2024-09-13T19:07:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 -- 172.21.15.151:0/3025106844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 msgr2=0x56168d5c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 --2- 172.21.15.151:0/3025106844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d5c1cd0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a420 tx=0x7f85fc01afd0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 -- 172.21.15.151:0/3025106844 shutdown_connections 2024-09-13T19:07:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 --2- 172.21.15.151:0/3025106844 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d5c1cd0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 -- 172.21.15.151:0/3025106844 >> 172.21.15.151:0/3025106844 conn(0x56168d535240 msgr2=0x56168d535650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 -- 172.21.15.151:0/3025106844 shutdown_connections 2024-09-13T19:07:06.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.642+0000 7f86073d7980 1 -- 172.21.15.151:0/3025106844 wait complete. 2024-09-13T19:07:06.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.658+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.658+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.658+0000 7f86073d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.658+0000 7f86073d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56168d46d200 con 0x56168d5c18f0 2024-09-13T19:07:06.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50938/0 (socket says 172.21.15.151:50938) 2024-09-13T19:07:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 -- 172.21.15.151:0/2054166053 learned_addr learned my addr 172.21.15.151:0/2054166053 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 -- 172.21.15.151:0/2054166053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d6ad210 con 0x56168d5c18f0 2024-09-13T19:07:06.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 --2- 172.21.15.151:0/2054166053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a420 tx=0x7f85fc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecacab1cc5860c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f84f2e0d640 1 -- 172.21.15.151:0/2054166053 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0af050 con 0x56168d5c18f0 2024-09-13T19:07:06.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f84f2e0d640 1 -- 172.21.15.151:0/2054166053 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0b0040 con 0x56168d5c18f0 2024-09-13T19:07:06.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f84f2e0d640 1 -- 172.21.15.151:0/2054166053 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0aac60 con 0x56168d5c18f0 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- 172.21.15.151:0/2054166053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 msgr2=0x56168d6acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 --2- 172.21.15.151:0/2054166053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00a420 tx=0x7f85fc0033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- 172.21.15.151:0/2054166053 shutdown_connections 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 --2- 172.21.15.151:0/2054166053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6acc40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- 172.21.15.151:0/2054166053 >> 172.21.15.151:0/2054166053 conn(0x56168d535240 msgr2=0x56168d6a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- 172.21.15.151:0/2054166053 shutdown_connections 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- 172.21.15.151:0/2054166053 wait complete. 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f86073d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56168d5c8f00 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50950/0 (socket says 172.21.15.151:50950) 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.662+0000 7f8604ee7640 1 -- 172.21.15.151:0/112418052 learned_addr learned my addr 172.21.15.151:0/112418052 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f8604ee7640 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d6b4490 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f8604ee7640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6b3f50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b8040 tx=0x7f85fc019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 -- 172.21.15.151:0/112418052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0c5070 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 -- 172.21.15.151:0/112418052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0c15d0 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56168d6b4720 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 -- 172.21.15.151:0/112418052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0cf060 con 0x56168d5c18f0 2024-09-13T19:07:06.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168d6b7400 con 0x56168d5c18f0 2024-09-13T19:07:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 -- 172.21.15.151:0/112418052 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f85fc0c8070 con 0x56168d5c18f0 2024-09-13T19:07:06.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84ec034650 0x7f84ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f84f160a640 1 -- 172.21.15.151:0/112418052 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f85fc0bb070 con 0x56168d5c18f0 2024-09-13T19:07:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86046e6640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84ec034650 0x7f84ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d5c2240 0x56168d6bb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6bb590 con 0x56168d5c2240 2024-09-13T19:07:06.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86056e8640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d5c2240 0x56168d6bb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86046e6640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84ec034650 0x7f84ec036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85f8001da0 tx=0x7f85f8001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86056e8640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d5c2240 0x56168d6bb050 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86056e8640 1 -- 172.21.15.151:0/112418052 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d5c2240 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6bb9e0 con 0x56168d5c2240 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86056e8640 1 -- 172.21.15.151:0/112418052 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d5c2240 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.666+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6bd7f0 0x56168d6bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6c02b0 con 0x56168d6bd7f0 2024-09-13T19:07:06.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6bd7f0 0x56168d6bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6bd7f0 0x56168d6bfbe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 -- 172.21.15.151:0/112418052 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85fc0c7030 con 0x56168d6bd7f0 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6bc660 con 0x56168d5c2240 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86056e8640 1 -- 172.21.15.151:0/112418052 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d5c2240 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56168d6c1710 0x56168d6c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6c41f0 con 0x56168d6c1710 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86046e6640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56168d6c1710 0x56168d6c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86046e6640 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56168d6c1710 0x56168d6c3b00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86046e6640 1 -- 172.21.15.151:0/112418052 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85f800e6c0 con 0x56168d6c1710 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f86073d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56168d4c6800 con 0x56168d6d1ca0 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50954/0 (socket says 172.21.15.151:50954) 2024-09-13T19:07:06.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 -- 172.21.15.151:0/1912951284 learned_addr learned my addr 172.21.15.151:0/1912951284 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 -- 172.21.15.151:0/1912951284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d6d2600 con 0x56168d6d1ca0 2024-09-13T19:07:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.670+0000 7f8604ee7640 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0cafd0 tx=0x7f85fc0c1a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 -- 172.21.15.151:0/1912951284 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0c0a80 con 0x56168d6d1ca0 2024-09-13T19:07:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56168d6d2830 con 0x56168d6d1ca0 2024-09-13T19:07:06.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 -- 172.21.15.151:0/1912951284 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0c0c20 con 0x56168d6d1ca0 2024-09-13T19:07:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 -- 172.21.15.151:0/1912951284 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0d3730 con 0x56168d6d1ca0 2024-09-13T19:07:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168d6d2830 con 0x56168d6d1ca0 2024-09-13T19:07:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 -- 172.21.15.151:0/1912951284 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f85fc0e3d10 con 0x56168d6d1ca0 2024-09-13T19:07:06.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 0x7f84dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84ea7fc640 1 -- 172.21.15.151:0/1912951284 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f85fc0f3ac0 con 0x56168d6d1ca0 2024-09-13T19:07:06.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86046e6640 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 0x7f84dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86046e6640 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 0x7f84dc036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56168d6bbda0 tx=0x7f85f800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f86073d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56168d6ad4d0 con 0x56168d6de1f0 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50962/0 (socket says 172.21.15.151:50962) 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f8604ee7640 1 -- 172.21.15.151:0/1469176300 learned_addr learned my addr 172.21.15.151:0/1469176300 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f8604ee7640 1 -- 172.21.15.151:0/1469176300 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d6deba0 con 0x56168d6de1f0 2024-09-13T19:07:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f8604ee7640 1 --2- 172.21.15.151:0/1469176300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ca5f0 tx=0x7f85fc0d4900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd93c6e0abbd9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.674+0000 7f84dbfff640 1 -- 172.21.15.151:0/1469176300 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc101020 con 0x56168d6de1f0 2024-09-13T19:07:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f84dbfff640 1 -- 172.21.15.151:0/1469176300 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0ace30 con 0x56168d6de1f0 2024-09-13T19:07:06.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f84dbfff640 1 -- 172.21.15.151:0/1469176300 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0c0510 con 0x56168d6de1f0 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/1469176300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 msgr2=0x56168d6de5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 --2- 172.21.15.151:0/1469176300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0ca5f0 tx=0x7f85fc0d4900 comp rx=0 tx=0).stop 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/1469176300 shutdown_connections 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 --2- 172.21.15.151:0/1469176300 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6de5d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/1469176300 >> 172.21.15.151:0/1469176300 conn(0x56168d6da5d0 msgr2=0x56168d6d86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/1469176300 shutdown_connections 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/1469176300 wait complete. 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 Processor -- start 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- start start 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56168d6df040 con 0x56168d6de1f0 2024-09-13T19:07:06.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f8604ee7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50970/0 (socket says 172.21.15.151:50970) 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 learned_addr learned my addr 172.21.15.151:0/3698737569 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168d6e5930 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f8604ee7640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0e5810 tx=0x7f85fc0c4fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f84da7fc640 1 -- 172.21.15.151:0/3698737569 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc116070 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56168d6e5930 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168d6e5930 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f84da7fc640 1 -- 172.21.15.151:0/3698737569 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85fc0d3a00 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.678+0000 7f84da7fc640 1 -- 172.21.15.151:0/3698737569 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85fc0e2640 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f84da7fc640 1 -- 172.21.15.151:0/3698737569 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f85fc119070 con 0x56168d6de1f0 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f84da7fc640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84d0034650 0x7f84d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f84da7fc640 1 -- 172.21.15.151:0/3698737569 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f85fc10c030 con 0x56168d6de1f0 2024-09-13T19:07:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86046e6640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84d0034650 0x7f84d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d6f04e0 0x56168d6f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f30f0 con 0x56168d6f04e0 2024-09-13T19:07:06.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d6f04e0 0x56168d6f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86046e6640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84d0034650 0x7f84d0036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56168d6c45d0 tx=0x7f85f8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d6f04e0 0x56168d6f29a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 realm 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f3500 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f3dd0 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6f4ed0 0x56168d6f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f7910 con 0x56168d6f4ed0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6f4ed0 0x56168d6f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6f4ed0 0x56168d6f72c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 20 searching for the correct realm 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f9170 con 0x56168d6f4ed0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f85fc11b060 0x7f85fc0f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f9170 con 0x7f85fc11b060 2024-09-13T19:07:06.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.682+0000 7f86046e6640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f85fc11b060 0x7f85fc0f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86046e6640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f85fc11b060 0x7f85fc0f3050 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f800e6c0 con 0x7f85fc11b060 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f9170 con 0x7f85fc11b060 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f800e6c0 con 0x7f85fc11b060 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f9170 con 0x56168d6f04e0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f85f4018410 0x7f85f4018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f85f4018410 0x7f85f4018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f85f4018410 0x7f85f4018890 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x7f85f4018410 2024-09-13T19:07:06.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x7f85f4018410 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.686+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85fc11b060 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f85f800e6c0 con 0x7f85fc11b060 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x7f85f4018410 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85fc11b060 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85f800e6c0 con 0x7f85fc11b060 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x7f85f4018410 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.690+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x7f85f4018410 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85fc11b060 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f800e6c0 con 0x7f85fc11b060 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f40083f0 con 0x56168d6f04e0 2024-09-13T19:07:06.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.694+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85fc11b060 2024-09-13T19:07:06.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f4ed0 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x7f85f4018410 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f4170 con 0x56168d6f04e0 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f85f403b040 con 0x7f85fc11b060 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:06.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f8160 con 0x56168d6f04e0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f8500 con 0x56168d6f04e0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f8500 con 0x7f85fc11b060 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 zone default found 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 4 Realm: () 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:06.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 zonegroup default 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f8e40 con 0x7f85f4018410 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6f8e70 con 0x56168d6f4ed0 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.698+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fb0a0 con 0x56168d6f4ed0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 20 started sync module instance, tier type = 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fa450 con 0x7f85fc11b060 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654862174272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fa0b0 con 0x7f85fc11b060 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fbfd0 con 0x56168d6f04e0 2024-09-13T19:07:06.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.702+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654862174272] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654862179104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fbf40 con 0x56168d6f04e0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fcd60 con 0x56168d6f4ed0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654862179104] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654862181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fd150 con 0x56168d6f4ed0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fdb10 con 0x7f85fc11b060 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654862188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fe780 con 0x7f85fc11b060 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.706+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6ff140 con 0x56168d6f04e0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654862181312] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654862188208] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654862191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fe780 con 0x56168d6f04e0 2024-09-13T19:07:06.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6ff0b0 con 0x7f85f4018410 2024-09-13T19:07:06.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.710+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654862191760] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654862189264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6fe6f0 con 0x7f85f4018410 2024-09-13T19:07:06.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d6ffe90 con 0x7f85f4018410 2024-09-13T19:07:06.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654862195168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d7002b0 con 0x7f85f4018410 2024-09-13T19:07:06.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d700dd0 con 0x7f85f4018410 2024-09-13T19:07:06.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.714+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654862189264] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654862198944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d700d90 con 0x7f85f4018410 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=0 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=1 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=2 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=3 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=4 2024-09-13T19:07:06.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=5 2024-09-13T19:07:06.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654862195168] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=6 2024-09-13T19:07:06.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654862198944] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 20 add_watcher() i=7 2024-09-13T19:07:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d6ffe00 con 0x56168d6f04e0 2024-09-13T19:07:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.718+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654862196224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d701200 con 0x56168d6f04e0 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654862196224] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f84bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 5 note: GC not initialized 2024-09-13T19:07:06.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f84b9fe3640 20 reqs_thread_entry: start 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 Filter name: none 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f842b7fe640 20 reqs_thread_entry: start 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d727900 con 0x7f85fc11b060 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 : miss 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.1f 8:ff78d1c5:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d7293c0 con 0x7f85fc11b060 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(63 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 info.flags=0x17 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 to cache LRU end 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 20 get_obj_state: octx=0x7f85f802d040 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56168d72ba68 s->prefetch_data=0 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.722+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 3.39s0 3:9c03d312:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x56168d6f4ed0 2024-09-13T19:07:06.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv6 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 10 manifest: total_size = 5 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 20 get_obj_state: setting s->obj_tag to _ybSzkP4IUAiVWHis8BeAQsf4I3MHHNJ 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f84bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654862196224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x56168d6f04e0 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94654862196224] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654862174272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x7f85fc11b060 2024-09-13T19:07:06.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94654862174272] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 20 remove_watcher() i=0 2024-09-13T19:07:06.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 2 removed watcher, disabling cache 2024-09-13T19:07:06.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.726+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654862179104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x56168d6f04e0 2024-09-13T19:07:06.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94654862179104] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f86073d7980 20 remove_watcher() i=1 2024-09-13T19:07:06.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654862181312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x56168d6f4ed0 2024-09-13T19:07:06.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f8604ee7640 1 -- 172.21.15.151:0/3698737569 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94654862181312] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85fc118030 con 0x56168d6f4ed0 2024-09-13T19:07:06.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f86073d7980 20 remove_watcher() i=2 2024-09-13T19:07:06.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.730+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654862188208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x7f85fc11b060 2024-09-13T19:07:06.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86046e6640 1 -- 172.21.15.151:0/3698737569 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94654862188208] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f8040040 con 0x7f85fc11b060 2024-09-13T19:07:06.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86073d7980 20 remove_watcher() i=3 2024-09-13T19:07:06.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654862191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x56168d6f04e0 2024-09-13T19:07:06.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94654862191760] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x56168d6f04e0 2024-09-13T19:07:06.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86073d7980 20 remove_watcher() i=4 2024-09-13T19:07:06.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.734+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654862189264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x7f85f4018410 2024-09-13T19:07:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94654862189264] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86073d7980 20 remove_watcher() i=5 2024-09-13T19:07:06.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654862195168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x7f85f4018410 2024-09-13T19:07:06.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94654862195168] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86073d7980 20 remove_watcher() i=6 2024-09-13T19:07:06.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.738+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654862198944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56168d72ca10 con 0x7f85f4018410 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94654862198944] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85f4036040 con 0x7f85f4018410 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 20 remove_watcher() i=7 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f85f4018410 msgr2=0x7f85f4018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f85f4018410 0x7f85f4018890 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d6f04e0 msgr2=0x56168d6f29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d6f04e0 0x56168d6f29a0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f85fc11b060 msgr2=0x7f85fc0f3050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f85fc11b060 0x7f85fc0f3050 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6f4ed0 msgr2=0x56168d6f72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6f4ed0 0x56168d6f72c0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84d0034650 msgr2=0x7f84d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84d0034650 0x7f84d0036b10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x56168d6c45d0 tx=0x7f85f8010000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86056e8640 1 -- 172.21.15.151:0/3698737569 reap_dead start 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 msgr2=0x56168d6e53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0e5810 tx=0x7f85fc0c4fd0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 shutdown_connections 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/3698737569 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6de1f0 0x56168d6e53f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 >> 172.21.15.151:0/3698737569 conn(0x56168d6da5d0 msgr2=0x56168d6d86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 shutdown_connections 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/3698737569 wait complete. 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 msgr2=0x7f84dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 0x7f84dc036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56168d6bbda0 tx=0x7f85f800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 msgr2=0x56168d6d20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0cafd0 tx=0x7f85fc0c1a70 comp rx=0 tx=0).stop 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 shutdown_connections 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84dc034650 0x7f84dc036b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/1912951284 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d6d1ca0 0x56168d6d20c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 >> 172.21.15.151:0/1912951284 conn(0x56168d6c6df0 msgr2=0x56168d6c9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 shutdown_connections 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/1912951284 wait complete. 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d5c2240 msgr2=0x56168d6bb050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56168d5c2240 0x56168d6bb050 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56168d6c1710 msgr2=0x56168d6c3b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56168d6c1710 0x56168d6c3b00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6bd7f0 msgr2=0x56168d6bfbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56168d6bd7f0 0x56168d6bfbe0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84ec034650 msgr2=0x7f84ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f84ec034650 0x7f84ec036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f85f8001da0 tx=0x7f85f8001300 comp rx=0 tx=0).stop 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 msgr2=0x56168d6b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 --2- 172.21.15.151:0/112418052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56168d5c18f0 0x56168d6b3f50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f85fc0b8040 tx=0x7f85fc019810 comp rx=0 tx=0).stop 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86056e8640 1 -- 172.21.15.151:0/112418052 reap_dead start 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 shutdown_connections 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 >> 172.21.15.151:0/112418052 conn(0x56168d535240 msgr2=0x56168d6a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 shutdown_connections 2024-09-13T19:07:06.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.742+0000 7f86073d7980 1 -- 172.21.15.151:0/112418052 wait complete. 2024-09-13T19:07:06.759 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoofooFooFULL_CONTROL 2024-09-13T19:07:06.759 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-13T19:07:06.762 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-13T19:07:06.768 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:06.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:07:06.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-13T19:07:06.769 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:07:06.840 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:06.840 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:06.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faec08f0980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ba2972f3c0 0x55ba2972db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faec08f0980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba29640ae0 con 0x55ba2972f7d0 2024-09-13T19:07:06.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faec08f0980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55ba29664e30 con 0x55ba2972f3c0 2024-09-13T19:07:06.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebe400640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ba2972f3c0 0x55ba2972db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebe400640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ba2972f3c0 0x55ba2972db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50974/0 (socket says 172.21.15.151:50974) 2024-09-13T19:07:06.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebdbff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55ba2972f7d0 0x55ba2972e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39648/0 (socket says 172.21.15.151:39648) 2024-09-13T19:07:06.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebe400640 1 -- 172.21.15.151:0/622948961 learned_addr learned my addr 172.21.15.151:0/622948961 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebe400640 1 -- 172.21.15.151:0/622948961 >> v1:172.21.15.12:6789/0 conn(0x55ba2972f7d0 legacy=0x55ba2972e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.838+0000 7faebe400640 1 -- 172.21.15.151:0/622948961 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba2972e8f0 con 0x55ba2972f3c0 2024-09-13T19:07:06.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faebe400640 1 --2- 172.21.15.151:0/622948961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba2972db80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faeb000a4e0 tx=0x7faeb001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c805e6fadaba12 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faebd3fe640 1 -- 172.21.15.151:0/622948961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00aa540 con 0x55ba2972f3c0 2024-09-13T19:07:06.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faebd3fe640 1 -- 172.21.15.151:0/622948961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00aa6e0 con 0x55ba2972f3c0 2024-09-13T19:07:06.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faebd3fe640 1 -- 172.21.15.151:0/622948961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00aaa40 con 0x55ba2972f3c0 2024-09-13T19:07:06.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 -- 172.21.15.151:0/622948961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 msgr2=0x55ba2972db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 --2- 172.21.15.151:0/622948961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba2972db80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faeb000a4e0 tx=0x7faeb001b090 comp rx=0 tx=0).stop 2024-09-13T19:07:06.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 -- 172.21.15.151:0/622948961 shutdown_connections 2024-09-13T19:07:06.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 --2- 172.21.15.151:0/622948961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba2972db80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 -- 172.21.15.151:0/622948961 >> 172.21.15.151:0/622948961 conn(0x55ba297b41c0 msgr2=0x55ba297b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 -- 172.21.15.151:0/622948961 shutdown_connections 2024-09-13T19:07:06.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.842+0000 7faec08f0980 1 -- 172.21.15.151:0/622948961 wait complete. 2024-09-13T19:07:06.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ba29666200 con 0x55ba2972f3c0 2024-09-13T19:07:06.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50976/0 (socket says 172.21.15.151:50976) 2024-09-13T19:07:06.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faebe400640 1 -- 172.21.15.151:0/1737296408 learned_addr learned my addr 172.21.15.151:0/1737296408 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faebe400640 1 -- 172.21.15.151:0/1737296408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba298a61d0 con 0x55ba2972f3c0 2024-09-13T19:07:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faebe400640 1 --2- 172.21.15.151:0/1737296408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faeb0017ca0 tx=0x7faeb00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211c0bf36c397280 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7fadac608640 1 -- 172.21.15.151:0/1737296408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00b9070 con 0x55ba2972f3c0 2024-09-13T19:07:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7fadac608640 1 -- 172.21.15.151:0/1737296408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00aab30 con 0x55ba2972f3c0 2024-09-13T19:07:06.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7fadac608640 1 -- 172.21.15.151:0/1737296408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00aae10 con 0x55ba2972f3c0 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 -- 172.21.15.151:0/1737296408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 msgr2=0x55ba298a5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.858+0000 7faec08f0980 1 --2- 172.21.15.151:0/1737296408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faeb0017ca0 tx=0x7faeb00033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1737296408 shutdown_connections 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 --2- 172.21.15.151:0/1737296408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298a5c00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1737296408 >> 172.21.15.151:0/1737296408 conn(0x55ba297b41c0 msgr2=0x55ba298a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1737296408 shutdown_connections 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1737296408 wait complete. 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ba297c4210 con 0x55ba2972f3c0 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50980/0 (socket says 172.21.15.151:50980) 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faebe400640 1 -- 172.21.15.151:0/1200573676 learned_addr learned my addr 172.21.15.151:0/1200573676 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faebe400640 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba298ad390 con 0x55ba2972f3c0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faebe400640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298ace50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faeb0017ca0 tx=0x7faeb0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 -- 172.21.15.151:0/1200573676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00b9070 con 0x55ba2972f3c0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba298ad620 con 0x55ba2972f3c0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 -- 172.21.15.151:0/1200573676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00b5e10 con 0x55ba2972f3c0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 -- 172.21.15.151:0/1200573676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00bd610 con 0x55ba2972f3c0 2024-09-13T19:07:06.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba298b0300 con 0x55ba2972f3c0 2024-09-13T19:07:06.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 -- 172.21.15.151:0/1200573676 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faeb00b3040 con 0x55ba2972f3c0 2024-09-13T19:07:06.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fada4034650 0x7fada4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.862+0000 7fadaae05640 1 -- 172.21.15.151:0/1200573676 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faeb00c4070 con 0x55ba2972f3c0 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebdbff640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fada4034650 0x7fada4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba2972f7d0 0x55ba298b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298b44d0 con 0x55ba2972f7d0 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebec01640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba2972f7d0 0x55ba298b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebdbff640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fada4034650 0x7fada4036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f70 tx=0x7faea8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebec01640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba2972f7d0 0x55ba298b3f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebec01640 1 -- 172.21.15.151:0/1200573676 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba2972f7d0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298b1500 con 0x55ba2972f7d0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebec01640 1 -- 172.21.15.151:0/1200573676 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba2972f7d0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298b67e0 0x55ba298b8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298b92a0 con 0x55ba298b67e0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebe400640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298b67e0 0x55ba298b8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebe400640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298b67e0 0x55ba298b8bd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebe400640 1 -- 172.21.15.151:0/1200573676 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faeb00cf480 con 0x55ba298b67e0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298b5680 con 0x55ba2972f7d0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebec01640 1 -- 172.21.15.151:0/1200573676 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba2972f7d0 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ba298ba700 0x55ba298bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298bd1f0 con 0x55ba298ba700 2024-09-13T19:07:06.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebdbff640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ba298ba700 0x55ba298bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebdbff640 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ba298ba700 0x55ba298bcaf0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faebdbff640 1 -- 172.21.15.151:0/1200573676 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faea800f6a0 con 0x55ba298ba700 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.866+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ba296bf800 con 0x55ba298cacc0 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:50992/0 (socket says 172.21.15.151:50992) 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebe400640 1 -- 172.21.15.151:0/3686804679 learned_addr learned my addr 172.21.15.151:0/3686804679 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebe400640 1 -- 172.21.15.151:0/3686804679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba298cb620 con 0x55ba298cacc0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebe400640 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faeb00a9fb0 tx=0x7faeb00b4690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 -- 172.21.15.151:0/3686804679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00b48a0 con 0x55ba298cacc0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 -- 172.21.15.151:0/3686804679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00bd9c0 con 0x55ba298cacc0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba298cb8b0 con 0x55ba298cacc0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 -- 172.21.15.151:0/3686804679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00bdca0 con 0x55ba298cacc0 2024-09-13T19:07:06.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba298ce530 con 0x55ba298cacc0 2024-09-13T19:07:06.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 -- 172.21.15.151:0/3686804679 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faeb00cf7d0 con 0x55ba298cacc0 2024-09-13T19:07:06.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 0x7fad98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7fada3fff640 1 -- 172.21.15.151:0/3686804679 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faeb00de070 con 0x55ba298cacc0 2024-09-13T19:07:06.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faebdbff640 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 0x7fad98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.870+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebdbff640 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 0x7fad98036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ba298b4d90 tx=0x7faea800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ba298a6490 con 0x55ba298d7650 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51004/0 (socket says 172.21.15.151:51004) 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 -- 172.21.15.151:0/2221126255 learned_addr learned my addr 172.21.15.151:0/2221126255 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 -- 172.21.15.151:0/2221126255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba298d8020 con 0x55ba298d7650 2024-09-13T19:07:06.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 --2- 172.21.15.151:0/2221126255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faeb00db200 tx=0x7faeb00eda90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547fc0f1ccaaf93a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7fada1ffb640 1 -- 172.21.15.151:0/2221126255 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00fc020 con 0x55ba298d7650 2024-09-13T19:07:06.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7fada1ffb640 1 -- 172.21.15.151:0/2221126255 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00ed3e0 con 0x55ba298d7650 2024-09-13T19:07:06.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7fada1ffb640 1 -- 172.21.15.151:0/2221126255 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00e13c0 con 0x55ba298d7650 2024-09-13T19:07:06.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- 172.21.15.151:0/2221126255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 msgr2=0x55ba298d7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 --2- 172.21.15.151:0/2221126255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faeb00db200 tx=0x7faeb00eda90 comp rx=0 tx=0).stop 2024-09-13T19:07:06.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- 172.21.15.151:0/2221126255 shutdown_connections 2024-09-13T19:07:06.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 --2- 172.21.15.151:0/2221126255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298d7a50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- 172.21.15.151:0/2221126255 >> 172.21.15.151:0/2221126255 conn(0x55ba298d39d0 msgr2=0x55ba298d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- 172.21.15.151:0/2221126255 shutdown_connections 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- 172.21.15.151:0/2221126255 wait complete. 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 Processor -- start 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- start start 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faec08f0980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ba298d83e0 con 0x55ba298d7650 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298de7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51008/0 (socket says 172.21.15.151:51008) 2024-09-13T19:07:06.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.874+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 learned_addr learned my addr 172.21.15.151:0/2696993095 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba298ded00 con 0x55ba298d7650 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebe400640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298de7c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faeb00e46a0 tx=0x7faeb00d3e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 -- 172.21.15.151:0/2696993095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb0111070 con 0x55ba298d7650 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba298ded00 con 0x55ba298d7650 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba298ded00 con 0x55ba298d7650 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 -- 172.21.15.151:0/2696993095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb00e1a90 con 0x55ba298d7650 2024-09-13T19:07:06.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 -- 172.21.15.151:0/2696993095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faeb00cfbf0 con 0x55ba298d7650 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 -- 172.21.15.151:0/2696993095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7faeb0114070 con 0x55ba298d7650 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad88034600 0x7fad88036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7fad8ffff640 1 -- 172.21.15.151:0/2696993095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faeb0108030 con 0x55ba298d7650 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebdbff640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad88034600 0x7fad88036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba298e97a0 0x55ba298ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ec3b0 con 0x55ba298e97a0 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebec01640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba298e97a0 0x55ba298ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebdbff640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad88034600 0x7fad88036ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faea800c010 tx=0x7faea8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebec01640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba298e97a0 0x55ba298ebc60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 realm 2024-09-13T19:07:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ec7c0 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.878+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed090 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298ee190 0x55ba298f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f0b90 con 0x55ba298ee190 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298ee190 0x55ba298f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298ee190 0x55ba298f0580 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 20 searching for the correct realm 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2460 con 0x55ba298ee190 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7faeb0116060 0x7faeb0101880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2460 con 0x7faeb0116060 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7faeb0116060 0x7faeb0101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7faeb0116060 0x7faeb0101880 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2460 con 0x7faeb0116060 2024-09-13T19:07:06.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2460 con 0x55ba298e97a0 2024-09-13T19:07:06.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7faeb8018410 0x7faeb8018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.882+0000 7faebec01640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7faeb8018410 0x7faeb8018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7faeb8018410 0x7faeb8018890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x7faeb8018410 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x7faeb8018410 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb0116060 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x7faeb8018410 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb0116060 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.886+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x7faeb8018410 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x7faeb8018410 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb0116060 2024-09-13T19:07:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb80083f0 con 0x55ba298e97a0 2024-09-13T19:07:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.890+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb0116060 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298ee190 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x7faeb8018410 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ba298ed430 con 0x55ba298e97a0 2024-09-13T19:07:06.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7faeb803b040 con 0x7faeb0116060 2024-09-13T19:07:06.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:06.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:06.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f1450 con 0x55ba298e97a0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f1840 con 0x55ba298e97a0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:06.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.894+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f1840 con 0x7faeb0116060 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 zone default found 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 4 Realm: () 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 zonegroup default 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2110 con 0x7faeb8018410 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f2140 con 0x55ba298ee190 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f4370 con 0x55ba298ee190 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 started sync module instance, tier type = 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:06.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f3710 con 0x7faeb0116060 2024-09-13T19:07:06.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258049530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f4c80 con 0x7faeb0116060 2024-09-13T19:07:06.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.898+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f54d0 con 0x55ba298e97a0 2024-09-13T19:07:06.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258049530672] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258049533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f5550 con 0x55ba298e97a0 2024-09-13T19:07:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f6070 con 0x55ba298ee190 2024-09-13T19:07:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258049533904] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258049538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f6460 con 0x55ba298ee190 2024-09-13T19:07:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.902+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f6e20 con 0x7faeb0116060 2024-09-13T19:07:06.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258049542512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f7670 con 0x7faeb0116060 2024-09-13T19:07:06.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f8070 con 0x55ba298e97a0 2024-09-13T19:07:06.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258049538880] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258049542512] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258049544640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f7b80 con 0x55ba298e97a0 2024-09-13T19:07:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.906+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f8910 con 0x7faeb8018410 2024-09-13T19:07:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.910+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258049544640] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.910+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.910+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258049536032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f8910 con 0x7faeb8018410 2024-09-13T19:07:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.910+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f91a0 con 0x7faeb8018410 2024-09-13T19:07:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258049536032] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258049549408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f9380 con 0x7faeb8018410 2024-09-13T19:07:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f9bd0 con 0x7faeb8018410 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258049549408] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258049553280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f9c50 con 0x7faeb8018410 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=0 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=1 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=2 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=3 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=4 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=5 2024-09-13T19:07:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.914+0000 7faec08f0980 20 add_watcher() i=6 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258049553280] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 add_watcher() i=7 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba298fcf80 con 0x55ba298e97a0 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258049567152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba298f9dc0 con 0x55ba298e97a0 2024-09-13T19:07:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258049567152] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7fad74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 5 note: GC not initialized 2024-09-13T19:07:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7facef7fe640 20 reqs_thread_entry: start 2024-09-13T19:07:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 Filter name: none 2024-09-13T19:07:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faced7fa640 20 reqs_thread_entry: start 2024-09-13T19:07:06.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.918+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba29920d10 con 0x7faeb0116060 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 : miss 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 20 rados->read ofs=0 len=0 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.1f 8:ff78d1c5:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba299227d0 con 0x7faeb0116060 2024-09-13T19:07:06.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(63 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 info.flags=0x17 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 to cache LRU end 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 20 get_obj_state: octx=0x7faea800bb70 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55ba29924e98 s->prefetch_data=0 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 3.39s0 3:9c03d312:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x55ba298ee190 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv7 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 10 manifest: total_size = 5 2024-09-13T19:07:06.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 20 get_obj_state: setting s->obj_tag to _ZnzHEfqgI8doYmqjM6ZOE37sCz_3bjc 2024-09-13T19:07:06.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7fad74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258049567152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x55ba298e97a0 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94258049567152] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.922+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258049530672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x7faeb0116060 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94258049530672] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faec08f0980 20 remove_watcher() i=0 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faec08f0980 2 removed watcher, disabling cache 2024-09-13T19:07:06.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258049533904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x55ba298e97a0 2024-09-13T19:07:06.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94258049533904] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faec08f0980 20 remove_watcher() i=1 2024-09-13T19:07:06.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.926+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258049538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x55ba298ee190 2024-09-13T19:07:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faebe400640 1 -- 172.21.15.151:0/2696993095 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94258049538880] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb0113030 con 0x55ba298ee190 2024-09-13T19:07:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faec08f0980 20 remove_watcher() i=2 2024-09-13T19:07:06.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258049542512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x7faeb0116060 2024-09-13T19:07:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faebdbff640 1 -- 172.21.15.151:0/2696993095 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94258049542512] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faea8037040 con 0x7faeb0116060 2024-09-13T19:07:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faec08f0980 20 remove_watcher() i=3 2024-09-13T19:07:06.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.930+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258049544640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x55ba298e97a0 2024-09-13T19:07:06.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94258049544640] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x55ba298e97a0 2024-09-13T19:07:06.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faec08f0980 20 remove_watcher() i=4 2024-09-13T19:07:06.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258049536032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x7faeb8018410 2024-09-13T19:07:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94258049536032] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faec08f0980 20 remove_watcher() i=5 2024-09-13T19:07:06.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.934+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258049549408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x7faeb8018410 2024-09-13T19:07:06.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94258049549408] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 20 remove_watcher() i=6 2024-09-13T19:07:06.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258049553280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ba29925dc0 con 0x7faeb8018410 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94258049553280] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faeb8036040 con 0x7faeb8018410 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 20 remove_watcher() i=7 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7faeb8018410 msgr2=0x7faeb8018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7faeb8018410 0x7faeb8018890 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba298e97a0 msgr2=0x55ba298ebc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba298e97a0 0x55ba298ebc60 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7faeb0116060 msgr2=0x7faeb0101880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7faeb0116060 0x7faeb0101880 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298ee190 msgr2=0x55ba298f0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298ee190 0x55ba298f0580 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad88034600 msgr2=0x7fad88036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad88034600 0x7fad88036ac0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faea800c010 tx=0x7faea8010000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 msgr2=0x55ba298de7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/2696993095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298d7650 0x55ba298de7c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faeb00e46a0 tx=0x7faeb00d3e80 comp rx=0 tx=0).stop 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faebec01640 1 -- 172.21.15.151:0/2696993095 reap_dead start 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 shutdown_connections 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 >> 172.21.15.151:0/2696993095 conn(0x55ba298d39d0 msgr2=0x55ba298d1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 shutdown_connections 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/2696993095 wait complete. 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 msgr2=0x7fad98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 0x7fad98036b10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55ba298b4d90 tx=0x7faea800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 msgr2=0x55ba298cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faeb00a9fb0 tx=0x7faeb00b4690 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 shutdown_connections 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fad98034650 0x7fad98036b10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 --2- 172.21.15.151:0/3686804679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba298cacc0 0x55ba298cb0e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 >> 172.21.15.151:0/3686804679 conn(0x55ba298bfe10 msgr2=0x55ba298c2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 shutdown_connections 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.938+0000 7faec08f0980 1 -- 172.21.15.151:0/3686804679 wait complete. 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba2972f7d0 msgr2=0x55ba298b3f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ba2972f7d0 0x55ba298b3f50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ba298ba700 msgr2=0x55ba298bcaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ba298ba700 0x55ba298bcaf0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298b67e0 msgr2=0x55ba298b8bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ba298b67e0 0x55ba298b8bd0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:06.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fada4034650 msgr2=0x7fada4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fada4034650 0x7fada4036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faea8000f70 tx=0x7faea8001380 comp rx=0 tx=0).stop 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 msgr2=0x55ba298ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 --2- 172.21.15.151:0/1200573676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ba2972f3c0 0x55ba298ace50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faeb0017ca0 tx=0x7faeb0017e30 comp rx=0 tx=0).stop 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faebec01640 1 -- 172.21.15.151:0/1200573676 reap_dead start 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 shutdown_connections 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 >> 172.21.15.151:0/1200573676 conn(0x55ba297b41c0 msgr2=0x55ba298a03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 shutdown_connections 2024-09-13T19:07:06.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:06.942+0000 7faec08f0980 1 -- 172.21.15.151:0/1200573676 wait complete. 2024-09-13T19:07:06.955 INFO:teuthology.orchestra.run.smithi151.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:07:06.955 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-13T19:07:06.958 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-13T19:07:06.978 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:07.085 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-13T19:07:07.086 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-13T19:07:07.086 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-13T19:07:07.086 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:07:07.086 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:07:07.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-13T19:07:07.086 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-13T19:07:07.127 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:07.127 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:07.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a864b4980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a4f0f6c70 0x558a4f0f9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a864b4980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a4ef78ae0 con 0x558a4f0f28f0 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a864b4980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x558a4ef9ce30 con 0x558a4f0f6c70 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a837c3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a4f0f6c70 0x558a4f0f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a837c3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a4f0f6c70 0x558a4f0f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51012/0 (socket says 172.21.15.151:51012) 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a83fc4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x558a4f0f28f0 0x558a4f0f2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39662/0 (socket says 172.21.15.151:39662) 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.122+0000 7f5a837c3640 1 -- 172.21.15.151:0/1634411056 learned_addr learned my addr 172.21.15.151:0/1634411056 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a837c3640 1 -- 172.21.15.151:0/1634411056 >> v1:172.21.15.12:6789/0 conn(0x558a4f0f28f0 legacy=0x558a4f0f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a837c3640 1 -- 172.21.15.151:0/1634411056 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f0fa5b0 con 0x558a4f0f6c70 2024-09-13T19:07:07.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a837c3640 1 --2- 172.21.15.151:0/1634411056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f6c70 0x558a4f0f9060 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800a5c0 tx=0x7f5a7801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67ac6e9334a166e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a82fc2640 1 -- 172.21.15.151:0/1634411056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780a6070 con 0x558a4f0f6c70 2024-09-13T19:07:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a82fc2640 1 -- 172.21.15.151:0/1634411056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a780af070 con 0x558a4f0f6c70 2024-09-13T19:07:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a82fc2640 1 -- 172.21.15.151:0/1634411056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a780aa5c0 con 0x558a4f0f6c70 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 -- 172.21.15.151:0/1634411056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f6c70 msgr2=0x558a4f0f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 --2- 172.21.15.151:0/1634411056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f6c70 0x558a4f0f9060 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800a5c0 tx=0x7f5a7801b340 comp rx=0 tx=0).stop 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 -- 172.21.15.151:0/1634411056 shutdown_connections 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 --2- 172.21.15.151:0/1634411056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f6c70 0x558a4f0f9060 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 -- 172.21.15.151:0/1634411056 >> 172.21.15.151:0/1634411056 conn(0x558a4f066240 msgr2=0x558a4f066650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 -- 172.21.15.151:0/1634411056 shutdown_connections 2024-09-13T19:07:07.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.126+0000 7f5a864b4980 1 -- 172.21.15.151:0/1634411056 wait complete. 2024-09-13T19:07:07.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.142+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.142+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.142+0000 7f5a864b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.142+0000 7f5a864b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a4ef9e200 con 0x558a4f0f28f0 2024-09-13T19:07:07.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51020/0 (socket says 172.21.15.151:51020) 2024-09-13T19:07:07.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 -- 172.21.15.151:0/73814520 learned_addr learned my addr 172.21.15.151:0/73814520 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 -- 172.21.15.151:0/73814520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f1de210 con 0x558a4f0f28f0 2024-09-13T19:07:07.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/73814520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5a740015f0 tx=0x7f5a74001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1172020c620150a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5971e0b640 1 -- 172.21.15.151:0/73814520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74013420 con 0x558a4f0f28f0 2024-09-13T19:07:07.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5971e0b640 1 -- 172.21.15.151:0/73814520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a740135e0 con 0x558a4f0f28f0 2024-09-13T19:07:07.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5971e0b640 1 -- 172.21.15.151:0/73814520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74013940 con 0x558a4f0f28f0 2024-09-13T19:07:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- 172.21.15.151:0/73814520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 msgr2=0x558a4f1ddc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 --2- 172.21.15.151:0/73814520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5a740015f0 tx=0x7f5a74001ab0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- 172.21.15.151:0/73814520 shutdown_connections 2024-09-13T19:07:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 --2- 172.21.15.151:0/73814520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1ddc40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- 172.21.15.151:0/73814520 >> 172.21.15.151:0/73814520 conn(0x558a4f066240 msgr2=0x558a4f1d9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- 172.21.15.151:0/73814520 shutdown_connections 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- 172.21.15.151:0/73814520 wait complete. 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a864b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a4f0fa0b0 con 0x558a4f0f28f0 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1e4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51036/0 (socket says 172.21.15.151:51036) 2024-09-13T19:07:07.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 -- 172.21.15.151:0/3508214748 learned_addr learned my addr 172.21.15.151:0/3508214748 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.146+0000 7f5a83fc4640 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f1e54f0 con 0x558a4f0f28f0 2024-09-13T19:07:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1e4fb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5a74006640 tx=0x7f5a74000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 -- 172.21.15.151:0/3508214748 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74022020 con 0x558a4f0f28f0 2024-09-13T19:07:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 -- 172.21.15.151:0/3508214748 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a74006320 con 0x558a4f0f28f0 2024-09-13T19:07:07.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a4f1e5780 con 0x558a4f0f28f0 2024-09-13T19:07:07.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 -- 172.21.15.151:0/3508214748 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74004af0 con 0x558a4f0f28f0 2024-09-13T19:07:07.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a4f1e8460 con 0x558a4f0f28f0 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 -- 172.21.15.151:0/3508214748 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a74025020 con 0x558a4f0f28f0 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f596c034650 0x7f596c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f596bfff640 1 -- 172.21.15.151:0/3508214748 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5a74018030 con 0x558a4f0f28f0 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a837c3640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f596c034650 0x7f596c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f0f6c70 0x558a4f1ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f1ec5e0 con 0x558a4f0f6c70 2024-09-13T19:07:07.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a847c5640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f0f6c70 0x558a4f1ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a837c3640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f596c034650 0x7f596c036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a780ae000 tx=0x7f5a780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a847c5640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f0f6c70 0x558a4f1ebfa0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a847c5640 1 -- 172.21.15.151:0/3508214748 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f0f6c70 2024-09-13T19:07:07.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f1e9680 con 0x558a4f0f6c70 2024-09-13T19:07:07.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a847c5640 1 -- 172.21.15.151:0/3508214748 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f0f6c70 2024-09-13T19:07:07.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f1ee910 0x558a4f1f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.150+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f1f13d0 con 0x558a4f1ee910 2024-09-13T19:07:07.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f1ee910 0x558a4f1f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f1ee910 0x558a4f1f0d00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 -- 172.21.15.151:0/3508214748 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a7401b070 con 0x558a4f1ee910 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f1ed7b0 con 0x558a4f0f6c70 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a847c5640 1 -- 172.21.15.151:0/3508214748 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f0f6c70 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a4f1f2810 0x558a4f1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f1f5390 con 0x558a4f1f2810 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a837c3640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a4f1f2810 0x558a4f1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.158 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a837c3640 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a4f1f2810 0x558a4f1f4c00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a837c3640 1 -- 172.21.15.151:0/3508214748 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a780aaae0 con 0x558a4f1f2810 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a864b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a4eff7800 con 0x558a4f202e20 2024-09-13T19:07:07.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51044/0 (socket says 172.21.15.151:51044) 2024-09-13T19:07:07.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 -- 172.21.15.151:0/316501659 learned_addr learned my addr 172.21.15.151:0/316501659 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 -- 172.21.15.151:0/316501659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f203780 con 0x558a4f202e20 2024-09-13T19:07:07.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.154+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5a740484a0 tx=0x7f5a7401ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 -- 172.21.15.151:0/316501659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7401de10 con 0x558a4f202e20 2024-09-13T19:07:07.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a4f203a10 con 0x558a4f202e20 2024-09-13T19:07:07.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 -- 172.21.15.151:0/316501659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7401e3f0 con 0x558a4f202e20 2024-09-13T19:07:07.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 -- 172.21.15.151:0/316501659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7401e710 con 0x558a4f202e20 2024-09-13T19:07:07.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a4f206690 con 0x558a4f202e20 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 -- 172.21.15.151:0/316501659 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a74046040 con 0x558a4f202e20 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 0x7f595c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f59697fa640 1 -- 172.21.15.151:0/316501659 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5a7404ed20 con 0x558a4f202e20 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a837c3640 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 0x7f595c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a837c3640 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 0x7f595c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5a78000c10 tx=0x7f5a78005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a864b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a4f1de590 con 0x558a4f20f750 2024-09-13T19:07:07.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51052/0 (socket says 172.21.15.151:51052) 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a83fc4640 1 -- 172.21.15.151:0/373932848 learned_addr learned my addr 172.21.15.151:0/373932848 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a83fc4640 1 -- 172.21.15.151:0/373932848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f210100 con 0x558a4f20f750 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/373932848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5a74014fd0 tx=0x7f5a740055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b601c8b188d8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5962ffd640 1 -- 172.21.15.151:0/373932848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a7405d020 con 0x558a4f20f750 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5962ffd640 1 -- 172.21.15.151:0/373932848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7401e8b0 con 0x558a4f20f750 2024-09-13T19:07:07.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.158+0000 7f5962ffd640 1 -- 172.21.15.151:0/373932848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74041e90 con 0x558a4f20f750 2024-09-13T19:07:07.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/373932848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 msgr2=0x558a4f20fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 --2- 172.21.15.151:0/373932848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5a74014fd0 tx=0x7f5a740055f0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/373932848 shutdown_connections 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 --2- 172.21.15.151:0/373932848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f20fb30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/373932848 >> 172.21.15.151:0/373932848 conn(0x558a4f20bb30 msgr2=0x558a4f209c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/373932848 shutdown_connections 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/373932848 wait complete. 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 Processor -- start 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- start start 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a4f2105a0 con 0x558a4f20f750 2024-09-13T19:07:07.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a83fc4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:51058/0 (socket says 172.21.15.151:51058) 2024-09-13T19:07:07.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 learned_addr learned my addr 172.21.15.151:0/2870629586 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a4f216dd0 con 0x558a4f20f750 2024-09-13T19:07:07.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5a740472c0 tx=0x7f5a7402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 -- 172.21.15.151:0/2870629586 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74072070 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a4f216dd0 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 -- 172.21.15.151:0/2870629586 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7403dcc0 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a4f216dd0 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 -- 172.21.15.151:0/2870629586 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a74027690 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 -- 172.21.15.151:0/2870629586 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5a74075070 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f594c0346a0 0x7f594c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.162+0000 7f59617fa640 1 -- 172.21.15.151:0/2870629586 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5a74069030 con 0x558a4f20f750 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a837c3640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f594c0346a0 0x7f594c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f2218c0 0x558a4f223d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2244d0 con 0x558a4f2218c0 2024-09-13T19:07:07.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f2218c0 0x558a4f223d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a837c3640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f594c0346a0 0x7f594c036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a780aa910 tx=0x7f5a780c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f2218c0 0x558a4f223d80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 realm 2024-09-13T19:07:07.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2248e0 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2251b0 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f2262b0 0x558a4f2286a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f228cb0 con 0x558a4f2262b0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f2262b0 0x558a4f2286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f2262b0 0x558a4f2286a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 20 searching for the correct realm 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a580 con 0x558a4f2262b0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5a74077060 0x7f5a74059440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a580 con 0x7f5a74077060 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a837c3640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5a74077060 0x7f5a74059440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.166+0000 7f5a837c3640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5a74077060 0x7f5a74059440 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a780aaae0 con 0x7f5a74077060 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a580 con 0x7f5a74077060 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a780aaae0 con 0x7f5a74077060 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a580 con 0x558a4f2218c0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5a7c018410 0x7f5a7c018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5a7c018410 0x7f5a7c018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5a7c018410 0x7f5a7c018890 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x7f5a7c018410 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x7f5a7c018410 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a74077060 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a780aaae0 con 0x7f5a74077060 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.170+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x7f5a7c018410 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a74077060 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a780aaae0 con 0x7f5a74077060 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x7f5a7c018410 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.174+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x7f5a7c018410 2024-09-13T19:07:07.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a74077060 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a780aaae0 con 0x7f5a74077060 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c0083f0 con 0x558a4f2218c0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a74077060 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2262b0 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.178+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x7f5a7c018410 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a4f225550 con 0x558a4f2218c0 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f5a7c03b040 con 0x7f5a74077060 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:07.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f229570 con 0x558a4f2218c0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f229960 con 0x558a4f2218c0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f229960 con 0x7f5a74077060 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 zone default found 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 4 Realm: () 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 zonegroup default 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a230 con 0x7f5a7c018410 2024-09-13T19:07:07.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22a230 con 0x558a4f2262b0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22c390 con 0x558a4f2262b0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 started sync module instance, tier type = 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.182+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22b830 con 0x7f5a74077060 2024-09-13T19:07:07.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94052521524304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22cc70 con 0x7f5a74077060 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22d4c0 con 0x558a4f2218c0 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94052521524304] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94052521527232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22d4c0 con 0x558a4f2218c0 2024-09-13T19:07:07.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.186+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22dfc0 con 0x558a4f2262b0 2024-09-13T19:07:07.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94052521527232] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94052521529360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22d430 con 0x558a4f2262b0 2024-09-13T19:07:07.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22ed10 con 0x7f5a74077060 2024-09-13T19:07:07.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94052521535584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22f5b0 con 0x7f5a74077060 2024-09-13T19:07:07.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.190+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22ffd0 con 0x558a4f2218c0 2024-09-13T19:07:07.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94052521529360] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94052521535584] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94052521540288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22f100 con 0x558a4f2218c0 2024-09-13T19:07:07.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f230870 con 0x7f5a7c018410 2024-09-13T19:07:07.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.194+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94052521540288] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94052521534384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f22f100 con 0x7f5a7c018410 2024-09-13T19:07:07.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f230d60 con 0x7f5a7c018410 2024-09-13T19:07:07.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94052521534384] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94052521542592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f230c90 con 0x7f5a7c018410 2024-09-13T19:07:07.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.198+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f231770 con 0x7f5a7c018410 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94052521546432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f231b90 con 0x7f5a7c018410 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=0 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=1 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=2 2024-09-13T19:07:07.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=3 2024-09-13T19:07:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=4 2024-09-13T19:07:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=5 2024-09-13T19:07:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94052521542592] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=6 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94052521546432] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 20 add_watcher() i=7 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2307e0 con 0x558a4f2218c0 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.202+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94052521543648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2320a0 con 0x558a4f2218c0 2024-09-13T19:07:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94052521543648] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a864b4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a864b4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:07.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23d4d0 con 0x558a4f2218c0 2024-09-13T19:07:07.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.206+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23dba0 con 0x7f5a7c018410 2024-09-13T19:07:07.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.210+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.210+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23dfe0 con 0x558a4f2262b0 2024-09-13T19:07:07.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.210+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.210+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23df30 con 0x558a4f2218c0 2024-09-13T19:07:07.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23e4c0 con 0x7f5a74077060 2024-09-13T19:07:07.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23ea30 con 0x558a4f2262b0 2024-09-13T19:07:07.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.214+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23ea30 con 0x558a4f2218c0 2024-09-13T19:07:07.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.218+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.218+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23eac0 con 0x7f5a7c018410 2024-09-13T19:07:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23eb50 con 0x7f5a74077060 2024-09-13T19:07:07.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f140 con 0x558a4f2262b0 2024-09-13T19:07:07.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.222+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f140 con 0x7f5a74077060 2024-09-13T19:07:07.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.226+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.226+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f6b0 con 0x7f5a7c018410 2024-09-13T19:07:07.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f6b0 con 0x7f5a74077060 2024-09-13T19:07:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f910 con 0x7f5a7c018410 2024-09-13T19:07:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.230+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f910 con 0x558a4f2218c0 2024-09-13T19:07:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.234+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.234+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f850 con 0x558a4f2262b0 2024-09-13T19:07:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.234+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.234+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f850 con 0x7f5a74077060 2024-09-13T19:07:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.238+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.238+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f8e0 con 0x558a4f2262b0 2024-09-13T19:07:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.238+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.238+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f8e0 con 0x558a4f2218c0 2024-09-13T19:07:07.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.242+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.245 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.242+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f8e0 con 0x558a4f2218c0 2024-09-13T19:07:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.242+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.242+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f8e0 con 0x558a4f2262b0 2024-09-13T19:07:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.246+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.246+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f8e0 con 0x7f5a74077060 2024-09-13T19:07:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.246+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.246+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.250+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.254+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.254+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x7f5a7c018410 2024-09-13T19:07:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.254+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.254+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.258+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.258+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x7f5a7c018410 2024-09-13T19:07:07.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.258+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.258+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.262+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.262+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x7f5a7c018410 2024-09-13T19:07:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.262+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.262+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23f9f0 con 0x7f5a74077060 2024-09-13T19:07:07.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5938fe1640 20 reqs_thread_entry: start 2024-09-13T19:07:07.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:07.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 20 Filter name: none 2024-09-13T19:07:07.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:07:07.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f23b930 con 0x7f5a74077060 2024-09-13T19:07:07.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f58b27fc640 20 reqs_thread_entry: start 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv35 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 : miss 2024-09-13T19:07:07.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.266+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 8.1f 8:ff78d1c5:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25c800 con 0x7f5a74077060 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(95 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 info.flags=0x17 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 to cache LRU end 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 2024-09-13T19:07:07.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:96 4.1c 4:3bf3fa2b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d9cf0 con 0x7f5a7c018410 2024-09-13T19:07:07.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(96 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 4.e 4:71f96e13:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d9cf0 con 0x7f5a74077060 2024-09-13T19:07:07.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(97 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d9d30 con 0x558a4f2262b0 2024-09-13T19:07:07.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(98 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:07:07.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 4.8 4:12e76b9c:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d9d30 con 0x558a4f2262b0 2024-09-13T19:07:07.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(99 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 4.2b 4:d5e7bada:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x558a4f2218c0 2024-09-13T19:07:07.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(100 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.270+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:101 4.1 4:815db2fb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x7f5a74077060 2024-09-13T19:07:07.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(101 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:102 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x558a4f2218c0 2024-09-13T19:07:07.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(102 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [call out=425b] v0'0 uv12 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:07:07.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:103 4.b 4:d0b44d9f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x7f5a74077060 2024-09-13T19:07:07.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(103 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780e7040 con 0x7f5a74077060 2024-09-13T19:07:07.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x7f5a7c018410 2024-09-13T19:07:07.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(104 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:07:07.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 4.38 4:1ed81742:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x558a4f2218c0 2024-09-13T19:07:07.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(105 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2da2c0 con 0x558a4f2262b0 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(106 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 3.fs0 3:f1affd57:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d7680 con 0x7f5a74077060 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.274+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(107 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 10 manifest: total_size = 6 2024-09-13T19:07:07.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10227678111767685422 2024-09-13T19:07:07.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 20 prepare_atomic_modification: state is not atomic. state=0x558a4f2d9188 2024-09-13T19:07:07.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 2024-09-13T19:07:07.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f261840 con 0x558a4f2262b0 2024-09-13T19:07:07.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(108 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.278+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:109 3.fs0 3:f1affd57:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f261840 con 0x7f5a74077060 2024-09-13T19:07:07.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(109 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2622d0 con 0x558a4f2262b0 2024-09-13T19:07:07.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:111 3.2s0 3:402fc0bd:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2622d0 con 0x558a4f2262b0 2024-09-13T19:07:07.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(111 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 10 manifest: total_size = 3 2024-09-13T19:07:07.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1766380442428631990 2024-09-13T19:07:07.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 20 prepare_atomic_modification: state is not atomic. state=0x558a4f2d9188 2024-09-13T19:07:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 2024-09-13T19:07:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:112 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f266f80 con 0x558a4f2218c0 2024-09-13T19:07:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(112 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:113 3.2s0 3:402fc0bd:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f264f60 con 0x558a4f2262b0 2024-09-13T19:07:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(110 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.282+0000 7f5962ffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-13T19:07:07.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(113 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:114 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f262f40 con 0x558a4f2218c0 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:115 3.37s0 3:ed4f178b:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f262f40 con 0x558a4f2218c0 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(115 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 10 manifest: total_size = 4 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.2088909669983633640 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 20 prepare_atomic_modification: state is not atomic. state=0x558a4f2d9188 2024-09-13T19:07:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 2024-09-13T19:07:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:116 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f262f40 con 0x7f5a7c018410 2024-09-13T19:07:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(114 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [stat,call,call] v34'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.286+0000 7f59627fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-13T19:07:07.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.290+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(116 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.290+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:117 3.37s0 3:ed4f178b:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f262a90 con 0x558a4f2218c0 2024-09-13T19:07:07.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.290+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(117 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:118 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f262f40 con 0x7f5a7c018410 2024-09-13T19:07:07.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.296 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:119 3.22s0 3:44888a2f:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f263b70 con 0x558a4f2262b0 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(119 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 10 manifest: total_size = 5 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.3849770370522579080 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 20 prepare_atomic_modification: state is not atomic. state=0x558a4f2d9188 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 2024-09-13T19:07:07.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:120 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f268570 con 0x558a4f2262b0 2024-09-13T19:07:07.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(118 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5962ffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-13T19:07:07.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(120 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.294+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:121 3.22s0 3:44888a2f:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f267560 con 0x558a4f2262b0 2024-09-13T19:07:07.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(121 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:122 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e130 con 0x558a4f2262b0 2024-09-13T19:07:07.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:123 3.39s0 3:9c03d312:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e130 con 0x558a4f2262b0 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(123 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv7 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 10 manifest: total_size = 5 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 20 get_obj_state: setting s->obj_tag to _ZnzHEfqgI8doYmqjM6ZOE37sCz_3bjc 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 20 get_obj_state: octx=0x7f5a780c8a00 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558a4f2d9188 s->prefetch_data=0 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 20 prepare_atomic_modification: state is not atomic. state=0x558a4f2d9188 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 2024-09-13T19:07:07.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.298+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:124 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e130 con 0x558a4f2262b0 2024-09-13T19:07:07.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(122 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f59627fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-13T19:07:07.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(124 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:125 3.39s0 3:9c03d312:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e8a0 con 0x558a4f2262b0 2024-09-13T19:07:07.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(125 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'8 uv8 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:126 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e130 con 0x558a4f2262b0 2024-09-13T19:07:07.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:127 4.1c 4:3bf3fa2b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25e670 con 0x7f5a7c018410 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:128 4.e 4:71f96e13:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f266690 con 0x7f5a74077060 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:129 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2d9450 con 0x558a4f2262b0 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:130 4.8 4:12e76b9c:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f26df60 con 0x558a4f2262b0 2024-09-13T19:07:07.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:131 4.2b 4:d5e7bada:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f270d00 con 0x558a4f2218c0 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:132 4.1 4:815db2fb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f273630 con 0x7f5a74077060 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:133 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f275fe0 con 0x558a4f2218c0 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:134 4.b 4:d0b44d9f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f278d80 con 0x7f5a74077060 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:135 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f27bbb0 con 0x7f5a7c018410 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:136 4.38 4:1ed81742:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f27e9e0 con 0x558a4f2218c0 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.302+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:137 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x558a4f2262b0 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(128 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(132 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(131 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(134 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(133 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(127 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(129 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(136 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(130 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(135 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(126 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5962ffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-13T19:07:07.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 44 ==== osd_op_reply(137 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5])"; uploads.size()=0; is_truncated=0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:138 4.1c 4:3bf3fa2b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a7c018410 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:139 4.e 4:71f96e13:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f27bb30 con 0x7f5a74077060 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:140 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x558a4f2262b0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:141 4.8 4:12e76b9c:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2706b0 con 0x558a4f2262b0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:142 4.2b 4:d5e7bada:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f27bb30 con 0x558a4f2218c0 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:143 4.1 4:815db2fb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a74077060 2024-09-13T19:07:07.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:144 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2706b0 con 0x558a4f2218c0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:145 4.b 4:d0b44d9f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2731d0 con 0x7f5a74077060 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:146 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f27bb30 con 0x7f5a7c018410 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:147 4.38 4:1ed81742:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2706b0 con 0x558a4f2218c0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:148 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x558a4f2262b0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(139 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 45 ==== osd_op_reply(141 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(142 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 46 ==== osd_op_reply(140 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(138 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 47 ==== osd_op_reply(148 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(145 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.306+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(143 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(144 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(146 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(147 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9 [call out=85b] v0'0 uv10 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a74077060 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(149 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a864b4980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-13T19:07:07.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.310+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a74077060 2024-09-13T19:07:07.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(150 myfoo [call,call,delete] v34'40 uv40 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:07:07.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:07:07.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94052522228080 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a7c018410 2024-09-13T19:07:07.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== watch-notify(notify (1) cookie 94052521542592 notify 146028888089 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558a4f23f140 con 0x7f5a7c018410 2024-09-13T19:07:07.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5962ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94052521542592 notifier 4645 bl.length()=149 2024-09-13T19:07:07.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5962ffd640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f5948003d70 con 0x7f5a7c018410 2024-09-13T19:07:07.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(151 notify.6 [notify cookie 94052522228080 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== watch-notify(notify_complete (2) cookie 94052522228080 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558a4f203a10 con 0x7f5a7c018410 2024-09-13T19:07:07.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:153 8.1f 8:ff78d1c5:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a74077060 2024-09-13T19:07:07.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(153 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 from cache 2024-09-13T19:07:07.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5, ofs0, ns] 2024-09-13T19:07:07.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94052521723760 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a7c018410 2024-09-13T19:07:07.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== watch-notify(notify (1) cookie 94052521542592 notify 146028888090 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558a4f203a10 con 0x7f5a7c018410 2024-09-13T19:07:07.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.314+0000 7f59627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94052521542592 notifier 4645 bl.length()=206 2024-09-13T19:07:07.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f59627fc640 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f58b80032d0 con 0x7f5a7c018410 2024-09-13T19:07:07.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(154 notify.6 [notify cookie 94052521723760 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== watch-notify(notify_complete (2) cookie 94052521723760 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558a4f23d660 con 0x7f5a7c018410 2024-09-13T19:07:07.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:156 4.1c 4:3bf3fa2b:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a7c018410 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:157 4.e 4:71f96e13:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25ea20 con 0x7f5a74077060 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:158 4.6 4:626746d8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d120 con 0x558a4f2262b0 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:159 4.8 4:12e76b9c:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d9f0 con 0x558a4f2262b0 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:160 4.2b 4:d5e7bada:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25dd90 con 0x558a4f2218c0 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:161 4.1 4:815db2fb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25ea20 con 0x7f5a74077060 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:162 4.38 4:1f77bdf5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d120 con 0x558a4f2218c0 2024-09-13T19:07:07.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:163 4.b 4:d0b44d9f:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d9f0 con 0x7f5a74077060 2024-09-13T19:07:07.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:164 4.21 4:87c6bad6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f281810 con 0x7f5a7c018410 2024-09-13T19:07:07.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:165 4.38 4:1ed81742:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25dd90 con 0x558a4f2218c0 2024-09-13T19:07:07.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:166 4.16 4:6ac9bfae:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25ea20 con 0x558a4f2262b0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(162 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.6 [delete] v34'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(156 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.0 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(157 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(161 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(163 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(164 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.318+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 48 ==== osd_op_reply(159 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.3 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(165 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.9 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(160 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 49 ==== osd_op_reply(158 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.2 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 50 ==== osd_op_reply(166 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5.10 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 : miss 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:167 6.e 6:7689a9ea:::pubsub..bucket.myfoo%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d120 con 0x558a4f2218c0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(167 pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 info.flags=0x0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 10 adding default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 to cache LRU end 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:168 6.e 6:7689a9ea:::pubsub..bucket.myfoo%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f25d120 con 0x558a4f2218c0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(168 pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.5 [delete] v34'27 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.322+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a74077060 2024-09-13T19:07:07.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.326+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(169 foo.buckets [call] v34'41 uv41 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.326+0000 7f5939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.326+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94052521543648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x558a4f2218c0 2024-09-13T19:07:07.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94052521543648] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94052521524304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a74077060 2024-09-13T19:07:07.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94052521524304] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 20 remove_watcher() i=0 2024-09-13T19:07:07.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 2 removed watcher, disabling cache 2024-09-13T19:07:07.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94052521527232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x558a4f2218c0 2024-09-13T19:07:07.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94052521527232] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 20 remove_watcher() i=1 2024-09-13T19:07:07.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.330+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94052521529360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x558a4f2262b0 2024-09-13T19:07:07.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a83fc4640 1 -- 172.21.15.151:0/2870629586 <== osd.3 v2:172.21.15.151:6800/3085220080 51 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94052521529360] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a74074030 con 0x558a4f2262b0 2024-09-13T19:07:07.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a864b4980 20 remove_watcher() i=2 2024-09-13T19:07:07.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94052521535584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a74077060 2024-09-13T19:07:07.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a837c3640 1 -- 172.21.15.151:0/2870629586 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94052521535584] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a780f4390 con 0x7f5a74077060 2024-09-13T19:07:07.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a864b4980 20 remove_watcher() i=3 2024-09-13T19:07:07.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.334+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94052521540288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x558a4f2218c0 2024-09-13T19:07:07.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94052521540288] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x558a4f2218c0 2024-09-13T19:07:07.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a864b4980 20 remove_watcher() i=4 2024-09-13T19:07:07.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94052521534384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a7c018410 2024-09-13T19:07:07.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94052521534384] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a864b4980 20 remove_watcher() i=5 2024-09-13T19:07:07.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.338+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94052521542592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a7c018410 2024-09-13T19:07:07.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.342+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94052521542592] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.342+0000 7f5a864b4980 20 remove_watcher() i=6 2024-09-13T19:07:07.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.342+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94052521546432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a4f2817d0 con 0x7f5a7c018410 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94052521546432] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a7c036040 con 0x7f5a7c018410 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 20 remove_watcher() i=7 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5a7c018410 msgr2=0x7f5a7c018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f5a7c018410 0x7f5a7c018890 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f2218c0 msgr2=0x558a4f223d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f2218c0 0x558a4f223d80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5a74077060 msgr2=0x7f5a74059440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f5a74077060 0x7f5a74059440 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f2262b0 msgr2=0x558a4f2286a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f2262b0 0x558a4f2286a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f594c0346a0 msgr2=0x7f594c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f594c0346a0 0x7f594c036b60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5a780aa910 tx=0x7f5a780c1040 comp rx=0 tx=0).stop 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a847c5640 1 -- 172.21.15.151:0/2870629586 reap_dead start 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 msgr2=0x558a4f216890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5a740472c0 tx=0x7f5a7402d000 comp rx=0 tx=0).stop 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 shutdown_connections 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/2870629586 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f20f750 0x558a4f216890 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 >> 172.21.15.151:0/2870629586 conn(0x558a4f20bb30 msgr2=0x558a4f209c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 shutdown_connections 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/2870629586 wait complete. 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 msgr2=0x7f595c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 0x7f595c036b10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5a78000c10 tx=0x7f5a78005ad0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 msgr2=0x558a4f203240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5a740484a0 tx=0x7f5a7401ee40 comp rx=0 tx=0).stop 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 shutdown_connections 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f595c034650 0x7f595c036b10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/316501659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f202e20 0x558a4f203240 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 >> 172.21.15.151:0/316501659 conn(0x558a4f1f7f70 msgr2=0x558a4f1fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 shutdown_connections 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/316501659 wait complete. 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f0f6c70 msgr2=0x558a4f1ebfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a4f0f6c70 0x558a4f1ebfa0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a4f1f2810 msgr2=0x558a4f1f4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a4f1f2810 0x558a4f1f4c00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f1ee910 msgr2=0x558a4f1f0d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a4f1ee910 0x558a4f1f0d00 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f596c034650 msgr2=0x7f596c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f596c034650 0x7f596c036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5a780ae000 tx=0x7f5a780a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 msgr2=0x558a4f1e4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 --2- 172.21.15.151:0/3508214748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a4f0f28f0 0x558a4f1e4fb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5a74006640 tx=0x7f5a74000f50 comp rx=0 tx=0).stop 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a847c5640 1 -- 172.21.15.151:0/3508214748 reap_dead start 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 shutdown_connections 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 >> 172.21.15.151:0/3508214748 conn(0x558a4f066240 msgr2=0x558a4f1d83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 shutdown_connections 2024-09-13T19:07:07.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.346+0000 7f5a864b4980 1 -- 172.21.15.151:0/3508214748 wait complete. 2024-09-13T19:07:07.361 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:07:07.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:07:07.361 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-13T19:07:07.441 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:07.441 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:07.442 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1949ac980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a5caccad0 0x558a5cacceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1949ac980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a5c956ae0 con 0x558a5cacd3f0 2024-09-13T19:07:07.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1949ac980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x558a5c97ae30 con 0x558a5caccad0 2024-09-13T19:07:07.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1924bc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a5caccad0 0x558a5cacceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1924bc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558a5caccad0 0x558a5cacceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53478/0 (socket says 172.21.15.151:53478) 2024-09-13T19:07:07.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1924bc640 1 -- 172.21.15.151:0/3788896853 learned_addr learned my addr 172.21.15.151:0/3788896853 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1924bc640 1 -- 172.21.15.151:0/3788896853 >> v1:172.21.15.12:6789/0 conn(0x558a5cacd3f0 legacy=0x558a5cad3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.438+0000 7ff1924bc640 1 -- 172.21.15.151:0/3788896853 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cad62d0 con 0x558a5caccad0 2024-09-13T19:07:07.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1924bc640 1 --2- 172.21.15.151:0/3788896853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacceb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff18400a4e0 tx=0x7ff18401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4c988d0a3595a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.446 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1914ba640 1 -- 172.21.15.151:0/3788896853 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840aa540 con 0x558a5caccad0 2024-09-13T19:07:07.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1914ba640 1 -- 172.21.15.151:0/3788896853 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840aa6e0 con 0x558a5caccad0 2024-09-13T19:07:07.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1914ba640 1 -- 172.21.15.151:0/3788896853 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840aaa40 con 0x558a5caccad0 2024-09-13T19:07:07.447 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 -- 172.21.15.151:0/3788896853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 msgr2=0x558a5cacceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3788896853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacceb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff18400a4e0 tx=0x7ff18401b090 comp rx=0 tx=0).stop 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 -- 172.21.15.151:0/3788896853 shutdown_connections 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3788896853 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacceb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 -- 172.21.15.151:0/3788896853 >> 172.21.15.151:0/3788896853 conn(0x558a5cac87b0 msgr2=0x558a5cacabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 -- 172.21.15.151:0/3788896853 shutdown_connections 2024-09-13T19:07:07.448 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.442+0000 7ff1949ac980 1 -- 172.21.15.151:0/3788896853 wait complete. 2024-09-13T19:07:07.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1949ac980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1949ac980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a5c97c200 con 0x558a5caccad0 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53480/0 (socket says 172.21.15.151:53480) 2024-09-13T19:07:07.464 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.458+0000 7ff1924bc640 1 -- 172.21.15.151:0/2283105622 learned_addr learned my addr 172.21.15.151:0/2283105622 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 -- 172.21.15.151:0/2283105622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cacf8c0 con 0x558a5caccad0 2024-09-13T19:07:07.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 --2- 172.21.15.151:0/2283105622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff184017ca0 tx=0x7ff1840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a607dac8833c8ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff080608640 1 -- 172.21.15.151:0/2283105622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840b9070 con 0x558a5caccad0 2024-09-13T19:07:07.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff080608640 1 -- 172.21.15.151:0/2283105622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840aaa80 con 0x558a5caccad0 2024-09-13T19:07:07.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff080608640 1 -- 172.21.15.151:0/2283105622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840aad60 con 0x558a5caccad0 2024-09-13T19:07:07.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- 172.21.15.151:0/2283105622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 msgr2=0x558a5cacf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2283105622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff184017ca0 tx=0x7ff1840033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- 172.21.15.151:0/2283105622 shutdown_connections 2024-09-13T19:07:07.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2283105622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cacf2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- 172.21.15.151:0/2283105622 >> 172.21.15.151:0/2283105622 conn(0x558a5cac87b0 msgr2=0x558a5cbb5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- 172.21.15.151:0/2283105622 shutdown_connections 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- 172.21.15.151:0/2283105622 wait complete. 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cbc2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1949ac980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a5cad5dd0 con 0x558a5caccad0 2024-09-13T19:07:07.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cbc2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cbc2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53494/0 (socket says 172.21.15.151:53494) 2024-09-13T19:07:07.468 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 -- 172.21.15.151:0/3447551144 learned_addr learned my addr 172.21.15.151:0/3447551144 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cbc3390 con 0x558a5caccad0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.462+0000 7ff1924bc640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cbc2e50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff18401aec0 tx=0x7ff184017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 -- 172.21.15.151:0/3447551144 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840cc070 con 0x558a5caccad0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a5cbc3620 con 0x558a5caccad0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a5cbc6300 con 0x558a5caccad0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 -- 172.21.15.151:0/3447551144 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840c7410 con 0x558a5caccad0 2024-09-13T19:07:07.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 -- 172.21.15.151:0/3447551144 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840b9070 con 0x558a5caccad0 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 -- 172.21.15.151:0/3447551144 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1840b3040 con 0x558a5caccad0 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0780346a0 0x7ff078036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff07ee05640 1 -- 172.21.15.151:0/3447551144 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff1840c4070 con 0x558a5caccad0 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cacd3f0 0x558a5cbc9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0780346a0 0x7ff078036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cbca490 con 0x558a5cacd3f0 2024-09-13T19:07:07.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff192cbd640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cacd3f0 0x558a5cbc9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0780346a0 0x7ff078036b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff17c000f70 tx=0x7ff17c001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.471 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff192cbd640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cacd3f0 0x558a5cbc9f50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff192cbd640 1 -- 172.21.15.151:0/3447551144 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cacd3f0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cbc7520 con 0x558a5cacd3f0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff192cbd640 1 -- 172.21.15.151:0/3447551144 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cacd3f0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cbcc810 0x558a5cbcec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cbcf2f0 con 0x558a5cbcc810 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1924bc640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cbcc810 0x558a5cbcec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.466+0000 7ff1924bc640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cbcc810 0x558a5cbcec00 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 -- 172.21.15.151:0/3447551144 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1840bd400 con 0x558a5cbcc810 2024-09-13T19:07:07.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cbcb6b0 con 0x558a5cacd3f0 2024-09-13T19:07:07.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff192cbd640 1 -- 172.21.15.151:0/3447551144 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cacd3f0 2024-09-13T19:07:07.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a5cbd0750 0x558a5cbd2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cbd3280 con 0x558a5cbd0750 2024-09-13T19:07:07.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a5cbd0750 0x558a5cbd2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a5cbd0750 0x558a5cbd2b40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff191cbb640 1 -- 172.21.15.151:0/3447551144 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff17c00d040 con 0x558a5cbd0750 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a5c9d5800 con 0x558a5cbe0d50 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53496/0 (socket says 172.21.15.151:53496) 2024-09-13T19:07:07.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 -- 172.21.15.151:0/3986352943 learned_addr learned my addr 172.21.15.151:0/3986352943 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 -- 172.21.15.151:0/3986352943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cbe16b0 con 0x558a5cbe0d50 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1924bc640 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff1840bffd0 tx=0x7ff1840d0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff077fff640 1 -- 172.21.15.151:0/3986352943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840e8020 con 0x558a5cbe0d50 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a5cbe1940 con 0x558a5cbe0d50 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff077fff640 1 -- 172.21.15.151:0/3986352943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840a93c0 con 0x558a5cbe0d50 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff077fff640 1 -- 172.21.15.151:0/3986352943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840a96c0 con 0x558a5cbe0d50 2024-09-13T19:07:07.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.470+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a5cbe45c0 con 0x558a5cbe0d50 2024-09-13T19:07:07.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff077fff640 1 -- 172.21.15.151:0/3986352943 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1840eb020 con 0x558a5cbe0d50 2024-09-13T19:07:07.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff077fff640 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 0x7ff06c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff077fff640 1 -- 172.21.15.151:0/3986352943 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff1840eed20 con 0x558a5cbe0d50 2024-09-13T19:07:07.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 0x7ff06c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff191cbb640 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 0x7ff06c036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558a5cbca990 tx=0x7ff17c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1949ac980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1949ac980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a5cacda20 con 0x558a5cbed6a0 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53504/0 (socket says 172.21.15.151:53504) 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1924bc640 1 -- 172.21.15.151:0/1742403948 learned_addr learned my addr 172.21.15.151:0/1742403948 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1924bc640 1 -- 172.21.15.151:0/1742403948 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cbee070 con 0x558a5cbed6a0 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff1924bc640 1 --2- 172.21.15.151:0/1742403948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff1840d2f60 tx=0x7ff1840ec3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511f8cb4182021d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff075ffb640 1 -- 172.21.15.151:0/1742403948 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840e1390 con 0x558a5cbed6a0 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff075ffb640 1 -- 172.21.15.151:0/1742403948 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840ce310 con 0x558a5cbed6a0 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.474+0000 7ff075ffb640 1 -- 172.21.15.151:0/1742403948 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840d0770 con 0x558a5cbed6a0 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/1742403948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 msgr2=0x558a5cbedaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 --2- 172.21.15.151:0/1742403948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff1840d2f60 tx=0x7ff1840ec3b0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/1742403948 shutdown_connections 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 --2- 172.21.15.151:0/1742403948 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbedaa0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/1742403948 >> 172.21.15.151:0/1742403948 conn(0x558a5cbe9a20 msgr2=0x558a5cbe7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/1742403948 shutdown_connections 2024-09-13T19:07:07.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/1742403948 wait complete. 2024-09-13T19:07:07.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 Processor -- start 2024-09-13T19:07:07.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- start start 2024-09-13T19:07:07.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558a5cbee430 con 0x558a5cbed6a0 2024-09-13T19:07:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1924bc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53520/0 (socket says 172.21.15.151:53520) 2024-09-13T19:07:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 learned_addr learned my addr 172.21.15.151:0/2551979572 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a5cbf4cd0 con 0x558a5cbed6a0 2024-09-13T19:07:07.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1924bc640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1840ec3f0 tx=0x7ff1840d2ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff063fff640 1 -- 172.21.15.151:0/2551979572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff184112070 con 0x558a5cbed6a0 2024-09-13T19:07:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff063fff640 1 -- 172.21.15.151:0/2551979572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1840d03f0 con 0x558a5cbed6a0 2024-09-13T19:07:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a5cbf4cd0 con 0x558a5cbed6a0 2024-09-13T19:07:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff063fff640 1 -- 172.21.15.151:0/2551979572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1840e4150 con 0x558a5cbed6a0 2024-09-13T19:07:07.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a5cbf5140 con 0x558a5cbed6a0 2024-09-13T19:07:07.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff063fff640 1 -- 172.21.15.151:0/2551979572 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff184115070 con 0x558a5cbed6a0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.478+0000 7ff063fff640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff05c034650 0x7ff05c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff063fff640 1 -- 172.21.15.151:0/2551979572 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff184118d60 con 0x558a5cbed6a0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff191cbb640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff05c034650 0x7ff05c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cbff8d0 0x558a5cc01d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc024e0 con 0x558a5cbff8d0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cbff8d0 0x558a5cc01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff191cbb640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff05c034650 0x7ff05c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x558a5cbd3680 tx=0x7ff17c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cbff8d0 0x558a5cc01d90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 realm 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc028f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc031c0 con 0x558a5cbff8d0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cc042c0 0x558a5cc066b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc06c80 con 0x558a5cc042c0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cc042c0 0x558a5cc066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cc042c0 0x558a5cc066b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:07.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 20 searching for the correct realm 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc08550 con 0x558a5cc042c0 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff184117060 0x7ff184123660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc08550 con 0x7ff184117060 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff191cbb640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff184117060 0x7ff184123660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.482+0000 7ff191cbb640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff184117060 0x7ff184123660 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc08550 con 0x7ff184117060 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc08550 con 0x558a5cbff8d0 2024-09-13T19:07:07.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff18c018410 0x7ff18c018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff18c018410 0x7ff18c018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff18c018410 0x7ff18c018890 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x7ff18c018410 2024-09-13T19:07:07.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x7ff18c018410 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff184117060 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.486+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x7ff18c018410 2024-09-13T19:07:07.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff184117060 2024-09-13T19:07:07.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x7ff18c018410 2024-09-13T19:07:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.490+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x7ff18c018410 2024-09-13T19:07:07.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff184117060 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c0083f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff184117060 2024-09-13T19:07:07.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cc042c0 2024-09-13T19:07:07.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.494+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x7ff18c018410 2024-09-13T19:07:07.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc03560 con 0x558a5cbff8d0 2024-09-13T19:07:07.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff18c03b040 con 0x7ff184117060 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc07540 con 0x558a5cbff8d0 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc07930 con 0x558a5cbff8d0 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc07930 con 0x7ff184117060 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 zone default found 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 4 Realm: () 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:07.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 zonegroup default 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc08270 con 0x7ff18c018410 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0a360 con 0x558a5cc042c0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0a700 con 0x558a5cc042c0 2024-09-13T19:07:07.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 started sync module instance, tier type = 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.498+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc09800 con 0x7ff184117060 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94052749974512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0af50 con 0x7ff184117060 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0b7a0 con 0x558a5cbff8d0 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94052749974512] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94052749978272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0b7a0 con 0x558a5cbff8d0 2024-09-13T19:07:07.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.502+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0c1a0 con 0x558a5cc042c0 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94052749982896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0ca40 con 0x558a5cc042c0 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0d440 con 0x7ff184117060 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94052749978272] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94052749980400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0d830 con 0x7ff184117060 2024-09-13T19:07:07.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.506+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0e1f0 con 0x558a5cbff8d0 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94052749982896] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94052749980400] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94052749987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0dd40 con 0x558a5cbff8d0 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0e590 con 0x7ff18c018410 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94052749987664] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94052749991232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0e980 con 0x7ff18c018410 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.510+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0f1d0 con 0x7ff18c018410 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94052749994368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0f2f0 con 0x7ff18c018410 2024-09-13T19:07:07.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0fe10 con 0x7ff18c018410 2024-09-13T19:07:07.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94052749991232] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94052749994368] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94052749995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0e160 con 0x7ff18c018410 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=0 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=1 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=2 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=3 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=4 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=5 2024-09-13T19:07:07.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.514+0000 7ff1949ac980 20 add_watcher() i=6 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94052749995424] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 20 add_watcher() i=7 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc12e00 con 0x558a5cbff8d0 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94052749998304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc10280 con 0x558a5cbff8d0 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94052749998304] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.518+0000 7ff1949ac980 5 note: GC not initialized 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7fefc37fe640 20 reqs_thread_entry: start 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 20 Filter name: none 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7fefc17fa640 20 reqs_thread_entry: start 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:07:07.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc36340 con 0x558a5cbff8d0 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:07.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc3c500 con 0x558a5cbff8d0 2024-09-13T19:07:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:07:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:07:07.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94052750180208 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc37dc0 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 94052749987664 notify 146028888086 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7ff18c010040 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff075ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94052749987664 notifier 4652 bl.length()=579 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff075ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff075ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 94052750180208 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff075ffb640 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff058003eb0 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.522+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 94052750180208 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff18c0079d0 con 0x558a5cbff8d0 2024-09-13T19:07:07.528 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:07:07.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94052749998304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc34170 con 0x558a5cbff8d0 2024-09-13T19:07:07.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94052749998304] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94052749974512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc34170 con 0x7ff184117060 2024-09-13T19:07:07.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94052749974512] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff1949ac980 20 remove_watcher() i=0 2024-09-13T19:07:07.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff1949ac980 2 removed watcher, disabling cache 2024-09-13T19:07:07.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.526+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94052749978272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc09bf0 con 0x558a5cbff8d0 2024-09-13T19:07:07.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94052749978272] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff1949ac980 20 remove_watcher() i=1 2024-09-13T19:07:07.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94052749982896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc34170 con 0x558a5cc042c0 2024-09-13T19:07:07.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff1924bc640 1 -- 172.21.15.151:0/2551979572 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94052749982896] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff184114030 con 0x558a5cc042c0 2024-09-13T19:07:07.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff1949ac980 20 remove_watcher() i=2 2024-09-13T19:07:07.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.530+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94052749980400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0aaa0 con 0x7ff184117060 2024-09-13T19:07:07.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff191cbb640 1 -- 172.21.15.151:0/2551979572 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94052749980400] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff17c036040 con 0x7ff184117060 2024-09-13T19:07:07.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff1949ac980 20 remove_watcher() i=3 2024-09-13T19:07:07.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94052749987664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc34170 con 0x558a5cbff8d0 2024-09-13T19:07:07.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94052749987664] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x558a5cbff8d0 2024-09-13T19:07:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff1949ac980 20 remove_watcher() i=4 2024-09-13T19:07:07.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.534+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94052749991232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0b2f0 con 0x7ff18c018410 2024-09-13T19:07:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94052749991232] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff1949ac980 20 remove_watcher() i=5 2024-09-13T19:07:07.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94052749994368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0aaa0 con 0x7ff18c018410 2024-09-13T19:07:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94052749994368] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff1949ac980 20 remove_watcher() i=6 2024-09-13T19:07:07.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.538+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94052749995424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a5cc0aaa0 con 0x7ff18c018410 2024-09-13T19:07:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94052749995424] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff18c036040 con 0x7ff18c018410 2024-09-13T19:07:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 20 remove_watcher() i=7 2024-09-13T19:07:07.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff18c018410 msgr2=0x7ff18c018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff18c018410 0x7ff18c018890 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cbff8d0 msgr2=0x558a5cc01d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cbff8d0 0x558a5cc01d90 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff184117060 msgr2=0x7ff184123660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff184117060 0x7ff184123660 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cc042c0 msgr2=0x558a5cc066b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cc042c0 0x558a5cc066b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff05c034650 msgr2=0x7ff05c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff05c034650 0x7ff05c036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x558a5cbd3680 tx=0x7ff17c011000 comp rx=0 tx=0).stop 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff192cbd640 1 -- 172.21.15.151:0/2551979572 reap_dead start 2024-09-13T19:07:07.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 msgr2=0x558a5cbf4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ff1840ec3f0 tx=0x7ff1840d2ec0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 shutdown_connections 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/2551979572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbed6a0 0x558a5cbf4790 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 >> 172.21.15.151:0/2551979572 conn(0x558a5cbe9a20 msgr2=0x558a5cbe7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 shutdown_connections 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/2551979572 wait complete. 2024-09-13T19:07:07.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 msgr2=0x7ff06c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 0x7ff06c036b10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x558a5cbca990 tx=0x7ff17c006000 comp rx=0 tx=0).stop 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 msgr2=0x558a5cbe1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff1840bffd0 tx=0x7ff1840d0e40 comp rx=0 tx=0).stop 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 shutdown_connections 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff06c034650 0x7ff06c036b10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3986352943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5cbe0d50 0x558a5cbe1170 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 >> 172.21.15.151:0/3986352943 conn(0x558a5cbd5ea0 msgr2=0x558a5cbd8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 shutdown_connections 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3986352943 wait complete. 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cacd3f0 msgr2=0x558a5cbc9f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558a5cacd3f0 0x558a5cbc9f50 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a5cbd0750 msgr2=0x558a5cbd2b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558a5cbd0750 0x558a5cbd2b40 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cbcc810 msgr2=0x558a5cbcec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558a5cbcc810 0x558a5cbcec00 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0780346a0 msgr2=0x7ff078036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff0780346a0 0x7ff078036b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff17c000f70 tx=0x7ff17c001420 comp rx=0 tx=0).stop 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 msgr2=0x558a5cbc2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 --2- 172.21.15.151:0/3447551144 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558a5caccad0 0x558a5cbc2e50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff18401aec0 tx=0x7ff184017e30 comp rx=0 tx=0).stop 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff192cbd640 1 -- 172.21.15.151:0/3447551144 reap_dead start 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 shutdown_connections 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 >> 172.21.15.151:0/3447551144 conn(0x558a5cac87b0 msgr2=0x558a5cacdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 shutdown_connections 2024-09-13T19:07:07.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.542+0000 7ff1949ac980 1 -- 172.21.15.151:0/3447551144 wait complete. 2024-09-13T19:07:07.558 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:07:07.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:07:07.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-13T19:07:07.558 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-13T19:07:07.640 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:07.641 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:07.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c5b6f7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557770ba07d0 0x557770b9f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c5b6f7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557770ab1ae0 con 0x557770ba03c0 2024-09-13T19:07:07.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c5b6f7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x557770ad5e30 con 0x557770ba07d0 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c58a06640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557770ba07d0 0x557770b9f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c59207640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x557770ba03c0 0x557770b9eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59168/0 (socket says 172.21.15.151:59168) 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c59207640 1 -- 172.21.15.151:0/1866385129 learned_addr learned my addr 172.21.15.151:0/1866385129 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c4bfff640 1 -- 172.21.15.151:0/1866385129 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403095267 0 0) 0x557770ab1ae0 con 0x557770ba03c0 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c4bfff640 1 -- 172.21.15.151:0/1866385129 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c44001e20 con 0x557770ba03c0 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c58a06640 1 -- 172.21.15.151:0/1866385129 >> v1:172.21.15.12:6789/0 conn(0x557770ba03c0 legacy=0x557770b9eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.638+0000 7f8c58a06640 1 -- 172.21.15.151:0/1866385129 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770b9f8f0 con 0x557770ba07d0 2024-09-13T19:07:07.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c58a06640 1 --2- 172.21.15.151:0/1866385129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba07d0 0x557770b9f290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a480 tx=0x7f8c5001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7d0e85c69845c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c4bfff640 1 -- 172.21.15.151:0/1866385129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b0070 con 0x557770ba07d0 2024-09-13T19:07:07.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c4bfff640 1 -- 172.21.15.151:0/1866385129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c500ab540 con 0x557770ba07d0 2024-09-13T19:07:07.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c4bfff640 1 -- 172.21.15.151:0/1866385129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab840 con 0x557770ba07d0 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1866385129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba07d0 msgr2=0x557770b9f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1866385129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba07d0 0x557770b9f290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000a480 tx=0x7f8c5001b280 comp rx=0 tx=0).stop 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1866385129 shutdown_connections 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1866385129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba07d0 0x557770b9f290 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1866385129 >> 172.21.15.151:0/1866385129 conn(0x557770c251c0 msgr2=0x557770c275e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1866385129 shutdown_connections 2024-09-13T19:07:07.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.642+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1866385129 wait complete. 2024-09-13T19:07:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c5b6f7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c5b6f7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557770ad7200 con 0x557770ba03c0 2024-09-13T19:07:07.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53532/0 (socket says 172.21.15.151:53532) 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c59207640 1 -- 172.21.15.151:0/487163135 learned_addr learned my addr 172.21.15.151:0/487163135 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.658+0000 7f8c59207640 1 -- 172.21.15.151:0/487163135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770d16fd0 con 0x557770ba03c0 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 --2- 172.21.15.151:0/487163135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8c54001740 tx=0x7f8c54001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bd812977e2fd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b47606640 1 -- 172.21.15.151:0/487163135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54016070 con 0x557770ba03c0 2024-09-13T19:07:07.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b47606640 1 -- 172.21.15.151:0/487163135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54004530 con 0x557770ba03c0 2024-09-13T19:07:07.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b47606640 1 -- 172.21.15.151:0/487163135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54004850 con 0x557770ba03c0 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/487163135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 msgr2=0x557770d16a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/487163135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8c54001740 tx=0x7f8c54001c00 comp rx=0 tx=0).stop 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/487163135 shutdown_connections 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/487163135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d16a00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/487163135 >> 172.21.15.151:0/487163135 conn(0x557770c251c0 msgr2=0x557770d12630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/487163135 shutdown_connections 2024-09-13T19:07:07.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/487163135 wait complete. 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d1ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557770c35210 con 0x557770ba03c0 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d1ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d1ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53546/0 (socket says 172.21.15.151:53546) 2024-09-13T19:07:07.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 -- 172.21.15.151:0/1680984850 learned_addr learned my addr 172.21.15.151:0/1680984850 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770d1e2f0 con 0x557770ba03c0 2024-09-13T19:07:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c59207640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d1ddb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8c54014040 tx=0x7f8c54001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b45e03640 1 -- 172.21.15.151:0/1680984850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54016040 con 0x557770ba03c0 2024-09-13T19:07:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b45e03640 1 -- 172.21.15.151:0/1680984850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54011400 con 0x557770ba03c0 2024-09-13T19:07:07.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557770d1e580 con 0x557770ba03c0 2024-09-13T19:07:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8b45e03640 1 -- 172.21.15.151:0/1680984850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54011720 con 0x557770ba03c0 2024-09-13T19:07:07.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.662+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557770d21260 con 0x557770ba03c0 2024-09-13T19:07:07.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8b45e03640 1 -- 172.21.15.151:0/1680984850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c54011990 con 0x557770ba03c0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8b45e03640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b400346a0 0x7f8b40036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8b45e03640 1 -- 172.21.15.151:0/1680984850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c540495c0 con 0x557770ba03c0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c58a06640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b400346a0 0x7f8b40036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770ba07d0 0x557770d24eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d253f0 con 0x557770ba07d0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59a08640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770ba07d0 0x557770d24eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c58a06640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b400346a0 0x7f8b40036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ad000 tx=0x7f8c500a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59a08640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770ba07d0 0x557770d24eb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59a08640 1 -- 172.21.15.151:0/1680984850 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770ba07d0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d22480 con 0x557770ba07d0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59a08640 1 -- 172.21.15.151:0/1680984850 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770ba07d0 2024-09-13T19:07:07.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d27720 0x557770d29b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d2a1e0 con 0x557770d27720 2024-09-13T19:07:07.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59207640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d27720 0x557770d29b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59207640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d27720 0x557770d29b10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59207640 1 -- 172.21.15.151:0/1680984850 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d27720 2024-09-13T19:07:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d265c0 con 0x557770ba07d0 2024-09-13T19:07:07.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c59a08640 1 -- 172.21.15.151:0/1680984850 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770ba07d0 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557770d2b640 0x557770d2da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d2e170 con 0x557770d2b640 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.666+0000 7f8c58a06640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557770d2b640 0x557770d2da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c58a06640 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557770d2b640 0x557770d2da30 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c58a06640 1 -- 172.21.15.151:0/1680984850 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c500b3040 con 0x557770d2b640 2024-09-13T19:07:07.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557770b30800 con 0x557770d3bc40 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53558/0 (socket says 172.21.15.151:53558) 2024-09-13T19:07:07.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c59207640 1 -- 172.21.15.151:0/3603496806 learned_addr learned my addr 172.21.15.151:0/3603496806 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c59207640 1 -- 172.21.15.151:0/3603496806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770d3c5a0 con 0x557770d3bc40 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c59207640 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8c540478b0 tx=0x7f8c5400f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8b3effd640 1 -- 172.21.15.151:0/3603496806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54046380 con 0x557770d3bc40 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8b3effd640 1 -- 172.21.15.151:0/3603496806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c540490c0 con 0x557770d3bc40 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557770d3c830 con 0x557770d3bc40 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8b3effd640 1 -- 172.21.15.151:0/3603496806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c540493e0 con 0x557770d3bc40 2024-09-13T19:07:07.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557770d3f4b0 con 0x557770d3bc40 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.670+0000 7f8b3effd640 1 -- 172.21.15.151:0/3603496806 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c5402d350 con 0x557770d3bc40 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8b3effd640 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 0x7f8b30036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8b3effd640 1 -- 172.21.15.151:0/3603496806 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c54039dd0 con 0x557770d3bc40 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 0x7f8b30036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 0x7f8b30036b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x557770d25cd0 tx=0x7f8c50005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557770d17350 con 0x557770d48550 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53574/0 (socket says 172.21.15.151:53574) 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 -- 172.21.15.151:0/3324151431 learned_addr learned my addr 172.21.15.151:0/3324151431 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 -- 172.21.15.151:0/3324151431 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770d48f20 con 0x557770d48550 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 --2- 172.21.15.151:0/3324151431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400d010 tx=0x7f8c540258e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc7abede8b32f0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8b3cff9640 1 -- 172.21.15.151:0/3324151431 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54059070 con 0x557770d48550 2024-09-13T19:07:07.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8b3cff9640 1 -- 172.21.15.151:0/3324151431 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54045380 con 0x557770d48550 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8b3cff9640 1 -- 172.21.15.151:0/3324151431 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c5402fd70 con 0x557770d48550 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3324151431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 msgr2=0x557770d48950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3324151431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400d010 tx=0x7f8c540258e0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3324151431 shutdown_connections 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3324151431 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d48950 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3324151431 >> 172.21.15.151:0/3324151431 conn(0x557770d448d0 msgr2=0x557770d429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3324151431 shutdown_connections 2024-09-13T19:07:07.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3324151431 wait complete. 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 Processor -- start 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- start start 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d4f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c5b6f7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557770d492e0 con 0x557770d48550 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d4f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d4f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53590/0 (socket says 172.21.15.151:53590) 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.674+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 learned_addr learned my addr 172.21.15.151:0/3247433003 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557770d4fba0 con 0x557770d48550 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c59207640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d4f660 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8c54025ba0 tx=0x7f8c540452c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 -- 172.21.15.151:0/3247433003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54064020 con 0x557770d48550 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557770d4fba0 con 0x557770d48550 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 -- 172.21.15.151:0/3247433003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c54047990 con 0x557770d48550 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 -- 172.21.15.151:0/3247433003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c54059030 con 0x557770d48550 2024-09-13T19:07:07.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557770d4fba0 con 0x557770d48550 2024-09-13T19:07:07.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 -- 172.21.15.151:0/3247433003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8c54067020 con 0x557770d48550 2024-09-13T19:07:07.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b240345b0 0x7f8b24036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8b2effd640 1 -- 172.21.15.151:0/3247433003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8c5405a070 con 0x557770d48550 2024-09-13T19:07:07.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b240345b0 0x7f8b24036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770d5a7e0 0x557770d5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d5d3f0 con 0x557770d5a7e0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c59a08640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770d5a7e0 0x557770d5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b240345b0 0x7f8b24036a70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c50017e90 tx=0x7f8c500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c59a08640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770d5a7e0 0x557770d5cca0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 20 realm 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.678+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d5d800 con 0x557770d5a7e0 2024-09-13T19:07:07.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e0d0 con 0x557770d5a7e0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d5f1d0 0x557770d615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d61bd0 con 0x557770d5f1d0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d5f1d0 0x557770d615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d5f1d0 0x557770d615c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 20 searching for the correct realm 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d63430 con 0x557770d5f1d0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8c54074040 0x7f8c5402ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d63430 con 0x7f8c54074040 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8c54074040 0x7f8c5402ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8c54074040 0x7f8c5402ea60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d63430 con 0x7f8c54074040 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d63430 con 0x557770d5a7e0 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8c4c018410 0x7f8c4c018870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.682+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8c4c018410 0x7f8c4c018870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8c4c018410 0x7f8c4c018870 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x7f8c4c018410 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x7f8c4c018410 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c54074040 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x7f8c4c018410 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.686+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c54074040 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x7f8c4c018410 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x7f8c4c018410 2024-09-13T19:07:07.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.690+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c54074040 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c0083f0 con 0x557770d5a7e0 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c54074040 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5f1d0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x7f8c4c018410 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557770d5e470 con 0x557770d5a7e0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.694+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8c4c03b040 con 0x7f8c54074040 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d62420 con 0x557770d5a7e0 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d627c0 con 0x557770d5a7e0 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d627c0 con 0x7f8c54074040 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 zone default found 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 4 Realm: () 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:07.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 zonegroup default 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d63090 con 0x7f8c4c018410 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d63090 con 0x557770d5f1d0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d652e0 con 0x557770d5f1d0 2024-09-13T19:07:07.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 started sync module instance, tier type = 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.698+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d646e0 con 0x7f8c54074040 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93971482561232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d65bf0 con 0x7f8c54074040 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d66440 con 0x557770d5a7e0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93971482561232] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93971482564416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d66440 con 0x557770d5a7e0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.702+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d66f20 con 0x557770d5f1d0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93971482564416] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93971482566544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d663b0 con 0x557770d5f1d0 2024-09-13T19:07:07.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d67cb0 con 0x7f8c54074040 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93971482575008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d68970 con 0x7f8c54074040 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d69330 con 0x557770d5a7e0 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93971482566544] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.706+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93971482575008] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93971482578560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d68970 con 0x557770d5a7e0 2024-09-13T19:07:07.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d692a0 con 0x7f8c4c018410 2024-09-13T19:07:07.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93971482578560] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93971482576064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d688e0 con 0x7f8c4c018410 2024-09-13T19:07:07.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.710+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d6a080 con 0x7f8c4c018410 2024-09-13T19:07:07.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93971482576064] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93971482580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d69ff0 con 0x7f8c4c018410 2024-09-13T19:07:07.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d6aa30 con 0x7f8c4c018410 2024-09-13T19:07:07.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93971482580768] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93971482584320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d6ac10 con 0x7f8c4c018410 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=0 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=1 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=2 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=3 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=4 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=5 2024-09-13T19:07:07.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.714+0000 7f8c5b6f7980 20 add_watcher() i=6 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93971482584320] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c5b6f7980 20 add_watcher() i=7 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c5b6f7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d6dfe0 con 0x557770d5a7e0 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93971482585856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d6b3d0 con 0x557770d5a7e0 2024-09-13T19:07:07.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93971482585856] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.718+0000 7f8b0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 5 note: GC not initialized 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8b0e7e4640 20 reqs_thread_entry: start 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 Filter name: none 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8a7ffff640 20 reqs_thread_entry: start 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d91560 con 0x557770d5a7e0 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 20 rados_obj.operate() r=0 bl.length=403 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:07.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d97750 con 0x557770d5a7e0 2024-09-13T19:07:07.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:07:07.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93971482767808 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557770d92fe0 con 0x557770d5a7e0 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify (1) cookie 93971482578560 notify 146028888087 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f8c4c010040 con 0x557770d5a7e0 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8b3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93971482578560 notifier 4659 bl.length()=567 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8b3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8b3cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(64 notify.4 [notify cookie 93971482767808 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8b3cff9640 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8b1c003eb0 con 0x557770d5a7e0 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.722+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== watch-notify(notify_complete (2) cookie 93971482767808 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c4c007720 con 0x557770d5a7e0 2024-09-13T19:07:07.729 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-13T19:06:40.271996Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:06:40.271986Z","tags":[],"group_ids":[]} 2024-09-13T19:07:07.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8b0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93971482585856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d8f390 con 0x557770d5a7e0 2024-09-13T19:07:07.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93971482585856] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93971482561232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d8f390 con 0x7f8c54074040 2024-09-13T19:07:07.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93971482561232] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c5b6f7980 20 remove_watcher() i=0 2024-09-13T19:07:07.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c5b6f7980 2 removed watcher, disabling cache 2024-09-13T19:07:07.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.726+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93971482564416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d64ad0 con 0x557770d5a7e0 2024-09-13T19:07:07.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93971482564416] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c5b6f7980 20 remove_watcher() i=1 2024-09-13T19:07:07.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93971482566544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d8f390 con 0x557770d5f1d0 2024-09-13T19:07:07.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c59207640 1 -- 172.21.15.151:0/3247433003 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93971482566544] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c5402c070 con 0x557770d5f1d0 2024-09-13T19:07:07.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c5b6f7980 20 remove_watcher() i=2 2024-09-13T19:07:07.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.730+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93971482575008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d65740 con 0x7f8c54074040 2024-09-13T19:07:07.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c58a06640 1 -- 172.21.15.151:0/3247433003 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93971482575008] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c500d8070 con 0x7f8c54074040 2024-09-13T19:07:07.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c5b6f7980 20 remove_watcher() i=3 2024-09-13T19:07:07.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93971482578560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d64ad0 con 0x557770d5a7e0 2024-09-13T19:07:07.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93971482578560] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x557770d5a7e0 2024-09-13T19:07:07.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c5b6f7980 20 remove_watcher() i=4 2024-09-13T19:07:07.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.734+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93971482576064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d65f90 con 0x7f8c4c018410 2024-09-13T19:07:07.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93971482576064] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c5b6f7980 20 remove_watcher() i=5 2024-09-13T19:07:07.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93971482580768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d8f390 con 0x7f8c4c018410 2024-09-13T19:07:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93971482580768] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c5b6f7980 20 remove_watcher() i=6 2024-09-13T19:07:07.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.738+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93971482584320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557770d65740 con 0x7f8c4c018410 2024-09-13T19:07:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93971482584320] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c4c036040 con 0x7f8c4c018410 2024-09-13T19:07:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 20 remove_watcher() i=7 2024-09-13T19:07:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8c4c018410 msgr2=0x7f8c4c018870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8c4c018410 0x7f8c4c018870 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770d5a7e0 msgr2=0x557770d5cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770d5a7e0 0x557770d5cca0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8c54074040 msgr2=0x7f8c5402ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8c54074040 0x7f8c5402ea60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d5f1d0 msgr2=0x557770d615c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d5f1d0 0x557770d615c0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b240345b0 msgr2=0x7f8b24036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b240345b0 0x7f8b24036a70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c50017e90 tx=0x7f8c500a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 msgr2=0x557770d4f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3247433003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d48550 0x557770d4f660 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8c54025ba0 tx=0x7f8c540452c0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 reap_dead start 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c59a08640 1 -- 172.21.15.151:0/3247433003 reap_dead start 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 shutdown_connections 2024-09-13T19:07:07.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 >> 172.21.15.151:0/3247433003 conn(0x557770d448d0 msgr2=0x557770d429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 shutdown_connections 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3247433003 wait complete. 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 msgr2=0x7f8b30036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 0x7f8b30036b60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x557770d25cd0 tx=0x7f8c50005a10 comp rx=0 tx=0).stop 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 msgr2=0x557770d3c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8c540478b0 tx=0x7f8c5400f8b0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 shutdown_connections 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b300346a0 0x7f8b30036b60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/3603496806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770d3bc40 0x557770d3c060 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 >> 172.21.15.151:0/3603496806 conn(0x557770d30d90 msgr2=0x557770d33810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 shutdown_connections 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/3603496806 wait complete. 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770ba07d0 msgr2=0x557770d24eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557770ba07d0 0x557770d24eb0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557770d2b640 msgr2=0x557770d2da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557770d2b640 0x557770d2da30 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d27720 msgr2=0x557770d29b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557770d27720 0x557770d29b10 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b400346a0 msgr2=0x7f8b40036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8b400346a0 0x7f8b40036b60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8c500ad000 tx=0x7f8c500a5040 comp rx=0 tx=0).stop 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 msgr2=0x557770d1ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 --2- 172.21.15.151:0/1680984850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557770ba03c0 0x557770d1ddb0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8c54014040 tx=0x7f8c54001260 comp rx=0 tx=0).stop 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c59a08640 1 -- 172.21.15.151:0/1680984850 reap_dead start 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 shutdown_connections 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 >> 172.21.15.151:0/1680984850 conn(0x557770c251c0 msgr2=0x557770d111b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 shutdown_connections 2024-09-13T19:07:07.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.742+0000 7f8c5b6f7980 1 -- 172.21.15.151:0/1680984850 wait complete. 2024-09-13T19:07:07.757 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-13T19:06:40.271996Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:06:40.271986Z', 'tags': [], 'group_ids': []} 2024-09-13T19:07:07.775 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:07.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-13T19:07:07.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-13T19:07:07.776 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-13T19:07:07.832 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:07.832 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:07.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e4010980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55786ba7fac0 0x55786ba81eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e4010980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55786b903ae0 con 0x55786b9f0290 2024-09-13T19:07:07.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e4010980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55786b927e30 con 0x55786ba7fac0 2024-09-13T19:07:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e131f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55786ba7fac0 0x55786ba81eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e131f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55786ba7fac0 0x55786ba81eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53594/0 (socket says 172.21.15.151:53594) 2024-09-13T19:07:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e131f640 1 -- 172.21.15.151:0/1524406247 learned_addr learned my addr 172.21.15.151:0/1524406247 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e131f640 1 -- 172.21.15.151:0/1524406247 >> v1:172.21.15.12:6789/0 conn(0x55786b9f0290 legacy=0x55786ba7e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.830+0000 7f32e131f640 1 -- 172.21.15.151:0/1524406247 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786b9f0820 con 0x55786ba7fac0 2024-09-13T19:07:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e131f640 1 --2- 172.21.15.151:0/1524406247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786ba7fac0 0x55786ba81eb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00a5c0 tx=0x7f32cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2799d6852b3ebd5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e0b1e640 1 -- 172.21.15.151:0/1524406247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc0a6070 con 0x55786ba7fac0 2024-09-13T19:07:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e0b1e640 1 -- 172.21.15.151:0/1524406247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32cc0af070 con 0x55786ba7fac0 2024-09-13T19:07:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e0b1e640 1 -- 172.21.15.151:0/1524406247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32cc0aa5c0 con 0x55786ba7fac0 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 -- 172.21.15.151:0/1524406247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786ba7fac0 msgr2=0x55786ba81eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 --2- 172.21.15.151:0/1524406247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786ba7fac0 0x55786ba81eb0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00a5c0 tx=0x7f32cc01b340 comp rx=0 tx=0).stop 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 -- 172.21.15.151:0/1524406247 shutdown_connections 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 --2- 172.21.15.151:0/1524406247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786ba7fac0 0x55786ba81eb0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 -- 172.21.15.151:0/1524406247 >> 172.21.15.151:0/1524406247 conn(0x55786ba76090 msgr2=0x55786ba784b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 -- 172.21.15.151:0/1524406247 shutdown_connections 2024-09-13T19:07:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.834+0000 7f32e4010980 1 -- 172.21.15.151:0/1524406247 wait complete. 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e4010980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e4010980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55786b929200 con 0x55786b9f0290 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53606/0 (socket says 172.21.15.151:53606) 2024-09-13T19:07:07.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e1b20640 1 -- 172.21.15.151:0/1856506449 learned_addr learned my addr 172.21.15.151:0/1856506449 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e1b20640 1 -- 172.21.15.151:0/1856506449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786bb66fd0 con 0x55786b9f0290 2024-09-13T19:07:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f32e1b20640 1 --2- 172.21.15.151:0/1856506449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f32d40016c0 tx=0x7f32d4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67242c0f53021b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f31cfe07640 1 -- 172.21.15.151:0/1856506449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4016070 con 0x55786b9f0290 2024-09-13T19:07:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f31cfe07640 1 -- 172.21.15.151:0/1856506449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d400f640 con 0x55786b9f0290 2024-09-13T19:07:07.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.850+0000 7f31cfe07640 1 -- 172.21.15.151:0/1856506449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d400f9a0 con 0x55786b9f0290 2024-09-13T19:07:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/1856506449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 msgr2=0x55786bb66a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 --2- 172.21.15.151:0/1856506449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f32d40016c0 tx=0x7f32d4001b80 comp rx=0 tx=0).stop 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/1856506449 shutdown_connections 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 --2- 172.21.15.151:0/1856506449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786bb66a00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/1856506449 >> 172.21.15.151:0/1856506449 conn(0x55786ba76090 msgr2=0x55786bb62630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/1856506449 shutdown_connections 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/1856506449 wait complete. 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786ba7bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55786ba82f00 con 0x55786b9f0290 2024-09-13T19:07:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786ba7bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786ba7bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53614/0 (socket says 172.21.15.151:53614) 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e1b20640 1 -- 172.21.15.151:0/616297871 learned_addr learned my addr 172.21.15.151:0/616297871 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e1b20640 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786ba7a3c0 con 0x55786b9f0290 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e1b20640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786ba7bca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f32d400f610 tx=0x7f32d4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f31ce604640 1 -- 172.21.15.151:0/616297871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4021020 con 0x55786b9f0290 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f31ce604640 1 -- 172.21.15.151:0/616297871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4011770 con 0x55786b9f0290 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f31ce604640 1 -- 172.21.15.151:0/616297871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4016040 con 0x55786b9f0290 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55786ba7a650 con 0x55786b9f0290 2024-09-13T19:07:07.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.854+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55786ba7ab40 con 0x55786b9f0290 2024-09-13T19:07:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f31ce604640 1 -- 172.21.15.151:0/616297871 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32d4024020 con 0x55786b9f0290 2024-09-13T19:07:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f31ce604640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31c8034650 0x7f31c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f31ce604640 1 -- 172.21.15.151:0/616297871 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f32d4049840 con 0x55786b9f0290 2024-09-13T19:07:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e131f640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31c8034650 0x7f31c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786ba7fac0 0x55786bb77190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb776d0 con 0x55786ba7fac0 2024-09-13T19:07:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e2321640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786ba7fac0 0x55786bb77190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e131f640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31c8034650 0x7f31c8036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0ae000 tx=0x7f32cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e2321640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786ba7fac0 0x55786bb77190 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e2321640 1 -- 172.21.15.151:0/616297871 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786ba7fac0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb77a90 con 0x55786ba7fac0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e2321640 1 -- 172.21.15.151:0/616297871 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786ba7fac0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bb798a0 0x55786bb7bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb7c380 con 0x55786bb798a0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e1b20640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bb798a0 0x55786bb7bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e1b20640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bb798a0 0x55786bb7bc90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e1b20640 1 -- 172.21.15.151:0/616297871 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32d400f070 con 0x55786bb798a0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb78740 con 0x55786ba7fac0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e2321640 1 -- 172.21.15.151:0/616297871 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786ba7fac0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55786bb7d7e0 0x55786bb7fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb80310 con 0x55786bb7d7e0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e131f640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55786bb7d7e0 0x55786bb7fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.858+0000 7f32e131f640 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55786bb7d7e0 0x55786bb7fbd0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e131f640 1 -- 172.21.15.151:0/616297871 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32cc0aaad0 con 0x55786bb7d7e0 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55786b982800 con 0x55786bb8dde0 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53616/0 (socket says 172.21.15.151:53616) 2024-09-13T19:07:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e1b20640 1 -- 172.21.15.151:0/3927779387 learned_addr learned my addr 172.21.15.151:0/3927779387 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e1b20640 1 -- 172.21.15.151:0/3927779387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786bb8e740 con 0x55786bb8dde0 2024-09-13T19:07:07.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e1b20640 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f32d4047b00 tx=0x7f32d401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 -- 172.21.15.151:0/3927779387 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d4010be0 con 0x55786bb8dde0 2024-09-13T19:07:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 -- 172.21.15.151:0/3927779387 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4010d80 con 0x55786bb8dde0 2024-09-13T19:07:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55786bb8e9d0 con 0x55786bb8dde0 2024-09-13T19:07:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 -- 172.21.15.151:0/3927779387 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d402d450 con 0x55786bb8dde0 2024-09-13T19:07:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55786bb91650 con 0x55786bb8dde0 2024-09-13T19:07:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 -- 172.21.15.151:0/3927779387 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32d4049b60 con 0x55786bb8dde0 2024-09-13T19:07:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 0x7f31bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f31c77fe640 1 -- 172.21.15.151:0/3927779387 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f32d4037070 con 0x55786bb8dde0 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e131f640 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 0x7f31bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.862+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e131f640 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 0x7f31bc036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55786ba7ae60 tx=0x7f32cc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55786bb67350 con 0x55786bb9a720 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53632/0 (socket says 172.21.15.151:53632) 2024-09-13T19:07:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 -- 172.21.15.151:0/2534680384 learned_addr learned my addr 172.21.15.151:0/2534680384 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 -- 172.21.15.151:0/2534680384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786bb9b0d0 con 0x55786bb9a720 2024-09-13T19:07:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 --2- 172.21.15.151:0/2534680384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f32d4046010 tx=0x7f32d403b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a637e306a5597d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f31c57fa640 1 -- 172.21.15.151:0/2534680384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d402d5f0 con 0x55786bb9a720 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f31c57fa640 1 -- 172.21.15.151:0/2534680384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4059030 con 0x55786bb9a720 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f31c57fa640 1 -- 172.21.15.151:0/2534680384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d402dad0 con 0x55786bb9a720 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- 172.21.15.151:0/2534680384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 msgr2=0x55786bb9ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 --2- 172.21.15.151:0/2534680384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f32d4046010 tx=0x7f32d403b640 comp rx=0 tx=0).stop 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- 172.21.15.151:0/2534680384 shutdown_connections 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 --2- 172.21.15.151:0/2534680384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bb9ab00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- 172.21.15.151:0/2534680384 >> 172.21.15.151:0/2534680384 conn(0x55786bb96b00 msgr2=0x55786bb94c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- 172.21.15.151:0/2534680384 shutdown_connections 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- 172.21.15.151:0/2534680384 wait complete. 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 Processor -- start 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- start start 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e4010980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55786bb9b570 con 0x55786bb9a720 2024-09-13T19:07:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:53642/0 (socket says 172.21.15.151:53642) 2024-09-13T19:07:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 learned_addr learned my addr 172.21.15.151:0/1937227830 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.866+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55786bba1e40 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e1b20640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f32d40469a0 tx=0x7f32d4030130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 -- 172.21.15.151:0/1937227830 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d406d070 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 -- 172.21.15.151:0/1937227830 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d403baa0 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55786bba1e40 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 -- 172.21.15.151:0/1937227830 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d403be00 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55786bba1e40 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 -- 172.21.15.151:0/1937227830 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32d4070070 con 0x55786bb9a720 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31ac034650 0x7f31ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f31b37fe640 1 -- 172.21.15.151:0/1937227830 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f32d4065070 con 0x55786bb9a720 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e131f640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31ac034650 0x7f31ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786bbaca10 0x55786bbaeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbaf620 con 0x55786bbaca10 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786bbaca10 0x55786bbaeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e131f640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31ac034650 0x7f31ac036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f32cc000c10 tx=0x7f32cc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786bbaca10 0x55786bbaeed0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 realm 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbafa30 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb0300 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bbb1400 0x55786bbb37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.870+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb3dc0 con 0x55786bbb1400 2024-09-13T19:07:07.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bbb1400 0x55786bbb37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bbb1400 0x55786bbb37f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e4010980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e4010980 20 searching for the correct realm 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5690 con 0x55786bbb1400 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32d4072060 0x7f32d4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5690 con 0x7f32d4072060 2024-09-13T19:07:07.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32d4072060 0x7f32d4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32d4072060 0x7f32d4068870 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0aaad0 con 0x7f32d4072060 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5690 con 0x7f32d4072060 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0aaad0 con 0x7f32d4072060 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5690 con 0x55786bbaca10 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f32dc018410 0x7f32dc018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f32dc018410 0x7f32dc018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.874+0000 7f32e2321640 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f32dc018410 0x7f32dc018890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x7f32dc018410 2024-09-13T19:07:07.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x7f32dc018410 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32d4072060 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32cc0aaad0 con 0x7f32d4072060 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x7f32dc018410 2024-09-13T19:07:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32d4072060 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32cc0aaad0 con 0x7f32d4072060 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.878+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x7f32dc018410 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x7f32dc018410 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32d4072060 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0aaad0 con 0x7f32d4072060 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0083f0 con 0x55786bbaca10 2024-09-13T19:07:07.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.882+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32d4072060 2024-09-13T19:07:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbb1400 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x7f32dc018410 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb06a0 con 0x55786bbaca10 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f32dc03b040 con 0x7f32d4072060 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb4680 con 0x55786bbaca10 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb4a70 con 0x55786bbaca10 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.886+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb4a70 con 0x7f32d4072060 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 zone default found 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 4 Realm: () 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 zonegroup default 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5340 con 0x7f32dc018410 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb5340 con 0x55786bbb1400 2024-09-13T19:07:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb74d0 con 0x55786bbb1400 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 started sync module instance, tier type = 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6940 con 0x7f32d4072060 2024-09-13T19:07:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93975691881776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb65a0 con 0x7f32d4072060 2024-09-13T19:07:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.890+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb83e0 con 0x55786bbaca10 2024-09-13T19:07:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93975691881776] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93975691886384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb8800 con 0x55786bbaca10 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb91c0 con 0x55786bbb1400 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93975691886384] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.894+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93975691887440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb8770 con 0x55786bbb1400 2024-09-13T19:07:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb9ec0 con 0x7f32d4072060 2024-09-13T19:07:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93975691895472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbab80 con 0x7f32d4072060 2024-09-13T19:07:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbb540 con 0x55786bbaca10 2024-09-13T19:07:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93975691887440] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93975691895472] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93975691899024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbab80 con 0x55786bbaca10 2024-09-13T19:07:07.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.898+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbb4b0 con 0x7f32dc018410 2024-09-13T19:07:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.902+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.902+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93975691900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbbde0 con 0x7f32dc018410 2024-09-13T19:07:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.902+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbc830 con 0x7f32dc018410 2024-09-13T19:07:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.902+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93975691899024] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.902+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93975691900080] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.906+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.906+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93975691903776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbb930 con 0x7f32dc018410 2024-09-13T19:07:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.906+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbcec0 con 0x7f32dc018410 2024-09-13T19:07:07.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93975691905552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbd2e0 con 0x7f32dc018410 2024-09-13T19:07:07.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=0 2024-09-13T19:07:07.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=1 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=2 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=3 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=4 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=5 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93975691903776] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=6 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93975691905552] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 20 add_watcher() i=7 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc0310 con 0x55786bbaca10 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.910+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93975691906608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbd700 con 0x55786bbaca10 2024-09-13T19:07:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93975691906608] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f3197fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e4010980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e4010980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:07.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc8a40 con 0x55786bbaca10 2024-09-13T19:07:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.914+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc9110 con 0x7f32dc018410 2024-09-13T19:07:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc9530 con 0x55786bbb1400 2024-09-13T19:07:07.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc95a0 con 0x55786bbaca10 2024-09-13T19:07:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.918+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc9b10 con 0x7f32d4072060 2024-09-13T19:07:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca080 con 0x55786bbb1400 2024-09-13T19:07:07.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca440 con 0x55786bbaca10 2024-09-13T19:07:07.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.922+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca440 con 0x7f32dc018410 2024-09-13T19:07:07.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.926+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.926+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca440 con 0x7f32d4072060 2024-09-13T19:07:07.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca8f0 con 0x55786bbb1400 2024-09-13T19:07:07.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbca8f0 con 0x7f32d4072060 2024-09-13T19:07:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.930+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcae60 con 0x7f32dc018410 2024-09-13T19:07:07.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.934+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.934+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcae60 con 0x7f32d4072060 2024-09-13T19:07:07.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.934+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.934+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x7f32dc018410 2024-09-13T19:07:07.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.938+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.938+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbaca10 2024-09-13T19:07:07.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.938+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.938+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbb1400 2024-09-13T19:07:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.938+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.942+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x7f32d4072060 2024-09-13T19:07:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.942+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.942+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbb1400 2024-09-13T19:07:07.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.942+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.942+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbaca10 2024-09-13T19:07:07.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.946+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.946+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbaca10 2024-09-13T19:07:07.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.946+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.946+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x55786bbb1400 2024-09-13T19:07:07.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6880 con 0x7f32d4072060 2024-09-13T19:07:07.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc6930 con 0x55786bbb1400 2024-09-13T19:07:07.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.950+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x55786bbb1400 2024-09-13T19:07:07.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.954+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.954+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x55786bbb1400 2024-09-13T19:07:07.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.954+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.954+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x55786bbb1400 2024-09-13T19:07:07.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.958+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.958+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x7f32dc018410 2024-09-13T19:07:07.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.958+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.958+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x55786bbb1400 2024-09-13T19:07:07.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.962+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.962+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x7f32dc018410 2024-09-13T19:07:07.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.962+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.962+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x55786bbb1400 2024-09-13T19:07:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.966+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.966+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x7f32dc018410 2024-09-13T19:07:07.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.966+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbcb450 con 0x7f32d4072060 2024-09-13T19:07:07.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f3196fe5640 20 reqs_thread_entry: start 2024-09-13T19:07:07.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:07.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 20 Filter name: none 2024-09-13T19:07:07.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f3194fe1640 20 reqs_thread_entry: start 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 20 rados->read ofs=0 len=0 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.970+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb5ee70 con 0x55786bbaca10 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:07.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:07:07.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:07:07.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:07.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55786bb5e910 con 0x7f32d4072060 2024-09-13T19:07:07.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.977 INFO:teuthology.orchestra.run.smithi151.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-13T19:07:07.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f3197fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:07.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93975691906608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc2670 con 0x55786bbaca10 2024-09-13T19:07:07.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.974+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93975691906608] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93975691881776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbc21c0 con 0x7f32d4072060 2024-09-13T19:07:07.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93975691881776] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 20 remove_watcher() i=0 2024-09-13T19:07:07.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 2 removed watcher, disabling cache 2024-09-13T19:07:07.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93975691886384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6d30 con 0x55786bbaca10 2024-09-13T19:07:07.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93975691886384] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 20 remove_watcher() i=1 2024-09-13T19:07:07.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.978+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93975691887440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6d30 con 0x55786bbb1400 2024-09-13T19:07:07.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e1b20640 1 -- 172.21.15.151:0/1937227830 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93975691887440] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d406f030 con 0x55786bbb1400 2024-09-13T19:07:07.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e4010980 20 remove_watcher() i=2 2024-09-13T19:07:07.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93975691895472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6d30 con 0x7f32d4072060 2024-09-13T19:07:07.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e131f640 1 -- 172.21.15.151:0/1937227830 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93975691895472] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32cc0e7040 con 0x7f32d4072060 2024-09-13T19:07:07.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e4010980 20 remove_watcher() i=3 2024-09-13T19:07:07.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.982+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93975691899024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6d30 con 0x55786bbaca10 2024-09-13T19:07:07.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.986+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93975691899024] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x55786bbaca10 2024-09-13T19:07:07.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.986+0000 7f32e4010980 20 remove_watcher() i=4 2024-09-13T19:07:07.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.986+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93975691900080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbb090 con 0x7f32dc018410 2024-09-13T19:07:07.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93975691900080] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e4010980 20 remove_watcher() i=5 2024-09-13T19:07:07.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93975691903776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbb6d30 con 0x7f32dc018410 2024-09-13T19:07:07.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93975691903776] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e4010980 20 remove_watcher() i=6 2024-09-13T19:07:07.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.990+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93975691905552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55786bbbc320 con 0x7f32dc018410 2024-09-13T19:07:07.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93975691905552] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc036040 con 0x7f32dc018410 2024-09-13T19:07:07.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 20 remove_watcher() i=7 2024-09-13T19:07:07.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f32dc018410 msgr2=0x7f32dc018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:07.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f32dc018410 0x7f32dc018890 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:07.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786bbaca10 msgr2=0x55786bbaeed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786bbaca10 0x55786bbaeed0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32d4072060 msgr2=0x7f32d4068870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f32d4072060 0x7f32d4068870 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bbb1400 msgr2=0x55786bbb37f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bbb1400 0x55786bbb37f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31ac034650 msgr2=0x7f31ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31ac034650 0x7f31ac036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f32cc000c10 tx=0x7f32cc0c1040 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 msgr2=0x55786bba1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e2321640 1 -- 172.21.15.151:0/1937227830 reap_dead start 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f32d40469a0 tx=0x7f32d4030130 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 shutdown_connections 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/1937227830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb9a720 0x55786bba1900 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 >> 172.21.15.151:0/1937227830 conn(0x55786bb96b00 msgr2=0x55786bb94bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 shutdown_connections 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/1937227830 wait complete. 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 msgr2=0x7f31bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 0x7f31bc036b10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55786ba7ae60 tx=0x7f32cc005ad0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 msgr2=0x55786bb8e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f32d4047b00 tx=0x7f32d401ccc0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 shutdown_connections 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31bc034650 0x7f31bc036b10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 --2- 172.21.15.151:0/3927779387 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786bb8dde0 0x55786bb8e200 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 >> 172.21.15.151:0/3927779387 conn(0x55786bb82f30 msgr2=0x55786bb859b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 shutdown_connections 2024-09-13T19:07:08.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.994+0000 7f32e4010980 1 -- 172.21.15.151:0/3927779387 wait complete. 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786ba7fac0 msgr2=0x55786bb77190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55786ba7fac0 0x55786bb77190 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55786bb7d7e0 msgr2=0x55786bb7fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55786bb7d7e0 0x55786bb7fbd0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bb798a0 msgr2=0x55786bb7bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55786bb798a0 0x55786bb7bc90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31c8034650 msgr2=0x7f31c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31c8034650 0x7f31c8036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f32cc0ae000 tx=0x7f32cc0a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 msgr2=0x55786ba7bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 --2- 172.21.15.151:0/616297871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55786b9f0290 0x55786ba7bca0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f32d400f610 tx=0x7f32d4001260 comp rx=0 tx=0).stop 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e2321640 1 -- 172.21.15.151:0/616297871 reap_dead start 2024-09-13T19:07:08.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 shutdown_connections 2024-09-13T19:07:08.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 >> 172.21.15.151:0/616297871 conn(0x55786ba76090 msgr2=0x55786bb611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:08.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 shutdown_connections 2024-09-13T19:07:08.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:07.998+0000 7f32e4010980 1 -- 172.21.15.151:0/616297871 wait complete. 2024-09-13T19:07:08.016 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:07:08.045 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:08.053 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-13T19:07:43.054 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:07:43.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-13T19:07:43.055 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-13T19:07:43.095 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:43.095 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.090+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.090+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff886aeb980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557f1f0f1930 0x557f1f0f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff886aeb980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f1ef73ae0 con 0x557f1f0eddf0 2024-09-13T19:07:43.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff886aeb980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x557f1ef97e30 con 0x557f1f0f1930 2024-09-13T19:07:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557f1f0f1930 0x557f1f0f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557f1f0f1930 0x557f1f0f3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37122/0 (socket says 172.21.15.151:37122) 2024-09-13T19:07:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 -- 172.21.15.151:0/3500329849 learned_addr learned my addr 172.21.15.151:0/3500329849 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 -- 172.21.15.151:0/3500329849 >> v1:172.21.15.12:6789/0 conn(0x557f1f0eddf0 legacy=0x557f1f0f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 -- 172.21.15.151:0/3500329849 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f0f53f0 con 0x557f1f0f1930 2024-09-13T19:07:43.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.094+0000 7ff883dfa640 1 --2- 172.21.15.151:0/3500329849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0f1930 0x557f1f0f3d50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a4e0 tx=0x7ff87c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ddb8f985c28326 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff8835f9640 1 -- 172.21.15.151:0/3500329849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c0aa540 con 0x557f1f0f1930 2024-09-13T19:07:43.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff8835f9640 1 -- 172.21.15.151:0/3500329849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c0aa6e0 con 0x557f1f0f1930 2024-09-13T19:07:43.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff8835f9640 1 -- 172.21.15.151:0/3500329849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c0aaa40 con 0x557f1f0f1930 2024-09-13T19:07:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 -- 172.21.15.151:0/3500329849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0f1930 msgr2=0x557f1f0f3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3500329849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0f1930 0x557f1f0f3d50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a4e0 tx=0x7ff87c01b090 comp rx=0 tx=0).stop 2024-09-13T19:07:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 -- 172.21.15.151:0/3500329849 shutdown_connections 2024-09-13T19:07:43.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3500329849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0f1930 0x557f1f0f3d50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 -- 172.21.15.151:0/3500329849 >> 172.21.15.151:0/3500329849 conn(0x557f1f061280 msgr2=0x557f1f061690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 -- 172.21.15.151:0/3500329849 shutdown_connections 2024-09-13T19:07:43.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.098+0000 7ff886aeb980 1 -- 172.21.15.151:0/3500329849 wait complete. 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f1ef99200 con 0x557f1f0eddf0 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37128/0 (socket says 172.21.15.151:37128) 2024-09-13T19:07:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff8845fb640 1 -- 172.21.15.151:0/1785259778 learned_addr learned my addr 172.21.15.151:0/1785259778 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff8845fb640 1 -- 172.21.15.151:0/1785259778 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f1d92b0 con 0x557f1f0eddf0 2024-09-13T19:07:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff8845fb640 1 --2- 172.21.15.151:0/1785259778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00b1f0 tx=0x7ff86c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171f950b58665132 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff77260c640 1 -- 172.21.15.151:0/1785259778 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c00a040 con 0x557f1f0eddf0 2024-09-13T19:07:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff77260c640 1 -- 172.21.15.151:0/1785259778 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c00f750 con 0x557f1f0eddf0 2024-09-13T19:07:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff77260c640 1 -- 172.21.15.151:0/1785259778 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c00fa70 con 0x557f1f0eddf0 2024-09-13T19:07:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- 172.21.15.151:0/1785259778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 msgr2=0x557f1f1d8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 --2- 172.21.15.151:0/1785259778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00b1f0 tx=0x7ff86c00b6b0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- 172.21.15.151:0/1785259778 shutdown_connections 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 --2- 172.21.15.151:0/1785259778 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1d8ce0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- 172.21.15.151:0/1785259778 >> 172.21.15.151:0/1785259778 conn(0x557f1f061280 msgr2=0x557f1f1d4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.114+0000 7ff886aeb980 1 -- 172.21.15.151:0/1785259778 shutdown_connections 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- 172.21.15.151:0/1785259778 wait complete. 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1dffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f1f0f4ec0 con 0x557f1f0eddf0 2024-09-13T19:07:43.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1dffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1dffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37130/0 (socket says 172.21.15.151:37130) 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff8845fb640 1 -- 172.21.15.151:0/384504764 learned_addr learned my addr 172.21.15.151:0/384504764 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff8845fb640 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f1e04f0 con 0x557f1f0eddf0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff8845fb640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1dffb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00b6f0 tx=0x7ff86c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 -- 172.21.15.151:0/384504764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c001300 con 0x557f1f0eddf0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 -- 172.21.15.151:0/384504764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c01c9c0 con 0x557f1f0eddf0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f1f1e0780 con 0x557f1f0eddf0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 -- 172.21.15.151:0/384504764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c01cca0 con 0x557f1f0eddf0 2024-09-13T19:07:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1f1e3460 con 0x557f1f0eddf0 2024-09-13T19:07:43.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 -- 172.21.15.151:0/384504764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff86c017050 con 0x557f1f0eddf0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff76c034650 0x7ff76c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff770e09640 1 -- 172.21.15.151:0/384504764 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff86c015020 con 0x557f1f0eddf0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff883dfa640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff76c034650 0x7ff76c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f0f1930 0x557f1f1e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.118+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f1e75f0 con 0x557f1f0f1930 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff884dfc640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f0f1930 0x557f1f1e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff883dfa640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff76c034650 0x7ff76c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0ab000 tx=0x7ff87c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff884dfc640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f0f1930 0x557f1f1e70b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff884dfc640 1 -- 172.21.15.151:0/384504764 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f0f1930 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f1e4660 con 0x557f1f0f1930 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff884dfc640 1 -- 172.21.15.151:0/384504764 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f0f1930 2024-09-13T19:07:43.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f1e9920 0x557f1f1ebd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f1ec400 con 0x557f1f1e9920 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff8845fb640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f1e9920 0x557f1f1ebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff8845fb640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f1e9920 0x557f1f1ebd10 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff8845fb640 1 -- 172.21.15.151:0/384504764 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f1e9920 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f1e87c0 con 0x557f1f0f1930 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff884dfc640 1 -- 172.21.15.151:0/384504764 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f0f1930 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f1f1ed860 0x557f1f1efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f1f0390 con 0x557f1f1ed860 2024-09-13T19:07:43.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff883dfa640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f1f1ed860 0x557f1f1efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff883dfa640 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f1f1ed860 0x557f1f1efc50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff883dfa640 1 -- 172.21.15.151:0/384504764 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff87c0bc040 con 0x557f1f1ed860 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.122+0000 7ff886aeb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f1eff2800 con 0x557f1f1fde60 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37132/0 (socket says 172.21.15.151:37132) 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff8845fb640 1 -- 172.21.15.151:0/665115638 learned_addr learned my addr 172.21.15.151:0/665115638 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff8845fb640 1 -- 172.21.15.151:0/665115638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f1fe7c0 con 0x557f1f1fde60 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff8845fb640 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff86c01ced0 tx=0x7ff86c02fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 -- 172.21.15.151:0/665115638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c03f070 con 0x557f1f1fde60 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f1f1fea50 con 0x557f1f1fde60 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 -- 172.21.15.151:0/665115638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c018d80 con 0x557f1f1fde60 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1f2016d0 con 0x557f1f1fde60 2024-09-13T19:07:43.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 -- 172.21.15.151:0/665115638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c01a480 con 0x557f1f1fde60 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 -- 172.21.15.151:0/665115638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff86c01a620 con 0x557f1f1fde60 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 0x7ff75c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff769ffb640 1 -- 172.21.15.151:0/665115638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff86c0024e0 con 0x557f1f1fde60 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff883dfa640 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 0x7ff75c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff886aeb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f1f1d9630 con 0x557f1f20a5b0 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.126+0000 7ff883dfa640 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 0x7ff75c036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557f1f1e7ac0 tx=0x7ff87c005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37138/0 (socket says 172.21.15.151:37138) 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 -- 172.21.15.151:0/2512380807 learned_addr learned my addr 172.21.15.151:0/2512380807 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 -- 172.21.15.151:0/2512380807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f20af80 con 0x557f1f20a5b0 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- 172.21.15.151:0/2512380807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff86c01d5c0 tx=0x7ff86c013250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f7f9c90a9413d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff7637fe640 1 -- 172.21.15.151:0/2512380807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c04a600 con 0x557f1f20a5b0 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff7637fe640 1 -- 172.21.15.151:0/2512380807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c042b00 con 0x557f1f20a5b0 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff7637fe640 1 -- 172.21.15.151:0/2512380807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c045dd0 con 0x557f1f20a5b0 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/2512380807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 msgr2=0x557f1f20a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 --2- 172.21.15.151:0/2512380807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff86c01d5c0 tx=0x7ff86c013250 comp rx=0 tx=0).stop 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/2512380807 shutdown_connections 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 --2- 172.21.15.151:0/2512380807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f20a9b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/2512380807 >> 172.21.15.151:0/2512380807 conn(0x557f1f206990 msgr2=0x557f1f204a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/2512380807 shutdown_connections 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/2512380807 wait complete. 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 Processor -- start 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- start start 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557f1f20b400 con 0x557f1f20a5b0 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37144/0 (socket says 172.21.15.151:37144) 2024-09-13T19:07:43.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 learned_addr learned my addr 172.21.15.151:0/3899342319 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f1f211d00 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff8845fb640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff86c048e20 tx=0x7ff86c002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff761ffb640 1 -- 172.21.15.151:0/3899342319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c06c020 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff761ffb640 1 -- 172.21.15.151:0/3899342319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86c019580 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f1f211d00 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff761ffb640 1 -- 172.21.15.151:0/3899342319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff86c064040 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.130+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f1f212170 con 0x557f1f20a5b0 2024-09-13T19:07:43.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff761ffb640 1 -- 172.21.15.151:0/3899342319 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff86c06f020 con 0x557f1f20a5b0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff761ffb640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff754034650 0x7ff754036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff761ffb640 1 -- 172.21.15.151:0/3899342319 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff86c072d20 con 0x557f1f20a5b0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff883dfa640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff754034650 0x7ff754036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f21c8d0 0x557f1f21ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f21f4e0 con 0x557f1f21c8d0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f21c8d0 0x557f1f21ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff883dfa640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff754034650 0x7ff754036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a190 tx=0x7ff87c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f21c8d0 0x557f1f21ed90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 realm 2024-09-13T19:07:43.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f21f8f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220190 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f221290 0x557f1f223680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f223bc0 con 0x557f1f221290 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff8845fb640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f221290 0x557f1f223680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff8845fb640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f221290 0x557f1f223680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 20 searching for the correct realm 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.134+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f225460 con 0x557f1f221290 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff8845fb640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff86c071020 0x7ff86c0027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f225460 con 0x7ff86c071020 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff86c071020 0x7ff86c0027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff86c071020 0x7ff86c0027b0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f225460 con 0x7ff86c071020 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f225460 con 0x557f1f21c8d0 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff874018410 0x7ff874018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff874018410 0x7ff874018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff874018410 0x7ff874018890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x7ff874018410 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.138+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x7ff874018410 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff86c071020 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x7ff874018410 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff86c071020 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.160 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x7ff874018410 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.142+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x7ff874018410 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff86c071020 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff8740083f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.146+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff86c071020 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f221290 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x7ff874018410 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff87403b040 con 0x7ff86c071020 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:43.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f220530 con 0x557f1f21c8d0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f224410 con 0x557f1f21c8d0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f224410 con 0x7ff86c071020 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 zone default found 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 4 Realm: () 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 zonegroup default 2024-09-13T19:07:43.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.150+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f224ce0 con 0x7ff874018410 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f224ce0 con 0x557f1f221290 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f227310 con 0x557f1f221290 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 started sync module instance, tier type = 2024-09-13T19:07:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f2267b0 con 0x7ff86c071020 2024-09-13T19:07:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94004471557024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f226410 con 0x7ff86c071020 2024-09-13T19:07:43.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f228090 con 0x557f1f21c8d0 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.154+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94004471557024] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.158+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.158+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94004471559856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f228480 con 0x557f1f21c8d0 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.158+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f228e40 con 0x557f1f221290 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.158+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94004471559856] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94004471564688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f229230 con 0x557f1f221290 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f229bf0 con 0x7ff86c071020 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94004471570320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22a860 con 0x7ff86c071020 2024-09-13T19:07:43.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b220 con 0x557f1f21c8d0 2024-09-13T19:07:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94004471564688] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94004471570320] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.162+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94004471573872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22a860 con 0x557f1f21c8d0 2024-09-13T19:07:43.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.166+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b190 con 0x7ff874018410 2024-09-13T19:07:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.166+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94004471573872] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.166+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.166+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94004471571376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22a7d0 con 0x7ff874018410 2024-09-13T19:07:43.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.166+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22c0e0 con 0x7ff874018410 2024-09-13T19:07:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94004471577648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22c500 con 0x7ff874018410 2024-09-13T19:07:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22cff0 con 0x7ff874018410 2024-09-13T19:07:43.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94004471571376] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94004471577648] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94004471581376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22c050 con 0x7ff874018410 2024-09-13T19:07:43.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=0 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=1 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=2 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=3 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=4 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=5 2024-09-13T19:07:43.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.170+0000 7ff886aeb980 20 add_watcher() i=6 2024-09-13T19:07:43.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94004471581376] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 20 add_watcher() i=7 2024-09-13T19:07:43.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:43.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f2300f0 con 0x557f1f21c8d0 2024-09-13T19:07:43.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94004471576080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22d570 con 0x557f1f21c8d0 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94004471576080] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff73a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 5 note: GC not initialized 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff7397e2640 20 reqs_thread_entry: start 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 20 Filter name: none 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff6aaffd640 20 reqs_thread_entry: start 2024-09-13T19:07:43.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.174+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253ab0 con 0x557f1f21c8d0 2024-09-13T19:07:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253ab0 con 0x7ff86c071020 2024-09-13T19:07:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253ab0 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f221290 2024-09-13T19:07:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x557f1f221290 2024-09-13T19:07:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.178+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f253a70 con 0x7ff874018410 2024-09-13T19:07:43.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff86c071020 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.182+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff86c071020 2024-09-13T19:07:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.186+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f21c8d0 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x557f1f221290 2024-09-13T19:07:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557f1f255750 con 0x7ff874018410 2024-09-13T19:07:43.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff73a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.190+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94004471576080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f2516c0 con 0x557f1f21c8d0 2024-09-13T19:07:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94004471576080] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94004471557024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b610 con 0x7ff86c071020 2024-09-13T19:07:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94004471557024] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff886aeb980 20 remove_watcher() i=0 2024-09-13T19:07:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff886aeb980 2 removed watcher, disabling cache 2024-09-13T19:07:43.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.194+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94004471559856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b610 con 0x557f1f21c8d0 2024-09-13T19:07:43.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94004471559856] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 20 remove_watcher() i=1 2024-09-13T19:07:43.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94004471564688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b610 con 0x557f1f221290 2024-09-13T19:07:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff8845fb640 1 -- 172.21.15.151:0/3899342319 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94004471564688] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff86c02e070 con 0x557f1f221290 2024-09-13T19:07:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 20 remove_watcher() i=2 2024-09-13T19:07:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94004471570320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f228990 con 0x7ff86c071020 2024-09-13T19:07:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff883dfa640 1 -- 172.21.15.151:0/3899342319 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94004471570320] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c0ca070 con 0x7ff86c071020 2024-09-13T19:07:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 20 remove_watcher() i=3 2024-09-13T19:07:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.198+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94004471573872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b610 con 0x557f1f21c8d0 2024-09-13T19:07:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94004471573872] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x557f1f21c8d0 2024-09-13T19:07:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff886aeb980 20 remove_watcher() i=4 2024-09-13T19:07:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94004471571376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f229f90 con 0x7ff874018410 2024-09-13T19:07:43.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94004471571376] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff886aeb980 20 remove_watcher() i=5 2024-09-13T19:07:43.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.202+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94004471577648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22ad70 con 0x7ff874018410 2024-09-13T19:07:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.206+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94004471577648] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.206+0000 7ff886aeb980 20 remove_watcher() i=6 2024-09-13T19:07:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.206+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94004471581376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557f1f22b610 con 0x7ff874018410 2024-09-13T19:07:43.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94004471581376] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff874036040 con 0x7ff874018410 2024-09-13T19:07:43.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 20 remove_watcher() i=7 2024-09-13T19:07:43.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff874018410 msgr2=0x7ff874018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff874018410 0x7ff874018890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f21c8d0 msgr2=0x557f1f21ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f21c8d0 0x557f1f21ed90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff86c071020 msgr2=0x7ff86c0027b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff86c071020 0x7ff86c0027b0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f221290 msgr2=0x557f1f223680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f221290 0x557f1f223680 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff754034650 msgr2=0x7ff754036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff754034650 0x7ff754036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a190 tx=0x7ff87c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 msgr2=0x557f1f2117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff884dfc640 1 -- 172.21.15.151:0/3899342319 reap_dead start 2024-09-13T19:07:43.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff86c048e20 tx=0x7ff86c002180 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 shutdown_connections 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/3899342319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f20a5b0 0x557f1f2117c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 >> 172.21.15.151:0/3899342319 conn(0x557f1f206990 msgr2=0x557f1f204a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 shutdown_connections 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/3899342319 wait complete. 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 msgr2=0x7ff75c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 0x7ff75c036b10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x557f1f1e7ac0 tx=0x7ff87c005e50 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 msgr2=0x557f1f1fe280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff86c01ced0 tx=0x7ff86c02fe70 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 shutdown_connections 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff75c034650 0x7ff75c036b10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/665115638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f1fde60 0x557f1f1fe280 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 >> 172.21.15.151:0/665115638 conn(0x557f1f1f2fb0 msgr2=0x557f1f1f5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 shutdown_connections 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/665115638 wait complete. 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f0f1930 msgr2=0x557f1f1e70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557f1f0f1930 0x557f1f1e70b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f1f1ed860 msgr2=0x557f1f1efc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557f1f1ed860 0x557f1f1efc50 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f1e9920 msgr2=0x557f1f1ebd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557f1f1e9920 0x557f1f1ebd10 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff76c034650 msgr2=0x7ff76c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff76c034650 0x7ff76c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff87c0ab000 tx=0x7ff87c0a5000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 msgr2=0x557f1f1dffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 --2- 172.21.15.151:0/384504764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557f1f0eddf0 0x557f1f1dffb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00b6f0 tx=0x7ff86c000ee0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff884dfc640 1 -- 172.21.15.151:0/384504764 reap_dead start 2024-09-13T19:07:43.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 shutdown_connections 2024-09-13T19:07:43.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 >> 172.21.15.151:0/384504764 conn(0x557f1f061280 msgr2=0x557f1f1d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 shutdown_connections 2024-09-13T19:07:43.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.210+0000 7ff886aeb980 1 -- 172.21.15.151:0/384504764 wait complete. 2024-09-13T19:07:43.226 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:07:43.227 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:07:43.227 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-13T19:07:43.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-13T19:07:43.227 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-13T19:07:43.304 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:43.305 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:43.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee716b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561dcf1138d0 0x561dcf113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee716b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561dcef99ae0 con 0x561dcf114220 2024-09-13T19:07:43.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee716b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x561dcefbde30 con 0x561dcf1138d0 2024-09-13T19:07:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee4c7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561dcf1138d0 0x561dcf113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee4c7b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561dcf1138d0 0x561dcf113cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37158/0 (socket says 172.21.15.151:37158) 2024-09-13T19:07:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3189495599 learned_addr learned my addr 172.21.15.151:0/3189495599 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3189495599 >> v1:172.21.15.12:6789/0 conn(0x561dcf114220 legacy=0x561dcf118c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.302+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3189495599 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf11b4a0 con 0x561dcf1138d0 2024-09-13T19:07:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3189495599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf113cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400a5c0 tx=0x7f0ed401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32334cd2c34dec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee3c79640 1 -- 172.21.15.151:0/3189495599 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40a6070 con 0x561dcf1138d0 2024-09-13T19:07:43.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee3c79640 1 -- 172.21.15.151:0/3189495599 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40af070 con 0x561dcf1138d0 2024-09-13T19:07:43.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee3c79640 1 -- 172.21.15.151:0/3189495599 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40aa5c0 con 0x561dcf1138d0 2024-09-13T19:07:43.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 -- 172.21.15.151:0/3189495599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 msgr2=0x561dcf113cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3189495599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf113cb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400a5c0 tx=0x7f0ed401b340 comp rx=0 tx=0).stop 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 -- 172.21.15.151:0/3189495599 shutdown_connections 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3189495599 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf113cb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 -- 172.21.15.151:0/3189495599 >> 172.21.15.151:0/3189495599 conn(0x561dcf087220 msgr2=0x561dcf087630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 -- 172.21.15.151:0/3189495599 shutdown_connections 2024-09-13T19:07:43.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.306+0000 7f0ee716b980 1 -- 172.21.15.151:0/3189495599 wait complete. 2024-09-13T19:07:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee716b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee716b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcefbf200 con 0x561dcf1138d0 2024-09-13T19:07:43.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37162/0 (socket says 172.21.15.151:37162) 2024-09-13T19:07:43.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/1454260737 learned_addr learned my addr 172.21.15.151:0/1454260737 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.322+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/1454260737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf1ff190 con 0x561dcf1138d0 2024-09-13T19:07:43.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/1454260737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400a5c0 tx=0x7f0ed4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7e518e6a424e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd2e0d640 1 -- 172.21.15.151:0/1454260737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40aa9b0 con 0x561dcf1138d0 2024-09-13T19:07:43.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd2e0d640 1 -- 172.21.15.151:0/1454260737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40aab50 con 0x561dcf1138d0 2024-09-13T19:07:43.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd2e0d640 1 -- 172.21.15.151:0/1454260737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40aae50 con 0x561dcf1138d0 2024-09-13T19:07:43.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/1454260737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 msgr2=0x561dcf1febc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 --2- 172.21.15.151:0/1454260737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0ed400a5c0 tx=0x7f0ed4003030 comp rx=0 tx=0).stop 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/1454260737 shutdown_connections 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 --2- 172.21.15.151:0/1454260737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf1febc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/1454260737 >> 172.21.15.151:0/1454260737 conn(0x561dcf087220 msgr2=0x561dcf1fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/1454260737 shutdown_connections 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/1454260737 wait complete. 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf205df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcf11aee0 con 0x561dcf1138d0 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf205df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf205df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37164/0 (socket says 172.21.15.151:37164) 2024-09-13T19:07:43.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3011613140 learned_addr learned my addr 172.21.15.151:0/3011613140 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf206330 con 0x561dcf1138d0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf205df0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401bbe0 tx=0x7f0ed40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd160a640 1 -- 172.21.15.151:0/3011613140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40c6750 con 0x561dcf1138d0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd160a640 1 -- 172.21.15.151:0/3011613140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40c68f0 con 0x561dcf1138d0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcf2065c0 con 0x561dcf1138d0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0dd160a640 1 -- 172.21.15.151:0/3011613140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40c6c10 con 0x561dcf1138d0 2024-09-13T19:07:43.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.326+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcf2092a0 con 0x561dcf1138d0 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0dd160a640 1 -- 172.21.15.151:0/3011613140 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ed40ce020 con 0x561dcf1138d0 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0dd160a640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dcc0346a0 0x7f0dcc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0dd160a640 1 -- 172.21.15.151:0/3011613140 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ed40cc020 con 0x561dcf1138d0 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dcc0346a0 0x7f0dcc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf114220 0x561dcf20cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf20d3f0 con 0x561dcf114220 2024-09-13T19:07:43.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf114220 0x561dcf20cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dcc0346a0 0x7f0dcc036b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8000f70 tx=0x7f0ed8001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf114220 0x561dcf20cd80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee547c640 1 -- 172.21.15.151:0/3011613140 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf114220 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf20dd00 con 0x561dcf114220 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee547c640 1 -- 172.21.15.151:0/3011613140 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf114220 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf20f610 0x561dcf211ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf212260 con 0x561dcf20f610 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf20f610 0x561dcf211ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf20f610 0x561dcf211ad0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3011613140 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ed40bd3f0 con 0x561dcf20f610 2024-09-13T19:07:43.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.330+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf20e550 con 0x561dcf114220 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee547c640 1 -- 172.21.15.151:0/3011613140 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf114220 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcf2136c0 0x561dcf215ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf2161a0 con 0x561dcf2136c0 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcf2136c0 0x561dcf215ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcf2136c0 0x561dcf215ab0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee447a640 1 -- 172.21.15.151:0/3011613140 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ed800d040 con 0x561dcf2136c0 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcf018800 con 0x561dcf223c70 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37174/0 (socket says 172.21.15.151:37174) 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/629743358 learned_addr learned my addr 172.21.15.151:0/629743358 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/629743358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf2245d0 con 0x561dcf223c70 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a4070 tx=0x7f0ed40bcd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0dca7fc640 1 -- 172.21.15.151:0/629743358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40e50b0 con 0x561dcf223c70 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcf224860 con 0x561dcf223c70 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcf2274e0 con 0x561dcf223c70 2024-09-13T19:07:43.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0dca7fc640 1 -- 172.21.15.151:0/629743358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40e5250 con 0x561dcf223c70 2024-09-13T19:07:43.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.334+0000 7f0dca7fc640 1 -- 172.21.15.151:0/629743358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40cfc90 con 0x561dcf223c70 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dca7fc640 1 -- 172.21.15.151:0/629743358 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ed40e32f0 con 0x561dcf223c70 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dca7fc640 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 0x7f0dbc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dca7fc640 1 -- 172.21.15.151:0/629743358 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ed40ddd70 con 0x561dcf223c70 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee447a640 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 0x7f0dbc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcf1ff450 con 0x561dcf230660 2024-09-13T19:07:43.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee447a640 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 0x7f0dbc036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x561dcf20a500 tx=0x7f0ed8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37176/0 (socket says 172.21.15.151:37176) 2024-09-13T19:07:43.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/2359876157 learned_addr learned my addr 172.21.15.151:0/2359876157 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/2359876157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf231010 con 0x561dcf230660 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/2359876157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a86d0 tx=0x7f0ed40a83f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a31457568f09c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dbbfff640 1 -- 172.21.15.151:0/2359876157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40fc020 con 0x561dcf230660 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dbbfff640 1 -- 172.21.15.151:0/2359876157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40b3b30 con 0x561dcf230660 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0dbbfff640 1 -- 172.21.15.151:0/2359876157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed40e3cf0 con 0x561dcf230660 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- 172.21.15.151:0/2359876157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 msgr2=0x561dcf230a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 --2- 172.21.15.151:0/2359876157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a86d0 tx=0x7f0ed40a83f0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- 172.21.15.151:0/2359876157 shutdown_connections 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 --2- 172.21.15.151:0/2359876157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf230a40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- 172.21.15.151:0/2359876157 >> 172.21.15.151:0/2359876157 conn(0x561dcf22ca40 msgr2=0x561dcf22ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- 172.21.15.151:0/2359876157 shutdown_connections 2024-09-13T19:07:43.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.338+0000 7f0ee716b980 1 -- 172.21.15.151:0/2359876157 wait complete. 2024-09-13T19:07:43.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 Processor -- start 2024-09-13T19:07:43.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 -- start start 2024-09-13T19:07:43.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561dcf231010 con 0x561dcf230660 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee4c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37186/0 (socket says 172.21.15.151:37186) 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 learned_addr learned my addr 172.21.15.151:0/3442702130 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dcf237c20 con 0x561dcf230660 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a8720 tx=0x7f0ed40ddfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 -- 172.21.15.151:0/3442702130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4110070 con 0x561dcf230660 2024-09-13T19:07:43.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561dcf237c20 con 0x561dcf230660 2024-09-13T19:07:43.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 -- 172.21.15.151:0/3442702130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed40a8ad0 con 0x561dcf230660 2024-09-13T19:07:43.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 -- 172.21.15.151:0/3442702130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ed4006810 con 0x561dcf230660 2024-09-13T19:07:43.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dcf237c20 con 0x561dcf230660 2024-09-13T19:07:43.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 -- 172.21.15.151:0/3442702130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0ed4113070 con 0x561dcf230660 2024-09-13T19:07:43.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0db0034650 0x7f0db0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0dba7fc640 1 -- 172.21.15.151:0/3442702130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ed4108050 con 0x561dcf230660 2024-09-13T19:07:43.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0db0034650 0x7f0db0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf242610 0x561dcf244ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.342+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf245200 con 0x561dcf242610 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf242610 0x561dcf244ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0db0034650 0x7f0db0036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x561dcf2165a0 tx=0x7f0ed8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf242610 0x561dcf244ab0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 realm 2024-09-13T19:07:43.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf245610 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf245eb0 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf246fb0 0x561dcf2493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf249920 con 0x561dcf246fb0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf246fb0 0x561dcf2493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf246fb0 0x561dcf2493a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 20 searching for the correct realm 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24b1c0 con 0x561dcf246fb0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0ed4115060 0x7f0ed40069b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24b1c0 con 0x7f0ed4115060 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0ed4115060 0x7f0ed40069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee447a640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0ed4115060 0x7f0ed40069b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.346+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24b1c0 con 0x7f0ed4115060 2024-09-13T19:07:43.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24b1c0 con 0x561dcf242610 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0edc016440 0x7f0edc0168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0edc016440 0x7f0edc0168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0edc016440 0x7f0edc0168c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0ed4115060 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.350+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0ed4115060 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.354+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0ed4115060 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0ed4115060 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf246fb0 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.358+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0edc016440 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x561dcf242610 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561dcf246250 con 0x7f0ed4115060 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24a170 con 0x561dcf242610 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24a560 con 0x561dcf242610 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24a560 con 0x7f0ed4115060 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 zone default found 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 4 Realm: () 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:43.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 zonegroup default 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24b690 con 0x7f0edc016440 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24d070 con 0x561dcf246fb0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24d410 con 0x561dcf246fb0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 started sync module instance, tier type = 2024-09-13T19:07:43.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:43.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.362+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24c510 con 0x7f0ed4115060 2024-09-13T19:07:43.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94686029334784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24dcb0 con 0x7f0ed4115060 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24e500 con 0x561dcf242610 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94686029334784] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94686029338624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24e500 con 0x561dcf242610 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.366+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24f020 con 0x561dcf246fb0 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94686029338624] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94686029340752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24e470 con 0x561dcf246fb0 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf24fd90 con 0x7f0ed4115060 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94686029347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf250630 con 0x7f0ed4115060 2024-09-13T19:07:43.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.370+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf251030 con 0x561dcf242610 2024-09-13T19:07:43.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94686029340752] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94686029347008] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94686029345808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf250180 con 0x561dcf242610 2024-09-13T19:07:43.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf2518d0 con 0x7f0edc016440 2024-09-13T19:07:43.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.374+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94686029345808] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94686029351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf2515f0 con 0x7f0edc016440 2024-09-13T19:07:43.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf251e40 con 0x7f0edc016440 2024-09-13T19:07:43.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94686029351744] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94686029353552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf251c20 con 0x7f0edc016440 2024-09-13T19:07:43.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.378+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf252710 con 0x7f0edc016440 2024-09-13T19:07:43.385 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94686029353552] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94686029357536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf2526d0 con 0x7f0edc016440 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=0 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=1 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=2 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=3 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=4 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=5 2024-09-13T19:07:43.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=6 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94686029357536] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 20 add_watcher() i=7 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf255b60 con 0x561dcf242610 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.382+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94686029354608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf253020 con 0x561dcf242610 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94686029354608] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0d9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 5 note: GC not initialized 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0d9a7e4640 20 reqs_thread_entry: start 2024-09-13T19:07:43.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:43.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 20 Filter name: none 2024-09-13T19:07:43.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0d937fe640 20 reqs_thread_entry: start 2024-09-13T19:07:43.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279760 con 0x561dcf242610 2024-09-13T19:07:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279760 con 0x7f0ed4115060 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279780 con 0x561dcf242610 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.386+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf242610 2024-09-13T19:07:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf242610 2024-09-13T19:07:43.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf246fb0 2024-09-13T19:07:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x561dcf246fb0 2024-09-13T19:07:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf279740 con 0x7f0edc016440 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0ed4115060 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.390+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0ed4115060 2024-09-13T19:07:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.394+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.402 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf242610 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561dcf27b3d0 con 0x7f0edc016440 2024-09-13T19:07:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.398+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0d9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94686029354608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf277550 con 0x561dcf242610 2024-09-13T19:07:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94686029354608] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94686029334784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x7f0ed4115060 2024-09-13T19:07:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94686029334784] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee716b980 20 remove_watcher() i=0 2024-09-13T19:07:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee716b980 2 removed watcher, disabling cache 2024-09-13T19:07:43.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.402+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94686029338624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x561dcf242610 2024-09-13T19:07:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94686029338624] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee716b980 20 remove_watcher() i=1 2024-09-13T19:07:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94686029340752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x561dcf246fb0 2024-09-13T19:07:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee4c7b640 1 -- 172.21.15.151:0/3442702130 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94686029340752] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed4112030 con 0x561dcf246fb0 2024-09-13T19:07:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee716b980 20 remove_watcher() i=2 2024-09-13T19:07:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.406+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94686029347008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x7f0ed4115060 2024-09-13T19:07:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee447a640 1 -- 172.21.15.151:0/3442702130 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94686029347008] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ed8036040 con 0x7f0ed4115060 2024-09-13T19:07:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee716b980 20 remove_watcher() i=3 2024-09-13T19:07:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94686029345808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x561dcf242610 2024-09-13T19:07:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94686029345808] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x561dcf242610 2024-09-13T19:07:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee716b980 20 remove_watcher() i=4 2024-09-13T19:07:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.410+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94686029351744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x7f0edc016440 2024-09-13T19:07:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94686029351744] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee716b980 20 remove_watcher() i=5 2024-09-13T19:07:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94686029353552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf276be0 con 0x7f0edc016440 2024-09-13T19:07:43.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94686029353552] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee716b980 20 remove_watcher() i=6 2024-09-13T19:07:43.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.414+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94686029357536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561dcf251700 con 0x7f0edc016440 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94686029357536] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0edc00a4d0 con 0x7f0edc016440 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 20 remove_watcher() i=7 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0edc016440 msgr2=0x7f0edc0168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0edc016440 0x7f0edc0168c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf242610 msgr2=0x561dcf244ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf242610 0x561dcf244ab0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0ed4115060 msgr2=0x7f0ed40069b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f0ed4115060 0x7f0ed40069b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf246fb0 msgr2=0x561dcf2493a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf246fb0 0x561dcf2493a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0db0034650 msgr2=0x7f0db0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0db0034650 0x7f0db0036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x561dcf2165a0 tx=0x7f0ed8011000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 msgr2=0x561dcf2376e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a8720 tx=0x7f0ed40ddfc0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee547c640 1 -- 172.21.15.151:0/3442702130 reap_dead start 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 shutdown_connections 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3442702130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf230660 0x561dcf2376e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 >> 172.21.15.151:0/3442702130 conn(0x561dcf22ca40 msgr2=0x561dcf22ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 shutdown_connections 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3442702130 wait complete. 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 msgr2=0x7f0dbc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 0x7f0dbc036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x561dcf20a500 tx=0x7f0ed8006000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 msgr2=0x561dcf224090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40a4070 tx=0x7f0ed40bcd80 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 shutdown_connections 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dbc034650 0x7f0dbc036b10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/629743358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf223c70 0x561dcf224090 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 >> 172.21.15.151:0/629743358 conn(0x561dcf218dc0 msgr2=0x561dcf21b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 shutdown_connections 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/629743358 wait complete. 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf114220 msgr2=0x561dcf20cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561dcf114220 0x561dcf20cd80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcf2136c0 msgr2=0x561dcf215ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561dcf2136c0 0x561dcf215ab0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf20f610 msgr2=0x561dcf211ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561dcf20f610 0x561dcf211ad0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.426 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dcc0346a0 msgr2=0x7f0dcc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0dcc0346a0 0x7f0dcc036b60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8000f70 tx=0x7f0ed8001420 comp rx=0 tx=0).stop 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 msgr2=0x561dcf205df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 --2- 172.21.15.151:0/3011613140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561dcf1138d0 0x561dcf205df0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0ed401bbe0 tx=0x7f0ed40180e0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee547c640 1 -- 172.21.15.151:0/3011613140 reap_dead start 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 shutdown_connections 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 >> 172.21.15.151:0/3011613140 conn(0x561dcf087220 msgr2=0x561dcf1f9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 shutdown_connections 2024-09-13T19:07:43.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.418+0000 7f0ee716b980 1 -- 172.21.15.151:0/3011613140 wait complete. 2024-09-13T19:07:43.435 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:07:43.435 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:07:43.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:07:43.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:07:43.436 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:07:43.511 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:43.512 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b1bb81980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560248aa18e0 0x560248aa1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b1bb81980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560248927ae0 con 0x560248aa2230 2024-09-13T19:07:43.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b1bb81980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56024894be30 con 0x560248aa18e0 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b19691640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560248aa18e0 0x560248aa1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b13fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x560248aa2230 0x560248aa6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59772/0 (socket says 172.21.15.151:59772) 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b19691640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x560248aa18e0 0x560248aa1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37194/0 (socket says 172.21.15.151:37194) 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b13fff640 1 -- 172.21.15.151:0/1034900234 learned_addr learned my addr 172.21.15.151:0/1034900234 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b19691640 1 -- 172.21.15.151:0/1034900234 >> v1:172.21.15.12:6789/0 conn(0x560248aa2230 legacy=0x560248aa6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.510+0000 7f7b19691640 1 -- 172.21.15.151:0/1034900234 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248aa94b0 con 0x560248aa18e0 2024-09-13T19:07:43.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b19691640 1 --2- 172.21.15.151:0/1034900234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248aa1cc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00a480 tx=0x7f7b0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4829386ff48387 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b18e90640 1 -- 172.21.15.151:0/1034900234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0b0070 con 0x560248aa18e0 2024-09-13T19:07:43.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b18e90640 1 -- 172.21.15.151:0/1034900234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0ab540 con 0x560248aa18e0 2024-09-13T19:07:43.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b18e90640 1 -- 172.21.15.151:0/1034900234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0ab840 con 0x560248aa18e0 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1034900234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 msgr2=0x560248aa1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/1034900234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248aa1cc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00a480 tx=0x7f7b0c01b280 comp rx=0 tx=0).stop 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1034900234 shutdown_connections 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/1034900234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248aa1cc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1034900234 >> 172.21.15.151:0/1034900234 conn(0x560248a15230 msgr2=0x560248a15640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1034900234 shutdown_connections 2024-09-13T19:07:43.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.514+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1034900234 wait complete. 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56024894d200 con 0x560248aa18e0 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37196/0 (socket says 172.21.15.151:37196) 2024-09-13T19:07:43.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b19691640 1 -- 172.21.15.151:0/2614890661 learned_addr learned my addr 172.21.15.151:0/2614890661 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b19691640 1 -- 172.21.15.151:0/2614890661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248b8d220 con 0x560248aa18e0 2024-09-13T19:07:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b19691640 1 --2- 172.21.15.151:0/2614890661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c017e90 tx=0x7f7b0c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4e464ab099c7f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7a07606640 1 -- 172.21.15.151:0/2614890661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0b0070 con 0x560248aa18e0 2024-09-13T19:07:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7a07606640 1 -- 172.21.15.151:0/2614890661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0b1040 con 0x560248aa18e0 2024-09-13T19:07:43.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7a07606640 1 -- 172.21.15.151:0/2614890661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0abc30 con 0x560248aa18e0 2024-09-13T19:07:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- 172.21.15.151:0/2614890661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 msgr2=0x560248b8cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/2614890661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c017e90 tx=0x7f7b0c003030 comp rx=0 tx=0).stop 2024-09-13T19:07:43.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- 172.21.15.151:0/2614890661 shutdown_connections 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/2614890661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b8cc50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- 172.21.15.151:0/2614890661 >> 172.21.15.151:0/2614890661 conn(0x560248a15230 msgr2=0x560248b88880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- 172.21.15.151:0/2614890661 shutdown_connections 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.530+0000 7f7b1bb81980 1 -- 172.21.15.151:0/2614890661 wait complete. 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b93e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560248aa8ef0 con 0x560248aa18e0 2024-09-13T19:07:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b93e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37198/0 (socket says 172.21.15.151:37198) 2024-09-13T19:07:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b19691640 1 -- 172.21.15.151:0/3980651262 learned_addr learned my addr 172.21.15.151:0/3980651262 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b19691640 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248b943c0 con 0x560248aa18e0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b19691640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b93e80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c017e90 tx=0x7f7b0c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 -- 172.21.15.151:0/3980651262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0c6070 con 0x560248aa18e0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 -- 172.21.15.151:0/3980651262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0b78c0 con 0x560248aa18e0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560248b94650 con 0x560248aa18e0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 -- 172.21.15.151:0/3980651262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0b7ba0 con 0x560248aa18e0 2024-09-13T19:07:43.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560248b97330 con 0x560248aa18e0 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 -- 172.21.15.151:0/3980651262 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b0c0c9070 con 0x560248aa18e0 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7a000346a0 0x7f7a00036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7a05e03640 1 -- 172.21.15.151:0/3980651262 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7b0c0bc070 con 0x560248aa18e0 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b13fff640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7a000346a0 0x7f7a00036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.534+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248aa2230 0x560248b9ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248b9b480 con 0x560248aa2230 2024-09-13T19:07:43.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19e92640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248aa2230 0x560248b9ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b13fff640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7a000346a0 0x7f7a00036b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f70 tx=0x7f7b040012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19e92640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248aa2230 0x560248b9ae10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19e92640 1 -- 172.21.15.151:0/3980651262 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248aa2230 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248b98530 con 0x560248aa2230 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19e92640 1 -- 172.21.15.151:0/3980651262 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248aa2230 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248b9d800 0x560248b9fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248ba02c0 con 0x560248b9d800 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19691640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248b9d800 0x560248b9fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19691640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248b9d800 0x560248b9fbf0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19691640 1 -- 172.21.15.151:0/3980651262 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7b0c0d2070 con 0x560248b9d800 2024-09-13T19:07:43.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248b9c6a0 con 0x560248aa2230 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b19e92640 1 -- 172.21.15.151:0/3980651262 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248aa2230 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560248ba1720 0x560248ba3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248ba4210 con 0x560248ba1720 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b13fff640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560248ba1720 0x560248ba3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b13fff640 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560248ba1720 0x560248ba3b10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b13fff640 1 -- 172.21.15.151:0/3980651262 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7b0400e620 con 0x560248ba1720 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.538+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5602489a6800 con 0x560248bb1ce0 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37214/0 (socket says 172.21.15.151:37214) 2024-09-13T19:07:43.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b19691640 1 -- 172.21.15.151:0/601060211 learned_addr learned my addr 172.21.15.151:0/601060211 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b19691640 1 -- 172.21.15.151:0/601060211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248bb2640 con 0x560248bb1ce0 2024-09-13T19:07:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b19691640 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0e3500 tx=0x7f7b0c0b5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 -- 172.21.15.151:0/601060211 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0e37f0 con 0x560248bb1ce0 2024-09-13T19:07:43.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 -- 172.21.15.151:0/601060211 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0e3990 con 0x560248bb1ce0 2024-09-13T19:07:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560248bb28d0 con 0x560248bb1ce0 2024-09-13T19:07:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 -- 172.21.15.151:0/601060211 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0e3cb0 con 0x560248bb1ce0 2024-09-13T19:07:43.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560248bb5550 con 0x560248bb1ce0 2024-09-13T19:07:43.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 -- 172.21.15.151:0/601060211 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b0c0bf570 con 0x560248bb1ce0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 0x7f79f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f79feffd640 1 -- 172.21.15.151:0/601060211 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7b0c0e0040 con 0x560248bb1ce0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b13fff640 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 0x7f79f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.542+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b13fff640 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 0x7f79f0036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bf60 tx=0x7f7b0400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560248b8d4e0 con 0x560248bbe5c0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37220/0 (socket says 172.21.15.151:37220) 2024-09-13T19:07:43.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 -- 172.21.15.151:0/1889912336 learned_addr learned my addr 172.21.15.151:0/1889912336 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 -- 172.21.15.151:0/1889912336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248bbef90 con 0x560248bbe5c0 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 --2- 172.21.15.151:0/1889912336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0b7fa0 tx=0x7f7b0c0b6ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34388bc987e13d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f79fcff9640 1 -- 172.21.15.151:0/1889912336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0e73b0 con 0x560248bbe5c0 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f79fcff9640 1 -- 172.21.15.151:0/1889912336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0e8ab0 con 0x560248bbe5c0 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f79fcff9640 1 -- 172.21.15.151:0/1889912336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0f4100 con 0x560248bbe5c0 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1889912336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 msgr2=0x560248bbe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/1889912336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0b7fa0 tx=0x7f7b0c0b6ee0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1889912336 shutdown_connections 2024-09-13T19:07:43.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/1889912336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bbe9c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1889912336 >> 172.21.15.151:0/1889912336 conn(0x560248bba9f0 msgr2=0x560248bb8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1889912336 shutdown_connections 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- 172.21.15.151:0/1889912336 wait complete. 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 Processor -- start 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- start start 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b1bb81980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560248bbf460 con 0x560248bbe5c0 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37226/0 (socket says 172.21.15.151:37226) 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 learned_addr learned my addr 172.21.15.151:0/637441724 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.546+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560248bc5d40 con 0x560248bbe5c0 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19691640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0e5010 tx=0x7f7b0c0f5f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 -- 172.21.15.151:0/637441724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0bfb90 con 0x560248bbe5c0 2024-09-13T19:07:43.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 -- 172.21.15.151:0/637441724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0c0b9cb0 con 0x560248bbe5c0 2024-09-13T19:07:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560248bc5d40 con 0x560248bbe5c0 2024-09-13T19:07:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 -- 172.21.15.151:0/637441724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c0bfd30 con 0x560248bbe5c0 2024-09-13T19:07:43.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560248bc5d40 con 0x560248bbe5c0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 -- 172.21.15.151:0/637441724 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7b0c0d6940 con 0x560248bbe5c0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79e4034650 0x7f79e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f79eeffd640 1 -- 172.21.15.151:0/637441724 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7b0c0a8070 con 0x560248bbe5c0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b13fff640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79e4034650 0x7f79e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248bd0770 0x560248bd2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd3360 con 0x560248bd0770 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19e92640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248bd0770 0x560248bd2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b13fff640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79e4034650 0x7f79e4036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560248b9bdb0 tx=0x7f7b04010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19e92640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248bd0770 0x560248bd2c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 realm 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd3770 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd4010 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.550+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248bd5110 0x560248bd7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd7a80 con 0x560248bd5110 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248bd5110 0x560248bd7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248bd5110 0x560248bd7500 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 20 searching for the correct realm 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd92e0 con 0x560248bd5110 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7b0c0e8450 0x7f7b0c11b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd92e0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7b0c0e8450 0x7f7b0c11b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7b0c0e8450 0x7f7b0c11b8a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0400e620 con 0x7f7b0c0e8450 2024-09-13T19:07:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd92e0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0400e620 con 0x7f7b0c0e8450 2024-09-13T19:07:43.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd92e0 con 0x560248bd0770 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7b14016440 0x7f7b140168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.554+0000 7f7b19e92640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7b14016440 0x7f7b140168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7b14016440 0x7f7b140168c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7b0400e620 con 0x7f7b0c0e8450 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7b0400e620 con 0x7f7b0c0e8450 2024-09-13T19:07:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.558+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0400e620 con 0x7f7b0c0e8450 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.562+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd5110 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b14016440 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x560248bd0770 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560248bd43b0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:43.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd83d0 con 0x560248bd0770 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd8010 con 0x560248bd0770 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd8010 con 0x7f7b0c0e8450 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.566+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 zone default found 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 4 Realm: () 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 zonegroup default 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bd91f0 con 0x7f7b14016440 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bdb190 con 0x560248bd5110 2024-09-13T19:07:43.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248bdb530 con 0x560248bd5110 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 started sync module instance, tier type = 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:43.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bda630 con 0x7f7b0c0e8450 2024-09-13T19:07:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94567810312784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bda290 con 0x7f7b0c0e8450 2024-09-13T19:07:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.570+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdc3a0 con 0x560248bd0770 2024-09-13T19:07:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94567810312784] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94567810318064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdc310 con 0x560248bd0770 2024-09-13T19:07:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdd120 con 0x560248bd5110 2024-09-13T19:07:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94567810318064] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94567810320320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdd510 con 0x560248bd5110 2024-09-13T19:07:43.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.574+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdded0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94567810327152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdeb40 con 0x7f7b0c0e8450 2024-09-13T19:07:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf500 con 0x560248bd0770 2024-09-13T19:07:43.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94567810320320] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94567810327152] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94567810330704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdeb40 con 0x560248bd0770 2024-09-13T19:07:43.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.578+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf470 con 0x7f7b14016440 2024-09-13T19:07:43.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94567810330704] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94567810328208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdeab0 con 0x7f7b14016440 2024-09-13T19:07:43.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be02d0 con 0x7f7b14016440 2024-09-13T19:07:43.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94567810334112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be0740 con 0x7f7b14016440 2024-09-13T19:07:43.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be1230 con 0x7f7b14016440 2024-09-13T19:07:43.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.582+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94567810328208] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94567810334112] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94567810338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be0290 con 0x7f7b14016440 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=0 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=1 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=2 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=3 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=4 2024-09-13T19:07:43.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=5 2024-09-13T19:07:43.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=6 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94567810338048] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 20 add_watcher() i=7 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.586+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248be4330 con 0x560248bd0770 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94567810332912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be17b0 con 0x560248bd0770 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94567810332912] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f79cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 5 note: GC not initialized 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f79ce7e4640 20 reqs_thread_entry: start 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 Filter name: none 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f793ffff640 20 reqs_thread_entry: start 2024-09-13T19:07:43.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248c072b0 con 0x560248bd0770 2024-09-13T19:07:43.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:43.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560248c08800 con 0x7f7b14016440 2024-09-13T19:07:43.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.590+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f79cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94567810332912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248be6180 con 0x560248bd0770 2024-09-13T19:07:43.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94567810332912] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94567810312784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf8f0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94567810312784] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b1bb81980 20 remove_watcher() i=0 2024-09-13T19:07:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b1bb81980 2 removed watcher, disabling cache 2024-09-13T19:07:43.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.594+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94567810318064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf8f0 con 0x560248bd0770 2024-09-13T19:07:43.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94567810318064] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b1bb81980 20 remove_watcher() i=1 2024-09-13T19:07:43.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94567810320320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdbef0 con 0x560248bd5110 2024-09-13T19:07:43.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b19691640 1 -- 172.21.15.151:0/637441724 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94567810320320] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b0c118020 con 0x560248bd5110 2024-09-13T19:07:43.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b1bb81980 20 remove_watcher() i=2 2024-09-13T19:07:43.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.598+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94567810327152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf8f0 con 0x7f7b0c0e8450 2024-09-13T19:07:43.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b13fff640 1 -- 172.21.15.151:0/637441724 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94567810327152] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b04040040 con 0x7f7b0c0e8450 2024-09-13T19:07:43.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b1bb81980 20 remove_watcher() i=3 2024-09-13T19:07:43.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94567810330704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdc7c0 con 0x560248bd0770 2024-09-13T19:07:43.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94567810330704] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x560248bd0770 2024-09-13T19:07:43.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b1bb81980 20 remove_watcher() i=4 2024-09-13T19:07:43.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.602+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94567810328208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdbef0 con 0x7f7b14016440 2024-09-13T19:07:43.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94567810328208] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b1bb81980 20 remove_watcher() i=5 2024-09-13T19:07:43.610 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94567810334112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf8f0 con 0x7f7b14016440 2024-09-13T19:07:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94567810334112] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b1bb81980 20 remove_watcher() i=6 2024-09-13T19:07:43.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.606+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94567810338048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560248bdf050 con 0x7f7b14016440 2024-09-13T19:07:43.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94567810338048] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7b1400a4d0 con 0x7f7b14016440 2024-09-13T19:07:43.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 20 remove_watcher() i=7 2024-09-13T19:07:43.616 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7b14016440 msgr2=0x7f7b140168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f7b14016440 0x7f7b140168c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248bd0770 msgr2=0x560248bd2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248bd0770 0x560248bd2c10 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7b0c0e8450 msgr2=0x7f7b0c11b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f7b0c0e8450 0x7f7b0c11b8a0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248bd5110 msgr2=0x560248bd7500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248bd5110 0x560248bd7500 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79e4034650 msgr2=0x7f79e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79e4034650 0x7f79e4036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560248b9bdb0 tx=0x7f7b04010000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 msgr2=0x560248bc5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0e5010 tx=0x7f7b0c0f5f70 comp rx=0 tx=0).stop 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b19e92640 1 -- 172.21.15.151:0/637441724 reap_dead start 2024-09-13T19:07:43.617 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 shutdown_connections 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/637441724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bbe5c0 0x560248bc5800 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 >> 172.21.15.151:0/637441724 conn(0x560248bba9f0 msgr2=0x560248bb8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 shutdown_connections 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/637441724 wait complete. 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 msgr2=0x7f79f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 0x7f79f0036b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b0400bf60 tx=0x7f7b0400f000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 msgr2=0x560248bb2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0e3500 tx=0x7f7b0c0b5970 comp rx=0 tx=0).stop 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 shutdown_connections 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f79f0034650 0x7f79f0036b10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/601060211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248bb1ce0 0x560248bb2100 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 >> 172.21.15.151:0/601060211 conn(0x560248ba6e30 msgr2=0x560248ba98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 shutdown_connections 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/601060211 wait complete. 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248aa2230 msgr2=0x560248b9ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x560248aa2230 0x560248b9ae10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560248ba1720 msgr2=0x560248ba3b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x560248ba1720 0x560248ba3b10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248b9d800 msgr2=0x560248b9fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x560248b9d800 0x560248b9fbf0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7a000346a0 msgr2=0x7f7a00036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7a000346a0 0x7f7a00036b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7b04000f70 tx=0x7f7b040012c0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 msgr2=0x560248b93e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 --2- 172.21.15.151:0/3980651262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560248aa18e0 0x560248b93e80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c017e90 tx=0x7f7b0c018020 comp rx=0 tx=0).stop 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b19e92640 1 -- 172.21.15.151:0/3980651262 reap_dead start 2024-09-13T19:07:43.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 shutdown_connections 2024-09-13T19:07:43.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 >> 172.21.15.151:0/3980651262 conn(0x560248a15230 msgr2=0x560248b87400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 shutdown_connections 2024-09-13T19:07:43.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.610+0000 7f7b1bb81980 1 -- 172.21.15.151:0/3980651262 wait complete. 2024-09-13T19:07:43.627 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-13T19:07:43.627 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-13T19:07:43.628 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:07:43.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-13T19:07:43.628 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-13T19:07:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:43.703 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.698+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4193845980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559520b076a0 0x559520b07a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4193845980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55952098fae0 con 0x559520b07ff0 2024-09-13T19:07:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4193845980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5595209b3e30 con 0x559520b076a0 2024-09-13T19:07:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559520b076a0 0x559520b07a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559520b076a0 0x559520b07a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37240/0 (socket says 172.21.15.151:37240) 2024-09-13T19:07:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 -- 172.21.15.151:0/2561532752 learned_addr learned my addr 172.21.15.151:0/2561532752 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4190b54640 1 --1- 172.21.15.151:0/2561532752 >> v1:172.21.15.12:6789/0 conn(0x559520b07ff0 0x559520b0ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59786/0 (socket says 172.21.15.151:59786) 2024-09-13T19:07:43.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 -- 172.21.15.151:0/2561532752 >> v1:172.21.15.12:6789/0 conn(0x559520b07ff0 legacy=0x559520b0ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 -- 172.21.15.151:0/2561532752 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520b0f270 con 0x559520b076a0 2024-09-13T19:07:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.702+0000 7f4191355640 1 --2- 172.21.15.151:0/2561532752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520b07a80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a4e0 tx=0x7f418c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f6c3018b1f7fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4183fff640 1 -- 172.21.15.151:0/2561532752 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0aa540 con 0x559520b076a0 2024-09-13T19:07:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4183fff640 1 -- 172.21.15.151:0/2561532752 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0aa6e0 con 0x559520b076a0 2024-09-13T19:07:43.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4183fff640 1 -- 172.21.15.151:0/2561532752 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0aaa40 con 0x559520b076a0 2024-09-13T19:07:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 -- 172.21.15.151:0/2561532752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 msgr2=0x559520b07a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 --2- 172.21.15.151:0/2561532752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520b07a80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f418c00a4e0 tx=0x7f418c01b090 comp rx=0 tx=0).stop 2024-09-13T19:07:43.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 -- 172.21.15.151:0/2561532752 shutdown_connections 2024-09-13T19:07:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 --2- 172.21.15.151:0/2561532752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520b07a80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 -- 172.21.15.151:0/2561532752 >> 172.21.15.151:0/2561532752 conn(0x559520b031c0 msgr2=0x559520b055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 -- 172.21.15.151:0/2561532752 shutdown_connections 2024-09-13T19:07:43.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.706+0000 7f4193845980 1 -- 172.21.15.151:0/2561532752 wait complete. 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5595209b5200 con 0x559520b076a0 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37254/0 (socket says 172.21.15.151:37254) 2024-09-13T19:07:43.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4191355640 1 -- 172.21.15.151:0/3934269332 learned_addr learned my addr 172.21.15.151:0/3934269332 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4191355640 1 -- 172.21.15.151:0/3934269332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520bf3070 con 0x559520b076a0 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4191355640 1 --2- 172.21.15.151:0/3934269332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f418c017ca0 tx=0x7f418c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d22601c43465c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f407f606640 1 -- 172.21.15.151:0/3934269332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0b9070 con 0x559520b076a0 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f407f606640 1 -- 172.21.15.151:0/3934269332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0aaa80 con 0x559520b076a0 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f407f606640 1 -- 172.21.15.151:0/3934269332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0aad60 con 0x559520b076a0 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- 172.21.15.151:0/3934269332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 msgr2=0x559520bf2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 --2- 172.21.15.151:0/3934269332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f418c017ca0 tx=0x7f418c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- 172.21.15.151:0/3934269332 shutdown_connections 2024-09-13T19:07:43.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 --2- 172.21.15.151:0/3934269332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf2aa0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- 172.21.15.151:0/3934269332 >> 172.21.15.151:0/3934269332 conn(0x559520b031c0 msgr2=0x559520bee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- 172.21.15.151:0/3934269332 shutdown_connections 2024-09-13T19:07:43.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.722+0000 7f4193845980 1 -- 172.21.15.151:0/3934269332 wait complete. 2024-09-13T19:07:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559520b0ecb0 con 0x559520b076a0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37256/0 (socket says 172.21.15.151:37256) 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4191355640 1 -- 172.21.15.151:0/4168442254 learned_addr learned my addr 172.21.15.151:0/4168442254 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4191355640 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520bfa1e0 con 0x559520b076a0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4191355640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf9ca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f418c01aec0 tx=0x7f418c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 -- 172.21.15.151:0/4168442254 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0cc070 con 0x559520b076a0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559520bfa470 con 0x559520b076a0 2024-09-13T19:07:43.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 -- 172.21.15.151:0/4168442254 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0c7410 con 0x559520b076a0 2024-09-13T19:07:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 -- 172.21.15.151:0/4168442254 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0b9070 con 0x559520b076a0 2024-09-13T19:07:43.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559520bfd150 con 0x559520b076a0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 -- 172.21.15.151:0/4168442254 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f418c0b3040 con 0x559520b076a0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4078034650 0x7f4078036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f407de03640 1 -- 172.21.15.151:0/4168442254 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f418c0c4070 con 0x559520b076a0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4190b54640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4078034650 0x7f4078036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520b07ff0 0x559520c00da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.726+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c01370 con 0x559520b07ff0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191b56640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520b07ff0 0x559520c00da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4190b54640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4078034650 0x7f4078036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f70 tx=0x7f4188001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191b56640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520b07ff0 0x559520c00da0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191b56640 1 -- 172.21.15.151:0/4168442254 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41840083f0 con 0x559520b07ff0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520bfe370 con 0x559520b07ff0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191b56640 1 -- 172.21.15.151:0/4168442254 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41840083f0 con 0x559520b07ff0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c036d0 0x559520c05ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c061b0 con 0x559520c036d0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191355640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c036d0 0x559520c05ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191355640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c036d0 0x559520c05ac0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191355640 1 -- 172.21.15.151:0/4168442254 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f418c0ce310 con 0x559520c036d0 2024-09-13T19:07:43.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c02570 con 0x559520b07ff0 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4191b56640 1 -- 172.21.15.151:0/4168442254 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41840083f0 con 0x559520b07ff0 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559520c07610 0x559520c09a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c0a140 con 0x559520c07610 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4190b54640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559520c07610 0x559520c09a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4190b54640 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559520c07610 0x559520c09a00 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4190b54640 1 -- 172.21.15.151:0/4168442254 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f418800f6a0 con 0x559520c07610 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.730+0000 7f4193845980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559520a0e800 con 0x559520c17c10 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37272/0 (socket says 172.21.15.151:37272) 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4191355640 1 -- 172.21.15.151:0/157629581 learned_addr learned my addr 172.21.15.151:0/157629581 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4191355640 1 -- 172.21.15.151:0/157629581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520c18570 con 0x559520c17c10 2024-09-13T19:07:43.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4191355640 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f418c0e2e90 tx=0x7f418c0c6f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 -- 172.21.15.151:0/157629581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0e9070 con 0x559520c17c10 2024-09-13T19:07:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559520c18800 con 0x559520c17c10 2024-09-13T19:07:43.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 -- 172.21.15.151:0/157629581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0cf6a0 con 0x559520c17c10 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559520c1b480 con 0x559520c17c10 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 -- 172.21.15.151:0/157629581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0e1410 con 0x559520c17c10 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 -- 172.21.15.151:0/157629581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f418c0ec070 con 0x559520c17c10 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 0x7f4068036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4076ffd640 1 -- 172.21.15.151:0/157629581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f418c0de070 con 0x559520c17c10 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4190b54640 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 0x7f4068036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4190b54640 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 0x7f4068036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x559520c01850 tx=0x7f418800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.734+0000 7f4193845980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559520bf3330 con 0x559520a7cbe0 2024-09-13T19:07:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37274/0 (socket says 172.21.15.151:37274) 2024-09-13T19:07:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 -- 172.21.15.151:0/3828791271 learned_addr learned my addr 172.21.15.151:0/3828791271 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 -- 172.21.15.151:0/3828791271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520a7d590 con 0x559520a7cbe0 2024-09-13T19:07:43.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- 172.21.15.151:0/3828791271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c68f0 tx=0x7f418c0efe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faba7f77e9271402 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4074ff9640 1 -- 172.21.15.151:0/3828791271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0cedf0 con 0x559520a7cbe0 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4074ff9640 1 -- 172.21.15.151:0/3828791271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0c00a0 con 0x559520a7cbe0 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4074ff9640 1 -- 172.21.15.151:0/3828791271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0bd400 con 0x559520a7cbe0 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- 172.21.15.151:0/3828791271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 msgr2=0x559520a7cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 --2- 172.21.15.151:0/3828791271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c68f0 tx=0x7f418c0efe80 comp rx=0 tx=0).stop 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- 172.21.15.151:0/3828791271 shutdown_connections 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 --2- 172.21.15.151:0/3828791271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520a7cfc0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- 172.21.15.151:0/3828791271 >> 172.21.15.151:0/3828791271 conn(0x559520c208e0 msgr2=0x559520c1e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- 172.21.15.151:0/3828791271 shutdown_connections 2024-09-13T19:07:43.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- 172.21.15.151:0/3828791271 wait complete. 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 Processor -- start 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- start start 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4193845980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559520a7dbe0 con 0x559520a7cbe0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37284/0 (socket says 172.21.15.151:37284) 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 learned_addr learned my addr 172.21.15.151:0/1304394345 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559520c2ddc0 con 0x559520a7cbe0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.738+0000 7f4191355640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c68f0 tx=0x7f418c0c0380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 -- 172.21.15.151:0/1304394345 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c10b070 con 0x559520a7cbe0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 -- 172.21.15.151:0/1304394345 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f418c0d9df0 con 0x559520a7cbe0 2024-09-13T19:07:43.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 -- 172.21.15.151:0/1304394345 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f418c0dcc20 con 0x559520a7cbe0 2024-09-13T19:07:43.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559520c2ddc0 con 0x559520a7cbe0 2024-09-13T19:07:43.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559520c2ddc0 con 0x559520a7cbe0 2024-09-13T19:07:43.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 -- 172.21.15.151:0/1304394345 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f418c0fa070 con 0x559520a7cbe0 2024-09-13T19:07:43.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f405c0346a0 0x7f405c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4066ffd640 1 -- 172.21.15.151:0/1304394345 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f418c100070 con 0x559520a7cbe0 2024-09-13T19:07:43.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4190b54640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f405c0346a0 0x7f405c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520c38900 0x559520c3adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3b510 con 0x559520c38900 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520c38900 0x559520c3adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4190b54640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f405c0346a0 0x7f405c036b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f418800ffd0 tx=0x7f4188010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520c38900 0x559520c3adc0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 realm 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3b970 con 0x559520c38900 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c210 con 0x559520c38900 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c3d310 0x559520c3f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3fc40 con 0x559520c3d310 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.742+0000 7f4191355640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c3d310 0x559520c3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191355640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c3d310 0x559520c3f700 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4193845980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4193845980 20 searching for the correct realm 2024-09-13T19:07:43.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c414e0 con 0x559520c3d310 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191355640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f418c0ee060 0x7f418c0a77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c414e0 con 0x7f418c0ee060 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f418c0ee060 0x7f418c0a77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f418c0ee060 0x7f418c0a77a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c414e0 con 0x7f418c0ee060 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c414e0 con 0x559520c38900 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4184018410 0x7f4184018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4184018410 0x7f4184018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.746+0000 7f4191b56640 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4184018410 0x7f4184018890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x7f4184018410 2024-09-13T19:07:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x7f4184018410 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f418c0ee060 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x7f4184018410 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f418c0ee060 2024-09-13T19:07:43.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x7f4184018410 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.750+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x7f4184018410 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f418c0ee060 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41840083f0 con 0x559520c38900 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.754+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f418c0ee060 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c3d310 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x7f4184018410 2024-09-13T19:07:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f418403b040 con 0x7f418c0ee060 2024-09-13T19:07:43.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c3c5b0 con 0x559520c38900 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c40490 con 0x559520c38900 2024-09-13T19:07:43.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c40490 con 0x7f418c0ee060 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 zone default found 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 4 Realm: () 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 zonegroup default 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.758+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c40d60 con 0x7f4184018410 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c40d60 con 0x559520c3d310 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c43390 con 0x559520c3d310 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 started sync module instance, tier type = 2024-09-13T19:07:43.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c40950 con 0x7f418c0ee060 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098988214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c43780 con 0x7f418c0ee060 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c44280 con 0x559520c38900 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.762+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098988214496] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098988219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c44670 con 0x559520c38900 2024-09-13T19:07:43.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c45030 con 0x559520c3d310 2024-09-13T19:07:43.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098988219760] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098988223360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c45420 con 0x559520c3d310 2024-09-13T19:07:43.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.766+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c45de0 con 0x7f418c0ee060 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098988226864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c46630 con 0x7f418c0ee060 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c47050 con 0x559520c38900 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098988223360] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098988226864] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098988228992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c42dc0 con 0x559520c38900 2024-09-13T19:07:43.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.770+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c478f0 con 0x7f4184018410 2024-09-13T19:07:43.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098988228992] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098988231488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c478f0 con 0x7f4184018410 2024-09-13T19:07:43.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c481a0 con 0x7f4184018410 2024-09-13T19:07:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098988234992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48850 con 0x7f4184018410 2024-09-13T19:07:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c490e0 con 0x7f4184018410 2024-09-13T19:07:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.774+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098988231488] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098988234992] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098988233792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48890 con 0x7f4184018410 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=0 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=1 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=2 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=3 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=4 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=5 2024-09-13T19:07:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=6 2024-09-13T19:07:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098988233792] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 20 add_watcher() i=7 2024-09-13T19:07:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c4c1e0 con 0x559520c38900 2024-09-13T19:07:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.778+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098988237696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c49660 con 0x559520c38900 2024-09-13T19:07:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098988237696] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f40477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 5 note: GC not initialized 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f40467e4640 20 reqs_thread_entry: start 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 Filter name: none 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f3fb7fff640 20 reqs_thread_entry: start 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c6f0d0 con 0x559520c38900 2024-09-13T19:07:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559520c70620 con 0x7f4184018410 2024-09-13T19:07:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f40477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.782+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098988237696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c4e4e0 con 0x559520c38900 2024-09-13T19:07:43.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94098988237696] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098988214496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48380 con 0x7f418c0ee060 2024-09-13T19:07:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94098988214496] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4193845980 20 remove_watcher() i=0 2024-09-13T19:07:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4193845980 2 removed watcher, disabling cache 2024-09-13T19:07:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.786+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098988219760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48380 con 0x559520c38900 2024-09-13T19:07:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94098988219760] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 20 remove_watcher() i=1 2024-09-13T19:07:43.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098988223360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c43d70 con 0x559520c3d310 2024-09-13T19:07:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4191355640 1 -- 172.21.15.151:0/1304394345 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94098988223360] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f418c116070 con 0x559520c3d310 2024-09-13T19:07:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 20 remove_watcher() i=2 2024-09-13T19:07:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098988226864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48380 con 0x7f418c0ee060 2024-09-13T19:07:43.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4190b54640 1 -- 172.21.15.151:0/1304394345 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94098988226864] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4188037040 con 0x7f418c0ee060 2024-09-13T19:07:43.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 20 remove_watcher() i=3 2024-09-13T19:07:43.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.790+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098988228992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c43d70 con 0x559520c38900 2024-09-13T19:07:43.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94098988228992] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x559520c38900 2024-09-13T19:07:43.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4193845980 20 remove_watcher() i=4 2024-09-13T19:07:43.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098988231488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c48380 con 0x7f4184018410 2024-09-13T19:07:43.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94098988231488] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4193845980 20 remove_watcher() i=5 2024-09-13T19:07:43.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.794+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098988234992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c46180 con 0x7f4184018410 2024-09-13T19:07:43.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94098988234992] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 20 remove_watcher() i=6 2024-09-13T19:07:43.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098988233792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559520c46180 con 0x7f4184018410 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94098988233792] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4184036040 con 0x7f4184018410 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 20 remove_watcher() i=7 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4184018410 msgr2=0x7f4184018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4184018410 0x7f4184018890 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520c38900 msgr2=0x559520c3adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520c38900 0x559520c3adc0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f418c0ee060 msgr2=0x7f418c0a77a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f418c0ee060 0x7f418c0a77a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c3d310 msgr2=0x559520c3f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c3d310 0x559520c3f700 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f405c0346a0 msgr2=0x7f405c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f405c0346a0 0x7f405c036b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f418800ffd0 tx=0x7f4188010000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 msgr2=0x559520c2d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4191b56640 1 -- 172.21.15.151:0/1304394345 reap_dead start 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f418c0c68f0 tx=0x7f418c0c0380 comp rx=0 tx=0).stop 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 shutdown_connections 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 --2- 172.21.15.151:0/1304394345 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520a7cbe0 0x559520c2d880 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 >> 172.21.15.151:0/1304394345 conn(0x559520c208e0 msgr2=0x559520c1e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.798+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 shutdown_connections 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/1304394345 wait complete. 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 msgr2=0x7f4068036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 0x7f4068036b10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x559520c01850 tx=0x7f418800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 msgr2=0x559520c18030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f418c0e2e90 tx=0x7f418c0c6f50 comp rx=0 tx=0).stop 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 shutdown_connections 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4068034650 0x7f4068036b10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/157629581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520c17c10 0x559520c18030 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 >> 172.21.15.151:0/157629581 conn(0x559520c0cd60 msgr2=0x559520c0f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 shutdown_connections 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/157629581 wait complete. 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520b07ff0 msgr2=0x559520c00da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559520b07ff0 0x559520c00da0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559520c07610 msgr2=0x559520c09a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559520c07610 0x559520c09a00 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c036d0 msgr2=0x559520c05ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559520c036d0 0x559520c05ac0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4078034650 msgr2=0x7f4078036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4078034650 0x7f4078036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4188000f70 tx=0x7f4188001380 comp rx=0 tx=0).stop 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 msgr2=0x559520bf9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 --2- 172.21.15.151:0/4168442254 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559520b076a0 0x559520bf9ca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f418c01aec0 tx=0x7f418c017e30 comp rx=0 tx=0).stop 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4191b56640 1 -- 172.21.15.151:0/4168442254 reap_dead start 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 shutdown_connections 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 >> 172.21.15.151:0/4168442254 conn(0x559520b031c0 msgr2=0x559520bed250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 shutdown_connections 2024-09-13T19:07:43.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.802+0000 7f4193845980 1 -- 172.21.15.151:0/4168442254 wait complete. 2024-09-13T19:07:43.815 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-13T19:07:43.815 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-13T19:07:43.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:07:43.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-13T19:07:43.816 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-13T19:07:43.888 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:43.888 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd34ab980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5565cc65f3c0 0x5565cc65db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd34ab980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565cc570ae0 con 0x5565cc65f7d0 2024-09-13T19:07:43.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd34ab980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5565cc594e30 con 0x5565cc65f3c0 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd0fbb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5565cc65f3c0 0x5565cc65db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd0fbb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5565cc65f3c0 0x5565cc65db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37292/0 (socket says 172.21.15.151:37292) 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd07ba640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5565cc65f7d0 0x5565cc65e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59802/0 (socket says 172.21.15.151:59802) 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/2826061279 learned_addr learned my addr 172.21.15.151:0/2826061279 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/2826061279 >> v1:172.21.15.12:6789/0 conn(0x5565cc65f7d0 legacy=0x5565cc65e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.886+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/2826061279 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc65e8f0 con 0x5565cc65f3c0 2024-09-13T19:07:43.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/2826061279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc65db80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a5c0 tx=0x7f9dc001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987e719748afc442 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dcffb9640 1 -- 172.21.15.151:0/2826061279 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00a6070 con 0x5565cc65f3c0 2024-09-13T19:07:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dcffb9640 1 -- 172.21.15.151:0/2826061279 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00af070 con 0x5565cc65f3c0 2024-09-13T19:07:43.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dcffb9640 1 -- 172.21.15.151:0/2826061279 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00aa5c0 con 0x5565cc65f3c0 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2826061279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 msgr2=0x5565cc65db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2826061279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc65db80 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a5c0 tx=0x7f9dc001b340 comp rx=0 tx=0).stop 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2826061279 shutdown_connections 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2826061279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc65db80 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2826061279 >> 172.21.15.151:0/2826061279 conn(0x5565cc6e41c0 msgr2=0x5565cc6e65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2826061279 shutdown_connections 2024-09-13T19:07:43.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.890+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2826061279 wait complete. 2024-09-13T19:07:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.902+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.902+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.902+0000 7f9dd34ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.902+0000 7f9dd34ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565cc596200 con 0x5565cc65f3c0 2024-09-13T19:07:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37302/0 (socket says 172.21.15.151:37302) 2024-09-13T19:07:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4139538574 learned_addr learned my addr 172.21.15.151:0/4139538574 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4139538574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc7d61c0 con 0x5565cc65f3c0 2024-09-13T19:07:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/4139538574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0017f50 tx=0x7f9dc0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8c9282a39c7864 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9cbee0d640 1 -- 172.21.15.151:0/4139538574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00aa8f0 con 0x5565cc65f3c0 2024-09-13T19:07:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9cbee0d640 1 -- 172.21.15.151:0/4139538574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00aaa90 con 0x5565cc65f3c0 2024-09-13T19:07:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9cbee0d640 1 -- 172.21.15.151:0/4139538574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00aad70 con 0x5565cc65f3c0 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4139538574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 msgr2=0x5565cc7d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4139538574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0017f50 tx=0x7f9dc0003030 comp rx=0 tx=0).stop 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4139538574 shutdown_connections 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4139538574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7d5bf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4139538574 >> 172.21.15.151:0/4139538574 conn(0x5565cc6e41c0 msgr2=0x5565cc7d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4139538574 shutdown_connections 2024-09-13T19:07:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4139538574 wait complete. 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7dce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd34ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565cc6f4210 con 0x5565cc65f3c0 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7dce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37314/0 (socket says 172.21.15.151:37314) 2024-09-13T19:07:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4034637585 learned_addr learned my addr 172.21.15.151:0/4034637585 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc7dd340 con 0x5565cc65f3c0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.906+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7dce00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001b820 tx=0x7f9dc00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 -- 172.21.15.151:0/4034637585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00aa890 con 0x5565cc65f3c0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565cc7dd5d0 con 0x5565cc65f3c0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 -- 172.21.15.151:0/4034637585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00cd070 con 0x5565cc65f3c0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 -- 172.21.15.151:0/4034637585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00bda80 con 0x5565cc65f3c0 2024-09-13T19:07:43.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565cc7e02b0 con 0x5565cc65f3c0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 -- 172.21.15.151:0/4034637585 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dc00bdc70 con 0x5565cc65f3c0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9cb8034650 0x7f9cb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9cbd60a640 1 -- 172.21.15.151:0/4034637585 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc00e5ac0 con 0x5565cc65f3c0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9cb8034650 0x7f9cb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc65f7d0 0x5565cc7e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc7e4480 con 0x5565cc65f7d0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc65f7d0 0x5565cc7e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9cb8034650 0x7f9cb8036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e50 tx=0x7f9db80013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc65f7d0 0x5565cc7e3f00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd17bc640 1 -- 172.21.15.151:0/4034637585 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc65f7d0 2024-09-13T19:07:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc7e4d50 con 0x5565cc65f7d0 2024-09-13T19:07:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd17bc640 1 -- 172.21.15.151:0/4034637585 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc65f7d0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc7e6660 0x5565cc7e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc7e92b0 con 0x5565cc7e6660 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc7e6660 0x5565cc7e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc7e6660 0x5565cc7e8b20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4034637585 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc7e6660 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.910+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc7e55a0 con 0x5565cc65f7d0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd17bc640 1 -- 172.21.15.151:0/4034637585 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc65f7d0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565cc7ea710 0x5565cc7ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc7ed1f0 con 0x5565cc7ea710 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565cc7ea710 0x5565cc7ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565cc7ea710 0x5565cc7ecb00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd07ba640 1 -- 172.21.15.151:0/4034637585 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9db800f700 con 0x5565cc7ea710 2024-09-13T19:07:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565cc5ef800 con 0x5565cc7facc0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37324/0 (socket says 172.21.15.151:37324) 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/2811642748 learned_addr learned my addr 172.21.15.151:0/2811642748 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/2811642748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc7fb620 con 0x5565cc7facc0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c7930 tx=0x7f9dc00c6f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9cb67fc640 1 -- 172.21.15.151:0/2811642748 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00c5560 con 0x5565cc7facc0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565cc7fb8b0 con 0x5565cc7facc0 2024-09-13T19:07:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565cc7fe530 con 0x5565cc7facc0 2024-09-13T19:07:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9cb67fc640 1 -- 172.21.15.151:0/2811642748 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00c0bb0 con 0x5565cc7facc0 2024-09-13T19:07:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.914+0000 7f9cb67fc640 1 -- 172.21.15.151:0/2811642748 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00f2060 con 0x5565cc7facc0 2024-09-13T19:07:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9cb67fc640 1 -- 172.21.15.151:0/2811642748 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dc00b3ad0 con 0x5565cc7facc0 2024-09-13T19:07:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9cb67fc640 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 0x7f9ca8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9cb67fc640 1 -- 172.21.15.151:0/2811642748 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc00d4100 con 0x5565cc7facc0 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 0x7f9ca8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 0x7f9ca8036ac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5565cc7e1510 tx=0x7f9db800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565cc7d6480 con 0x5565cc807580 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37326/0 (socket says 172.21.15.151:37326) 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4270610486 learned_addr learned my addr 172.21.15.151:0/4270610486 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/4270610486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc807f30 con 0x5565cc807580 2024-09-13T19:07:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/4270610486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00b4960 tx=0x7f9dc00b3dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fe6cb89b313db2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9ca7fff640 1 -- 172.21.15.151:0/4270610486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00c58a0 con 0x5565cc807580 2024-09-13T19:07:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9ca7fff640 1 -- 172.21.15.151:0/4270610486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00b4050 con 0x5565cc807580 2024-09-13T19:07:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9ca7fff640 1 -- 172.21.15.151:0/4270610486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00e0cb0 con 0x5565cc807580 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4270610486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 msgr2=0x5565cc807960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4270610486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00b4960 tx=0x7f9dc00b3dc0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4270610486 shutdown_connections 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4270610486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc807960 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4270610486 >> 172.21.15.151:0/4270610486 conn(0x5565cc803960 msgr2=0x5565cc801a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4270610486 shutdown_connections 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4270610486 wait complete. 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 Processor -- start 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- start start 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd34ab980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5565cc8083d0 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.918+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd0fbb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37328/0 (socket says 172.21.15.151:37328) 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 learned_addr learned my addr 172.21.15.151:0/1953002385 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565cc80ecc0 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00e5db0 tx=0x7f9dc00a5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 -- 172.21.15.151:0/1953002385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00c67c0 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565cc80ecc0 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 -- 172.21.15.151:0/1953002385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00c6960 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 -- 172.21.15.151:0/1953002385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00e50b0 con 0x5565cc807580 2024-09-13T19:07:43.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565cc80ecc0 con 0x5565cc807580 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 -- 172.21.15.151:0/1953002385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dc0118060 con 0x5565cc807580 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9c9c034650 0x7f9c9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9ca67fc640 1 -- 172.21.15.151:0/1953002385 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc011bd20 con 0x5565cc807580 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9c9c034650 0x7f9c9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc819730 0x5565cc81bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81c340 con 0x5565cc819730 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc819730 0x5565cc81bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9c9c034650 0x7f9c9c036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5565cc7ed5f0 tx=0x7f9db8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc819730 0x5565cc81bbf0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 realm 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81c750 con 0x5565cc819730 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81cff0 con 0x5565cc819730 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.922+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc81e0f0 0x5565cc8204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc820a60 con 0x5565cc81e0f0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc81e0f0 0x5565cc8204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc81e0f0 0x5565cc8204e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 20 searching for the correct realm 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8222c0 con 0x5565cc81e0f0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9dc0106040 0x7f9dc010ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8222c0 con 0x7f9dc0106040 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9dc0106040 0x7f9dc010ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9dc0106040 0x7f9dc010ca20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8222c0 con 0x7f9dc0106040 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8222c0 con 0x5565cc819730 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9dc8016440 0x7f9dc80168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9dc8016440 0x7f9dc80168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.926+0000 7f9dd17bc640 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9dc8016440 0x7f9dc80168c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc0106040 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc0106040 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.930+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc0106040 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc0106040 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.934+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc81e0f0 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc8016440 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x5565cc819730 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5565cc81d390 con 0x7f9dc0106040 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8213b0 con 0x5565cc819730 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc820fc0 con 0x5565cc819730 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:43.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc820fc0 con 0x7f9dc0106040 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 zone default found 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 4 Realm: () 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 zonegroup default 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8221e0 con 0x7f9dc8016440 2024-09-13T19:07:43.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc824170 con 0x5565cc81e0f0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc824510 con 0x5565cc81e0f0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 started sync module instance, tier type = 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.938+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc823610 con 0x7f9dc0106040 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93895711144496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc824d60 con 0x7f9dc0106040 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8255b0 con 0x5565cc819730 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93895711144496] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93895711148208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc825650 con 0x5565cc819730 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.942+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc826170 con 0x5565cc81e0f0 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93895711148208] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93895711153216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc826560 con 0x5565cc81e0f0 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc826f20 con 0x7f9dc0106040 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93895711159056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc827be0 con 0x7f9dc0106040 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8285a0 con 0x5565cc819730 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93895711153216] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.946+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93895711159056] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93895711150336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc827840 con 0x5565cc819730 2024-09-13T19:07:43.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc828c90 con 0x7f9dc8016440 2024-09-13T19:07:43.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93895711150336] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93895711164224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc828c50 con 0x7f9dc8016440 2024-09-13T19:07:43.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.950+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8296a0 con 0x7f9dc8016440 2024-09-13T19:07:43.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93895711164224] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93895711162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8296a0 con 0x7f9dc8016440 2024-09-13T19:07:43.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc82a060 con 0x7f9dc8016440 2024-09-13T19:07:43.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93895711162608] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93895711167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc82a060 con 0x7f9dc8016440 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=0 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=1 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=2 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=3 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=4 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=5 2024-09-13T19:07:43.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.954+0000 7f9dd34ab980 20 add_watcher() i=6 2024-09-13T19:07:43.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93895711167232] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 add_watcher() i=7 2024-09-13T19:07:43.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:43.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc82d370 con 0x5565cc819730 2024-09-13T19:07:43.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93895711169824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc82a5f0 con 0x5565cc819730 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93895711169824] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 5 note: GC not initialized 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9c85fe3640 20 reqs_thread_entry: start 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 Filter name: none 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9bf77fe640 20 reqs_thread_entry: start 2024-09-13T19:07:43.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 20 rados->read ofs=0 len=0 2024-09-13T19:07:43.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.958+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc850590 con 0x5565cc819730 2024-09-13T19:07:43.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd34ab980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:43.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5565cc851ae0 con 0x7f9dc8016440 2024-09-13T19:07:43.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:43.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93895711169824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc84ecf0 con 0x5565cc819730 2024-09-13T19:07:43.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93895711169824] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.962+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93895711144496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc829d20 con 0x7f9dc0106040 2024-09-13T19:07:43.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93895711144496] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd34ab980 20 remove_watcher() i=0 2024-09-13T19:07:43.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd34ab980 2 removed watcher, disabling cache 2024-09-13T19:07:43.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93895711148208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc829d20 con 0x5565cc819730 2024-09-13T19:07:43.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93895711148208] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd34ab980 20 remove_watcher() i=1 2024-09-13T19:07:43.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.966+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93895711153216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc8248b0 con 0x5565cc81e0f0 2024-09-13T19:07:43.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd0fbb640 1 -- 172.21.15.151:0/1953002385 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93895711153216] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc00c5d00 con 0x5565cc81e0f0 2024-09-13T19:07:43.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 20 remove_watcher() i=2 2024-09-13T19:07:43.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93895711159056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc829d20 con 0x7f9dc0106040 2024-09-13T19:07:43.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd07ba640 1 -- 172.21.15.151:0/1953002385 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93895711159056] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9db8037040 con 0x7f9dc0106040 2024-09-13T19:07:43.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 20 remove_watcher() i=3 2024-09-13T19:07:43.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93895711150336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc825c40 con 0x5565cc819730 2024-09-13T19:07:43.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93895711150336] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x5565cc819730 2024-09-13T19:07:43.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 20 remove_watcher() i=4 2024-09-13T19:07:43.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.970+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93895711164224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc827310 con 0x7f9dc8016440 2024-09-13T19:07:43.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93895711164224] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd34ab980 20 remove_watcher() i=5 2024-09-13T19:07:43.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93895711162608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc829d20 con 0x7f9dc8016440 2024-09-13T19:07:43.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93895711162608] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd34ab980 20 remove_watcher() i=6 2024-09-13T19:07:43.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.974+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93895711167232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5565cc825c40 con 0x7f9dc8016440 2024-09-13T19:07:43.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93895711167232] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9dc800a4d0 con 0x7f9dc8016440 2024-09-13T19:07:43.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 20 remove_watcher() i=7 2024-09-13T19:07:43.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9dc8016440 msgr2=0x7f9dc80168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9dc8016440 0x7f9dc80168c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc819730 msgr2=0x5565cc81bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc819730 0x5565cc81bbf0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9dc0106040 msgr2=0x7f9dc010ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f9dc0106040 0x7f9dc010ca20 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc81e0f0 msgr2=0x5565cc8204e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc81e0f0 0x5565cc8204e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9c9c034650 msgr2=0x7f9c9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9c9c034650 0x7f9c9c036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x5565cc7ed5f0 tx=0x7f9db8010000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 msgr2=0x5565cc80e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd17bc640 1 -- 172.21.15.151:0/1953002385 reap_dead start 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00e5db0 tx=0x7f9dc00a5f10 comp rx=0 tx=0).stop 2024-09-13T19:07:43.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 shutdown_connections 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/1953002385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc807580 0x5565cc80e780 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 >> 172.21.15.151:0/1953002385 conn(0x5565cc803960 msgr2=0x5565cc801a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 shutdown_connections 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/1953002385 wait complete. 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 msgr2=0x7f9ca8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 0x7f9ca8036ac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5565cc7e1510 tx=0x7f9db800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 msgr2=0x5565cc7fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c7930 tx=0x7f9dc00c6f40 comp rx=0 tx=0).stop 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 shutdown_connections 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ca8034600 0x7f9ca8036ac0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/2811642748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc7facc0 0x5565cc7fb0e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 >> 172.21.15.151:0/2811642748 conn(0x5565cc7efe10 msgr2=0x5565cc7f2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 shutdown_connections 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/2811642748 wait complete. 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc65f7d0 msgr2=0x5565cc7e3f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5565cc65f7d0 0x5565cc7e3f00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565cc7ea710 msgr2=0x5565cc7ecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5565cc7ea710 0x5565cc7ecb00 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc7e6660 msgr2=0x5565cc7e8b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5565cc7e6660 0x5565cc7e8b20 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9cb8034650 msgr2=0x7f9cb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9cb8034650 0x7f9cb8036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e50 tx=0x7f9db80013b0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 msgr2=0x5565cc7dce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 --2- 172.21.15.151:0/4034637585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5565cc65f3c0 0x5565cc7dce00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9dc001b820 tx=0x7f9dc00180e0 comp rx=0 tx=0).stop 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd17bc640 1 -- 172.21.15.151:0/4034637585 reap_dead start 2024-09-13T19:07:43.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 shutdown_connections 2024-09-13T19:07:43.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 >> 172.21.15.151:0/4034637585 conn(0x5565cc6e41c0 msgr2=0x5565cc7d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:43.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 shutdown_connections 2024-09-13T19:07:43.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:43.978+0000 7f9dd34ab980 1 -- 172.21.15.151:0/4034637585 wait complete. 2024-09-13T19:07:43.992 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-13T19:07:43.992 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-13T19:07:43.992 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:07:43.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-13T19:07:43.993 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-13T19:07:44.070 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:44.070 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd43c8980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557cc7d7c7d0 0x557cc7d7b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd43c8980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557cc7c8dae0 con 0x557cc7d7c3c0 2024-09-13T19:07:44.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd43c8980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x557cc7cb1e30 con 0x557cc7d7c7d0 2024-09-13T19:07:44.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd16d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557cc7d7c7d0 0x557cc7d7b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd16d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x557cc7d7c7d0 0x557cc7d7b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37342/0 (socket says 172.21.15.151:37342) 2024-09-13T19:07:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd1ed8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x557cc7d7c3c0 0x557cc7d7ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59808/0 (socket says 172.21.15.151:59808) 2024-09-13T19:07:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd16d7640 1 -- 172.21.15.151:0/908905632 learned_addr learned my addr 172.21.15.151:0/908905632 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd16d7640 1 -- 172.21.15.151:0/908905632 >> v1:172.21.15.12:6789/0 conn(0x557cc7d7c3c0 legacy=0x557cc7d7ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.066+0000 7efdd16d7640 1 -- 172.21.15.151:0/908905632 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7d7b8f0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd16d7640 1 --2- 172.21.15.151:0/908905632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c7d0 0x557cc7d7b290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efdc800a5c0 tx=0x7efdc801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3015b044ffa0f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd0ed6640 1 -- 172.21.15.151:0/908905632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc80a6070 con 0x557cc7d7c7d0 2024-09-13T19:07:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd0ed6640 1 -- 172.21.15.151:0/908905632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc80af070 con 0x557cc7d7c7d0 2024-09-13T19:07:44.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd0ed6640 1 -- 172.21.15.151:0/908905632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdc80aa5c0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 -- 172.21.15.151:0/908905632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c7d0 msgr2=0x557cc7d7b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 --2- 172.21.15.151:0/908905632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c7d0 0x557cc7d7b290 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7efdc800a5c0 tx=0x7efdc801b340 comp rx=0 tx=0).stop 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 -- 172.21.15.151:0/908905632 shutdown_connections 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 --2- 172.21.15.151:0/908905632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c7d0 0x557cc7d7b290 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 -- 172.21.15.151:0/908905632 >> 172.21.15.151:0/908905632 conn(0x557cc7e011c0 msgr2=0x557cc7e035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 -- 172.21.15.151:0/908905632 shutdown_connections 2024-09-13T19:07:44.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.070+0000 7efdd43c8980 1 -- 172.21.15.151:0/908905632 wait complete. 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cc7cb3200 con 0x557cc7d7c3c0 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37358/0 (socket says 172.21.15.151:37358) 2024-09-13T19:07:44.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2960538935 learned_addr learned my addr 172.21.15.151:0/2960538935 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2960538935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7ef31d0 con 0x557cc7d7c3c0 2024-09-13T19:07:44.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/2960538935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0015f0 tx=0x7efdcc001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40838a48f5ca5b3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efcbfe07640 1 -- 172.21.15.151:0/2960538935 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc013420 con 0x557cc7d7c3c0 2024-09-13T19:07:44.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efcbfe07640 1 -- 172.21.15.151:0/2960538935 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc0135e0 con 0x557cc7d7c3c0 2024-09-13T19:07:44.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efcbfe07640 1 -- 172.21.15.151:0/2960538935 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc013940 con 0x557cc7d7c3c0 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- 172.21.15.151:0/2960538935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 msgr2=0x557cc7ef2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2960538935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0015f0 tx=0x7efdcc001ab0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- 172.21.15.151:0/2960538935 shutdown_connections 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2960538935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef2c00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- 172.21.15.151:0/2960538935 >> 172.21.15.151:0/2960538935 conn(0x557cc7e011c0 msgr2=0x557cc7eee830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- 172.21.15.151:0/2960538935 shutdown_connections 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- 172.21.15.151:0/2960538935 wait complete. 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd43c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cc7e11210 con 0x557cc7d7c3c0 2024-09-13T19:07:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37372/0 (socket says 172.21.15.151:37372) 2024-09-13T19:07:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2830348230 learned_addr learned my addr 172.21.15.151:0/2830348230 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.086+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7efa4b0 con 0x557cc7d7c3c0 2024-09-13T19:07:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef9f70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006640 tx=0x7efdcc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 -- 172.21.15.151:0/2830348230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc022020 con 0x557cc7d7c3c0 2024-09-13T19:07:44.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc7efa740 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 -- 172.21.15.151:0/2830348230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc006320 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 -- 172.21.15.151:0/2830348230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc004ab0 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc7efd420 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 -- 172.21.15.151:0/2830348230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdcc025020 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcb8034650 0x7efcb8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efcbe604640 1 -- 172.21.15.151:0/2830348230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efdcc018030 con 0x557cc7d7c3c0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcb8034650 0x7efcb8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7d7c7d0 0x557cc7f00fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f015f0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd26d9640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7d7c7d0 0x557cc7f00fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcb8034650 0x7efcb8036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ae000 tx=0x7efdc80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd26d9640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7d7c7d0 0x557cc7f00fb0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd26d9640 1 -- 172.21.15.151:0/2830348230 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7efe640 con 0x557cc7d7c7d0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd26d9640 1 -- 172.21.15.151:0/2830348230 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f03920 0x557cc7f05d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f063e0 con 0x557cc7f03920 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f03920 0x557cc7f05d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f03920 0x557cc7f05d10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2830348230 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efdcc01b070 con 0x557cc7f03920 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.090+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f02790 con 0x557cc7d7c7d0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd26d9640 1 -- 172.21.15.151:0/2830348230 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7d7c7d0 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557cc7f07820 0x557cc7f09c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f0a380 con 0x557cc7f07820 2024-09-13T19:07:44.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557cc7f07820 0x557cc7f09c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557cc7f07820 0x557cc7f09c10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd16d7640 1 -- 172.21.15.151:0/2830348230 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efdc80aab40 con 0x557cc7f07820 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cc7d0c800 con 0x557cc7f17df0 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37378/0 (socket says 172.21.15.151:37378) 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2118441185 learned_addr learned my addr 172.21.15.151:0/2118441185 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd1ed8640 1 -- 172.21.15.151:0/2118441185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7f18750 con 0x557cc7f17df0 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0069a0 tx=0x7efdcc01ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efcb77fe640 1 -- 172.21.15.151:0/2118441185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc01d580 con 0x557cc7f17df0 2024-09-13T19:07:44.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc7f189e0 con 0x557cc7f17df0 2024-09-13T19:07:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc7f1b660 con 0x557cc7f17df0 2024-09-13T19:07:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efcb77fe640 1 -- 172.21.15.151:0/2118441185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc01d720 con 0x557cc7f17df0 2024-09-13T19:07:44.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.094+0000 7efcb77fe640 1 -- 172.21.15.151:0/2118441185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc01da00 con 0x557cc7f17df0 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb77fe640 1 -- 172.21.15.151:0/2118441185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdcc010070 con 0x557cc7f17df0 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb77fe640 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 0x7efcac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb77fe640 1 -- 172.21.15.151:0/2118441185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efdcc01f5c0 con 0x557cc7f17df0 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 0x7efcac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.102 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cc7ef3550 con 0x557cc7f24730 2024-09-13T19:07:44.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd16d7640 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 0x7efcac036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efdc8017f50 tx=0x7efdc8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37388/0 (socket says 172.21.15.151:37388) 2024-09-13T19:07:44.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd1ed8640 1 -- 172.21.15.151:0/3884955035 learned_addr learned my addr 172.21.15.151:0/3884955035 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd1ed8640 1 -- 172.21.15.151:0/3884955035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7f250e0 con 0x557cc7f24730 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/3884955035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0046c0 tx=0x7efdcc027400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92aed1dcdbef22e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb57fa640 1 -- 172.21.15.151:0/3884955035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc0412c0 con 0x557cc7f24730 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb57fa640 1 -- 172.21.15.151:0/3884955035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc053070 con 0x557cc7f24730 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efcb57fa640 1 -- 172.21.15.151:0/3884955035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc049ce0 con 0x557cc7f24730 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- 172.21.15.151:0/3884955035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 msgr2=0x557cc7f24b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 --2- 172.21.15.151:0/3884955035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0046c0 tx=0x7efdcc027400 comp rx=0 tx=0).stop 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- 172.21.15.151:0/3884955035 shutdown_connections 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 --2- 172.21.15.151:0/3884955035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f24b10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- 172.21.15.151:0/3884955035 >> 172.21.15.151:0/3884955035 conn(0x557cc7f20b10 msgr2=0x557cc7f1ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- 172.21.15.151:0/3884955035 shutdown_connections 2024-09-13T19:07:44.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- 172.21.15.151:0/3884955035 wait complete. 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 Processor -- start 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- start start 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.098+0000 7efdd43c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557cc7f25580 con 0x557cc7f24730 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd1ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37392/0 (socket says 172.21.15.151:37392) 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 learned_addr learned my addr 172.21.15.151:0/1862142608 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557cc7f2be30 con 0x557cc7f24730 2024-09-13T19:07:44.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efdcc04ffd0 tx=0x7efdcc01f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 -- 172.21.15.151:0/1862142608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc068070 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557cc7f2be30 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557cc7f2be30 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 -- 172.21.15.151:0/1862142608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc026700 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 -- 172.21.15.151:0/1862142608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdcc0416d0 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 -- 172.21.15.151:0/1862142608 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efdcc061040 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efc9c034600 0x7efc9c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efca37fe640 1 -- 172.21.15.151:0/1862142608 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efdcc05f020 con 0x557cc7f24730 2024-09-13T19:07:44.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd16d7640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efc9c034600 0x7efc9c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7f369d0 0x557cc7f38e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f395c0 con 0x557cc7f369d0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd26d9640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7f369d0 0x557cc7f38e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd16d7640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efc9c034600 0x7efc9c036ac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ac040 tx=0x7efdc80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd26d9640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7f369d0 0x557cc7f38e70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 realm 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f399d0 con 0x557cc7f369d0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.102+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a270 con 0x557cc7f369d0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f3b370 0x557cc7f3d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3dce0 con 0x557cc7f3b370 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f3b370 0x557cc7f3d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f3b370 0x557cc7f3d760 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 20 searching for the correct realm 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f540 con 0x557cc7f3b370 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdcc064040 0x7efdcc00b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f540 con 0x7efdcc064040 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdcc064040 0x7efdcc00b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdcc064040 0x7efdcc00b150 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc80aab40 con 0x7efdcc064040 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f540 con 0x7efdcc064040 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc80aab40 con 0x7efdcc064040 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f540 con 0x557cc7f369d0 2024-09-13T19:07:44.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdc4018410 0x7efdc4018870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdc4018410 0x7efdc4018870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.106+0000 7efdd26d9640 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdc4018410 0x7efdc4018870 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdc4018410 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdc4018410 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdcc064040 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efdc80aab40 con 0x7efdcc064040 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdc4018410 2024-09-13T19:07:44.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdcc064040 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efdc80aab40 con 0x7efdcc064040 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.110+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdc4018410 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x7efdc4018410 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdcc064040 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc80aab40 con 0x7efdcc064040 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc40083f0 con 0x557cc7f369d0 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.114+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdcc064040 2024-09-13T19:07:44.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f3b370 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x7efdc4018410 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3a610 con 0x557cc7f369d0 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efdc403b040 con 0x7efdcc064040 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:44.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3e530 con 0x557cc7f369d0 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3e920 con 0x557cc7f369d0 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3e920 con 0x7efdcc064040 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 zone default found 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 4 Realm: () 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 zonegroup default 2024-09-13T19:07:44.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f1f0 con 0x7efdc4018410 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.118+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f3f1f0 con 0x557cc7f3b370 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f413d0 con 0x557cc7f3b370 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 20 started sync module instance, tier type = 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:44.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f40870 con 0x7efdcc064040 2024-09-13T19:07:44.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93994418965520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f41030 con 0x7efdcc064040 2024-09-13T19:07:44.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f42240 con 0x557cc7f369d0 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.122+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93994418965520] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93994418970000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f42660 con 0x557cc7f369d0 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f42f10 con 0x557cc7f3b370 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93994418972560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f437b0 con 0x557cc7f3b370 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f441b0 con 0x7efdcc064040 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93994418970000] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93994418971056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f44a80 con 0x7efdcc064040 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.126+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f452d0 con 0x557cc7f369d0 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93994418971056] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93994418972560] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93994418980304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f44ea0 con 0x557cc7f369d0 2024-09-13T19:07:44.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f45b70 con 0x7efdc4018410 2024-09-13T19:07:44.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93994418984640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f44ea0 con 0x7efdc4018410 2024-09-13T19:07:44.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f46610 con 0x7efdc4018410 2024-09-13T19:07:44.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.130+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93994418980304] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.134+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93994418984640] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.134+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.134+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93994418987264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f449f0 con 0x7efdc4018410 2024-09-13T19:07:44.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.134+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f46ee0 con 0x7efdc4018410 2024-09-13T19:07:44.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.134+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93994418987264] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93994418985696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f449f0 con 0x7efdc4018410 2024-09-13T19:07:44.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=0 2024-09-13T19:07:44.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=1 2024-09-13T19:07:44.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=2 2024-09-13T19:07:44.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=3 2024-09-13T19:07:44.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=4 2024-09-13T19:07:44.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=5 2024-09-13T19:07:44.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=6 2024-09-13T19:07:44.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93994418985696] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 add_watcher() i=7 2024-09-13T19:07:44.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:44.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f49ec0 con 0x557cc7f369d0 2024-09-13T19:07:44.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93994418989536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f47380 con 0x557cc7f369d0 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93994418989536] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efc837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.138+0000 7efdd43c8980 5 note: GC not initialized 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efc827fc640 20 reqs_thread_entry: start 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 20 Filter name: none 2024-09-13T19:07:44.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efbf3fff640 20 reqs_thread_entry: start 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f6d090 con 0x557cc7f369d0 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f6e660 con 0x7efdc4018410 2024-09-13T19:07:44.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efc837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93994418989536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f30930 con 0x557cc7f369d0 2024-09-13T19:07:44.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93994418989536] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.142+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93994418965520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f469e0 con 0x7efdcc064040 2024-09-13T19:07:44.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93994418965520] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd43c8980 20 remove_watcher() i=0 2024-09-13T19:07:44.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd43c8980 2 removed watcher, disabling cache 2024-09-13T19:07:44.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93994418970000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f469e0 con 0x557cc7f369d0 2024-09-13T19:07:44.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93994418970000] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd43c8980 20 remove_watcher() i=1 2024-09-13T19:07:44.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.146+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93994418972560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f41d90 con 0x557cc7f3b370 2024-09-13T19:07:44.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd1ed8640 1 -- 172.21.15.151:0/1862142608 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93994418972560] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdcc039070 con 0x557cc7f3b370 2024-09-13T19:07:44.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd43c8980 20 remove_watcher() i=2 2024-09-13T19:07:44.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93994418971056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f469e0 con 0x7efdcc064040 2024-09-13T19:07:44.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd16d7640 1 -- 172.21.15.151:0/1862142608 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93994418971056] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc80e7040 con 0x7efdcc064040 2024-09-13T19:07:44.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd43c8980 20 remove_watcher() i=3 2024-09-13T19:07:44.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.150+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93994418980304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f469e0 con 0x557cc7f369d0 2024-09-13T19:07:44.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93994418980304] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x557cc7f369d0 2024-09-13T19:07:44.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd43c8980 20 remove_watcher() i=4 2024-09-13T19:07:44.157 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93994418984640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f445d0 con 0x7efdc4018410 2024-09-13T19:07:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93994418984640] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd43c8980 20 remove_watcher() i=5 2024-09-13T19:07:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.154+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93994418987264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f469e0 con 0x7efdc4018410 2024-09-13T19:07:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93994418987264] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 20 remove_watcher() i=6 2024-09-13T19:07:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93994418985696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557cc7f456c0 con 0x7efdc4018410 2024-09-13T19:07:44.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93994418985696] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efdc4036040 con 0x7efdc4018410 2024-09-13T19:07:44.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 20 remove_watcher() i=7 2024-09-13T19:07:44.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdc4018410 msgr2=0x7efdc4018870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7efdc4018410 0x7efdc4018870 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7f369d0 msgr2=0x557cc7f38e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7f369d0 0x557cc7f38e70 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdcc064040 msgr2=0x7efdcc00b150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7efdcc064040 0x7efdcc00b150 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f3b370 msgr2=0x557cc7f3d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f3b370 0x557cc7f3d760 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efc9c034600 msgr2=0x7efc9c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efc9c034600 0x7efc9c036ac0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ac040 tx=0x7efdc80c1040 comp rx=0 tx=0).stop 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 msgr2=0x557cc7f2b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd26d9640 1 -- 172.21.15.151:0/1862142608 reap_dead start 2024-09-13T19:07:44.167 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efdcc04ffd0 tx=0x7efdcc01f260 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 shutdown_connections 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/1862142608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f24730 0x557cc7f2b8f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 >> 172.21.15.151:0/1862142608 conn(0x557cc7f20b10 msgr2=0x557cc7f1ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 shutdown_connections 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/1862142608 wait complete. 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 msgr2=0x7efcac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.158+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 0x7efcac036b10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efdc8017f50 tx=0x7efdc8005ad0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 msgr2=0x557cc7f18210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0069a0 tx=0x7efdcc01ed20 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 shutdown_connections 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcac034650 0x7efcac036b10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2118441185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7f17df0 0x557cc7f18210 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 >> 172.21.15.151:0/2118441185 conn(0x557cc7f0cf40 msgr2=0x557cc7f0f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 shutdown_connections 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2118441185 wait complete. 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7d7c7d0 msgr2=0x557cc7f00fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x557cc7d7c7d0 0x557cc7f00fb0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557cc7f07820 msgr2=0x557cc7f09c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x557cc7f07820 0x557cc7f09c10 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f03920 msgr2=0x557cc7f05d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x557cc7f03920 0x557cc7f05d10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcb8034650 msgr2=0x7efcb8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efcb8034650 0x7efcb8036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efdc80ae000 tx=0x7efdc80a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 msgr2=0x557cc7ef9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 --2- 172.21.15.151:0/2830348230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557cc7d7c3c0 0x557cc7ef9f70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7efdcc006640 tx=0x7efdcc000f50 comp rx=0 tx=0).stop 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd26d9640 1 -- 172.21.15.151:0/2830348230 reap_dead start 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 shutdown_connections 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 >> 172.21.15.151:0/2830348230 conn(0x557cc7e011c0 msgr2=0x557cc7eed3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 shutdown_connections 2024-09-13T19:07:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.162+0000 7efdd43c8980 1 -- 172.21.15.151:0/2830348230 wait complete. 2024-09-13T19:07:44.174 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-13T19:07:44.174 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:07:44.175 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:07:44.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-13T19:07:44.175 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-13T19:07:44.251 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:44.252 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.246+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.246+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f465a2eb980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55601620f580 0x55601620f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f465a2eb980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556016098ae0 con 0x55601620fed0 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f465a2eb980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5560160bce30 con 0x55601620f580 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f4657dfb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55601620f580 0x55601620f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f464f5fa640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55601620fed0 0x556016214900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59822/0 (socket says 172.21.15.151:59822) 2024-09-13T19:07:44.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f4657dfb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55601620f580 0x55601620f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37396/0 (socket says 172.21.15.151:37396) 2024-09-13T19:07:44.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f464f5fa640 1 -- 172.21.15.151:0/1269373485 learned_addr learned my addr 172.21.15.151:0/1269373485 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:44.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f4657dfb640 1 -- 172.21.15.151:0/1269373485 >> v1:172.21.15.12:6789/0 conn(0x55601620fed0 legacy=0x556016214900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f4657dfb640 1 -- 172.21.15.151:0/1269373485 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560161848f0 con 0x55601620f580 2024-09-13T19:07:44.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f4657dfb640 1 --2- 172.21.15.151:0/1269373485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x55601620f960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f464000a480 tx=0x7f464001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7166df5c6c428a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f46575fa640 1 -- 172.21.15.151:0/1269373485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400b0070 con 0x55601620f580 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f46575fa640 1 -- 172.21.15.151:0/1269373485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400ab540 con 0x55601620f580 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.250+0000 7f46575fa640 1 -- 172.21.15.151:0/1269373485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400ab840 con 0x55601620f580 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 -- 172.21.15.151:0/1269373485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 msgr2=0x55601620f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 --2- 172.21.15.151:0/1269373485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x55601620f960 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f464000a480 tx=0x7f464001b280 comp rx=0 tx=0).stop 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 -- 172.21.15.151:0/1269373485 shutdown_connections 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 --2- 172.21.15.151:0/1269373485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x55601620f960 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 -- 172.21.15.151:0/1269373485 >> 172.21.15.151:0/1269373485 conn(0x55601620b0a0 msgr2=0x55601620d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 -- 172.21.15.151:0/1269373485 shutdown_connections 2024-09-13T19:07:44.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.254+0000 7f465a2eb980 1 -- 172.21.15.151:0/1269373485 wait complete. 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5560160be200 con 0x55601620f580 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37402/0 (socket says 172.21.15.151:37402) 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4657dfb640 1 -- 172.21.15.151:0/1734304872 learned_addr learned my addr 172.21.15.151:0/1734304872 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4657dfb640 1 -- 172.21.15.151:0/1734304872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560162190a0 con 0x55601620f580 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4657dfb640 1 --2- 172.21.15.151:0/1734304872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46400ae040 tx=0x7f4640003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da8f22d06c46ead server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4545e0b640 1 -- 172.21.15.151:0/1734304872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400b0040 con 0x55601620f580 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4545e0b640 1 -- 172.21.15.151:0/1734304872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400ab9d0 con 0x55601620f580 2024-09-13T19:07:44.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f4545e0b640 1 -- 172.21.15.151:0/1734304872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400abcf0 con 0x55601620f580 2024-09-13T19:07:44.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- 172.21.15.151:0/1734304872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 msgr2=0x556016218ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 --2- 172.21.15.151:0/1734304872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f46400ae040 tx=0x7f4640003030 comp rx=0 tx=0).stop 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- 172.21.15.151:0/1734304872 shutdown_connections 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 --2- 172.21.15.151:0/1734304872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016218ad0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- 172.21.15.151:0/1734304872 >> 172.21.15.151:0/1734304872 conn(0x55601620b0a0 msgr2=0x5560162f7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- 172.21.15.151:0/1734304872 shutdown_connections 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- 172.21.15.151:0/1734304872 wait complete. 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016304ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.266+0000 7f465a2eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556016185690 con 0x55601620f580 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016304ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016304ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37410/0 (socket says 172.21.15.151:37410) 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f4657dfb640 1 -- 172.21.15.151:0/28993928 learned_addr learned my addr 172.21.15.151:0/28993928 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f4657dfb640 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556016305410 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f4657dfb640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016304ed0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4640019930 tx=0x7f4640018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 -- 172.21.15.151:0/28993928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400b0070 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560163056a0 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 -- 172.21.15.151:0/28993928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400b68b0 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 -- 172.21.15.151:0/28993928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400b6b90 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556016308380 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 -- 172.21.15.151:0/28993928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46400b7420 con 0x55601620f580 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4540034650 0x7f4540036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f453ffff640 1 -- 172.21.15.151:0/28993928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f46400bc070 con 0x55601620f580 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f464f5fa640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4540034650 0x7f4540036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55601620fed0 0x55601630bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55601630c4f0 con 0x55601620fed0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f46585fc640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55601620fed0 0x55601630bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f464f5fa640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4540034650 0x7f4540036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4648000f70 tx=0x7f46480012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f46585fc640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55601620fed0 0x55601630bea0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f46585fc640 1 -- 172.21.15.151:0/28993928 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x55601620fed0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163095a0 con 0x55601620fed0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f46585fc640 1 -- 172.21.15.151:0/28993928 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f465000a4d0 con 0x55601620fed0 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55601630e840 0x556016310c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.270+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016311300 con 0x55601630e840 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55601630e840 0x556016310c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55601630e840 0x556016310c30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 -- 172.21.15.151:0/28993928 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46400b3040 con 0x55601630e840 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55601630d6e0 con 0x55601620fed0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f46585fc640 1 -- 172.21.15.151:0/28993928 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f465000a4d0 con 0x55601620fed0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556016312760 0x556016314b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016315250 con 0x556016312760 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f464f5fa640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556016312760 0x556016314b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f464f5fa640 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556016312760 0x556016314b50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f464f5fa640 1 -- 172.21.15.151:0/28993928 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f464800e620 con 0x556016312760 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556016117800 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37416/0 (socket says 172.21.15.151:37416) 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 -- 172.21.15.151:0/836488054 learned_addr learned my addr 172.21.15.151:0/836488054 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 -- 172.21.15.151:0/836488054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556016323680 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f4657dfb640 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f46400e2c60 tx=0x7f46400bf3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f453d7fa640 1 -- 172.21.15.151:0/836488054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400b4370 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556016323910 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556016326590 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f453d7fa640 1 -- 172.21.15.151:0/836488054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400b4c60 con 0x556016322d20 2024-09-13T19:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.274+0000 7f453d7fa640 1 -- 172.21.15.151:0/836488054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400e9060 con 0x556016322d20 2024-09-13T19:07:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f453d7fa640 1 -- 172.21.15.151:0/836488054 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46400da030 con 0x556016322d20 2024-09-13T19:07:44.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f453d7fa640 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 0x7f4530036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f453d7fa640 1 -- 172.21.15.151:0/836488054 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f46400a8070 con 0x556016322d20 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f464f5fa640 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 0x7f4530036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f464f5fa640 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 0x7f4530036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f464800bf60 tx=0x7f464800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556016217200 con 0x55601632f610 2024-09-13T19:07:44.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37428/0 (socket says 172.21.15.151:37428) 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4657dfb640 1 -- 172.21.15.151:0/2681926078 learned_addr learned my addr 172.21.15.151:0/2681926078 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4657dfb640 1 -- 172.21.15.151:0/2681926078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55601632ffe0 con 0x55601632f610 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4657dfb640 1 --2- 172.21.15.151:0/2681926078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f46400d9fd0 tx=0x7f46400b4610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f457246f38fbc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4536ffd640 1 -- 172.21.15.151:0/2681926078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400f7070 con 0x55601632f610 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4536ffd640 1 -- 172.21.15.151:0/2681926078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400aae10 con 0x55601632f610 2024-09-13T19:07:44.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f4536ffd640 1 -- 172.21.15.151:0/2681926078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400ce300 con 0x55601632f610 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- 172.21.15.151:0/2681926078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 msgr2=0x55601632fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2681926078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f46400d9fd0 tx=0x7f46400b4610 comp rx=0 tx=0).stop 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- 172.21.15.151:0/2681926078 shutdown_connections 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2681926078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x55601632fa10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- 172.21.15.151:0/2681926078 >> 172.21.15.151:0/2681926078 conn(0x55601632ba30 msgr2=0x556016329b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- 172.21.15.151:0/2681926078 shutdown_connections 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 -- 172.21.15.151:0/2681926078 wait complete. 2024-09-13T19:07:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.278+0000 7f465a2eb980 1 Processor -- start 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 -- start start 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x556016330440 con 0x55601632f610 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f4657dfb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37440/0 (socket says 172.21.15.151:37440) 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 learned_addr learned my addr 172.21.15.151:0/2680125146 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556016336d50 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f4657dfb640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f46400e2c90 tx=0x7f46400f4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 -- 172.21.15.151:0/2680125146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400e4ac0 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556016336d50 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556016336d50 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 -- 172.21.15.151:0/2680125146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46400e4c60 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 -- 172.21.15.151:0/2680125146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46400d5a40 con 0x55601632f610 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 -- 172.21.15.151:0/2680125146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4640109020 con 0x55601632f610 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4520034650 0x7f4520036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f45357fa640 1 -- 172.21.15.151:0/2680125146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4640104170 con 0x55601632f610 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f464f5fa640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4520034650 0x7f4520036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556016341900 0x556016343da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163444f0 con 0x556016341900 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f46585fc640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556016341900 0x556016343da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f464f5fa640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4520034650 0x7f4520036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55601630cdf0 tx=0x7f4648010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.282+0000 7f46585fc640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556016341900 0x556016343da0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 realm 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016344900 con 0x556016341900 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163451a0 con 0x556016341900 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5560163462a0 0x556016348690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016348c10 con 0x5560163462a0 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5560163462a0 0x556016348690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5560163462a0 0x556016348690 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 20 searching for the correct realm 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55601634a470 con 0x5560163462a0 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f46400ab030 0x7f46400dc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55601634a470 con 0x7f46400ab030 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f46400ab030 0x7f46400dc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f46400ab030 0x7f46400dc8a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f464800e620 con 0x7f46400ab030 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55601634a470 con 0x7f46400ab030 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f464800e620 con 0x7f46400ab030 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55601634a470 con 0x556016341900 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4650016440 0x7f46500168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.286+0000 7f46585fc640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4650016440 0x7f46500168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4650016440 0x7f46500168c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f46400ab030 2024-09-13T19:07:44.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f464800e620 con 0x7f46400ab030 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f46400ab030 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f464800e620 con 0x7f46400ab030 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.290+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f46400ab030 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f464800e620 con 0x7f46400ab030 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.294+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f46400ab030 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x5560163462a0 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f4650016440 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x556016341900 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556016345540 con 0x7f46400ab030 2024-09-13T19:07:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016349590 con 0x556016341900 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163491d0 con 0x556016341900 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163491d0 con 0x7f46400ab030 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 zone default found 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 4 Realm: () 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 zonegroup default 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55601634a3b0 con 0x7f4650016440 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.298+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55601634c320 con 0x5560163462a0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55601634c6c0 con 0x5560163462a0 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 20 started sync module instance, tier type = 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634b7c0 con 0x7f46400ab030 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871177776048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634b420 con 0x7f46400ab030 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634d5c0 con 0x556016341900 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93871177776048] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871177781520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634d530 con 0x556016341900 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.302+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634e370 con 0x5560163462a0 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871177784928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634ec10 con 0x5560163462a0 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634f610 con 0x7f46400ab030 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93871177781520] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871177783728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634fa30 con 0x7f46400ab030 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.306+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163503f0 con 0x556016341900 2024-09-13T19:07:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93871177783728] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93871177784928] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871177787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634ff40 con 0x556016341900 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556016350c90 con 0x7f4650016440 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93871177787232] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.310+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871177789728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634ff40 con 0x7f4650016440 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.314+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556016351180 con 0x7f4650016440 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.314+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.314+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871177796752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163515a0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.314+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163520b0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.314+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93871177789728] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93871177796752] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871177800544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163510b0 con 0x7f4650016440 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=0 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=1 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=2 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=3 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=4 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=5 2024-09-13T19:07:44.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=6 2024-09-13T19:07:44.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93871177800544] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 20 add_watcher() i=7 2024-09-13T19:07:44.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:44.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5560163550a0 con 0x556016341900 2024-09-13T19:07:44.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871177795552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556016352520 con 0x556016341900 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.318+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93871177795552] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 5 note: GC not initialized 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f450cfe1640 20 reqs_thread_entry: start 2024-09-13T19:07:44.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 Filter name: none 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f44867fc640 20 reqs_thread_entry: start 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016378140 con 0x556016341900 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556016379690 con 0x7f4650016440 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f450dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.322+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871177795552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556016377b60 con 0x556016341900 2024-09-13T19:07:44.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93871177795552] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871177776048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163507e0 con 0x7f46400ab030 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93871177776048] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 20 remove_watcher() i=0 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 2 removed watcher, disabling cache 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871177781520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163507e0 con 0x556016341900 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93871177781520] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 20 remove_watcher() i=1 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.326+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871177784928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163507e0 con 0x5560163462a0 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f4657dfb640 1 -- 172.21.15.151:0/2680125146 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93871177784928] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46400b3040 con 0x5560163462a0 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f465a2eb980 20 remove_watcher() i=2 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871177783728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634de60 con 0x7f46400ab030 2024-09-13T19:07:44.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f464f5fa640 1 -- 172.21.15.151:0/2680125146 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93871177783728] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4648041040 con 0x7f46400ab030 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f465a2eb980 20 remove_watcher() i=3 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.330+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871177787232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163507e0 con 0x556016341900 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93871177787232] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x556016341900 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f465a2eb980 20 remove_watcher() i=4 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871177789728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634d9b0 con 0x7f4650016440 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93871177789728] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f465a2eb980 20 remove_watcher() i=5 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.334+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871177796752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55601634e760 con 0x7f4650016440 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93871177796752] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 20 remove_watcher() i=6 2024-09-13T19:07:44.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871177800544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5560163507e0 con 0x7f4650016440 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93871177800544] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f465000a4d0 con 0x7f4650016440 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 20 remove_watcher() i=7 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4650016440 msgr2=0x7f46500168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f4650016440 0x7f46500168c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556016341900 msgr2=0x556016343da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x556016341900 0x556016343da0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f46400ab030 msgr2=0x7f46400dc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f46400ab030 0x7f46400dc8a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5560163462a0 msgr2=0x556016348690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5560163462a0 0x556016348690 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4520034650 msgr2=0x7f4520036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4520034650 0x7f4520036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55601630cdf0 tx=0x7f4648010000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 msgr2=0x556016336810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f46585fc640 1 -- 172.21.15.151:0/2680125146 reap_dead start 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f46400e2c90 tx=0x7f46400f4000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 shutdown_connections 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/2680125146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601632f610 0x556016336810 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 >> 172.21.15.151:0/2680125146 conn(0x55601632ba30 msgr2=0x556016329b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 shutdown_connections 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/2680125146 wait complete. 2024-09-13T19:07:44.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 msgr2=0x7f4530036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 0x7f4530036b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f464800bf60 tx=0x7f464800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 msgr2=0x556016323140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f46400e2c60 tx=0x7f46400bf3f0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 shutdown_connections 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530034650 0x7f4530036b10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 --2- 172.21.15.151:0/836488054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556016322d20 0x556016323140 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 >> 172.21.15.151:0/836488054 conn(0x556016317e70 msgr2=0x55601631a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 shutdown_connections 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.338+0000 7f465a2eb980 1 -- 172.21.15.151:0/836488054 wait complete. 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55601620fed0 msgr2=0x55601630bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55601620fed0 0x55601630bea0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556016312760 msgr2=0x556016314b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x556016312760 0x556016314b50 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55601630e840 msgr2=0x556016310c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55601630e840 0x556016310c30 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4540034650 msgr2=0x7f4540036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4540034650 0x7f4540036b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4648000f70 tx=0x7f46480012c0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 msgr2=0x556016304ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 --2- 172.21.15.151:0/28993928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55601620f580 0x556016304ed0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4640019930 tx=0x7f4640018020 comp rx=0 tx=0).stop 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f46585fc640 1 -- 172.21.15.151:0/28993928 reap_dead start 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 shutdown_connections 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 >> 172.21.15.151:0/28993928 conn(0x55601620b0a0 msgr2=0x556016217720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 shutdown_connections 2024-09-13T19:07:44.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.342+0000 7f465a2eb980 1 -- 172.21.15.151:0/28993928 wait complete. 2024-09-13T19:07:44.353 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-13T19:00:00.000000Z","epoch":1726254000,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-13T19:07:44.354 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:07:44.354 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:07:44.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-13T19:07:44.354 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-13T19:07:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bf108b980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c06c952690 0x55c06c952a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bf108b980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c06c7daae0 con 0x55c06c952fe0 2024-09-13T19:07:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bf108b980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55c06c7fee30 con 0x55c06c952690 2024-09-13T19:07:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8beeb9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c06c952690 0x55c06c952a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bee39a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55c06c952fe0 0x55c06c957a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59828/0 (socket says 172.21.15.151:59828) 2024-09-13T19:07:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8bee39a640 1 -- 172.21.15.151:0/3412763168 learned_addr learned my addr 172.21.15.151:0/3412763168 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8beeb9b640 1 -- 172.21.15.151:0/3412763168 >> v1:172.21.15.12:6789/0 conn(0x55c06c952fe0 legacy=0x55c06c957a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.434+0000 7f8beeb9b640 1 -- 172.21.15.151:0/3412763168 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06c95a260 con 0x55c06c952690 2024-09-13T19:07:44.443 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/3412763168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c952a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8be000a480 tx=0x7f8be001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56fd7236d6ec62f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bedb99640 1 -- 172.21.15.151:0/3412763168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00b0070 con 0x55c06c952690 2024-09-13T19:07:44.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bedb99640 1 -- 172.21.15.151:0/3412763168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00ab540 con 0x55c06c952690 2024-09-13T19:07:44.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bedb99640 1 -- 172.21.15.151:0/3412763168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00ab840 con 0x55c06c952690 2024-09-13T19:07:44.444 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 -- 172.21.15.151:0/3412763168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 msgr2=0x55c06c952a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 --2- 172.21.15.151:0/3412763168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c952a70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8be000a480 tx=0x7f8be001b280 comp rx=0 tx=0).stop 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 -- 172.21.15.151:0/3412763168 shutdown_connections 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 --2- 172.21.15.151:0/3412763168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c952a70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 -- 172.21.15.151:0/3412763168 >> 172.21.15.151:0/3412763168 conn(0x55c06c94e1b0 msgr2=0x55c06c9505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 -- 172.21.15.151:0/3412763168 shutdown_connections 2024-09-13T19:07:44.445 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.438+0000 7f8bf108b980 1 -- 172.21.15.151:0/3412763168 wait complete. 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c06c800200 con 0x55c06c952690 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37472/0 (socket says 172.21.15.151:37472) 2024-09-13T19:07:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2074156093 learned_addr learned my addr 172.21.15.151:0/2074156093 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2074156093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06c8c9160 con 0x55c06c952690 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/2074156093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8be00ae040 tx=0x7f8be0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a775fcbdc9f19e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8adce09640 1 -- 172.21.15.151:0/2074156093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00b0040 con 0x55c06c952690 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8adce09640 1 -- 172.21.15.151:0/2074156093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00ab9b0 con 0x55c06c952690 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8adce09640 1 -- 172.21.15.151:0/2074156093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00abc90 con 0x55c06c952690 2024-09-13T19:07:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- 172.21.15.151:0/2074156093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 msgr2=0x55c06c8c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2074156093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8be00ae040 tx=0x7f8be0003030 comp rx=0 tx=0).stop 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- 172.21.15.151:0/2074156093 shutdown_connections 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2074156093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06c8c8b90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- 172.21.15.151:0/2074156093 >> 172.21.15.151:0/2074156093 conn(0x55c06c94e1b0 msgr2=0x55c06ca39770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- 172.21.15.151:0/2074156093 shutdown_connections 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- 172.21.15.151:0/2074156093 wait complete. 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.454+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06ca46f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c06c959ca0 con 0x55c06c952690 2024-09-13T19:07:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06ca46f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06ca46f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37482/0 (socket says 172.21.15.151:37482) 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1288439671 learned_addr learned my addr 172.21.15.151:0/1288439671 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06ca47470 con 0x55c06c952690 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06ca46f30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8be00030b0 tx=0x7f8be0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 -- 172.21.15.151:0/1288439671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00c5070 con 0x55c06c952690 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c06ca47700 con 0x55c06c952690 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 -- 172.21.15.151:0/1288439671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00b6970 con 0x55c06c952690 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 -- 172.21.15.151:0/1288439671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00b0050 con 0x55c06c952690 2024-09-13T19:07:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06ca4a3e0 con 0x55c06c952690 2024-09-13T19:07:44.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 -- 172.21.15.151:0/1288439671 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8be00c8070 con 0x55c06c952690 2024-09-13T19:07:44.465 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ad4034650 0x7f8ad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8adb606640 1 -- 172.21.15.151:0/1288439671 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8be00bc070 con 0x55c06c952690 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ad4034650 0x7f8ad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06c952fe0 0x55c06ca4dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca4e550 con 0x55c06c952fe0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06c952fe0 0x55c06ca4dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ad4034650 0x7f8ad4036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80012f0 tx=0x7f8bd8006700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.458+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06c952fe0 0x55c06ca4dee0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bef39c640 1 -- 172.21.15.151:0/1288439671 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06c952fe0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca4b600 con 0x55c06c952fe0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bef39c640 1 -- 172.21.15.151:0/1288439671 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06c952fe0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca508f0 0x55c06ca52ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca533d0 con 0x55c06ca508f0 2024-09-13T19:07:44.466 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca508f0 0x55c06ca52ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca508f0 0x55c06ca52ce0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1288439671 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca508f0 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca4f790 con 0x55c06c952fe0 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bef39c640 1 -- 172.21.15.151:0/1288439671 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06c952fe0 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c06ca54830 0x55c06ca56c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca57360 con 0x55c06ca54830 2024-09-13T19:07:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c06ca54830 0x55c06ca56c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c06ca54830 0x55c06ca56c20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bee39a640 1 -- 172.21.15.151:0/1288439671 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8bd800f070 con 0x55c06ca54830 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8bf108b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c06c859800 con 0x55c06ca64e30 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37484/0 (socket says 172.21.15.151:37484) 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2532074662 learned_addr learned my addr 172.21.15.151:0/2532074662 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2532074662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06ca65790 con 0x55c06ca64e30 2024-09-13T19:07:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.462+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8be00e1f50 tx=0x7f8be00b46f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 -- 172.21.15.151:0/2532074662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00aa4e0 con 0x55c06ca64e30 2024-09-13T19:07:44.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c06ca65a20 con 0x55c06ca64e30 2024-09-13T19:07:44.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06ca686a0 con 0x55c06ca64e30 2024-09-13T19:07:44.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 -- 172.21.15.151:0/2532074662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00aa680 con 0x55c06ca64e30 2024-09-13T19:07:44.470 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 -- 172.21.15.151:0/2532074662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00aa960 con 0x55c06ca64e30 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 -- 172.21.15.151:0/2532074662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8be00d7700 con 0x55c06ca64e30 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 0x7f8ac8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad8e01640 1 -- 172.21.15.151:0/2532074662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8be00df030 con 0x55c06ca64e30 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bee39a640 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 0x7f8ac8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bee39a640 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 0x7f8ac8036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55c06ca4ea70 tx=0x7f8bd800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8bf108b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c06c8c72c0 con 0x55c06ca71760 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37498/0 (socket says 172.21.15.151:37498) 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2676487552 learned_addr learned my addr 172.21.15.151:0/2676487552 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.472 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8beeb9b640 1 -- 172.21.15.151:0/2676487552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06ca72110 con 0x55c06ca71760 2024-09-13T19:07:44.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/2676487552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8be00bb040 tx=0x7f8be00cb450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885a3df097ca506d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad27fc640 1 -- 172.21.15.151:0/2676487552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00eee30 con 0x55c06ca71760 2024-09-13T19:07:44.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad27fc640 1 -- 172.21.15.151:0/2676487552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be0100070 con 0x55c06ca71760 2024-09-13T19:07:44.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.466+0000 7f8ad27fc640 1 -- 172.21.15.151:0/2676487552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00d0220 con 0x55c06ca71760 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/2676487552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 msgr2=0x55c06ca71b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2676487552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8be00bb040 tx=0x7f8be00cb450 comp rx=0 tx=0).stop 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/2676487552 shutdown_connections 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2676487552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca71b40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/2676487552 >> 172.21.15.151:0/2676487552 conn(0x55c06ca6db40 msgr2=0x55c06ca6bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/2676487552 shutdown_connections 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/2676487552 wait complete. 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 Processor -- start 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- start start 2024-09-13T19:07:44.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca78930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c06ca725b0 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca78930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8beeb9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca78930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37508/0 (socket says 172.21.15.151:37508) 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 learned_addr learned my addr 172.21.15.151:0/1573520282 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c06ca78e70 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca78930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8be00cbbd0 tx=0x7f8be00d0130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 -- 172.21.15.151:0/1573520282 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00ad130 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c06ca78e70 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c06ca78e70 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 -- 172.21.15.151:0/1573520282 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be00e30d0 con 0x55c06ca71760 2024-09-13T19:07:44.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 -- 172.21.15.151:0/1573520282 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8be00ad520 con 0x55c06ca71760 2024-09-13T19:07:44.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 -- 172.21.15.151:0/1573520282 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8be00e3430 con 0x55c06ca71760 2024-09-13T19:07:44.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ab8034650 0x7f8ab8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8ad0ff9640 1 -- 172.21.15.151:0/1573520282 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8be00d5040 con 0x55c06ca71760 2024-09-13T19:07:44.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ab8034650 0x7f8ab8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06ca83a30 0x55c06ca85ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.470+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca86640 con 0x55c06ca83a30 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06ca83a30 0x55c06ca85ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ab8034650 0x7f8ab8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80062e0 tx=0x7f8bd8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06ca83a30 0x55c06ca85ef0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 realm 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca86a50 con 0x55c06ca83a30 2024-09-13T19:07:44.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca872f0 con 0x55c06ca83a30 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca883f0 0x55c06ca8a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ae30 con 0x55c06ca883f0 2024-09-13T19:07:44.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca883f0 0x55c06ca8a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca883f0 0x55c06ca8a7e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 20 searching for the correct realm 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c690 con 0x55c06ca883f0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8be00ca060 0x7f8be00f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c690 con 0x7f8be00ca060 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8be00ca060 0x7f8be00f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8be00ca060 0x7f8be00f8450 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bd800f070 con 0x7f8be00ca060 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c690 con 0x7f8be00ca060 2024-09-13T19:07:44.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bd800f070 con 0x7f8be00ca060 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c690 con 0x55c06ca83a30 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8be8018410 0x7f8be8018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.474+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8be8018410 0x7f8be8018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8be8018410 0x7f8be8018890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x7f8be8018410 2024-09-13T19:07:44.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x7f8be8018410 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be00ca060 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8bd800f070 con 0x7f8be00ca060 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x7f8be8018410 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be00ca060 2024-09-13T19:07:44.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.478+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x7f8be8018410 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x7f8be8018410 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be00ca060 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be80083f0 con 0x55c06ca83a30 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.482+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be00ca060 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca883f0 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x7f8be8018410 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca87690 con 0x55c06ca83a30 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8be803b040 con 0x7f8be00ca060 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:44.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8b680 con 0x55c06ca83a30 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ba20 con 0x55c06ca83a30 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ba20 con 0x7f8be00ca060 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 zone default found 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 4 Realm: () 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 zonegroup default 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c310 con 0x7f8be8018410 2024-09-13T19:07:44.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.486+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8c310 con 0x55c06ca883f0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8e610 con 0x55c06ca883f0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 20 started sync module instance, tier type = 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8d970 con 0x7f8be00ca060 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94284945087840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ef20 con 0x7f8be00ca060 2024-09-13T19:07:44.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8f770 con 0x55c06ca83a30 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94284945087840] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94284945091184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8f770 con 0x55c06ca83a30 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.490+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca901d0 con 0x55c06ca883f0 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94284945095856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca90a70 con 0x55c06ca883f0 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca91490 con 0x7f8be00ca060 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94284945091184] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94284945100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca91880 con 0x7f8be00ca060 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca92240 con 0x55c06ca83a30 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.494+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94284945095856] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94284945100672] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94284945098176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8f3d0 con 0x55c06ca83a30 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca92980 con 0x7f8be8018410 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94284945098176] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94284945105968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca92940 con 0x7f8be8018410 2024-09-13T19:07:44.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.498+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca93390 con 0x7f8be8018410 2024-09-13T19:07:44.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94284945105968] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94284945104272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca93390 con 0x7f8be8018410 2024-09-13T19:07:44.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca93d50 con 0x7f8be8018410 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94284945111200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca94170 con 0x7f8be8018410 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=0 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=1 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=2 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=3 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=4 2024-09-13T19:07:44.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.502+0000 7f8bf108b980 20 add_watcher() i=5 2024-09-13T19:07:44.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94284945104272] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 add_watcher() i=6 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94284945111200] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 add_watcher() i=7 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca92f30 con 0x55c06ca83a30 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94284945108736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca945d0 con 0x55c06ca83a30 2024-09-13T19:07:44.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94284945108736] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8aa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 5 note: GC not initialized 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8a1ffff640 20 reqs_thread_entry: start 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 Filter name: none 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8a1dffb640 20 reqs_thread_entry: start 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.506+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06caba850 con 0x7f8be8018410 2024-09-13T19:07:44.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab8ff0 con 0x55c06ca83a30 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-13T19:07:44.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab98c0 con 0x7f8be8018410 2024-09-13T19:07:44.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:07:44.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:07:44.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:07:44.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94284945265680 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06cabe2f0 con 0x7f8be8018410 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== watch-notify(notify (1) cookie 94284945111200 notify 146028888095 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c06cab9c60 con 0x7f8be8018410 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8ad27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94284945111200 notifier 4722 bl.length()=556 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(65 notify.7 [notify cookie 94284945265680 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8ad27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8ad27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:07:44.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.510+0000 7f8ad27fc640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8ab4003eb0 con 0x7f8be8018410 2024-09-13T19:07:44.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== watch-notify(notify_complete (2) cookie 94284945265680 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c06caba2a0 con 0x7f8be8018410 2024-09-13T19:07:44.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab9390 con 0x55c06ca83a30 2024-09-13T19:07:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bf108b980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:07:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bf108b980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:07:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bf108b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:07:44.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94284945265552 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c06cabe2f0 con 0x7f8be8018410 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== watch-notify(notify (1) cookie 94284945105968 notify 146028888096 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c06caba2a0 con 0x7f8be8018410 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8ad27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94284945105968 notifier 4722 bl.length()=177 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8ad27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8ad27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8ad27fc640 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8ab4003eb0 con 0x7f8be8018410 2024-09-13T19:07:44.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(68 notify.5 [notify cookie 94284945265552 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== watch-notify(notify_complete (2) cookie 94284945265552 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8be8010040 con 0x7f8be8018410 2024-09-13T19:07:44.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.514+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.520 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:07:44.513129Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:07:44.513117Z","tags":[],"group_ids":[]} 2024-09-13T19:07:44.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8aa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94284945108736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab85f0 con 0x55c06ca83a30 2024-09-13T19:07:44.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94284945108736] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94284945087840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab85f0 con 0x7f8be00ca060 2024-09-13T19:07:44.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94284945087840] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bf108b980 20 remove_watcher() i=0 2024-09-13T19:07:44.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bf108b980 2 removed watcher, disabling cache 2024-09-13T19:07:44.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.518+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94284945091184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab85f0 con 0x55c06ca83a30 2024-09-13T19:07:44.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94284945091184] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bf108b980 20 remove_watcher() i=1 2024-09-13T19:07:44.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94284945095856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ea70 con 0x55c06ca883f0 2024-09-13T19:07:44.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8beeb9b640 1 -- 172.21.15.151:0/1573520282 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94284945095856] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be00c7030 con 0x55c06ca883f0 2024-09-13T19:07:44.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bf108b980 20 remove_watcher() i=2 2024-09-13T19:07:44.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94284945100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab85f0 con 0x7f8be00ca060 2024-09-13T19:07:44.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.522+0000 7f8bee39a640 1 -- 172.21.15.151:0/1573520282 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94284945100672] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bd803f040 con 0x7f8be00ca060 2024-09-13T19:07:44.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.526+0000 7f8bf108b980 20 remove_watcher() i=3 2024-09-13T19:07:44.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.526+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94284945098176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8fcb0 con 0x55c06ca83a30 2024-09-13T19:07:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.526+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94284945098176] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x55c06ca83a30 2024-09-13T19:07:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.526+0000 7f8bf108b980 20 remove_watcher() i=4 2024-09-13T19:07:44.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.526+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94284945105968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca8ea70 con 0x7f8be8018410 2024-09-13T19:07:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94284945105968] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bf108b980 20 remove_watcher() i=5 2024-09-13T19:07:44.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94284945104272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06cab85f0 con 0x7f8be8018410 2024-09-13T19:07:44.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94284945104272] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bf108b980 20 remove_watcher() i=6 2024-09-13T19:07:44.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.530+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94284945111200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c06ca905c0 con 0x7f8be8018410 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94284945111200] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8be8036040 con 0x7f8be8018410 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 20 remove_watcher() i=7 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8be8018410 msgr2=0x7f8be8018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8be8018410 0x7f8be8018890 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06ca83a30 msgr2=0x55c06ca85ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06ca83a30 0x55c06ca85ef0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8be00ca060 msgr2=0x7f8be00f8450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8be00ca060 0x7f8be00f8450 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca883f0 msgr2=0x55c06ca8a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca883f0 0x55c06ca8a7e0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ab8034650 msgr2=0x7f8ab8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ab8034650 0x7f8ab8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80062e0 tx=0x7f8bd8010000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 msgr2=0x55c06ca78930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1573520282 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca71760 0x55c06ca78930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8be00cbbd0 tx=0x7f8be00d0130 comp rx=0 tx=0).stop 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bef39c640 1 -- 172.21.15.151:0/1573520282 reap_dead start 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 shutdown_connections 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 >> 172.21.15.151:0/1573520282 conn(0x55c06ca6db40 msgr2=0x55c06ca6bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 shutdown_connections 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1573520282 wait complete. 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 msgr2=0x7f8ac8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 0x7f8ac8036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55c06ca4ea70 tx=0x7f8bd800f000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 msgr2=0x55c06ca65250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8be00e1f50 tx=0x7f8be00b46f0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 shutdown_connections 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ac8034650 0x7f8ac8036b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/2532074662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06ca64e30 0x55c06ca65250 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 >> 172.21.15.151:0/2532074662 conn(0x55c06ca59f80 msgr2=0x55c06ca5ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 shutdown_connections 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/2532074662 wait complete. 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06c952fe0 msgr2=0x55c06ca4dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c06c952fe0 0x55c06ca4dee0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c06ca54830 msgr2=0x55c06ca56c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55c06ca54830 0x55c06ca56c20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca508f0 msgr2=0x55c06ca52ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c06ca508f0 0x55c06ca52ce0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ad4034650 msgr2=0x7f8ad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f8ad4034650 0x7f8ad4036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80012f0 tx=0x7f8bd8006700 comp rx=0 tx=0).stop 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 msgr2=0x55c06ca46f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 --2- 172.21.15.151:0/1288439671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c06c952690 0x55c06ca46f30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8be00030b0 tx=0x7f8be0018020 comp rx=0 tx=0).stop 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bef39c640 1 -- 172.21.15.151:0/1288439671 reap_dead start 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 shutdown_connections 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 >> 172.21.15.151:0/1288439671 conn(0x55c06c94e1b0 msgr2=0x55c06c8c77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 shutdown_connections 2024-09-13T19:07:44.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.534+0000 7f8bf108b980 1 -- 172.21.15.151:0/1288439671 wait complete. 2024-09-13T19:07:44.547 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:07:44.513129Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:07:44.513117Z', 'tags': [], 'group_ids': []} 2024-09-13T19:07:44.588 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:44.597 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:07:44.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:07:44.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-13T19:07:44.598 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-13T19:07:44.632 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:44.632 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f639124a980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55648a3d7aa0 0x55648a3d9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f639124a980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55648a25bae0 con 0x55648a347ad0 2024-09-13T19:07:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f639124a980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55648a27fe30 con 0x55648a3d7aa0 2024-09-13T19:07:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f638e559640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55648a3d7aa0 0x55648a3d9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f638e559640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55648a3d7aa0 0x55648a3d9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37518/0 (socket says 172.21.15.151:37518) 2024-09-13T19:07:44.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f638e559640 1 -- 172.21.15.151:0/1574016875 learned_addr learned my addr 172.21.15.151:0/1574016875 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f638e559640 1 -- 172.21.15.151:0/1574016875 >> v1:172.21.15.12:6789/0 conn(0x55648a347ad0 legacy=0x55648a3d6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.630+0000 7f638e559640 1 -- 172.21.15.151:0/1574016875 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a3db3e0 con 0x55648a3d7aa0 2024-09-13T19:07:44.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f638e559640 1 --2- 172.21.15.151:0/1574016875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a3d7aa0 0x55648a3d9e90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f637800a5c0 tx=0x7f637801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b693718039bf52d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f638dd58640 1 -- 172.21.15.151:0/1574016875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780a6070 con 0x55648a3d7aa0 2024-09-13T19:07:44.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f638dd58640 1 -- 172.21.15.151:0/1574016875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780af070 con 0x55648a3d7aa0 2024-09-13T19:07:44.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f638dd58640 1 -- 172.21.15.151:0/1574016875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780aa5c0 con 0x55648a3d7aa0 2024-09-13T19:07:44.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 -- 172.21.15.151:0/1574016875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a3d7aa0 msgr2=0x55648a3d9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 --2- 172.21.15.151:0/1574016875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a3d7aa0 0x55648a3d9e90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f637800a5c0 tx=0x7f637801b340 comp rx=0 tx=0).stop 2024-09-13T19:07:44.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 -- 172.21.15.151:0/1574016875 shutdown_connections 2024-09-13T19:07:44.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 --2- 172.21.15.151:0/1574016875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a3d7aa0 0x55648a3d9e90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 -- 172.21.15.151:0/1574016875 >> 172.21.15.151:0/1574016875 conn(0x55648a3ce070 msgr2=0x55648a3d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 -- 172.21.15.151:0/1574016875 shutdown_connections 2024-09-13T19:07:44.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.634+0000 7f639124a980 1 -- 172.21.15.151:0/1574016875 wait complete. 2024-09-13T19:07:44.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f639124a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f639124a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55648a281200 con 0x55648a347ad0 2024-09-13T19:07:44.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37532/0 (socket says 172.21.15.151:37532) 2024-09-13T19:07:44.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f638ed5a640 1 -- 172.21.15.151:0/3523407583 learned_addr learned my addr 172.21.15.151:0/3523407583 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f638ed5a640 1 -- 172.21.15.151:0/3523407583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a3d40b0 con 0x55648a347ad0 2024-09-13T19:07:44.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f638ed5a640 1 --2- 172.21.15.151:0/3523407583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f63800016c0 tx=0x7f6380001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795c68c7de56668b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f627ce09640 1 -- 172.21.15.151:0/3523407583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6380016070 con 0x55648a347ad0 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f627ce09640 1 -- 172.21.15.151:0/3523407583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638000f640 con 0x55648a347ad0 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.646+0000 7f627ce09640 1 -- 172.21.15.151:0/3523407583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638000f9a0 con 0x55648a347ad0 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/3523407583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 msgr2=0x55648a3d3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 --2- 172.21.15.151:0/3523407583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f63800016c0 tx=0x7f6380001b80 comp rx=0 tx=0).stop 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/3523407583 shutdown_connections 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 --2- 172.21.15.151:0/3523407583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a3d3ae0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/3523407583 >> 172.21.15.151:0/3523407583 conn(0x55648a3ce070 msgr2=0x55648a4ba6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/3523407583 shutdown_connections 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/3523407583 wait complete. 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a4c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55648a3dae20 con 0x55648a347ad0 2024-09-13T19:07:44.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a4c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a4c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37536/0 (socket says 172.21.15.151:37536) 2024-09-13T19:07:44.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f638ed5a640 1 -- 172.21.15.151:0/4149573432 learned_addr learned my addr 172.21.15.151:0/4149573432 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f638ed5a640 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a4c8580 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f638ed5a640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a4c8040 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f638000f610 tx=0x7f6380001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f627b606640 1 -- 172.21.15.151:0/4149573432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6380021020 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f627b606640 1 -- 172.21.15.151:0/4149573432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380011770 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55648a4c8810 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f627b606640 1 -- 172.21.15.151:0/4149573432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6380016040 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648a4cb4f0 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.650+0000 7f627b606640 1 -- 172.21.15.151:0/4149573432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6380024020 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f627b606640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6274034650 0x7f6274036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f627b606640 1 -- 172.21.15.151:0/4149573432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6380049800 con 0x55648a347ad0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638e559640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6274034650 0x7f6274036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a3d7aa0 0x55648a4ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a4cf630 con 0x55648a3d7aa0 2024-09-13T19:07:44.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638f55b640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a3d7aa0 0x55648a4ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638e559640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6274034650 0x7f6274036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63780ae000 tx=0x7f63780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638f55b640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a3d7aa0 0x55648a4ceff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638f55b640 1 -- 172.21.15.151:0/4149573432 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63880083f0 con 0x55648a3d7aa0 2024-09-13T19:07:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a4cc6f0 con 0x55648a3d7aa0 2024-09-13T19:07:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638f55b640 1 -- 172.21.15.151:0/4149573432 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63880083f0 con 0x55648a3d7aa0 2024-09-13T19:07:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a4d1960 0x55648a4d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a4d4420 con 0x55648a4d1960 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638ed5a640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a4d1960 0x55648a4d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638ed5a640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a4d1960 0x55648a4d3d50 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638ed5a640 1 -- 172.21.15.151:0/4149573432 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f638000f070 con 0x55648a4d1960 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a4d0800 con 0x55648a3d7aa0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638f55b640 1 -- 172.21.15.151:0/4149573432 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f63880083f0 con 0x55648a3d7aa0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55648a4d5860 0x55648a4d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a4d83e0 con 0x55648a4d5860 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638e559640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55648a4d5860 0x55648a4d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638e559640 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55648a4d5860 0x55648a4d7c50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638e559640 1 -- 172.21.15.151:0/4149573432 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f63780aaad0 con 0x55648a4d5860 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f639124a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55648a2da800 con 0x55648a4e5e70 2024-09-13T19:07:44.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.654+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37550/0 (socket says 172.21.15.151:37550) 2024-09-13T19:07:44.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 -- 172.21.15.151:0/3702755670 learned_addr learned my addr 172.21.15.151:0/3702755670 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 -- 172.21.15.151:0/3702755670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a4e67d0 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6380047b30 tx=0x7f6380011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 -- 172.21.15.151:0/3702755670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6380010cc0 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55648a4e6a60 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 -- 172.21.15.151:0/3702755670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638002d300 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 -- 172.21.15.151:0/3702755670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6380010e60 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648a4e96e0 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 -- 172.21.15.151:0/3702755670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f638002d5e0 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 0x7f6268036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f6278e01640 1 -- 172.21.15.151:0/3702755670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6380037070 con 0x55648a4e5e70 2024-09-13T19:07:44.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638e559640 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 0x7f6268036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638e559640 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 0x7f6268036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6378017f50 tx=0x7f6378005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f639124a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55648a3d22d0 con 0x55648a4f27e0 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37558/0 (socket says 172.21.15.151:37558) 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 -- 172.21.15.151:0/4284216040 learned_addr learned my addr 172.21.15.151:0/4284216040 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.658+0000 7f638ed5a640 1 -- 172.21.15.151:0/4284216040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a4f3190 con 0x55648a4f27e0 2024-09-13T19:07:44.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 --2- 172.21.15.151:0/4284216040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6380011fa0 tx=0x7f638001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d9d7f7807f7edd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f62727fc640 1 -- 172.21.15.151:0/4284216040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638002dab0 con 0x55648a4f27e0 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f62727fc640 1 -- 172.21.15.151:0/4284216040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380059070 con 0x55648a4f27e0 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f62727fc640 1 -- 172.21.15.151:0/4284216040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638002f910 con 0x55648a4f27e0 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/4284216040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 msgr2=0x55648a4f2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 --2- 172.21.15.151:0/4284216040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6380011fa0 tx=0x7f638001c420 comp rx=0 tx=0).stop 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/4284216040 shutdown_connections 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 --2- 172.21.15.151:0/4284216040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f2bc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/4284216040 >> 172.21.15.151:0/4284216040 conn(0x55648a4eebc0 msgr2=0x55648a4eccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/4284216040 shutdown_connections 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/4284216040 wait complete. 2024-09-13T19:07:44.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 Processor -- start 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- start start 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55648a4f3630 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:37572/0 (socket says 172.21.15.151:37572) 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 learned_addr learned my addr 172.21.15.151:0/1982663273 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a4f9f20 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f638ed5a640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f63800469a0 tx=0x7f6380030130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f6270ff9640 1 -- 172.21.15.151:0/1982663273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638002fb70 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f6270ff9640 1 -- 172.21.15.151:0/1982663273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638002fd10 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55648a4f9f20 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f6270ff9640 1 -- 172.21.15.151:0/1982663273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f638001c540 con 0x55648a4f27e0 2024-09-13T19:07:44.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.662+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648a4f9f20 con 0x55648a4f27e0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f6270ff9640 1 -- 172.21.15.151:0/1982663273 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f638001c6e0 con 0x55648a4f27e0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f6270ff9640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6258034650 0x7f6258036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f6270ff9640 1 -- 172.21.15.151:0/1982663273 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f638006ad20 con 0x55648a4f27e0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6258034650 0x7f6258036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a504a80 0x55648a506f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a507660 con 0x55648a504a80 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a504a80 0x55648a506f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6258034650 0x7f6258036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c10 tx=0x7f63780c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a504a80 0x55648a506f10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 realm 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a507a70 con 0x55648a504a80 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a508310 con 0x55648a504a80 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a509410 0x55648a50b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50bea0 con 0x55648a509410 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a509410 0x55648a50b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a509410 0x55648a50b800 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 20 searching for the correct realm 2024-09-13T19:07:44.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d700 con 0x55648a509410 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6380026020 0x7f63800305c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d700 con 0x7f6380026020 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6380026020 0x7f63800305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6380026020 0x7f63800305c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780aaad0 con 0x7f6380026020 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d700 con 0x7f6380026020 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.666+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780aaad0 con 0x7f6380026020 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d700 con 0x55648a504a80 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6388018410 0x7f6388018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6388018410 0x7f6388018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6388018410 0x7f6388018890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x7f6388018410 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x7f6388018410 2024-09-13T19:07:44.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6380026020 2024-09-13T19:07:44.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f63780aaad0 con 0x7f6380026020 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.670+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x7f6388018410 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6380026020 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f63780aaad0 con 0x7f6380026020 2024-09-13T19:07:44.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x7f6388018410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.685 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.674+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x7f6388018410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6380026020 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780aaad0 con 0x7f6380026020 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63880083f0 con 0x55648a504a80 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6380026020 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a509410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x7f6388018410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55648a5086b0 con 0x55648a504a80 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.678+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f638803b040 con 0x7f6380026020 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:44.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50c6f0 con 0x55648a504a80 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50ca90 con 0x55648a504a80 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50ca90 con 0x7f6380026020 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:44.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 zone default found 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 4 Realm: () 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 zonegroup default 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d380 con 0x7f6388018410 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50d380 con 0x55648a509410 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a50f660 con 0x55648a509410 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 started sync module instance, tier type = 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a50e9e0 con 0x7f6380026020 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93890305650176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a50e640 con 0x7f6380026020 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.682+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a510590 con 0x55648a504a80 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93890305650176] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93890305655008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a5109b0 con 0x55648a504a80 2024-09-13T19:07:44.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a511370 con 0x55648a509410 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93890305655008] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93890305658560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a511710 con 0x55648a509410 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.686+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a512000 con 0x7f6380026020 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93890305663984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a512cc0 con 0x7f6380026020 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a513680 con 0x55648a504a80 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93890305658560] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93890305663984] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93890305667536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a512cc0 con 0x55648a504a80 2024-09-13T19:07:44.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.690+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a5135f0 con 0x7f6388018410 2024-09-13T19:07:44.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.694+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93890305667536] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.694+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.694+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93890305665040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a512c30 con 0x7f6388018410 2024-09-13T19:07:44.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.694+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a514450 con 0x7f6388018410 2024-09-13T19:07:44.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.694+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93890305665040] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93890305669744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a514410 con 0x7f6388018410 2024-09-13T19:07:44.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a514e10 con 0x7f6388018410 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93890305673504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a514d40 con 0x7f6388018410 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=0 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=1 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=2 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=3 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=4 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=5 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93890305669744] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.698+0000 7f639124a980 20 add_watcher() i=6 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93890305673504] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 add_watcher() i=7 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a513e90 con 0x55648a504a80 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93890305670800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a515780 con 0x55648a504a80 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93890305670800] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f62457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 5 note: GC not initialized 2024-09-13T19:07:44.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f61bffff640 20 reqs_thread_entry: start 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 Filter name: none 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f61bdffb640 20 reqs_thread_entry: start 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a53b8e0 con 0x7f6388018410 2024-09-13T19:07:44.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.702+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a53fa50 con 0x7f6380026020 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:07:44.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 93890305848336 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a540700 con 0x7f6388018410 2024-09-13T19:07:44.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== watch-notify(notify (1) cookie 93890305665040 notify 146028888097 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7f6388010040 con 0x7f6388018410 2024-09-13T19:07:44.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f62727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 93890305665040 notifier 4729 bl.length()=382 2024-09-13T19:07:44.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f62727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:07:44.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f62727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:44.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f62727fc640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6254003eb0 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(64 notify.5 [notify cookie 93890305848336 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== watch-notify(notify_complete (2) cookie 93890305848336 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63880077c0 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a53f410 con 0x55648a504a80 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 : miss 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 20 rados->read ofs=0 len=0 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.706+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 8.6 8:63ea27c0:root::.bucket.meta.myfoo6%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a53d6f0 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(67 .bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:44.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:44.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:44.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:07:44.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 2024-09-13T19:07:44.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 8.6 8:63ea27c0:root::.bucket.meta.myfoo6%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a5478d0 con 0x7f6388018410 2024-09-13T19:07:44.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(68 .bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:44.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:44.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:07:44.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9, ofs0, ns] 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 93890305835568 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a546580 con 0x55648a504a80 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== watch-notify(notify (1) cookie 93890305655008 notify 146028888089 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55648a53dae0 con 0x55648a504a80 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f6271ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 93890305655008 notifier 4729 bl.length()=748 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f6271ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f6271ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f6271ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:07:44.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f6271ffb640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f61c4003540 con 0x55648a504a80 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.710+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(69 notify.1 [notify cookie 93890305835568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify_complete (2) cookie 93890305835568 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55648a5408d0 con 0x55648a504a80 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): orig_sources= new_sources= 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): potential sources added=[] removed=[] 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): orig_dests= new_dests= 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): potential dests added=[] removed=[] 2024-09-13T19:07:44.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a53c230 con 0x55648a504a80 2024-09-13T19:07:44.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(71 bud.buckets [call] v34'5 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a5460d0 con 0x55648a504a80 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(72 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a5460d0 con 0x55648a504a80 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:07:44.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.714+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 93890305835568 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a5460d0 con 0x7f6380026020 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== watch-notify(notify (1) cookie 93890305663984 notify 146028888079 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7f63780bf5b0 con 0x7f6380026020 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f62727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 93890305663984 notifier 4729 bl.length()=316 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f62727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f62727fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f62727fc640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6254003eb0 con 0x7f6380026020 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(74 notify.3 [notify cookie 93890305835568 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== watch-notify(notify_complete (2) cookie 93890305835568 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63780bf850 con 0x7f6380026020 2024-09-13T19:07:44.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:07:44.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 2024-09-13T19:07:44.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 8.6 8:63ea27c0:root::.bucket.meta.myfoo6%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a53d140 con 0x7f6388018410 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(76 .bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9, ofs0, ns] 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 93890305867936 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a540d80 con 0x55648a504a80 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== watch-notify(notify (1) cookie 93890305655008 notify 146028888090 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55648a540b30 con 0x55648a504a80 2024-09-13T19:07:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f6271ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 93890305655008 notifier 4729 bl.length()=748 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.718+0000 7f6271ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f6271ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f6271ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f6271ffb640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f61c4003520 con 0x55648a504a80 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(77 notify.1 [notify cookie 93890305867936 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== watch-notify(notify_complete (2) cookie 93890305867936 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55648a544b70 con 0x55648a504a80 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): orig_sources= new_sources= 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): potential sources added=[] removed=[] 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): orig_dests= new_dests= 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 20 handle_bi_update(): bucket=:myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]): potential dests added=[] removed=[] 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 4.3a 4:5ed17ebb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544530 con 0x55648a509410 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(79 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:80 4.1f 4:f9902aee:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544530 con 0x55648a509410 2024-09-13T19:07:44.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(80 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:81 4.15 4:ab3d3d31:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a509410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(81 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:82 4.37 4:ec152082:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x7f6388018410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(82 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 4.b 4:d0f6b058:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x7f6380026020 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:84 4.2b 4:d79c5739:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a504a80 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(84 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:85 4.27 4:e4b96566:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a504a80 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(85 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 4.10 4:08796740:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a509410 2024-09-13T19:07:44.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(86 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f638006f020 con 0x55648a509410 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.722+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:87 4.22 4:45afb47a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a504a80 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(87 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x7f6388018410 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(88 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [call out=378b] v0'0 uv5 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:89 4.12 4:4b1b1a21:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544510 con 0x55648a504a80 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(89 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 get_obj_state: octx=0x55648a53f210 obj=myfoo6:thirteen state=0x55648a544f28 s->prefetch_data=0 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:90 3.36s0 3:6d7b03f7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a5460d0 con 0x7f6380026020 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(90 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 10 manifest: total_size = 8 2024-09-13T19:07:44.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.13045409947305826034 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 get_obj_state: octx=0x55648a53f210 obj=myfoo6:thirteen state=0x55648a544f28 s->prefetch_data=0 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 : hit (requested=0x17, cached=0x17) 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 2024-09-13T19:07:44.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 2024-09-13T19:07:44.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.726+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:91 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a54afa0 con 0x7f6388018410 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.730+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(91 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.730+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:92 3.36s0 3:6d7b03f7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a548f80 con 0x7f6380026020 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.730+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(92 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.730+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:93 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a54a940 con 0x7f6388018410 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:1 objects processed in :myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9]). Next marker thirteen 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.730+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a540110 con 0x7f6380026020 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 93890305867872 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a54a940 con 0x7f6388018410 2024-09-13T19:07:44.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== watch-notify(notify (1) cookie 93890305665040 notify 146028888098 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55648a544b70 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f62727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 93890305665040 notifier 4729 bl.length()=556 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f62727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f62727fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f62727fc640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6254003eb0 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(95 notify.5 [notify cookie 93890305867872 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(93 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f62727fc640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== watch-notify(notify_complete (2) cookie 93890305867872 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55648a5408d0 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a540110 con 0x55648a504a80 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.734+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 93890305851536 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a548f80 con 0x7f6388018410 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== watch-notify(notify (1) cookie 93890305665040 notify 146028888099 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55648a5408d0 con 0x7f6388018410 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f62727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 93890305665040 notifier 4729 bl.length()=177 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f62727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f62727fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f62727fc640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6254003eb0 con 0x7f6388018410 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(98 notify.5 [notify cookie 93890305851536 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== watch-notify(notify_complete (2) cookie 93890305851536 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63880077c0 con 0x7f6388018410 2024-09-13T19:07:44.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f639124a980 10 removing user index: bar 2024-09-13T19:07:44.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a540090 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(100 bar [delete] v34'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f639124a980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f639124a980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 93890305851536 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55648a544d40 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== watch-notify(notify (1) cookie 93890305673504 notify 146028888100 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f63880077c0 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f6271ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 93890305673504 notifier 4729 bl.length()=152 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f6271ffb640 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f61c4003520 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.738+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(101 notify.7 [notify cookie 93890305851536 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.745 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== watch-notify(notify_complete (2) cookie 93890305851536 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f63880427d0 con 0x7f6388018410 2024-09-13T19:07:44.745 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-13T19:07:44.513129Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:07:44.513117Z","tags":[],"group_ids":[]} 2024-09-13T19:07:44.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f62457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:44.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93890305670800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x55648a504a80 2024-09-13T19:07:44.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93890305670800] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.742+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93890305650176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x7f6380026020 2024-09-13T19:07:44.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93890305650176] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f639124a980 20 remove_watcher() i=0 2024-09-13T19:07:44.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f639124a980 2 removed watcher, disabling cache 2024-09-13T19:07:44.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93890305655008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x55648a504a80 2024-09-13T19:07:44.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93890305655008] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f639124a980 20 remove_watcher() i=1 2024-09-13T19:07:44.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.746+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93890305658560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x55648a509410 2024-09-13T19:07:44.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f638ed5a640 1 -- 172.21.15.151:0/1982663273 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93890305658560] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6380092040 con 0x55648a509410 2024-09-13T19:07:44.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 20 remove_watcher() i=2 2024-09-13T19:07:44.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93890305663984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x7f6380026020 2024-09-13T19:07:44.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f638e559640 1 -- 172.21.15.151:0/1982663273 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93890305663984] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780e7040 con 0x7f6380026020 2024-09-13T19:07:44.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 20 remove_watcher() i=3 2024-09-13T19:07:44.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93890305667536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x55648a504a80 2024-09-13T19:07:44.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93890305667536] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x55648a504a80 2024-09-13T19:07:44.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 20 remove_watcher() i=4 2024-09-13T19:07:44.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.750+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93890305665040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x7f6388018410 2024-09-13T19:07:44.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93890305665040] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f639124a980 20 remove_watcher() i=5 2024-09-13T19:07:44.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93890305669744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x7f6388018410 2024-09-13T19:07:44.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93890305669744] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f639124a980 20 remove_watcher() i=6 2024-09-13T19:07:44.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.754+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93890305673504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55648a52c400 con 0x7f6388018410 2024-09-13T19:07:44.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93890305673504] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6388036040 con 0x7f6388018410 2024-09-13T19:07:44.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 20 remove_watcher() i=7 2024-09-13T19:07:44.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6388018410 msgr2=0x7f6388018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6388018410 0x7f6388018890 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a504a80 msgr2=0x55648a506f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a504a80 0x55648a506f10 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6380026020 msgr2=0x7f63800305c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6380026020 0x7f63800305c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a509410 msgr2=0x55648a50b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a509410 0x55648a50b800 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6258034650 msgr2=0x7f6258036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6258034650 0x7f6258036b10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6378000c10 tx=0x7f63780c1040 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 msgr2=0x55648a4f99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f638f55b640 1 -- 172.21.15.151:0/1982663273 reap_dead start 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f63800469a0 tx=0x7f6380030130 comp rx=0 tx=0).stop 2024-09-13T19:07:44.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 shutdown_connections 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/1982663273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4f27e0 0x55648a4f99e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 >> 172.21.15.151:0/1982663273 conn(0x55648a4eebc0 msgr2=0x55648a4ecc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 shutdown_connections 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/1982663273 wait complete. 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 msgr2=0x7f6268036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 0x7f6268036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6378017f50 tx=0x7f6378005ad0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 msgr2=0x55648a4e6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f6380047b30 tx=0x7f6380011d10 comp rx=0 tx=0).stop 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 shutdown_connections 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6268034650 0x7f6268036b10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/3702755670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a4e5e70 0x55648a4e6290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 >> 172.21.15.151:0/3702755670 conn(0x55648a4dafc0 msgr2=0x55648a4dda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 shutdown_connections 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/3702755670 wait complete. 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a3d7aa0 msgr2=0x55648a4ceff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55648a3d7aa0 0x55648a4ceff0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55648a4d5860 msgr2=0x55648a4d7c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55648a4d5860 0x55648a4d7c50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a4d1960 msgr2=0x55648a4d3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55648a4d1960 0x55648a4d3d50 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6274034650 msgr2=0x7f6274036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6274034650 0x7f6274036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f63780ae000 tx=0x7f63780a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:44.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 msgr2=0x55648a4c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 --2- 172.21.15.151:0/4149573432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55648a347ad0 0x55648a4c8040 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f638000f610 tx=0x7f6380001260 comp rx=0 tx=0).stop 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f638f55b640 1 -- 172.21.15.151:0/4149573432 reap_dead start 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 shutdown_connections 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 >> 172.21.15.151:0/4149573432 conn(0x55648a3ce070 msgr2=0x55648a4ba2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 shutdown_connections 2024-09-13T19:07:44.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:44.758+0000 7f639124a980 1 -- 172.21.15.151:0/4149573432 wait complete. 2024-09-13T19:07:44.773 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-13T19:07:44.513129Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:07:44.513117Z', 'tags': [], 'group_ids': []} 2024-09-13T19:07:49.787 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:49.787 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:07:49.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:07:49.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-13T19:07:49.787 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-13T19:07:49.835 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:49.835 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:49.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.830+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.830+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc4add980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56485f27c920 0x56485f27cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc4add980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56485f102ae0 con 0x56485f27d270 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc4add980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56485f126e30 con 0x56485f27c920 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc25ed640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56485f27c920 0x56485f27cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc25ed640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56485f27c920 0x56485f27cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35752/0 (socket says 172.21.15.151:35752) 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc25ed640 1 -- 172.21.15.151:0/4272996607 learned_addr learned my addr 172.21.15.151:0/4272996607 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc25ed640 1 -- 172.21.15.151:0/4272996607 >> v1:172.21.15.12:6789/0 conn(0x56485f27d270 legacy=0x56485f281ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.834+0000 7fefc25ed640 1 -- 172.21.15.151:0/4272996607 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f2844f0 con 0x56485f27c920 2024-09-13T19:07:49.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc25ed640 1 --2- 172.21.15.151:0/4272996607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f27cd00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fefb400a5c0 tx=0x7fefb401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f94cb0dc4ec44b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc15eb640 1 -- 172.21.15.151:0/4272996607 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40a6070 con 0x56485f27c920 2024-09-13T19:07:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc15eb640 1 -- 172.21.15.151:0/4272996607 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb40af070 con 0x56485f27c920 2024-09-13T19:07:49.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc15eb640 1 -- 172.21.15.151:0/4272996607 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40aa5c0 con 0x56485f27c920 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 -- 172.21.15.151:0/4272996607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 msgr2=0x56485f27cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 --2- 172.21.15.151:0/4272996607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f27cd00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fefb400a5c0 tx=0x7fefb401b340 comp rx=0 tx=0).stop 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 -- 172.21.15.151:0/4272996607 shutdown_connections 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 --2- 172.21.15.151:0/4272996607 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f27cd00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 -- 172.21.15.151:0/4272996607 >> 172.21.15.151:0/4272996607 conn(0x56485f1f0270 msgr2=0x56485f1f0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 -- 172.21.15.151:0/4272996607 shutdown_connections 2024-09-13T19:07:49.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.838+0000 7fefc4add980 1 -- 172.21.15.151:0/4272996607 wait complete. 2024-09-13T19:07:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56485f128200 con 0x56485f27c920 2024-09-13T19:07:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35760/0 (socket says 172.21.15.151:35760) 2024-09-13T19:07:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc25ed640 1 -- 172.21.15.151:0/4087208794 learned_addr learned my addr 172.21.15.151:0/4087208794 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc25ed640 1 -- 172.21.15.151:0/4087208794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f3682a0 con 0x56485f27c920 2024-09-13T19:07:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc25ed640 1 --2- 172.21.15.151:0/4087208794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fefb400a5c0 tx=0x7fefb4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f809f810cd22e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7feeb0608640 1 -- 172.21.15.151:0/4087208794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40aa9b0 con 0x56485f27c920 2024-09-13T19:07:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7feeb0608640 1 -- 172.21.15.151:0/4087208794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb40aab50 con 0x56485f27c920 2024-09-13T19:07:49.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7feeb0608640 1 -- 172.21.15.151:0/4087208794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40aae50 con 0x56485f27c920 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- 172.21.15.151:0/4087208794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 msgr2=0x56485f367cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 --2- 172.21.15.151:0/4087208794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fefb400a5c0 tx=0x7fefb4003030 comp rx=0 tx=0).stop 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- 172.21.15.151:0/4087208794 shutdown_connections 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 --2- 172.21.15.151:0/4087208794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f367cd0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- 172.21.15.151:0/4087208794 >> 172.21.15.151:0/4087208794 conn(0x56485f1f0270 msgr2=0x56485f363900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- 172.21.15.151:0/4087208794 shutdown_connections 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.854+0000 7fefc4add980 1 -- 172.21.15.151:0/4087208794 wait complete. 2024-09-13T19:07:49.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f36ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56485f283f30 con 0x56485f27c920 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f36ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f36ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35762/0 (socket says 172.21.15.151:35762) 2024-09-13T19:07:49.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc25ed640 1 -- 172.21.15.151:0/3487300011 learned_addr learned my addr 172.21.15.151:0/3487300011 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc25ed640 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f36f480 con 0x56485f27c920 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc25ed640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f36ef40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fefb401bbe0 tx=0x7fefb40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 -- 172.21.15.151:0/3487300011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40c6750 con 0x56485f27c920 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56485f36f710 con 0x56485f27c920 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 -- 172.21.15.151:0/3487300011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb40c68f0 con 0x56485f27c920 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 -- 172.21.15.151:0/3487300011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40c6c10 con 0x56485f27c920 2024-09-13T19:07:49.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56485f3723f0 con 0x56485f27c920 2024-09-13T19:07:49.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 -- 172.21.15.151:0/3487300011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb40ce020 con 0x56485f27c920 2024-09-13T19:07:49.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feea8034650 0x7feea8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7feeaee05640 1 -- 172.21.15.151:0/3487300011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fefb40cc020 con 0x56485f27c920 2024-09-13T19:07:49.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc1dec640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feea8034650 0x7feea8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f27d270 0x56485f375f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f376550 con 0x56485f27d270 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.858+0000 7fefc2dee640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f27d270 0x56485f375f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc1dec640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feea8034650 0x7feea8036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefb8001570 tx=0x7fefb80066d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc2dee640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f27d270 0x56485f375f10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc2dee640 1 -- 172.21.15.151:0/3487300011 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f27d270 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f376e30 con 0x56485f27d270 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc2dee640 1 -- 172.21.15.151:0/3487300011 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f27d270 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f378740 0x56485f37abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f37b370 con 0x56485f378740 2024-09-13T19:07:49.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc25ed640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f378740 0x56485f37abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc25ed640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f378740 0x56485f37abe0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc25ed640 1 -- 172.21.15.151:0/3487300011 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fefb40cf370 con 0x56485f378740 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f377680 con 0x56485f27d270 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc2dee640 1 -- 172.21.15.151:0/3487300011 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f27d270 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56485f37c7d0 0x56485f37ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f37f330 con 0x56485f37c7d0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc1dec640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56485f37c7d0 0x56485f37ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc1dec640 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56485f37c7d0 0x56485f37ebc0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc1dec640 1 -- 172.21.15.151:0/3487300011 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fefb800f030 con 0x56485f37c7d0 2024-09-13T19:07:49.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.862+0000 7fefc4add980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56485f181800 con 0x56485f38cdd0 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35776/0 (socket says 172.21.15.151:35776) 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 -- 172.21.15.151:0/2438643675 learned_addr learned my addr 172.21.15.151:0/2438643675 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 -- 172.21.15.151:0/2438643675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f38d730 con 0x56485f38cdd0 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fefb40cf6d0 tx=0x7fefb40bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 -- 172.21.15.151:0/2438643675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40d0e60 con 0x56485f38cdd0 2024-09-13T19:07:49.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 -- 172.21.15.151:0/2438643675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb40e3860 con 0x56485f38cdd0 2024-09-13T19:07:49.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56485f38d9c0 con 0x56485f38cdd0 2024-09-13T19:07:49.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 -- 172.21.15.151:0/2438643675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40e3540 con 0x56485f38cdd0 2024-09-13T19:07:49.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56485f390640 con 0x56485f38cdd0 2024-09-13T19:07:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 -- 172.21.15.151:0/2438643675 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb40d05f0 con 0x56485f38cdd0 2024-09-13T19:07:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 0x7fee9c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7feea7fff640 1 -- 172.21.15.151:0/2438643675 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fefb40eed10 con 0x56485f38cdd0 2024-09-13T19:07:49.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc1dec640 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 0x7fee9c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc1dec640 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 0x7fee9c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56485f37b710 tx=0x7fefb8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc4add980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56485f368560 con 0x56485f399770 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35784/0 (socket says 172.21.15.151:35784) 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.866+0000 7fefc25ed640 1 -- 172.21.15.151:0/3362543678 learned_addr learned my addr 172.21.15.151:0/3362543678 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 -- 172.21.15.151:0/3362543678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f39a120 con 0x56485f399770 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 --2- 172.21.15.151:0/3362543678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fefb40bcf70 tx=0x7fefb40c9e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f21abeb9ab68c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7feea5ffb640 1 -- 172.21.15.151:0/3362543678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40fb030 con 0x56485f399770 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7feea5ffb640 1 -- 172.21.15.151:0/3362543678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb40cf970 con 0x56485f399770 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7feea5ffb640 1 -- 172.21.15.151:0/3362543678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40c95b0 con 0x56485f399770 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- 172.21.15.151:0/3362543678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 msgr2=0x56485f399b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 --2- 172.21.15.151:0/3362543678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fefb40bcf70 tx=0x7fefb40c9e40 comp rx=0 tx=0).stop 2024-09-13T19:07:49.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- 172.21.15.151:0/3362543678 shutdown_connections 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 --2- 172.21.15.151:0/3362543678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f399b50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- 172.21.15.151:0/3362543678 >> 172.21.15.151:0/3362543678 conn(0x56485f395b50 msgr2=0x56485f393c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- 172.21.15.151:0/3362543678 shutdown_connections 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- 172.21.15.151:0/3362543678 wait complete. 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 Processor -- start 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- start start 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc4add980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56485f39a5c0 con 0x56485f399770 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35798/0 (socket says 172.21.15.151:35798) 2024-09-13T19:07:49.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 learned_addr learned my addr 172.21.15.151:0/1929306864 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:49.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56485f3a0eb0 con 0x56485f399770 2024-09-13T19:07:49.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.870+0000 7fefc25ed640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fefb40bcf70 tx=0x7fefb40d5f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 -- 172.21.15.151:0/1929306864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40d08e0 con 0x56485f399770 2024-09-13T19:07:49.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56485f3a0eb0 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 -- 172.21.15.151:0/1929306864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb410d070 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 -- 172.21.15.151:0/1929306864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fefb40c9930 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56485f3a0eb0 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 -- 172.21.15.151:0/1929306864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fefb4101030 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee8c034650 0x7fee8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fee93fff640 1 -- 172.21.15.151:0/1929306864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fefb40ff070 con 0x56485f399770 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc1dec640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee8c034650 0x7fee8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f3ab7f0 0x56485f3adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ae400 con 0x56485f3ab7f0 2024-09-13T19:07:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f3ab7f0 0x56485f3adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc1dec640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee8c034650 0x7fee8c036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56485f37f710 tx=0x7fefb8012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f3ab7f0 0x56485f3adcb0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 realm 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ae810 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af0e0 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f3b01e0 0x56485f3b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b2b90 con 0x56485f3b01e0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.874+0000 7fefc25ed640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f3b01e0 0x56485f3b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc25ed640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f3b01e0 0x56485f3b25d0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc4add980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc4add980 20 searching for the correct realm 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b4460 con 0x56485f3b01e0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc25ed640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fefb4009040 0x7fefb40b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b4460 con 0x7fefb4009040 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fefb4009040 0x7fefb40b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fefb4009040 0x7fefb40b1790 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b4460 con 0x7fefb4009040 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b4460 con 0x56485f3ab7f0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fefbc018410 0x7fefbc018870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fefbc018410 0x7fefbc018870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.878+0000 7fefc2dee640 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fefbc018410 0x7fefbc018870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x7fefbc018410 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x7fefbc018410 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefb4009040 2024-09-13T19:07:49.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x7fefbc018410 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefb4009040 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.890 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.882+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x7fefbc018410 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x7fefbc018410 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefb4009040 2024-09-13T19:07:49.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc0083f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.886+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefb4009040 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3b01e0 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x7fefbc018410 2024-09-13T19:07:49.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56485f3af480 con 0x56485f3ab7f0 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fefbc03b040 con 0x7fefb4009040 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.899 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b3450 con 0x56485f3ab7f0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b3840 con 0x56485f3ab7f0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.890+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b3840 con 0x7fefb4009040 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 zone default found 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 4 Realm: () 2024-09-13T19:07:49.900 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 zonegroup default 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b4170 con 0x7fefbc018410 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b6270 con 0x56485f3b01e0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b6610 con 0x56485f3b01e0 2024-09-13T19:07:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 started sync module instance, tier type = 2024-09-13T19:07:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b5710 con 0x7fefb4009040 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94868835359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b6e60 con 0x7fefb4009040 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.894+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b76b0 con 0x56485f3ab7f0 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94868835359488] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94868835363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b76b0 con 0x56485f3ab7f0 2024-09-13T19:07:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b80b0 con 0x56485f3b01e0 2024-09-13T19:07:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94868835367872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b8950 con 0x56485f3b01e0 2024-09-13T19:07:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.898+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b9390 con 0x7fefb4009040 2024-09-13T19:07:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94868835363248] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94868835372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b9780 con 0x7fefb4009040 2024-09-13T19:07:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ba140 con 0x56485f3ab7f0 2024-09-13T19:07:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94868835367872] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94868835372640] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94868835370144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ba140 con 0x56485f3ab7f0 2024-09-13T19:07:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.902+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ba9e0 con 0x7fefbc018410 2024-09-13T19:07:49.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.906+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94868835370144] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.906+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.906+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94868835376544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3ba9e0 con 0x7fefbc018410 2024-09-13T19:07:49.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.906+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3bb290 con 0x7fefbc018410 2024-09-13T19:07:49.912 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94868835376544] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94868835378480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3bb470 con 0x7fefbc018410 2024-09-13T19:07:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3bbcc0 con 0x7fefbc018410 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94868835378480] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94868835382864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3baa90 con 0x7fefbc018410 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=0 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=1 2024-09-13T19:07:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=2 2024-09-13T19:07:49.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=3 2024-09-13T19:07:49.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=4 2024-09-13T19:07:49.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=5 2024-09-13T19:07:49.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.910+0000 7fefc4add980 20 add_watcher() i=6 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94868835382864] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 add_watcher() i=7 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3bf5a0 con 0x56485f3ab7f0 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94868835385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3bc9c0 con 0x56485f3ab7f0 2024-09-13T19:07:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94868835385536] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fee797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 5 note: GC not initialized 2024-09-13T19:07:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fee737fe640 20 reqs_thread_entry: start 2024-09-13T19:07:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 Filter name: none 2024-09-13T19:07:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fee717fa640 20 reqs_thread_entry: start 2024-09-13T19:07:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:07:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.914+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e2c50 con 0x7fefbc018410 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 20 rados->read ofs=0 len=0 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e13f0 con 0x7fefbc018410 2024-09-13T19:07:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-13T19:07:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.918+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e1cc0 con 0x7fefbc018410 2024-09-13T19:07:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc4add980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:07:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc4add980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc4add980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94868835538960 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e66f0 con 0x7fefbc018410 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== watch-notify(notify (1) cookie 94868835376544 notify 146028888101 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56485f3e2060 con 0x7fefbc018410 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7feea5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94868835376544 notifier 4736 bl.length()=556 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7feea5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-13T19:07:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7feea5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:07:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7feea5ffb640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fee88003eb0 con 0x7fefbc018410 2024-09-13T19:07:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(65 notify.5 [notify cookie 94868835538960 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== watch-notify(notify_complete (2) cookie 94868835538960 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56485f3e26a0 con 0x7fefbc018410 2024-09-13T19:07:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.922+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e4220 con 0x7fefbc018410 2024-09-13T19:07:49.929 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94868835538800 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e66f0 con 0x56485f3b01e0 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 94868835367872 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56485f38d9c0 con 0x56485f3b01e0 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [notify cookie 94868835538800 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7feea57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94868835367872 notifier 4736 bl.length()=177 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7feea57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-13T19:07:49.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7feea57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-13T19:07:49.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7feea57fa640 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fedec003410 con 0x56485f3b01e0 2024-09-13T19:07:49.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== watch-notify(notify_complete (2) cookie 94868835538800 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56485f38d730 con 0x56485f3b01e0 2024-09-13T19:07:49.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.931 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-13T19:07:49.922267Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:07:49.922249Z","tags":[],"group_ids":[]} 2024-09-13T19:07:49.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fee797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:49.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94868835385536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e09f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94868835385536] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.926+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94868835359488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e09f0 con 0x7fefb4009040 2024-09-13T19:07:49.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94868835359488] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc4add980 20 remove_watcher() i=0 2024-09-13T19:07:49.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc4add980 2 removed watcher, disabling cache 2024-09-13T19:07:49.933 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94868835363248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b5b00 con 0x56485f3ab7f0 2024-09-13T19:07:49.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94868835363248] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc4add980 20 remove_watcher() i=1 2024-09-13T19:07:49.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.930+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94868835367872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e09f0 con 0x56485f3b01e0 2024-09-13T19:07:49.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc25ed640 1 -- 172.21.15.151:0/1929306864 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94868835367872] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb40eb070 con 0x56485f3b01e0 2024-09-13T19:07:49.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc4add980 20 remove_watcher() i=2 2024-09-13T19:07:49.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94868835372640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b5b00 con 0x7fefb4009040 2024-09-13T19:07:49.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc1dec640 1 -- 172.21.15.151:0/1929306864 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94868835372640] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefb8021040 con 0x7fefb4009040 2024-09-13T19:07:49.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc4add980 20 remove_watcher() i=3 2024-09-13T19:07:49.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.934+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94868835370144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3e09f0 con 0x56485f3ab7f0 2024-09-13T19:07:49.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94868835370144] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x56485f3ab7f0 2024-09-13T19:07:49.941 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc4add980 20 remove_watcher() i=4 2024-09-13T19:07:49.942 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94868835376544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b8e60 con 0x7fefbc018410 2024-09-13T19:07:49.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94868835376544] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.943 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc4add980 20 remove_watcher() i=5 2024-09-13T19:07:49.944 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.938+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94868835378480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b5b00 con 0x7fefbc018410 2024-09-13T19:07:49.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.942+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94868835378480] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.942+0000 7fefc4add980 20 remove_watcher() i=6 2024-09-13T19:07:49.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.942+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94868835382864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56485f3b84a0 con 0x7fefbc018410 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.942+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94868835382864] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fefbc036040 con 0x7fefbc018410 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.942+0000 7fefc4add980 20 remove_watcher() i=7 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fefbc018410 msgr2=0x7fefbc018870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fefbc018410 0x7fefbc018870 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f3ab7f0 msgr2=0x56485f3adcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f3ab7f0 0x56485f3adcb0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fefb4009040 msgr2=0x7fefb40b1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fefb4009040 0x7fefb40b1790 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f3b01e0 msgr2=0x56485f3b25d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f3b01e0 0x56485f3b25d0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee8c034650 msgr2=0x7fee8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee8c034650 0x7fee8c036b10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56485f37f710 tx=0x7fefb8012000 comp rx=0 tx=0).stop 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 msgr2=0x56485f3a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc2dee640 1 -- 172.21.15.151:0/1929306864 reap_dead start 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fefb40bcf70 tx=0x7fefb40d5f00 comp rx=0 tx=0).stop 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 shutdown_connections 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/1929306864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f399770 0x56485f3a0970 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 >> 172.21.15.151:0/1929306864 conn(0x56485f395b50 msgr2=0x56485f393c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 shutdown_connections 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/1929306864 wait complete. 2024-09-13T19:07:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 msgr2=0x7fee9c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 0x7fee9c036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56485f37b710 tx=0x7fefb8011000 comp rx=0 tx=0).stop 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 msgr2=0x56485f38d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fefb40cf6d0 tx=0x7fefb40bcdc0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 shutdown_connections 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fee9c034650 0x7fee9c036b10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/2438643675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f38cdd0 0x56485f38d1f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 >> 172.21.15.151:0/2438643675 conn(0x56485f381f20 msgr2=0x56485f3849a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 shutdown_connections 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/2438643675 wait complete. 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f27d270 msgr2=0x56485f375f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56485f27d270 0x56485f375f10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56485f37c7d0 msgr2=0x56485f37ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56485f37c7d0 0x56485f37ebc0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f378740 msgr2=0x56485f37abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56485f378740 0x56485f37abe0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feea8034650 msgr2=0x7feea8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feea8034650 0x7feea8036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fefb8001570 tx=0x7fefb80066d0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 msgr2=0x56485f36ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 --2- 172.21.15.151:0/3487300011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56485f27c920 0x56485f36ef40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fefb401bbe0 tx=0x7fefb40180e0 comp rx=0 tx=0).stop 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc2dee640 1 -- 172.21.15.151:0/3487300011 reap_dead start 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 shutdown_connections 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 >> 172.21.15.151:0/3487300011 conn(0x56485f1f0270 msgr2=0x56485f362480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 shutdown_connections 2024-09-13T19:07:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:49.946+0000 7fefc4add980 1 -- 172.21.15.151:0/3487300011 wait complete. 2024-09-13T19:07:49.961 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-13T19:07:49.922267Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:07:49.922249Z', 'tags': [], 'group_ids': []} 2024-09-13T19:07:49.987 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:49.995 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-13T19:07:49.995 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:07:49.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-13T19:07:49.996 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-13T19:07:50.030 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:50.030 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:50.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb53ff7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5564f5752940 0x5564f5754d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb53ff7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5564f55d4ae0 con 0x5564f574ee00 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb53ff7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5564f55f8e30 con 0x5564f5752940 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb4bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5564f5752940 0x5564f5754d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb4bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5564f5752940 0x5564f5754d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35812/0 (socket says 172.21.15.151:35812) 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb51b07640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5564f574ee00 0x5564f57511f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:45888/0 (socket says 172.21.15.151:45888) 2024-09-13T19:07:50.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.026+0000 7fbb4bfff640 1 -- 172.21.15.151:0/2081599743 learned_addr learned my addr 172.21.15.151:0/2081599743 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb4bfff640 1 -- 172.21.15.151:0/2081599743 >> v1:172.21.15.12:6789/0 conn(0x5564f574ee00 legacy=0x5564f57511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb4bfff640 1 -- 172.21.15.151:0/2081599743 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f5756400 con 0x5564f5752940 2024-09-13T19:07:50.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/2081599743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f5752940 0x5564f5754d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00a5c0 tx=0x7fbb3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c6bb188b30f809 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb51306640 1 -- 172.21.15.151:0/2081599743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c0a6070 con 0x5564f5752940 2024-09-13T19:07:50.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb51306640 1 -- 172.21.15.151:0/2081599743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c0af070 con 0x5564f5752940 2024-09-13T19:07:50.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb51306640 1 -- 172.21.15.151:0/2081599743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c0aa5c0 con 0x5564f5752940 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2081599743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f5752940 msgr2=0x5564f5754d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2081599743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f5752940 0x5564f5754d60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00a5c0 tx=0x7fbb3c01b340 comp rx=0 tx=0).stop 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2081599743 shutdown_connections 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2081599743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f5752940 0x5564f5754d60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2081599743 >> 172.21.15.151:0/2081599743 conn(0x5564f56c2290 msgr2=0x5564f56c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2081599743 shutdown_connections 2024-09-13T19:07:50.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.030+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2081599743 wait complete. 2024-09-13T19:07:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb53ff7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb53ff7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5564f55fa200 con 0x5564f574ee00 2024-09-13T19:07:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35814/0 (socket says 172.21.15.151:35814) 2024-09-13T19:07:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb51b07640 1 -- 172.21.15.151:0/2579935556 learned_addr learned my addr 172.21.15.151:0/2579935556 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.046+0000 7fbb51b07640 1 -- 172.21.15.151:0/2579935556 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f583a270 con 0x5564f574ee00 2024-09-13T19:07:50.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 --2- 172.21.15.151:0/2579935556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001e50 tx=0x7fbb44001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef145f7688c416f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3fe07640 1 -- 172.21.15.151:0/2579935556 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb4400e5d0 con 0x5564f574ee00 2024-09-13T19:07:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3fe07640 1 -- 172.21.15.151:0/2579935556 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4400e770 con 0x5564f574ee00 2024-09-13T19:07:50.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3fe07640 1 -- 172.21.15.151:0/2579935556 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb4400eab0 con 0x5564f574ee00 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2579935556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 msgr2=0x5564f5839ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2579935556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001e50 tx=0x7fbb44001e80 comp rx=0 tx=0).stop 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2579935556 shutdown_connections 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2579935556 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5839ca0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2579935556 >> 172.21.15.151:0/2579935556 conn(0x5564f56c2290 msgr2=0x5564f58358d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2579935556 shutdown_connections 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2579935556 wait complete. 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5840f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5564f5755ed0 con 0x5564f574ee00 2024-09-13T19:07:50.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5840f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5840f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35816/0 (socket says 172.21.15.151:35816) 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 -- 172.21.15.151:0/977808745 learned_addr learned my addr 172.21.15.151:0/977808745 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f5841490 con 0x5564f574ee00 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb51b07640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5840f50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x5564f583ae80 tx=0x7fbb44000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3e604640 1 -- 172.21.15.151:0/977808745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44001260 con 0x5564f574ee00 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f5841720 con 0x5564f574ee00 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3e604640 1 -- 172.21.15.151:0/977808745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4400fa40 con 0x5564f574ee00 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fba3e604640 1 -- 172.21.15.151:0/977808745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb4400fd80 con 0x5564f574ee00 2024-09-13T19:07:50.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.050+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f5844400 con 0x5564f574ee00 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fba3e604640 1 -- 172.21.15.151:0/977808745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb44017070 con 0x5564f574ee00 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fba3e604640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba38034650 0x7fba38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fba3e604640 1 -- 172.21.15.151:0/977808745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb44015020 con 0x5564f574ee00 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba38034650 0x7fba38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f5752940 0x5564f5847f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5848590 con 0x5564f5752940 2024-09-13T19:07:50.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb52308640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f5752940 0x5564f5847f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.058 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba38034650 0x7fba38036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0ae000 tx=0x7fbb3c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb52308640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f5752940 0x5564f5847f20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb52308640 1 -- 172.21.15.151:0/977808745 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f5752940 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5845620 con 0x5564f5752940 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb52308640 1 -- 172.21.15.151:0/977808745 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f5752940 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f584a8e0 0x5564f584ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f584d3c0 con 0x5564f584a8e0 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb51b07640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f584a8e0 0x5564f584ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.059 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb51b07640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f584a8e0 0x5564f584ccd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb51b07640 1 -- 172.21.15.151:0/977808745 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb4402e070 con 0x5564f584a8e0 2024-09-13T19:07:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5849780 con 0x5564f5752940 2024-09-13T19:07:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb52308640 1 -- 172.21.15.151:0/977808745 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f5752940 2024-09-13T19:07:50.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5564f584e820 0x5564f5850c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5851380 con 0x5564f584e820 2024-09-13T19:07:50.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5564f584e820 0x5564f5850c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.054+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5564f584e820 0x5564f5850c10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb4bfff640 1 -- 172.21.15.151:0/977808745 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x5564f584e820 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5564f5653800 con 0x5564f585edf0 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35824/0 (socket says 172.21.15.151:35824) 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb51b07640 1 -- 172.21.15.151:0/118628636 learned_addr learned my addr 172.21.15.151:0/118628636 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb51b07640 1 -- 172.21.15.151:0/118628636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f585f750 con 0x5564f585edf0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb51b07640 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb4404a010 tx=0x7fbb44017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 -- 172.21.15.151:0/118628636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb4403f020 con 0x5564f585edf0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f585f9e0 con 0x5564f585edf0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 -- 172.21.15.151:0/118628636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb44042720 con 0x5564f585edf0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 -- 172.21.15.151:0/118628636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44042a00 con 0x5564f585edf0 2024-09-13T19:07:50.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f585f9e0 con 0x5564f585edf0 2024-09-13T19:07:50.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 -- 172.21.15.151:0/118628636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb4404ad10 con 0x5564f585edf0 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 0x7fba2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.058+0000 7fba377fe640 1 -- 172.21.15.151:0/118628636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb4404fae0 con 0x5564f585edf0 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 0x7fba2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 0x7fba2c036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c10 tx=0x7fbb3c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.065 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5564f583a5f0 con 0x5564f586b530 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35834/0 (socket says 172.21.15.151:35834) 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 -- 172.21.15.151:0/2084631092 learned_addr learned my addr 172.21.15.151:0/2084631092 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 -- 172.21.15.151:0/2084631092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f586bee0 con 0x5564f586b530 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 --2- 172.21.15.151:0/2084631092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbb44029fd0 tx=0x7fbb4403bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b4cbb5d484d3ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.067 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fba357fa640 1 -- 172.21.15.151:0/2084631092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb4404feb0 con 0x5564f586b530 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fba357fa640 1 -- 172.21.15.151:0/2084631092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4405f070 con 0x5564f586b530 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fba357fa640 1 -- 172.21.15.151:0/2084631092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44019990 con 0x5564f586b530 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2084631092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 msgr2=0x5564f586b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2084631092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbb44029fd0 tx=0x7fbb4403bd50 comp rx=0 tx=0).stop 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2084631092 shutdown_connections 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/2084631092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f586b910 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2084631092 >> 172.21.15.151:0/2084631092 conn(0x5564f5867910 msgr2=0x5564f5865a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2084631092 shutdown_connections 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- 172.21.15.151:0/2084631092 wait complete. 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 Processor -- start 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- start start 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb53ff7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5564f586c380 con 0x5564f586b530 2024-09-13T19:07:50.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35846/0 (socket says 172.21.15.151:35846) 2024-09-13T19:07:50.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 learned_addr learned my addr 172.21.15.151:0/847852363 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.062+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f5872c50 con 0x5564f586b530 2024-09-13T19:07:50.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb51b07640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbb44047d00 tx=0x7fbb44048250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 -- 172.21.15.151:0/847852363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44031e00 con 0x5564f586b530 2024-09-13T19:07:50.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5564f5872c50 con 0x5564f586b530 2024-09-13T19:07:50.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 -- 172.21.15.151:0/847852363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb4406a070 con 0x5564f586b530 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 -- 172.21.15.151:0/847852363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb44019be0 con 0x5564f586b530 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f58730c0 con 0x5564f586b530 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 -- 172.21.15.151:0/847852363 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbb44058040 con 0x5564f586b530 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba1c034650 0x7fba1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fba237fe640 1 -- 172.21.15.151:0/847852363 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbb44055040 con 0x5564f586b530 2024-09-13T19:07:50.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba1c034650 0x7fba1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f587d770 0x5564f587fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5880380 con 0x5564f587d770 2024-09-13T19:07:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba1c034650 0x7fba1c036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0aa910 tx=0x7fbb3c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb52308640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f587d770 0x5564f587fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb52308640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f587d770 0x5564f587fc30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 realm 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5880790 con 0x5564f587d770 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881060 con 0x5564f587d770 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.066+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f5882160 0x5564f5884550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5884b10 con 0x5564f5882160 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f5882160 0x5564f5884550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f5882160 0x5564f5884550 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:50.077 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 20 searching for the correct realm 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f58863e0 con 0x5564f5882160 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fbb44066040 0x7fbb4406a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f58863e0 con 0x7fbb44066040 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fbb44066040 0x7fbb4406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fbb44066040 0x7fbb4406a220 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x7fbb44066040 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f58863e0 con 0x7fbb44066040 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x7fbb44066040 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f58863e0 con 0x5564f587d770 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fbb4c016440 0x7fbb4c0168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.079 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fbb4c016440 0x7fbb4c0168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.070+0000 7fbb52308640 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fbb4c016440 0x7fbb4c0168c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb44066040 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x7fbb44066040 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.082 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb44066040 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x7fbb44066040 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.074+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.084 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb44066040 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c0aaae0 con 0x7fbb44066040 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.078+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb44066040 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f5882160 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb4c016440 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x5564f587d770 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5564f5881400 con 0x7fbb44066040 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.091 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f58854d0 con 0x5564f587d770 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f58850b0 con 0x5564f587d770 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5885d70 con 0x7fbb44066040 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 zone default found 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 4 Realm: () 2024-09-13T19:07:50.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 zonegroup default 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.082+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f5886810 con 0x7fbb4c016440 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f58881f0 con 0x5564f5882160 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f58886b0 con 0x5564f5882160 2024-09-13T19:07:50.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 started sync module instance, tier type = 2024-09-13T19:07:50.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:50.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f5887690 con 0x7fbb44066040 2024-09-13T19:07:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93892104452736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58872f0 con 0x7fbb44066040 2024-09-13T19:07:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58895e0 con 0x5564f587d770 2024-09-13T19:07:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.086+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93892104452736] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93892104458544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f5889a00 con 0x5564f587d770 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588a3c0 con 0x5564f5882160 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93892104458544] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93892104459600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f5889970 con 0x5564f5882160 2024-09-13T19:07:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.090+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588b0c0 con 0x7fbb44066040 2024-09-13T19:07:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93892104465424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588b960 con 0x7fbb44066040 2024-09-13T19:07:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588c380 con 0x5564f587d770 2024-09-13T19:07:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93892104459600] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93892104465424] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93892104470128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588b4b0 con 0x5564f587d770 2024-09-13T19:07:50.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.094+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588cc20 con 0x7fbb4c016440 2024-09-13T19:07:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93892104470128] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93892104464224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588b4b0 con 0x7fbb4c016440 2024-09-13T19:07:50.101 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588d110 con 0x7fbb4c016440 2024-09-13T19:07:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93892104464224] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93892104472432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588d040 con 0x7fbb4c016440 2024-09-13T19:07:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.098+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588dab0 con 0x7fbb4c016440 2024-09-13T19:07:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93892104476032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588df20 con 0x7fbb4c016440 2024-09-13T19:07:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=0 2024-09-13T19:07:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=1 2024-09-13T19:07:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=2 2024-09-13T19:07:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=3 2024-09-13T19:07:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=4 2024-09-13T19:07:50.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=5 2024-09-13T19:07:50.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93892104472432] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=6 2024-09-13T19:07:50.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 93892104476032] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 20 add_watcher() i=7 2024-09-13T19:07:50.112 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f588cb90 con 0x5564f587d770 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.102+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93892104473488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588e430 con 0x5564f587d770 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93892104473488] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fba037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.113 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:50.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:50.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 5 note: GC not initialized 2024-09-13T19:07:50.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fba027fc640 20 reqs_thread_entry: start 2024-09-13T19:07:50.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:50.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 Filter name: none 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fb973fff640 20 reqs_thread_entry: start 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b4590 con 0x7fbb44066040 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:50.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:07:50.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:50.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:50.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.106+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b8790 con 0x7fbb4c016440 2024-09-13T19:07:50.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.110+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.119 INFO:teuthology.orchestra.run.smithi151.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-13T19:07:50.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.110+0000 7fba037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.110+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93892104473488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x5564f587d770 2024-09-13T19:07:50.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.110+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93892104473488] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.110+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93892104452736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x7fbb44066040 2024-09-13T19:07:50.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93892104452736] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb53ff7980 20 remove_watcher() i=0 2024-09-13T19:07:50.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb53ff7980 2 removed watcher, disabling cache 2024-09-13T19:07:50.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93892104458544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x5564f587d770 2024-09-13T19:07:50.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93892104458544] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb53ff7980 20 remove_watcher() i=1 2024-09-13T19:07:50.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.114+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93892104459600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f5889130 con 0x5564f5882160 2024-09-13T19:07:50.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb51b07640 1 -- 172.21.15.151:0/847852363 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93892104459600] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb44041020 con 0x5564f5882160 2024-09-13T19:07:50.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 20 remove_watcher() i=2 2024-09-13T19:07:50.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93892104465424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x7fbb44066040 2024-09-13T19:07:50.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb4bfff640 1 -- 172.21.15.151:0/847852363 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93892104465424] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c0e7040 con 0x7fbb44066040 2024-09-13T19:07:50.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 20 remove_watcher() i=3 2024-09-13T19:07:50.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93892104470128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588ac10 con 0x5564f587d770 2024-09-13T19:07:50.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93892104470128] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x5564f587d770 2024-09-13T19:07:50.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 20 remove_watcher() i=4 2024-09-13T19:07:50.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.118+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93892104464224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x7fbb4c016440 2024-09-13T19:07:50.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.122+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93892104464224] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.122+0000 7fbb53ff7980 20 remove_watcher() i=5 2024-09-13T19:07:50.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.122+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93892104472432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f588ac10 con 0x7fbb4c016440 2024-09-13T19:07:50.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93892104472432] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 20 remove_watcher() i=6 2024-09-13T19:07:50.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93892104476032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5564f58b23c0 con 0x7fbb4c016440 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93892104476032] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb4c00a4d0 con 0x7fbb4c016440 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 20 remove_watcher() i=7 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fbb4c016440 msgr2=0x7fbb4c0168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fbb4c016440 0x7fbb4c0168c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f587d770 msgr2=0x5564f587fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f587d770 0x5564f587fc30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fbb44066040 msgr2=0x7fbb4406a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fbb44066040 0x7fbb4406a220 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f5882160 msgr2=0x5564f5884550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f5882160 0x5564f5884550 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba1c034650 msgr2=0x7fba1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba1c034650 0x7fba1c036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0aa910 tx=0x7fbb3c0c1040 comp rx=0 tx=0).stop 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb52308640 1 -- 172.21.15.151:0/847852363 reap_dead start 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 msgr2=0x5564f5872710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbb44047d00 tx=0x7fbb44048250 comp rx=0 tx=0).stop 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 shutdown_connections 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/847852363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f586b530 0x5564f5872710 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 >> 172.21.15.151:0/847852363 conn(0x5564f5867910 msgr2=0x5564f58659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 shutdown_connections 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/847852363 wait complete. 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 msgr2=0x7fba2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 0x7fba2c036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c000c10 tx=0x7fbb3c005ad0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 msgr2=0x5564f585f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fbb4404a010 tx=0x7fbb44017d50 comp rx=0 tx=0).stop 2024-09-13T19:07:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 shutdown_connections 2024-09-13T19:07:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba2c034650 0x7fba2c036b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/118628636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f585edf0 0x5564f585f210 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 >> 172.21.15.151:0/118628636 conn(0x5564f5853f40 msgr2=0x5564f58569c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 shutdown_connections 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/118628636 wait complete. 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f5752940 msgr2=0x5564f5847f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5564f5752940 0x5564f5847f20 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5564f584e820 msgr2=0x5564f5850c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5564f584e820 0x5564f5850c10 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f584a8e0 msgr2=0x5564f584ccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5564f584a8e0 0x5564f584ccd0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba38034650 msgr2=0x7fba38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba38034650 0x7fba38036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c0ae000 tx=0x7fbb3c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 msgr2=0x5564f5840f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 --2- 172.21.15.151:0/977808745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5564f574ee00 0x5564f5840f50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x5564f583ae80 tx=0x7fbb44000bd0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb52308640 1 -- 172.21.15.151:0/977808745 reap_dead start 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 shutdown_connections 2024-09-13T19:07:50.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 >> 172.21.15.151:0/977808745 conn(0x5564f56c2290 msgr2=0x5564f5834450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 shutdown_connections 2024-09-13T19:07:50.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.126+0000 7fbb53ff7980 1 -- 172.21.15.151:0/977808745 wait complete. 2024-09-13T19:07:50.142 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-13T19:07:50.189 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:50.189 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:07:50.195 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-13T19:07:50.195 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-13T19:07:50.195 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:07:50.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-13T19:07:50.196 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-13T19:07:50.228 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:50.229 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c02664980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x563406dfa3c0 0x563406df8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c02664980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563406d0bae0 con 0x563406dfa7d0 2024-09-13T19:07:50.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c02664980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x563406d2fe30 con 0x563406dfa3c0 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c00174640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x563406dfa3c0 0x563406df8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1bff973640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x563406dfa7d0 0x563406df90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:45902/0 (socket says 172.21.15.151:45902) 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c00174640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x563406dfa3c0 0x563406df8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35856/0 (socket says 172.21.15.151:35856) 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1bff973640 1 -- 172.21.15.151:0/346626433 learned_addr learned my addr 172.21.15.151:0/346626433 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c00174640 1 -- 172.21.15.151:0/346626433 >> v1:172.21.15.12:6789/0 conn(0x563406dfa7d0 legacy=0x563406df90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.226+0000 7f1c00174640 1 -- 172.21.15.151:0/346626433 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406df98f0 con 0x563406dfa3c0 2024-09-13T19:07:50.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c00174640 1 --2- 172.21.15.151:0/346626433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406df8b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400a480 tx=0x7f1bf401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e224fcbf4c0a8650 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1bff172640 1 -- 172.21.15.151:0/346626433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40b0070 con 0x563406dfa3c0 2024-09-13T19:07:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1bff172640 1 -- 172.21.15.151:0/346626433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40ab540 con 0x563406dfa3c0 2024-09-13T19:07:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1bff172640 1 -- 172.21.15.151:0/346626433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40ab840 con 0x563406dfa3c0 2024-09-13T19:07:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 -- 172.21.15.151:0/346626433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 msgr2=0x563406df8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 --2- 172.21.15.151:0/346626433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406df8b80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400a480 tx=0x7f1bf401b280 comp rx=0 tx=0).stop 2024-09-13T19:07:50.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 -- 172.21.15.151:0/346626433 shutdown_connections 2024-09-13T19:07:50.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 --2- 172.21.15.151:0/346626433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406df8b80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 -- 172.21.15.151:0/346626433 >> 172.21.15.151:0/346626433 conn(0x563406e7f1c0 msgr2=0x563406e815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 -- 172.21.15.151:0/346626433 shutdown_connections 2024-09-13T19:07:50.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.230+0000 7f1c02664980 1 -- 172.21.15.151:0/346626433 wait complete. 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c02664980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c02664980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563406d31200 con 0x563406dfa3c0 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35868/0 (socket says 172.21.15.151:35868) 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c00174640 1 -- 172.21.15.151:0/3935639126 learned_addr learned my addr 172.21.15.151:0/3935639126 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.242+0000 7f1c00174640 1 -- 172.21.15.151:0/3935639126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406f71170 con 0x563406dfa3c0 2024-09-13T19:07:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 --2- 172.21.15.151:0/3935639126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4018eb0 tx=0x7f1bf4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d5431688fa9e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aee60c640 1 -- 172.21.15.151:0/3935639126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40b0040 con 0x563406dfa3c0 2024-09-13T19:07:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aee60c640 1 -- 172.21.15.151:0/3935639126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40aba30 con 0x563406dfa3c0 2024-09-13T19:07:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aee60c640 1 -- 172.21.15.151:0/3935639126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40abd30 con 0x563406dfa3c0 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3935639126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 msgr2=0x563406f70ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 --2- 172.21.15.151:0/3935639126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4018eb0 tx=0x7f1bf4003030 comp rx=0 tx=0).stop 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3935639126 shutdown_connections 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 --2- 172.21.15.151:0/3935639126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f70ba0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3935639126 >> 172.21.15.151:0/3935639126 conn(0x563406e7f1c0 msgr2=0x563406f6c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3935639126 shutdown_connections 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3935639126 wait complete. 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f77eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563406e8f210 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f77eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f77eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35884/0 (socket says 172.21.15.151:35884) 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 -- 172.21.15.151:0/3243836638 learned_addr learned my addr 172.21.15.151:0/3243836638 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406f783f0 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c00174640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f77eb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1bf401bb20 tx=0x7f1bf4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aece09640 1 -- 172.21.15.151:0/3243836638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40b0070 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563406f78680 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aece09640 1 -- 172.21.15.151:0/3243836638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40b6cb0 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1aece09640 1 -- 172.21.15.151:0/3243836638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40c8440 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.246+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563406f7b360 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1aece09640 1 -- 172.21.15.151:0/3243836638 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bf40c85e0 con 0x563406dfa3c0 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1aece09640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ae8034650 0x7f1ae8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1aece09640 1 -- 172.21.15.151:0/3243836638 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bf40a8070 con 0x563406dfa3c0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1bff973640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ae8034650 0x7f1ae8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406dfa7d0 0x563406f7efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406f7f4f0 con 0x563406dfa7d0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00975640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406dfa7d0 0x563406f7efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1bff973640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ae8034650 0x7f1ae8036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0000f70 tx=0x7f1bf00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00975640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406dfa7d0 0x563406f7efb0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00975640 1 -- 172.21.15.151:0/3243836638 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406dfa7d0 2024-09-13T19:07:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406f7c560 con 0x563406dfa7d0 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00975640 1 -- 172.21.15.151:0/3243836638 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406dfa7d0 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406f81820 0x563406f83c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406f84300 con 0x563406f81820 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00174640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406f81820 0x563406f83c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00174640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406f81820 0x563406f83c10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00174640 1 -- 172.21.15.151:0/3243836638 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bf40b3040 con 0x563406f81820 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406f806c0 con 0x563406dfa7d0 2024-09-13T19:07:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c00975640 1 -- 172.21.15.151:0/3243836638 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406dfa7d0 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x563406f85760 0x563406f87b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406f88290 con 0x563406f85760 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1bff973640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x563406f85760 0x563406f87b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1bff973640 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x563406f85760 0x563406f87b50 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.250+0000 7f1bff973640 1 -- 172.21.15.151:0/3243836638 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bf000e620 con 0x563406f85760 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563406d8a800 con 0x563406f95d60 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35888/0 (socket says 172.21.15.151:35888) 2024-09-13T19:07:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c00174640 1 -- 172.21.15.151:0/82837766 learned_addr learned my addr 172.21.15.151:0/82837766 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c00174640 1 -- 172.21.15.151:0/82837766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406f966c0 con 0x563406f95d60 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c00174640 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40c8a40 tx=0x7f1bf40be5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 -- 172.21.15.151:0/82837766 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40c8cc0 con 0x563406f95d60 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563406f96950 con 0x563406f95d60 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 -- 172.21.15.151:0/82837766 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf4007e30 con 0x563406f95d60 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 -- 172.21.15.151:0/82837766 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40c8e60 con 0x563406f95d60 2024-09-13T19:07:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563406f995d0 con 0x563406f95d60 2024-09-13T19:07:50.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 -- 172.21.15.151:0/82837766 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bf40d1a70 con 0x563406f95d60 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 0x7f1ad8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1ae5ffb640 1 -- 172.21.15.151:0/82837766 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bf40e7070 con 0x563406f95d60 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1bff973640 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 0x7f1ad8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.254+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563406f714f0 con 0x563406fa2690 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1bff973640 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 0x7f1ad8036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000bf60 tx=0x7f1bf000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35902/0 (socket says 172.21.15.151:35902) 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 -- 172.21.15.151:0/97662363 learned_addr learned my addr 172.21.15.151:0/97662363 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 -- 172.21.15.151:0/97662363 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406fa3060 con 0x563406fa2690 2024-09-13T19:07:50.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- 172.21.15.151:0/97662363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40ca650 tx=0x7f1bf40df6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4d60e246f247a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1adf7fe640 1 -- 172.21.15.151:0/97662363 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40fa040 con 0x563406fa2690 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1adf7fe640 1 -- 172.21.15.151:0/97662363 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf4008150 con 0x563406fa2690 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1adf7fe640 1 -- 172.21.15.151:0/97662363 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40065c0 con 0x563406fa2690 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/97662363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 msgr2=0x563406fa2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 --2- 172.21.15.151:0/97662363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40ca650 tx=0x7f1bf40df6b0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/97662363 shutdown_connections 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 --2- 172.21.15.151:0/97662363 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa2a90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/97662363 >> 172.21.15.151:0/97662363 conn(0x563406f9ea70 msgr2=0x563406f9cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/97662363 shutdown_connections 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/97662363 wait complete. 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 Processor -- start 2024-09-13T19:07:50.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- start start 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563406fa3060 con 0x563406fa2690 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35918/0 (socket says 172.21.15.151:35918) 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 learned_addr learned my addr 172.21.15.151:0/2134872185 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563406fa9bf0 con 0x563406fa2690 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c00174640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40aafe0 tx=0x7f1bf40ca5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1addffb640 1 -- 172.21.15.151:0/2134872185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf410d070 con 0x563406fa2690 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.258+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563406fa9bf0 con 0x563406fa2690 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1addffb640 1 -- 172.21.15.151:0/2134872185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf40065c0 con 0x563406fa2690 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1addffb640 1 -- 172.21.15.151:0/2134872185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bf40ca0c0 con 0x563406fa2690 2024-09-13T19:07:50.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563406faa060 con 0x563406fa2690 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1addffb640 1 -- 172.21.15.151:0/2134872185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bf4110070 con 0x563406fa2690 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1addffb640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad0034650 0x7f1ad0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1addffb640 1 -- 172.21.15.151:0/2134872185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bf4113d70 con 0x563406fa2690 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1bff973640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad0034650 0x7f1ad0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406fb4640 0x563406fb6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fb7230 con 0x563406fb4640 2024-09-13T19:07:50.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406fb4640 0x563406fb6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1bff973640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad0034650 0x7f1ad0036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x563406f7f9c0 tx=0x7f1bf0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406fb4640 0x563406fb6ae0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 realm 2024-09-13T19:07:50.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fb7640 con 0x563406fb4640 2024-09-13T19:07:50.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fb7ee0 con 0x563406fb4640 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406fb8fe0 0x563406fbb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbba70 con 0x563406fb8fe0 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.262+0000 7f1c00174640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406fb8fe0 0x563406fbb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00174640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406fb8fe0 0x563406fbb3d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:50.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c02664980 20 searching for the correct realm 2024-09-13T19:07:50.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fbd2d0 con 0x563406fb8fe0 2024-09-13T19:07:50.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00174640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bf4112070 0x7f1bf40e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fbd2d0 con 0x7f1bf4112070 2024-09-13T19:07:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bf4112070 0x7f1bf40e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bf4112070 0x7f1bf40e6940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf000e620 con 0x7f1bf4112070 2024-09-13T19:07:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fbd2d0 con 0x7f1bf4112070 2024-09-13T19:07:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf000e620 con 0x7f1bf4112070 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fbd2d0 con 0x563406fb4640 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1bf8016440 0x7f1bf80168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1bf8016440 0x7f1bf80168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.266+0000 7f1c00975640 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1bf8016440 0x7f1bf80168c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf4112070 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1bf000e620 con 0x7f1bf4112070 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf4112070 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bf000e620 con 0x7f1bf4112070 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.270+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf4112070 2024-09-13T19:07:50.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf000e620 con 0x7f1bf4112070 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.274+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf4112070 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb8fe0 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf8016440 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x563406fb4640 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563406fb8280 con 0x7f1bf4112070 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:50.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbc3c0 con 0x563406fb4640 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbc000 con 0x563406fb4640 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbcc90 con 0x7f1bf4112070 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 zone default found 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 4 Realm: () 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 zonegroup default 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbd730 con 0x7f1bf8016440 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.278+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbf110 con 0x563406fb8fe0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fbf590 con 0x563406fb8fe0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 20 started sync module instance, tier type = 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fbe5b0 con 0x7f1bf4112070 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94781455460768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fbe210 con 0x7f1bf4112070 2024-09-13T19:07:50.313 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc04c0 con 0x563406fb4640 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94781455460768] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94781455466512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc0430 con 0x563406fb4640 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.282+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc1270 con 0x563406fb8fe0 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94781455466512] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94781455468720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc1690 con 0x563406fb8fe0 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc2050 con 0x7f1bf4112070 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94781455473568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc28a0 con 0x7f1bf4112070 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.286+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc32c0 con 0x563406fb4640 2024-09-13T19:07:50.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94781455473568] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94781455468720] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94781455478192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc23f0 con 0x563406fb4640 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc3b60 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94781455478192] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94781455469776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc23f0 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.290+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc4070 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.294+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94781455469776] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.294+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.294+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94781455480496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc4030 con 0x7f1bf8016440 2024-09-13T19:07:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.294+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc4a30 con 0x7f1bf8016440 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94781455480496] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94781455481552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc49f0 con 0x7f1bf8016440 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=0 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=1 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=2 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=3 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=4 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=5 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=6 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94781455481552] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 20 add_watcher() i=7 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fc7e50 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.298+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94781455484688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fc53a0 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94781455484688] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c02664980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c02664980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd0750 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.302+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd0da0 con 0x7f1bf8016440 2024-09-13T19:07:50.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd1200 con 0x563406fb8fe0 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd11f0 con 0x563406fb4640 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.306+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd1760 con 0x7f1bf4112070 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd1cd0 con 0x563406fb8fe0 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd1d60 con 0x563406fb4640 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.310+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd2160 con 0x7f1bf8016440 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.314+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.314+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd2160 con 0x7f1bf4112070 2024-09-13T19:07:50.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.314+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.314+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd2610 con 0x563406fb8fe0 2024-09-13T19:07:50.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fd2610 con 0x7f1bf4112070 2024-09-13T19:07:50.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce580 con 0x7f1bf8016440 2024-09-13T19:07:50.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.318+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce580 con 0x7f1bf4112070 2024-09-13T19:07:50.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce580 con 0x7f1bf8016440 2024-09-13T19:07:50.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb4640 2024-09-13T19:07:50.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.322+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf4112070 2024-09-13T19:07:50.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.326+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb4640 2024-09-13T19:07:50.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.330+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.330+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb4640 2024-09-13T19:07:50.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.330+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.330+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf4112070 2024-09-13T19:07:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.334+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.338+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.338+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.338+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.338+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf8016440 2024-09-13T19:07:50.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.342+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.342+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.342+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.342+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf8016440 2024-09-13T19:07:50.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.346+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.346+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x563406fb8fe0 2024-09-13T19:07:50.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.346+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.346+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf8016440 2024-09-13T19:07:50.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fce3b0 con 0x7f1bf4112070 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1ab57e2640 20 reqs_thread_entry: start 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 20 Filter name: none 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1a26ffd640 20 reqs_thread_entry: start 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.350+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fce470 con 0x7f1bf4112070 2024-09-13T19:07:50.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406fcdee0 con 0x563406fb4640 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv6 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 : miss 2024-09-13T19:07:50.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:96 8.6 8:63ea27c0:root::.bucket.meta.myfoo6%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff0820 con 0x7f1bf8016440 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(96 .bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x17 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:50.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:97 4.3a 4:5ed17ebb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9d0 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(97 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 4.1f 4:f9902aee:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9d0 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(98 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 4.15 4:ab3d3d31:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9d0 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(99 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4119070 con 0x563406fb8fe0 2024-09-13T19:07:50.367 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.354+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 4.37 4:ec152082:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706da10 con 0x7f1bf8016440 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(100 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf800a4d0 con 0x7f1bf8016440 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:101 4.b 4:d0f6b058:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706da10 con 0x7f1bf4112070 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(101 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:102 4.2b 4:d79c5739:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706da10 con 0x563406fb4640 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(102 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 4.27 4:e4b96566:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706da10 con 0x563406fb4640 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(103 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf800a4d0 con 0x563406fb4640 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:104 4.10 4:08796740:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9d0 con 0x563406fb8fe0 2024-09-13T19:07:50.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(104 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 4.22 4:45afb47a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9b0 con 0x563406fb4640 2024-09-13T19:07:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(105 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:106 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9b0 con 0x7f1bf8016440 2024-09-13T19:07:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(106 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [call out=345b] v0'0 uv7 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 10 cls_bucket_list_unordered: got thirteen 2024-09-13T19:07:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.358+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:107 4.12 4:4b1b1a21:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340706d9b0 con 0x563406fb4640 2024-09-13T19:07:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(107 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 20 get_obj_state: octx=0x7f1bf002d040 obj=myfoo6:thirteen state=0x563406ff1448 s->prefetch_data=0 2024-09-13T19:07:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:108 3.36s0 3:6d7b03f7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff2270 con 0x7f1bf4112070 2024-09-13T19:07:50.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(108 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 10 manifest: total_size = 8 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 20 get_obj_state: setting s->obj_tag to _yU0rEVBxEUvviPLCD2Dq79RYByrStLi 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 20 get_obj_state: octx=0x7f1bf002d040 obj=myfoo6:thirteen state=0x563406ff1448 s->prefetch_data=0 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 20 prepare_atomic_modification: state is not atomic. state=0x563406ff1448 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 2024-09-13T19:07:50.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:109 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ff6b70 con 0x7f1bf8016440 2024-09-13T19:07:50.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(109 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.362+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:110 3.36s0 3:6d7b03f7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ff4b50 con 0x7f1bf4112070 2024-09-13T19:07:50.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(110 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ff6ac0 con 0x7f1bf8016440 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:112 4.3a 4:5ed17ebb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff6ac0 con 0x563406fb8fe0 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:113 4.1f 4:f9902aee:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffb510 con 0x563406fb8fe0 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:114 4.15 4:ab3d3d31:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff6ac0 con 0x563406fb8fe0 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:115 4.37 4:ec152082:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff6ac0 con 0x7f1bf8016440 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:116 4.b 4:d0f6b058:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563407002b50 con 0x7f1bf4112070 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:117 4.2b 4:d79c5739:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563407005530 con 0x563406fb4640 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:118 4.27 4:e4b96566:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563407008330 con 0x563406fb4640 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:119 4.10 4:08796740:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700ac20 con 0x563406fb8fe0 2024-09-13T19:07:50.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(112 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:120 4.22 4:45afb47a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700d530 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:121 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700dea0 con 0x7f1bf8016440 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(113 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:122 4.12 4:4b1b1a21:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(114 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(117 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(116 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(119 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(118 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(120 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(122 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.366+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(115 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(111 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1adeffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(121 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9])"; uploads.size()=0; is_truncated=0 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:123 4.3a 4:5ed17ebb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb8fe0 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:124 4.1f 4:f9902aee:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff9d70 con 0x563406fb8fe0 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:125 4.15 4:ab3d3d31:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700d9d0 con 0x563406fb8fe0 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:126 4.37 4:ec152082:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x7f1bf8016440 2024-09-13T19:07:50.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:127 4.b 4:d0f6b058:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff9d70 con 0x7f1bf4112070 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:128 4.2b 4:d79c5739:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700d9d0 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:129 4.27 4:e4b96566:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:130 4.10 4:08796740:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff9d70 con 0x563406fb8fe0 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:131 4.22 4:45afb47a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700d9d0 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:132 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x7f1bf8016440 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:133 4.12 4:4b1b1a21:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56340700de00 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(128 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(127 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(133 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(131 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(129 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(123 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(124 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(125 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(132 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(130 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(126 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(134 bud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 20 rados_obj.operate() r=0 bl.length=166 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-13T19:07:50.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.370+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94781455692016 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== watch-notify(notify (1) cookie 94781455473568 notify 146028888081 ret 0) ==== 192+0+0 (crc 0 0 0) 0x563406fcebd0 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1adeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94781455473568 notifier 4750 bl.length()=150 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(137 notify.3 [notify cookie 94781455692016 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1adeffd640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a340032d0 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== watch-notify(notify_complete (2) cookie 94781455692016 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563406fd1760 con 0x7f1bf4112070 2024-09-13T19:07:50.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:139 8.6 8:63ea27c0:root::.bucket.meta.myfoo6%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x7f1bf8016440 2024-09-13T19:07:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(139 .bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 from cache 2024-09-13T19:07:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9, ofs0, ns] 2024-09-13T19:07:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94781455692016 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb4640 2024-09-13T19:07:50.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== watch-notify(notify (1) cookie 94781455466512 notify 146028888092 ret 0) ==== 249+0+0 (crc 0 0 0) 0x563406fefad0 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1adeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94781455466512 notifier 4750 bl.length()=207 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(140 notify.1 [notify cookie 94781455692016 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1adeffd640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a340032d0 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.374+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== watch-notify(notify_complete (2) cookie 94781455692016 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563406f96950 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:142 4.3a 4:5ed17ebb:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x563406fb8fe0 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:143 4.1f 4:f9902aee:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56340700dba0 con 0x563406fb8fe0 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:144 4.15 4:ab3d3d31:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffada0 con 0x563406fb8fe0 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:145 4.37 4:ec152082:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fee960 con 0x7f1bf8016440 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:146 4.b 4:d0f6b058:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa430 con 0x7f1bf4112070 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:147 4.2b 4:d79c5739:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56340700dba0 con 0x563406fb4640 2024-09-13T19:07:50.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:148 4.27 4:e4b96566:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffada0 con 0x563406fb4640 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:149 4.10 4:08796740:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ff96c0 con 0x563406fb8fe0 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:150 4.22 4:45afb47a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fee960 con 0x563406fb4640 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:151 4.1c 4:385e1597:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ff84e0 con 0x7f1bf8016440 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:152 4.12 4:4b1b1a21:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56340700dba0 con 0x563406fb4640 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(142 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(145 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.3 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(150 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(151 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(143 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.391 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(146 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.4 [delete] v34'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(149 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.7 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 48 ==== osd_op_reply(148 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.6 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 49 ==== osd_op_reply(147 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.5 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 50 ==== osd_op_reply(152 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.10 [delete] v34'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(144 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9.2 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 : miss 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:153 6.d 6:b5568121:::pubsub..bucket.myfoo6%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff9b00 con 0x563406fb4640 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.378+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 51 ==== osd_op_reply(153 pubsub..bucket.myfoo6/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 info.flags=0x0 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 10 adding default.rgw.log++pubsub..bucket.myfoo6/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 to cache LRU end 2024-09-13T19:07:50.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:154 6.d 6:b5568121:::pubsub..bucket.myfoo6%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa3f0 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 52 ==== osd_op_reply(154 pubsub..bucket.myfoo6/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9 [delete] v34'35 uv29 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa3f0 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 53 ==== osd_op_reply(155 bud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.382+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa3f0 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 54 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94781455705072 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff70b0 con 0x7f1bf8016440 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== watch-notify(notify (1) cookie 94781455469776 notify 146028888102 ret 0) ==== 212+0+0 (crc 0 0 0) 0x563406f96950 con 0x7f1bf8016440 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1adf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94781455469776 notifier 4750 bl.length()=170 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1adf7fe640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1ac4003d70 con 0x7f1bf8016440 2024-09-13T19:07:50.393 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(157 notify.5 [notify cookie 94781455705072 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== watch-notify(notify_complete (2) cookie 94781455705072 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563406fd0920 con 0x7f1bf8016440 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 10 removing email index: 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 10 removing user buckets index 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa3f0 con 0x563406fb4640 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 55 ==== osd_op_reply(159 bud.buckets [delete] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94781455705072 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff70b0 con 0x7f1bf8016440 2024-09-13T19:07:50.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== watch-notify(notify (1) cookie 94781455480496 notify 146028888103 ret 0) ==== 202+0+0 (crc 0 0 0) 0x563406fd0920 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1adeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94781455480496 notifier 4750 bl.length()=160 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(160 notify.6 [notify cookie 94781455705072 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.386+0000 7f1adeffd640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a340032d0 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== watch-notify(notify_complete (2) cookie 94781455705072 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563406fd0710 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c02664980 10 removing user index: bud 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406ffa3f0 con 0x7f1bf4112070 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c02664980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c02664980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94781455705072 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563406ff70b0 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== watch-notify(notify (1) cookie 94781455469776 notify 146028888104 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563406fd0710 con 0x7f1bf8016440 2024-09-13T19:07:50.397 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1adf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94781455469776 notifier 4750 bl.length()=152 2024-09-13T19:07:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1adf7fe640 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1ac4003d70 con 0x7f1bf8016440 2024-09-13T19:07:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(163 notify.5 [notify cookie 94781455705072 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== watch-notify(notify_complete (2) cookie 94781455705072 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563406fd0af0 con 0x7f1bf8016440 2024-09-13T19:07:50.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.390+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1ab67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94781455484688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x563406fb4640 2024-09-13T19:07:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 56 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94781455484688] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94781455460768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x7f1bf4112070 2024-09-13T19:07:50.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94781455460768] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c02664980 20 remove_watcher() i=0 2024-09-13T19:07:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c02664980 2 removed watcher, disabling cache 2024-09-13T19:07:50.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.394+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94781455466512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x563406fb4640 2024-09-13T19:07:50.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 57 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94781455466512] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c02664980 20 remove_watcher() i=1 2024-09-13T19:07:50.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94781455468720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x563406fb8fe0 2024-09-13T19:07:50.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c00174640 1 -- 172.21.15.151:0/2134872185 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94781455468720] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf4133060 con 0x563406fb8fe0 2024-09-13T19:07:50.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c02664980 20 remove_watcher() i=2 2024-09-13T19:07:50.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.398+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94781455473568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x7f1bf4112070 2024-09-13T19:07:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1bff973640 1 -- 172.21.15.151:0/2134872185 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94781455473568] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf0040040 con 0x7f1bf4112070 2024-09-13T19:07:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1c02664980 20 remove_watcher() i=3 2024-09-13T19:07:50.404 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94781455478192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x563406fb4640 2024-09-13T19:07:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.1 v2:172.21.15.151:6816/4016279334 58 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94781455478192] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x563406fb4640 2024-09-13T19:07:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1c02664980 20 remove_watcher() i=4 2024-09-13T19:07:50.407 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.402+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94781455469776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x7f1bf8016440 2024-09-13T19:07:50.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94781455469776] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c02664980 20 remove_watcher() i=5 2024-09-13T19:07:50.409 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94781455480496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x7f1bf8016440 2024-09-13T19:07:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94781455480496] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c02664980 20 remove_watcher() i=6 2024-09-13T19:07:50.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.406+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94781455481552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563406fcfd00 con 0x7f1bf8016440 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 <== osd.0 v2:172.21.15.12:6800/3844244554 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94781455481552] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bf8051060 con 0x7f1bf8016440 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 20 remove_watcher() i=7 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1bf8016440 msgr2=0x7f1bf80168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1bf8016440 0x7f1bf80168c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406fb4640 msgr2=0x563406fb6ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406fb4640 0x563406fb6ae0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bf4112070 msgr2=0x7f1bf40e6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bf4112070 0x7f1bf40e6940 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406fb8fe0 msgr2=0x563406fbb3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.416 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406fb8fe0 0x563406fbb3d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad0034650 msgr2=0x7f1ad0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad0034650 0x7f1ad0036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x563406f7f9c0 tx=0x7f1bf0010000 comp rx=0 tx=0).stop 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 msgr2=0x563406fa96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c00975640 1 -- 172.21.15.151:0/2134872185 reap_dead start 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40aafe0 tx=0x7f1bf40ca5e0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 shutdown_connections 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/2134872185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406fa2690 0x563406fa96b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 >> 172.21.15.151:0/2134872185 conn(0x563406f9ea70 msgr2=0x563406f9cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 shutdown_connections 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/2134872185 wait complete. 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 msgr2=0x7f1ad8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 0x7f1ad8036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1bf000bf60 tx=0x7f1bf000f000 comp rx=0 tx=0).stop 2024-09-13T19:07:50.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 msgr2=0x563406f96180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40c8a40 tx=0x7f1bf40be5d0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 shutdown_connections 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ad8034650 0x7f1ad8036b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/82837766 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406f95d60 0x563406f96180 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 >> 172.21.15.151:0/82837766 conn(0x563406f8aeb0 msgr2=0x563406f8d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 shutdown_connections 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/82837766 wait complete. 2024-09-13T19:07:50.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406dfa7d0 msgr2=0x563406f7efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x563406dfa7d0 0x563406f7efb0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x563406f85760 msgr2=0x563406f87b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x563406f85760 0x563406f87b50 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406f81820 msgr2=0x563406f83c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x563406f81820 0x563406f83c10 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ae8034650 msgr2=0x7f1ae8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1ae8034650 0x7f1ae8036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0000f70 tx=0x7f1bf00012c0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 msgr2=0x563406f77eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 --2- 172.21.15.151:0/3243836638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563406dfa3c0 0x563406f77eb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1bf401bb20 tx=0x7f1bf4018020 comp rx=0 tx=0).stop 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c00975640 1 -- 172.21.15.151:0/3243836638 reap_dead start 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 shutdown_connections 2024-09-13T19:07:50.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 >> 172.21.15.151:0/3243836638 conn(0x563406e7f1c0 msgr2=0x563406f6b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 shutdown_connections 2024-09-13T19:07:50.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.410+0000 7f1c02664980 1 -- 172.21.15.151:0/3243836638 wait complete. 2024-09-13T19:07:50.424 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:07:50.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-13T19:07:50.424 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-13T19:07:50.502 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:07:50.502 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:07:50.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff10b697980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5616163538f0 0x561616353cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff10b697980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616161d9ae0 con 0x561616354240 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff10b697980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5616161fde30 con 0x5616163538f0 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff1089a6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x561616354240 0x561616358c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:45918/0 (socket says 172.21.15.151:45918) 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff1089a6640 1 -- 172.21.15.151:0/2005908662 learned_addr learned my addr 172.21.15.151:0/2005908662 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:07:50.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2005908662 >> v2:172.21.15.12:3300/0 conn(0x5616163538f0 0x561616353cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff0fbfff640 1 -- 172.21.15.151:0/2005908662 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600385910 0 0) 0x5616161d9ae0 con 0x561616354240 2024-09-13T19:07:50.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.498+0000 7ff0fbfff640 1 -- 172.21.15.151:0/2005908662 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f4001e20 con 0x561616354240 2024-09-13T19:07:50.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff1091a7640 1 -- 172.21.15.151:0/2005908662 >> v1:172.21.15.12:6789/0 conn(0x561616354240 legacy=0x561616358c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff1091a7640 1 -- 172.21.15.151:0/2005908662 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161635b4c0 con 0x5616163538f0 2024-09-13T19:07:50.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2005908662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616353cd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a480 tx=0x7ff0fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7889d5c3e03cda8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff0fbfff640 1 -- 172.21.15.151:0/2005908662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b0070 con 0x5616163538f0 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff0fbfff640 1 -- 172.21.15.151:0/2005908662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0ab540 con 0x5616163538f0 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff0fbfff640 1 -- 172.21.15.151:0/2005908662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0ab820 con 0x5616163538f0 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 -- 172.21.15.151:0/2005908662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 msgr2=0x561616353cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 --2- 172.21.15.151:0/2005908662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616353cd0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a480 tx=0x7ff0fc01b280 comp rx=0 tx=0).stop 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 -- 172.21.15.151:0/2005908662 shutdown_connections 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 --2- 172.21.15.151:0/2005908662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616353cd0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 -- 172.21.15.151:0/2005908662 >> 172.21.15.151:0/2005908662 conn(0x5616162c7240 msgr2=0x5616162c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 -- 172.21.15.151:0/2005908662 shutdown_connections 2024-09-13T19:07:50.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.502+0000 7ff10b697980 1 -- 172.21.15.151:0/2005908662 wait complete. 2024-09-13T19:07:50.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5616161ff200 con 0x5616163538f0 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35942/0 (socket says 172.21.15.151:35942) 2024-09-13T19:07:50.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff1091a7640 1 -- 172.21.15.151:0/1095728134 learned_addr learned my addr 172.21.15.151:0/1095728134 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff1091a7640 1 -- 172.21.15.151:0/1095728134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161643efb0 con 0x5616163538f0 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff1091a7640 1 --2- 172.21.15.151:0/1095728134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc017e90 tx=0x7ff0fc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec5a74f89c2bb88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7feff7606640 1 -- 172.21.15.151:0/1095728134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b0040 con 0x5616163538f0 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7feff7606640 1 -- 172.21.15.151:0/1095728134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0aca40 con 0x5616163538f0 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7feff7606640 1 -- 172.21.15.151:0/1095728134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0acd20 con 0x5616163538f0 2024-09-13T19:07:50.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- 172.21.15.151:0/1095728134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 msgr2=0x56161643e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 --2- 172.21.15.151:0/1095728134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc017e90 tx=0x7ff0fc003030 comp rx=0 tx=0).stop 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- 172.21.15.151:0/1095728134 shutdown_connections 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 --2- 172.21.15.151:0/1095728134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x56161643e9e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- 172.21.15.151:0/1095728134 >> 172.21.15.151:0/1095728134 conn(0x5616162c7240 msgr2=0x56161643a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- 172.21.15.151:0/1095728134 shutdown_connections 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- 172.21.15.151:0/1095728134 wait complete. 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616445c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.518+0000 7ff10b697980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56161635af00 con 0x5616163538f0 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616445c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616445c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35948/0 (socket says 172.21.15.151:35948) 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1091a7640 1 -- 172.21.15.151:0/2567532771 learned_addr learned my addr 172.21.15.151:0/2567532771 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1091a7640 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561616446190 con 0x5616163538f0 2024-09-13T19:07:50.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616445c50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc01bb20 tx=0x7ff0fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 -- 172.21.15.151:0/2567532771 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0c5030 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 -- 172.21.15.151:0/2567532771 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0b6c60 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561616446420 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 -- 172.21.15.151:0/2567532771 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b0070 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561616449100 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 -- 172.21.15.151:0/2567532771 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0fc0c8070 con 0x5616163538f0 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feff0034600 0x7feff0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7feff5e03640 1 -- 172.21.15.151:0/2567532771 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff0fc0c6070 con 0x5616163538f0 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feff0034600 0x7feff0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561616354240 0x56161644cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161644d290 con 0x561616354240 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561616354240 0x56161644cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feff0034600 0x7feff0036ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff100000f70 tx=0x7ff1000010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561616354240 0x56161644cd50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff1099a8640 1 -- 172.21.15.151:0/2567532771 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x561616354240 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.522+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161644a300 con 0x561616354240 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1099a8640 1 -- 172.21.15.151:0/2567532771 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10400a4d0 con 0x561616354240 2024-09-13T19:07:50.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56161644f5c0 0x5616164519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164520a0 con 0x56161644f5c0 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56161644f5c0 0x5616164519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56161644f5c0 0x5616164519b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 -- 172.21.15.151:0/2567532771 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0fc0b3040 con 0x56161644f5c0 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161644e460 con 0x561616354240 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1099a8640 1 -- 172.21.15.151:0/2567532771 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10400a4d0 con 0x561616354240 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561616453500 0x5616164558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616456030 con 0x561616453500 2024-09-13T19:07:50.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561616453500 0x5616164558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561616453500 0x5616164558f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1089a6640 1 -- 172.21.15.151:0/2567532771 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff10000e6c0 con 0x561616453500 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff10b697980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561616258800 con 0x561616463b00 2024-09-13T19:07:50.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35958/0 (socket says 172.21.15.151:35958) 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 -- 172.21.15.151:0/738050689 learned_addr learned my addr 172.21.15.151:0/738050689 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 -- 172.21.15.151:0/738050689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561616464460 con 0x561616463b00 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.526+0000 7ff1091a7640 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0e3140 tx=0x7ff0fc0aafc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 -- 172.21.15.151:0/738050689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0aaa80 con 0x561616463b00 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 -- 172.21.15.151:0/738050689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0c9a40 con 0x561616463b00 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561616464690 con 0x561616463b00 2024-09-13T19:07:50.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 -- 172.21.15.151:0/738050689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0c9d40 con 0x561616463b00 2024-09-13T19:07:50.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561616467310 con 0x561616463b00 2024-09-13T19:07:50.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 -- 172.21.15.151:0/738050689 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0fc0b7600 con 0x561616463b00 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 0x7fefe0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefeeffd640 1 -- 172.21.15.151:0/738050689 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff0fc0de070 con 0x561616463b00 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1089a6640 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 0x7fefe0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1089a6640 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 0x7fefe0036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56161644d760 tx=0x7ff10000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56161643f270 con 0x561616470390 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35964/0 (socket says 172.21.15.151:35964) 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1091a7640 1 -- 172.21.15.151:0/2414800994 learned_addr learned my addr 172.21.15.151:0/2414800994 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1091a7640 1 -- 172.21.15.151:0/2414800994 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561616470d60 con 0x561616470390 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2414800994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c1fd0 tx=0x7ff0fc0c1470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab595af0415fd653 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefecff9640 1 -- 172.21.15.151:0/2414800994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0e1800 con 0x561616470390 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefecff9640 1 -- 172.21.15.151:0/2414800994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0eede0 con 0x561616470390 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7fefecff9640 1 -- 172.21.15.151:0/2414800994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b5850 con 0x561616470390 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- 172.21.15.151:0/2414800994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 msgr2=0x561616470790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 --2- 172.21.15.151:0/2414800994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c1fd0 tx=0x7ff0fc0c1470 comp rx=0 tx=0).stop 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 -- 172.21.15.151:0/2414800994 shutdown_connections 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.530+0000 7ff10b697980 1 --2- 172.21.15.151:0/2414800994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616470790 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2414800994 >> 172.21.15.151:0/2414800994 conn(0x56161646c7c0 msgr2=0x56161646a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2414800994 shutdown_connections 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2414800994 wait complete. 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 Processor -- start 2024-09-13T19:07:50.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- start start 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561616470d60 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1091a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:35976/0 (socket says 172.21.15.151:35976) 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 learned_addr learned my addr 172.21.15.151:0/2187365307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616164779c0 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c1f00 tx=0x7ff0fc002ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 -- 172.21.15.151:0/2187365307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0b78f0 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 -- 172.21.15.151:0/2187365307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc0b7ab0 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616164779c0 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 -- 172.21.15.151:0/2187365307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0fc0cea90 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616164779c0 con 0x561616470390 2024-09-13T19:07:50.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 -- 172.21.15.151:0/2187365307 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff0fc0cec50 con 0x561616470390 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefd40346a0 0x7fefd4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7fefdeffd640 1 -- 172.21.15.151:0/2187365307 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff0fc0bc070 con 0x561616470390 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefd40346a0 0x7fefd4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5616164823f0 0x5616164848b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616485000 con 0x5616164823f0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.534+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5616164823f0 0x5616164848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefd40346a0 0x7fefd4036b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c010 tx=0x7ff100010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5616164823f0 0x5616164848b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 realm 2024-09-13T19:07:50.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616485410 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616485ce0 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561616486de0 0x5616164891d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164897e0 con 0x561616486de0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561616486de0 0x5616164891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561616486de0 0x5616164891d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 20 searching for the correct realm 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56161648b0b0 con 0x561616486de0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff0fc105040 0x7ff0fc0f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56161648b0b0 con 0x7ff0fc105040 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff0fc105040 0x7ff0fc0f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff0fc105040 0x7ff0fc0f6920 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56161648b0b0 con 0x7ff0fc105040 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56161648b0b0 con 0x5616164823f0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff104016440 0x7ff1040168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.538+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff104016440 0x7ff1040168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff104016440 0x7ff1040168c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff0fc105040 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.542+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff0fc105040 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff0fc105040 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.546+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff0fc105040 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x561616486de0 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff104016440 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x5616164823f0 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561616486080 con 0x7ff0fc105040 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161648a1a0 con 0x5616164823f0 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616489db0 con 0x5616164823f0 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.550+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161648aa90 con 0x7ff0fc105040 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 zone default found 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 4 Realm: () 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:07:50.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 zonegroup default 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161648b4e0 con 0x7ff104016440 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161648cef0 con 0x561616486de0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161648d3e0 con 0x561616486de0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 started sync module instance, tier type = 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648af60 con 0x7ff0fc105040 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94652863136816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648d840 con 0x7ff0fc105040 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648e300 con 0x5616164823f0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.554+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94652863136816] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94652863143376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648e6f0 con 0x5616164823f0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648f0b0 con 0x561616486de0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94652863147008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648f950 con 0x561616486de0 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616490370 con 0x7ff0fc105040 2024-09-13T19:07:50.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.558+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94652863143376] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94652863151712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616490760 con 0x7ff0fc105040 2024-09-13T19:07:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616491120 con 0x5616164823f0 2024-09-13T19:07:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94652863147008] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94652863151712] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94652863137968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616490c70 con 0x5616164823f0 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.562+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616491500 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94652863137968] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94652863149216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616491120 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616491f10 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94652863149216] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94652863155584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616491f10 con 0x7ff104016440 2024-09-13T19:07:50.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.566+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164928d0 con 0x7ff104016440 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94652863155584] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94652863159152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164928d0 con 0x7ff104016440 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=0 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=1 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=2 2024-09-13T19:07:50.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=3 2024-09-13T19:07:50.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=4 2024-09-13T19:07:50.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=5 2024-09-13T19:07:50.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=6 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94652863159152] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 20 add_watcher() i=7 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 2 all 8 watchers are set, enabling cache 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.570+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561616495ba0 con 0x5616164823f0 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94652863161744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616492e60 con 0x5616164823f0 2024-09-13T19:07:50.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94652863161744] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7fefbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff10b697980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:07:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff10b697980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:07:50.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561616495390 con 0x5616164823f0 2024-09-13T19:07:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.574+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649ec60 con 0x7ff104016440 2024-09-13T19:07:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.578+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.578+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649ec60 con 0x561616486de0 2024-09-13T19:07:50.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.578+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.578+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649f110 con 0x5616164823f0 2024-09-13T19:07:50.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649f590 con 0x7ff0fc105040 2024-09-13T19:07:50.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649fb00 con 0x561616486de0 2024-09-13T19:07:50.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.582+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649ff00 con 0x5616164823f0 2024-09-13T19:07:50.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.586+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.586+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649ff00 con 0x7ff104016440 2024-09-13T19:07:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.586+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.586+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161649ff90 con 0x7ff0fc105040 2024-09-13T19:07:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0500 con 0x561616486de0 2024-09-13T19:07:50.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.594 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0500 con 0x7ff0fc105040 2024-09-13T19:07:50.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.590+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0ad0 con 0x7ff104016440 2024-09-13T19:07:50.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.594+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.594+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0ad0 con 0x7ff0fc105040 2024-09-13T19:07:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.594+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.594+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0bb0 con 0x7ff104016440 2024-09-13T19:07:50.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0bb0 con 0x5616164823f0 2024-09-13T19:07:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.602 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0bb0 con 0x561616486de0 2024-09-13T19:07:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.598+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a0c70 con 0x7ff0fc105040 2024-09-13T19:07:50.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x5616164823f0 2024-09-13T19:07:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.602+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x5616164823f0 2024-09-13T19:07:50.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.611 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x7ff0fc105040 2024-09-13T19:07:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.606+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.610+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x7ff104016440 2024-09-13T19:07:50.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.614+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.614+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.614+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.614+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x7ff104016440 2024-09-13T19:07:50.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.618+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.618+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x561616486de0 2024-09-13T19:07:50.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.618+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.618+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x7ff104016440 2024-09-13T19:07:50.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.622+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.622+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164a1250 con 0x7ff0fc105040 2024-09-13T19:07:50.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7fefbefe5640 20 reqs_thread_entry: start 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 init_complete bucket index max shards: 11 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 Filter name: none 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7fefbcfe1640 20 reqs_thread_entry: start 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-13T19:07:50.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164bc280 con 0x7ff104016440 2024-09-13T19:07:50.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=380 2024-09-13T19:07:50.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-13T19:07:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-13T19:07:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:50.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164be750 con 0x7ff104016440 2024-09-13T19:07:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 : miss 2024-09-13T19:07:50.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:96 8.14 8:2cabecf5:root::.bucket.meta.myfoo7%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164beb40 con 0x561616486de0 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=382 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 info.flags=0x17 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 to cache LRU end 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.626+0000 7ff10b697980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:97 4.e 4:70a79d23:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x7ff0fc105040 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(97 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:98 4.3d 4:bdcd5c14:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x561616486de0 2024-09-13T19:07:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(98 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 4.e 4:739e1ae1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x7ff0fc105040 2024-09-13T19:07:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(99 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 4.31 4:8ca749f8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x5616164823f0 2024-09-13T19:07:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(100 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.635 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 4.37 4:ed038ff9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x7ff104016440 2024-09-13T19:07:50.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(101 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10400a4d0 con 0x7ff104016440 2024-09-13T19:07:50.636 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:102 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bd30 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(102 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [call out=377b] v0'0 uv3 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 10 cls_bucket_list_unordered: got fourteen 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:103 4.1b 4:da8e5bf7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bcb0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(103 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 4.e 4:71fd8b52:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bcb0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(104 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:105 4.b 4:d3120d2a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bcd0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(105 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.630+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:106 4.9 4:917a8be0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bcd0 con 0x5616164823f0 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(106 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10400a4d0 con 0x5616164823f0 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 4.e 4:70327617:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653bcd0 con 0x7ff0fc105040 2024-09-13T19:07:50.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(107 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 20 get_obj_state: octx=0x56161649fd40 obj=myfoo7:fourteen state=0x561616539df8 s->prefetch_data=0 2024-09-13T19:07:50.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 3.2s0 3:424ede45:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56161653a770 con 0x561616486de0 2024-09-13T19:07:50.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(108 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 10 manifest: total_size = 8 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.9511932933324966079 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 20 get_obj_state: octx=0x56161649fd40 obj=myfoo7:fourteen state=0x561616539df8 s->prefetch_data=0 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 20 prepare_atomic_modification: state is not atomic. state=0x561616539df8 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:109 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161653b030 con 0x7ff0fc105040 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(109 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.634+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 3.2s0 3:424ede45:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161653b030 con 0x561616486de0 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(110 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10_fourteen [call] v34'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:111 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164c33f0 con 0x7ff0fc105040 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:112 4.e 4:70a79d23:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c33f0 con 0x7ff0fc105040 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:113 4.3d 4:bdcd5c14:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c7670 con 0x561616486de0 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:114 4.e 4:739e1ae1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c9f70 con 0x7ff0fc105040 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:115 4.31 4:8ca749f8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c33f0 con 0x5616164823f0 2024-09-13T19:07:50.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:116 4.37 4:ed038ff9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c7670 con 0x7ff104016440 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:117 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d1700 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:118 4.1b 4:da8e5bf7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4550 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:119 4.e 4:71fd8b52:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d7390 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:120 4.b 4:d3120d2a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d9c40 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:121 4.9 4:917a8be0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164dc5d0 con 0x5616164823f0 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:122 4.e 4:70327617:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164deec0 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(112 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(113 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(115 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(118 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(114 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.644 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(119 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(120 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(121 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.645 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(122 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(116 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x7ff104016440 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(111 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.638+0000 7fefecff9640 20 handle_completion(): completion ok for obj=fourteen 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(117 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:07:50.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10])"; uploads.size()=0; is_truncated=0 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:123 4.e 4:70a79d23:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d3f00 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:124 4.3d 4:bdcd5c14:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a70 con 0x561616486de0 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:125 4.e 4:739e1ae1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4e50 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:126 4.31 4:8ca749f8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d5230 con 0x5616164823f0 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:127 4.37 4:ed038ff9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a70 con 0x7ff104016440 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:128 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4e50 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:129 4.1b 4:da8e5bf7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d5230 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:130 4.e 4:71fd8b52:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c33f0 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:131 4.b 4:d3120d2a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a70 con 0x7ff0fc105040 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:132 4.9 4:917a8be0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164c7670 con 0x5616164823f0 2024-09-13T19:07:50.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:133 4.e 4:70327617:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164dea80 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(124 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(126 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(123 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(125 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(128 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(129 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(127 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x7ff104016440 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(132 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(130 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(131 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(133 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10 [call out=85b] v0'0 uv6 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff104016440 2024-09-13T19:07:50.650 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(134 fud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff104051040 con 0x7ff104016440 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff0fc105040 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 43 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv46 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 20 rados_obj.operate() r=0 bl.length=168 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-13T19:07:50.651 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.642+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff0fc105040 2024-09-13T19:07:50.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 44 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'47 uv47 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94652863433232 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d3df0 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 45 ==== watch-notify(notify (1) cookie 94652863151712 notify 146028888082 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5616164a0500 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94652863151712 notifier 4757 bl.length()=150 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 46 ==== osd_op_reply(137 notify.3 [notify cookie 94652863433232 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7fefecff9640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefcc003d70 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 47 ==== watch-notify(notify_complete (2) cookie 94652863433232 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56161649f590 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 48 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:139 8.14 8:2cabecf5:root::.bucket.meta.myfoo7%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x561616486de0 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(139 .bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 from cache 2024-09-13T19:07:50.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10, ofs0, ns] 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.646+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94652863340656 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== watch-notify(notify (1) cookie 94652863137968 notify 146028888093 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5616164a0880 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94652863137968 notifier 4757 bl.length()=208 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(140 notify.4 [notify cookie 94652863340656 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7fefecff9640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefcc003d70 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== watch-notify(notify_complete (2) cookie 94652863340656 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56161649f760 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff104051040 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:142 4.e 4:70a79d23:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff0fc105040 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:143 4.3d 4:bdcd5c14:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x561616486de0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 4.e 4:739e1ae1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d54d0 con 0x7ff0fc105040 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:145 4.31 4:8ca749f8:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d60a0 con 0x5616164823f0 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:146 4.37 4:ed038ff9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff104016440 2024-09-13T19:07:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:147 4.1a 4:5b334100:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:148 4.1b 4:da8e5bf7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d54d0 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:149 4.e 4:71fd8b52:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d60a0 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:150 4.b 4:d3120d2a:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:151 4.9 4:917a8be0:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x5616164823f0 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:152 4.e 4:70327617:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d54d0 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(143 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.1 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(145 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.3 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x5616164823f0 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(151 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.9 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x5616164823f0 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 49 ==== osd_op_reply(142 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.0 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 50 ==== osd_op_reply(144 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.2 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.650+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(146 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.4 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.654+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 51 ==== osd_op_reply(147 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.5 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.654+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 52 ==== osd_op_reply(148 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.6 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.654+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 53 ==== osd_op_reply(150 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.8 [delete] v34'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 54 ==== osd_op_reply(149 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.7 [delete] v34'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 55 ==== osd_op_reply(152 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10.10 [delete] v34'10 uv10 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 : miss 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 20 rados->read ofs=0 len=0 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:153 6.10 6:0d2de90c:::pubsub..bucket.myfoo7%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.661 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(153 pubsub..bucket.myfoo7/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:07:50.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 info.flags=0x0 2024-09-13T19:07:50.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 10 adding default.rgw.log++pubsub..bucket.myfoo7/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 to cache LRU end 2024-09-13T19:07:50.662 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:154 6.10 6:0d2de90c:::pubsub..bucket.myfoo7%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.658+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(154 pubsub..bucket.myfoo7/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10 [delete] v34'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.662+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.662+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(155 fud.buckets [call] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.662+0000 7ff10b697980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-13T19:07:50.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.662+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-13T19:07:50.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94652863433232 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x561616486de0 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== watch-notify(notify (1) cookie 94652863147008 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5616164bdcb0 con 0x561616486de0 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94652863147008 notifier 4757 bl.length()=170 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7fefecff9640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefcc003d70 con 0x561616486de0 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(157 notify.2 [notify cookie 94652863433232 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== watch-notify(notify_complete (2) cookie 94652863433232 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561616464460 con 0x561616486de0 2024-09-13T19:07:50.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 10 removing email index: 2024-09-13T19:07:50.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 10 removing user buckets index 2024-09-13T19:07:50.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(159 fud.buckets [delete] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-13T19:07:50.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.666+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94652863433232 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d6c70 con 0x7ff104016440 2024-09-13T19:07:50.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== watch-notify(notify (1) cookie 94652863155584 notify 146028888105 ret 0) ==== 202+0+0 (crc 0 0 0) 0x56161649f760 con 0x7ff104016440 2024-09-13T19:07:50.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7fefdffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94652863155584 notifier 4757 bl.length()=160 2024-09-13T19:07:50.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7fefdffff640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fef30003310 con 0x7ff104016440 2024-09-13T19:07:50.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(160 notify.6 [notify cookie 94652863433232 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== watch-notify(notify_complete (2) cookie 94652863433232 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561616495730 con 0x7ff104016440 2024-09-13T19:07:50.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff10b697980 10 removing user index: fud 2024-09-13T19:07:50.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff104016440 2024-09-13T19:07:50.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(162 fud [call,call,delete] v34'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff10b697980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-13T19:07:50.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff10b697980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-13T19:07:50.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.670+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94652863441952 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff104016440 2024-09-13T19:07:50.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== watch-notify(notify (1) cookie 94652863149216 notify 146028888106 ret 0) ==== 194+0+0 (crc 0 0 0) 0x561616495730 con 0x7ff104016440 2024-09-13T19:07:50.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(163 notify.5 [notify cookie 94652863441952 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94652863149216 notifier 4757 bl.length()=152 2024-09-13T19:07:50.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7fefecff9640 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefcc003d70 con 0x7ff104016440 2024-09-13T19:07:50.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.677 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== watch-notify(notify_complete (2) cookie 94652863441952 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561616464690 con 0x7ff104016440 2024-09-13T19:07:50.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7fefbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:07:50.679 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.674+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94652863161744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x5616164823f0 2024-09-13T19:07:50.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94652863161744] v34'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x5616164823f0 2024-09-13T19:07:50.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94652863136816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x7ff0fc105040 2024-09-13T19:07:50.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 56 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94652863136816] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 20 remove_watcher() i=0 2024-09-13T19:07:50.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 2 removed watcher, disabling cache 2024-09-13T19:07:50.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94652863143376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x5616164823f0 2024-09-13T19:07:50.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94652863143376] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x5616164823f0 2024-09-13T19:07:50.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 20 remove_watcher() i=1 2024-09-13T19:07:50.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.678+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94652863147008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616164d4a10 con 0x561616486de0 2024-09-13T19:07:50.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff1091a7640 1 -- 172.21.15.151:0/2187365307 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94652863147008] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0fc114020 con 0x561616486de0 2024-09-13T19:07:50.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff10b697980 20 remove_watcher() i=2 2024-09-13T19:07:50.686 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94652863151712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648ddd0 con 0x7ff0fc105040 2024-09-13T19:07:50.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff1089a6640 1 -- 172.21.15.151:0/2187365307 <== osd.2 v2:172.21.15.151:6808/3546065622 57 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94652863151712] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10000e6c0 con 0x7ff0fc105040 2024-09-13T19:07:50.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff10b697980 20 remove_watcher() i=3 2024-09-13T19:07:50.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.682+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94652863137968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648fe60 con 0x5616164823f0 2024-09-13T19:07:50.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.686+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94652863137968] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x5616164823f0 2024-09-13T19:07:50.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.686+0000 7ff10b697980 20 remove_watcher() i=4 2024-09-13T19:07:50.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.686+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94652863149216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648ddd0 con 0x7ff104016440 2024-09-13T19:07:50.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94652863149216] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff10b697980 20 remove_watcher() i=5 2024-09-13T19:07:50.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94652863155584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648fe60 con 0x7ff104016440 2024-09-13T19:07:50.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94652863155584] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff10b697980 20 remove_watcher() i=6 2024-09-13T19:07:50.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.690+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94652863159152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56161648ddd0 con 0x7ff104016440 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94652863159152] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10405a040 con 0x7ff104016440 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 20 remove_watcher() i=7 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff104016440 msgr2=0x7ff1040168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff104016440 0x7ff1040168c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5616164823f0 msgr2=0x5616164848b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5616164823f0 0x5616164848b0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff0fc105040 msgr2=0x7ff0fc0f6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff0fc105040 0x7ff0fc0f6920 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561616486de0 msgr2=0x5616164891d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561616486de0 0x5616164891d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefd40346a0 msgr2=0x7fefd4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefd40346a0 0x7fefd4036b60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff10000c010 tx=0x7ff100010000 comp rx=0 tx=0).stop 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 msgr2=0x561616477480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0c1f00 tx=0x7ff0fc002ec0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff1099a8640 1 -- 172.21.15.151:0/2187365307 reap_dead start 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 shutdown_connections 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2187365307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616470390 0x561616477480 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 >> 172.21.15.151:0/2187365307 conn(0x56161646c7c0 msgr2=0x56161646a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 shutdown_connections 2024-09-13T19:07:50.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2187365307 wait complete. 2024-09-13T19:07:50.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 msgr2=0x7fefe0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 0x7fefe0036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x56161644d760 tx=0x7ff10000f000 comp rx=0 tx=0).stop 2024-09-13T19:07:50.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 msgr2=0x561616463f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc0e3140 tx=0x7ff0fc0aafc0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 shutdown_connections 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fefe0034650 0x7fefe0036b10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/738050689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561616463b00 0x561616463f20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 >> 172.21.15.151:0/738050689 conn(0x561616458c50 msgr2=0x56161645b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 shutdown_connections 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/738050689 wait complete. 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561616354240 msgr2=0x56161644cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561616354240 0x56161644cd50 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561616453500 msgr2=0x5616164558f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561616453500 0x5616164558f0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56161644f5c0 msgr2=0x5616164519b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56161644f5c0 0x5616164519b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feff0034600 msgr2=0x7feff0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7feff0034600 0x7feff0036ac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff100000f70 tx=0x7ff1000010b0 comp rx=0 tx=0).stop 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 msgr2=0x561616445c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 --2- 172.21.15.151:0/2567532771 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5616163538f0 0x561616445c50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc01bb20 tx=0x7ff0fc018020 comp rx=0 tx=0).stop 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff1099a8640 1 -- 172.21.15.151:0/2567532771 reap_dead start 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 shutdown_connections 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 >> 172.21.15.151:0/2567532771 conn(0x5616162c7240 msgr2=0x561616439190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 shutdown_connections 2024-09-13T19:07:50.703 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:07:50.694+0000 7ff10b697980 1 -- 172.21.15.151:0/2567532771 wait complete. 2024-09-13T19:08:30.715 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-13T19:08:30.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-13T19:08:30.716 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-13T19:08:30.755 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:30.755 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:30.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.748+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.748+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.748+0000 7fe81a111980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56113d3ef8f0 0x56113d3f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.756 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.748+0000 7fe81a111980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56113d274ae0 con 0x56113d3eb570 2024-09-13T19:08:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.748+0000 7fe81a111980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56113d298e30 con 0x56113d3ef8f0 2024-09-13T19:08:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56113d3ef8f0 0x56113d3f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56113d3ef8f0 0x56113d3f1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58236/0 (socket says 172.21.15.151:58236) 2024-09-13T19:08:30.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 -- 172.21.15.151:0/2232522042 learned_addr learned my addr 172.21.15.151:0/2232522042 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817c21640 1 --1- 172.21.15.151:0/2232522042 >> v1:172.21.15.12:6789/0 conn(0x56113d3eb570 0x56113d3eb950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39692/0 (socket says 172.21.15.151:39692) 2024-09-13T19:08:30.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 -- 172.21.15.151:0/2232522042 >> v1:172.21.15.12:6789/0 conn(0x56113d3eb570 legacy=0x56113d3eb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 -- 172.21.15.151:0/2232522042 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d3f3230 con 0x56113d3ef8f0 2024-09-13T19:08:30.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe816c1f640 1 -- 172.21.15.151:0/2232522042 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423438132 0 0) 0x56113d274ae0 con 0x56113d3eb570 2024-09-13T19:08:30.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe817420640 1 --2- 172.21.15.151:0/2232522042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3ef8f0 0x56113d3f1ce0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00a5c0 tx=0x7fe80c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1615ddaf92fa9fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe816c1f640 1 -- 172.21.15.151:0/2232522042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe80c0a6070 con 0x56113d3ef8f0 2024-09-13T19:08:30.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe816c1f640 1 -- 172.21.15.151:0/2232522042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c0af070 con 0x56113d3ef8f0 2024-09-13T19:08:30.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.752+0000 7fe816c1f640 1 -- 172.21.15.151:0/2232522042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe80c0aa5c0 con 0x56113d3ef8f0 2024-09-13T19:08:30.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 -- 172.21.15.151:0/2232522042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3ef8f0 msgr2=0x56113d3f1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 --2- 172.21.15.151:0/2232522042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3ef8f0 0x56113d3f1ce0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe80c00a5c0 tx=0x7fe80c01b340 comp rx=0 tx=0).stop 2024-09-13T19:08:30.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 -- 172.21.15.151:0/2232522042 shutdown_connections 2024-09-13T19:08:30.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 --2- 172.21.15.151:0/2232522042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3ef8f0 0x56113d3f1ce0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 -- 172.21.15.151:0/2232522042 >> 172.21.15.151:0/2232522042 conn(0x56113d3e7090 msgr2=0x56113d3e94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 -- 172.21.15.151:0/2232522042 shutdown_connections 2024-09-13T19:08:30.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.756+0000 7fe81a111980 1 -- 172.21.15.151:0/2232522042 wait complete. 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113d29a200 con 0x56113d3eb570 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58238/0 (socket says 172.21.15.151:58238) 2024-09-13T19:08:30.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 -- 172.21.15.151:0/3309841301 learned_addr learned my addr 172.21.15.151:0/3309841301 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 -- 172.21.15.151:0/3309841301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d4d5ba0 con 0x56113d3eb570 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 --2- 172.21.15.151:0/3309841301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe8080016c0 tx=0x7fe808001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6277d1cfc704959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe705e0b640 1 -- 172.21.15.151:0/3309841301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808003460 con 0x56113d3eb570 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe705e0b640 1 -- 172.21.15.151:0/3309841301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808003600 con 0x56113d3eb570 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe705e0b640 1 -- 172.21.15.151:0/3309841301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808003920 con 0x56113d3eb570 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- 172.21.15.151:0/3309841301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 msgr2=0x56113d4d55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 --2- 172.21.15.151:0/3309841301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe8080016c0 tx=0x7fe808001b80 comp rx=0 tx=0).stop 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- 172.21.15.151:0/3309841301 shutdown_connections 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 --2- 172.21.15.151:0/3309841301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4d55d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- 172.21.15.151:0/3309841301 >> 172.21.15.151:0/3309841301 conn(0x56113d3e7090 msgr2=0x56113d4d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- 172.21.15.151:0/3309841301 shutdown_connections 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- 172.21.15.151:0/3309841301 wait complete. 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4dc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe81a111980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113d3f2d30 con 0x56113d3eb570 2024-09-13T19:08:30.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4dc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58252/0 (socket says 172.21.15.151:58252) 2024-09-13T19:08:30.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.772+0000 7fe817c21640 1 -- 172.21.15.151:0/3172046775 learned_addr learned my addr 172.21.15.151:0/3172046775 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe817c21640 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d4dced0 con 0x56113d3eb570 2024-09-13T19:08:30.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe817c21640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4dc990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe8080012f0 tx=0x7fe808001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 -- 172.21.15.151:0/3172046775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808013760 con 0x56113d3eb570 2024-09-13T19:08:30.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56113d4dd160 con 0x56113d3eb570 2024-09-13T19:08:30.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 -- 172.21.15.151:0/3172046775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808023070 con 0x56113d3eb570 2024-09-13T19:08:30.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 -- 172.21.15.151:0/3172046775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808013a30 con 0x56113d3eb570 2024-09-13T19:08:30.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113d4dfe40 con 0x56113d3eb570 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 -- 172.21.15.151:0/3172046775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe808010070 con 0x56113d3eb570 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe700034650 0x7fe700036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe6fffff640 1 -- 172.21.15.151:0/3172046775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe808049cf0 con 0x56113d3eb570 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe817420640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe700034650 0x7fe700036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d3ef8f0 0x56113d4e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d4e4010 con 0x56113d3ef8f0 2024-09-13T19:08:30.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe818422640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d3ef8f0 0x56113d4e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe817420640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe700034650 0x7fe700036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe818422640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d3ef8f0 0x56113d4e3a90 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe818422640 1 -- 172.21.15.151:0/3172046775 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d3ef8f0 2024-09-13T19:08:30.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.776+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d4e1060 con 0x56113d3ef8f0 2024-09-13T19:08:30.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe818422640 1 -- 172.21.15.151:0/3172046775 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d3ef8f0 2024-09-13T19:08:30.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d4e6390 0x56113d4e8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d4e8e50 con 0x56113d4e6390 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d4e6390 0x56113d4e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d4e6390 0x56113d4e8780 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 -- 172.21.15.151:0/3172046775 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe80800f030 con 0x56113d4e6390 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d4e5230 con 0x56113d3ef8f0 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe818422640 1 -- 172.21.15.151:0/3172046775 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d3ef8f0 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56113d4ea2b0 0x56113d4ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d4ecda0 con 0x56113d4ea2b0 2024-09-13T19:08:30.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817420640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56113d4ea2b0 0x56113d4ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817420640 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56113d4ea2b0 0x56113d4ec6a0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817420640 1 -- 172.21.15.151:0/3172046775 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe80c0aa9e0 con 0x56113d4ea2b0 2024-09-13T19:08:30.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe81a111980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113d2f3800 con 0x56113d4fa830 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58260/0 (socket says 172.21.15.151:58260) 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 -- 172.21.15.151:0/1997976754 learned_addr learned my addr 172.21.15.151:0/1997976754 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.780+0000 7fe817c21640 1 -- 172.21.15.151:0/1997976754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d4fb190 con 0x56113d4fa830 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe808047fe0 tx=0x7fe808011600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 -- 172.21.15.151:0/1997976754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808041120 con 0x56113d4fa830 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 -- 172.21.15.151:0/1997976754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808019040 con 0x56113d4fa830 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 -- 172.21.15.151:0/1997976754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808041430 con 0x56113d4fa830 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56113d4fb420 con 0x56113d4fa830 2024-09-13T19:08:30.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113d4fe0a0 con 0x56113d4fa830 2024-09-13T19:08:30.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 -- 172.21.15.151:0/1997976754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe808041820 con 0x56113d4fa830 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 0x7fe6f0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6fd7fa640 1 -- 172.21.15.151:0/1997976754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe80804c980 con 0x56113d4fa830 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817420640 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 0x7fe6f0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817420640 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 0x7fe6f0036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x56113d4e4940 tx=0x7fe80c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe81a111980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113d4d5f20 con 0x56113d50b790 2024-09-13T19:08:30.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58270/0 (socket says 172.21.15.151:58270) 2024-09-13T19:08:30.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 -- 172.21.15.151:0/882024598 learned_addr learned my addr 172.21.15.151:0/882024598 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 -- 172.21.15.151:0/882024598 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d50c160 con 0x56113d50b790 2024-09-13T19:08:30.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe817c21640 1 --2- 172.21.15.151:0/882024598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe808027530 tx=0x7fe808033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebca7614c32ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6f6ffd640 1 -- 172.21.15.151:0/882024598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808063070 con 0x56113d50b790 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6f6ffd640 1 -- 172.21.15.151:0/882024598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe808004d30 con 0x56113d50b790 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.784+0000 7fe6f6ffd640 1 -- 172.21.15.151:0/882024598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe80801dbb0 con 0x56113d50b790 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/882024598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 msgr2=0x56113d50bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 --2- 172.21.15.151:0/882024598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe808027530 tx=0x7fe808033c90 comp rx=0 tx=0).stop 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/882024598 shutdown_connections 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 --2- 172.21.15.151:0/882024598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d50bb90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/882024598 >> 172.21.15.151:0/882024598 conn(0x56113d503710 msgr2=0x56113d501810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/882024598 shutdown_connections 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/882024598 wait complete. 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 Processor -- start 2024-09-13T19:08:30.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- start start 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56113d50c6b0 con 0x56113d50b790 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe817c21640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58282/0 (socket says 172.21.15.151:58282) 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 learned_addr learned my addr 172.21.15.151:0/2243098253 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d512f00 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe817c21640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe808027530 tx=0x7fe808004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe6f57fa640 1 -- 172.21.15.151:0/2243098253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe80806d020 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe6f57fa640 1 -- 172.21.15.151:0/2243098253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80803e800 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56113d512f00 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe6f57fa640 1 -- 172.21.15.151:0/2243098253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808063040 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113d513370 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.788+0000 7fe6f57fa640 1 -- 172.21.15.151:0/2243098253 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe808070020 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe6f57fa640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6e00346a0 0x7fe6e0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe6f57fa640 1 -- 172.21.15.151:0/2243098253 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe80805b070 con 0x56113d50b790 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817420640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6e00346a0 0x7fe6e0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d51d990 0x56113d51fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d5205a0 con 0x56113d51d990 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d51d990 0x56113d51fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817420640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6e00346a0 0x7fe6e0036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0c8fd0 tx=0x7fe80c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d51d990 0x56113d51fe50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 realm 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d5209b0 con 0x56113d51d990 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d521280 con 0x56113d51d990 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d522380 0x56113d524770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d524d80 con 0x56113d522380 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d522380 0x56113d524770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d522380 0x56113d524770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:30.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 20 searching for the correct realm 2024-09-13T19:08:30.803 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d526650 con 0x56113d522380 2024-09-13T19:08:30.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe808072020 0x7fe808012700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d526650 con 0x7fe808072020 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817420640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe808072020 0x7fe808012700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.792+0000 7fe817420640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe808072020 0x7fe808012700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe80c0df040 con 0x7fe808072020 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d526650 con 0x7fe808072020 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe80c0df040 con 0x7fe808072020 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d526650 con 0x56113d51d990 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe810018410 0x7fe810018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe810018410 0x7fe810018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe810018410 0x7fe810018890 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x7fe810018410 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x7fe810018410 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe808072020 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe80c0df040 con 0x7fe808072020 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.796+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x7fe810018410 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe808072020 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe80c0df040 con 0x7fe808072020 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x7fe810018410 2024-09-13T19:08:30.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.800+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x7fe810018410 2024-09-13T19:08:30.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe808072020 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe80c0df040 con 0x7fe808072020 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe8100083f0 con 0x56113d51d990 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.804+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe808072020 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d522380 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x7fe810018410 2024-09-13T19:08:30.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56113d521620 con 0x56113d51d990 2024-09-13T19:08:30.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe81003b040 con 0x7fe808072020 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d525640 con 0x56113d51d990 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d525a30 con 0x56113d51d990 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d525a30 con 0x7fe808072020 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 zone default found 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 4 Realm: () 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 zonegroup default 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d526300 con 0x7fe810018410 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d526300 con 0x56113d522380 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.808+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d528460 con 0x56113d522380 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 20 started sync module instance, tier type = 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:30.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d525f10 con 0x7fe808072020 2024-09-13T19:08:30.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632043248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d528870 con 0x7fe808072020 2024-09-13T19:08:30.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d529390 con 0x56113d51d990 2024-09-13T19:08:30.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.812+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632043248080] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632043253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d529780 con 0x56113d51d990 2024-09-13T19:08:30.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52a140 con 0x56113d522380 2024-09-13T19:08:30.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632043253344] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632043249360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52a140 con 0x56113d522380 2024-09-13T19:08:30.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.816+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52ab00 con 0x7fe808072020 2024-09-13T19:08:30.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632043259472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52b350 con 0x7fe808072020 2024-09-13T19:08:30.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52bd70 con 0x56113d51d990 2024-09-13T19:08:30.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632043249360] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632043259472] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632043261600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d529c90 con 0x56113d51d990 2024-09-13T19:08:30.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.820+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52c610 con 0x7fe810018410 2024-09-13T19:08:30.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632043261600] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632043264096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52c610 con 0x7fe810018410 2024-09-13T19:08:30.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52cea0 con 0x7fe810018410 2024-09-13T19:08:30.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632043264096] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.824+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632043266880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52cd50 con 0x7fe810018410 2024-09-13T19:08:30.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52d850 con 0x7fe810018410 2024-09-13T19:08:30.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632043266880] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632043270976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52d810 con 0x7fe810018410 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=0 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=1 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=2 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=3 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=4 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=5 2024-09-13T19:08:30.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.828+0000 7fe81a111980 20 add_watcher() i=6 2024-09-13T19:08:30.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632043270976] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 add_watcher() i=7 2024-09-13T19:08:30.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:30.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d530cd0 con 0x56113d51d990 2024-09-13T19:08:30.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632043268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d52e1f0 con 0x56113d51d990 2024-09-13T19:08:30.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632043268000] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe6cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:30.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:30.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:30.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 5 note: GC not initialized 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe6ccfe1640 20 reqs_thread_entry: start 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 Filter name: none 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe6467fc640 20 reqs_thread_entry: start 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 rados->read ofs=0 len=0 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56113d554340 con 0x56113d51d990 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:08:30.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:08:30.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:08:30.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:30.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.832+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe810018410 2024-09-13T19:08:30.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.836+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.836+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe810018410 2024-09-13T19:08:30.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.840+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.840+0000 7fe6cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:30.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.840+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632043268000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x56113d51d990 2024-09-13T19:08:30.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.840+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94632043268000] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.840+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632043248080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe808072020 2024-09-13T19:08:30.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94632043248080] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe81a111980 20 remove_watcher() i=0 2024-09-13T19:08:30.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe81a111980 2 removed watcher, disabling cache 2024-09-13T19:08:30.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632043253344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x56113d51d990 2024-09-13T19:08:30.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94632043253344] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe81a111980 20 remove_watcher() i=1 2024-09-13T19:08:30.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.844+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632043249360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x56113d522380 2024-09-13T19:08:30.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe817c21640 1 -- 172.21.15.151:0/2243098253 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94632043249360] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808052070 con 0x56113d522380 2024-09-13T19:08:30.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe81a111980 20 remove_watcher() i=2 2024-09-13T19:08:30.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632043259472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe808072020 2024-09-13T19:08:30.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe817420640 1 -- 172.21.15.151:0/2243098253 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94632043259472] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe80c0e8040 con 0x7fe808072020 2024-09-13T19:08:30.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe81a111980 20 remove_watcher() i=3 2024-09-13T19:08:30.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.848+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632043261600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x56113d51d990 2024-09-13T19:08:30.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94632043261600] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x56113d51d990 2024-09-13T19:08:30.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe81a111980 20 remove_watcher() i=4 2024-09-13T19:08:30.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632043264096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe810018410 2024-09-13T19:08:30.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94632043264096] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe81a111980 20 remove_watcher() i=5 2024-09-13T19:08:30.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.852+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632043266880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe810018410 2024-09-13T19:08:30.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94632043266880] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 20 remove_watcher() i=6 2024-09-13T19:08:30.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632043270976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56113d553e20 con 0x7fe810018410 2024-09-13T19:08:30.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94632043270976] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810036040 con 0x7fe810018410 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 20 remove_watcher() i=7 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe810018410 msgr2=0x7fe810018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe810018410 0x7fe810018890 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d51d990 msgr2=0x56113d51fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d51d990 0x56113d51fe50 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe808072020 msgr2=0x7fe808012700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe808072020 0x7fe808012700 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d522380 msgr2=0x56113d524770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d522380 0x56113d524770 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6e00346a0 msgr2=0x7fe6e0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6e00346a0 0x7fe6e0036b60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0c8fd0 tx=0x7fe80c0c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 msgr2=0x56113d5129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe818422640 1 -- 172.21.15.151:0/2243098253 reap_dead start 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe808027530 tx=0x7fe808004b80 comp rx=0 tx=0).stop 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 shutdown_connections 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 --2- 172.21.15.151:0/2243098253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d50b790 0x56113d5129c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.856+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 >> 172.21.15.151:0/2243098253 conn(0x56113d503710 msgr2=0x56113d5017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 shutdown_connections 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/2243098253 wait complete. 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 msgr2=0x7fe6f0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 0x7fe6f0036b10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x56113d4e4940 tx=0x7fe80c005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 msgr2=0x56113d4fac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe808047fe0 tx=0x7fe808011600 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 shutdown_connections 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe6f0034650 0x7fe6f0036b10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/1997976754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d4fa830 0x56113d4fac50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 >> 172.21.15.151:0/1997976754 conn(0x56113d4ef980 msgr2=0x56113d4f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 shutdown_connections 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/1997976754 wait complete. 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d3ef8f0 msgr2=0x56113d4e3a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56113d3ef8f0 0x56113d4e3a90 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56113d4ea2b0 msgr2=0x56113d4ec6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56113d4ea2b0 0x56113d4ec6a0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d4e6390 msgr2=0x56113d4e8780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56113d4e6390 0x56113d4e8780 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe700034650 msgr2=0x7fe700036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe700034650 0x7fe700036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0ae000 tx=0x7fe80c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 msgr2=0x56113d4dc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 --2- 172.21.15.151:0/3172046775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56113d3eb570 0x56113d4dc990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe8080012f0 tx=0x7fe808001260 comp rx=0 tx=0).stop 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe818422640 1 -- 172.21.15.151:0/3172046775 reap_dead start 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 shutdown_connections 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 >> 172.21.15.151:0/3172046775 conn(0x56113d3e7090 msgr2=0x56113d4cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 shutdown_connections 2024-09-13T19:08:30.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.860+0000 7fe81a111980 1 -- 172.21.15.151:0/3172046775 wait complete. 2024-09-13T19:08:30.878 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-13T19:08:30.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-13T19:08:30.878 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-13T19:08:30.961 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:30.961 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:30.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:30.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:30.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2674c62980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b0da0d3290 0x55b0da1613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2674c62980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b0d9fe6ae0 con 0x55b0da1618e0 2024-09-13T19:08:30.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2674c62980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55b0da00ae30 con 0x55b0da0d3290 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2672772640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b0da0d3290 0x55b0da1613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2671f71640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55b0da1618e0 0x55b0da163cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39696/0 (socket says 172.21.15.151:39696) 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2672772640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55b0da0d3290 0x55b0da1613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58286/0 (socket says 172.21.15.151:58286) 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2671f71640 1 -- 172.21.15.151:0/744863960 learned_addr learned my addr 172.21.15.151:0/744863960 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2672772640 1 -- 172.21.15.151:0/744863960 >> v1:172.21.15.12:6789/0 conn(0x55b0da1618e0 legacy=0x55b0da163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.956+0000 7f2672772640 1 -- 172.21.15.151:0/744863960 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da0d3820 con 0x55b0da0d3290 2024-09-13T19:08:30.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2672772640 1 --2- 172.21.15.151:0/744863960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da1613a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a420 tx=0x7f266c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7692696a3245ba28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2671770640 1 -- 172.21.15.151:0/744863960 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0af070 con 0x55b0da0d3290 2024-09-13T19:08:30.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2671770640 1 -- 172.21.15.151:0/744863960 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0aa530 con 0x55b0da0d3290 2024-09-13T19:08:30.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2671770640 1 -- 172.21.15.151:0/744863960 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0aa850 con 0x55b0da0d3290 2024-09-13T19:08:30.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 -- 172.21.15.151:0/744863960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 msgr2=0x55b0da1613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 --2- 172.21.15.151:0/744863960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da1613a0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a420 tx=0x7f266c01afd0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 -- 172.21.15.151:0/744863960 shutdown_connections 2024-09-13T19:08:30.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 --2- 172.21.15.151:0/744863960 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da1613a0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 -- 172.21.15.151:0/744863960 >> 172.21.15.151:0/744863960 conn(0x55b0da159090 msgr2=0x55b0da15b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 -- 172.21.15.151:0/744863960 shutdown_connections 2024-09-13T19:08:30.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.960+0000 7f2674c62980 1 -- 172.21.15.151:0/744863960 wait complete. 2024-09-13T19:08:30.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:30.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:30.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2674c62980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2674c62980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0da00c200 con 0x55b0da0d3290 2024-09-13T19:08:30.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58288/0 (socket says 172.21.15.151:58288) 2024-09-13T19:08:30.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2672772640 1 -- 172.21.15.151:0/3718718024 learned_addr learned my addr 172.21.15.151:0/3718718024 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2672772640 1 -- 172.21.15.151:0/3718718024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da249f90 con 0x55b0da0d3290 2024-09-13T19:08:30.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2672772640 1 --2- 172.21.15.151:0/3718718024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a420 tx=0x7f266c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead8fbf0eba9aeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.976+0000 7f2560608640 1 -- 172.21.15.151:0/3718718024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0af050 con 0x55b0da0d3290 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2560608640 1 -- 172.21.15.151:0/3718718024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0b0040 con 0x55b0da0d3290 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2560608640 1 -- 172.21.15.151:0/3718718024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0aac60 con 0x55b0da0d3290 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/3718718024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 msgr2=0x55b0da2499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 --2- 172.21.15.151:0/3718718024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f266c00a420 tx=0x7f266c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/3718718024 shutdown_connections 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 --2- 172.21.15.151:0/3718718024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da2499c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:30.986 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/3718718024 >> 172.21.15.151:0/3718718024 conn(0x55b0da159090 msgr2=0x55b0da2455f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:30.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/3718718024 shutdown_connections 2024-09-13T19:08:30.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/3718718024 wait complete. 2024-09-13T19:08:30.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:30.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:30.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0da165f00 con 0x55b0da0d3290 2024-09-13T19:08:30.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58294/0 (socket says 172.21.15.151:58294) 2024-09-13T19:08:30.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2672772640 1 -- 172.21.15.151:0/2980192025 learned_addr learned my addr 172.21.15.151:0/2980192025 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2672772640 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da15f1a0 con 0x55b0da0d3290 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2672772640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da15ec60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f266c01b870 tx=0x7f266c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f255ee05640 1 -- 172.21.15.151:0/2980192025 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0c5020 con 0x55b0da0d3290 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0da15d380 con 0x55b0da0d3290 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f255ee05640 1 -- 172.21.15.151:0/2980192025 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0b6cb0 con 0x55b0da0d3290 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f255ee05640 1 -- 172.21.15.151:0/2980192025 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0c1480 con 0x55b0da0d3290 2024-09-13T19:08:30.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.980+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0da15d8d0 con 0x55b0da0d3290 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f255ee05640 1 -- 172.21.15.151:0/2980192025 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f266c0c8070 con 0x55b0da0d3290 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f255ee05640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2558034650 0x7f2558036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f255ee05640 1 -- 172.21.15.151:0/2980192025 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f266c0bb070 con 0x55b0da0d3290 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2671f71640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2558034650 0x7f2558036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da1618e0 0x55b0da25a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da25a550 con 0x55b0da1618e0 2024-09-13T19:08:30.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672f73640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da1618e0 0x55b0da25a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2671f71640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2558034650 0x7f2558036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2668001da0 tx=0x7f2668001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672f73640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da1618e0 0x55b0da25a010 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672f73640 1 -- 172.21.15.151:0/2980192025 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da1618e0 2024-09-13T19:08:30.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da25a980 con 0x55b0da1618e0 2024-09-13T19:08:30.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672f73640 1 -- 172.21.15.151:0/2980192025 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da1618e0 2024-09-13T19:08:30.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da25c790 0x55b0da25eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da25f250 con 0x55b0da25c790 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672772640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da25c790 0x55b0da25eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672772640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da25c790 0x55b0da25eb80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672772640 1 -- 172.21.15.151:0/2980192025 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f266c0c7030 con 0x55b0da25c790 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da25b630 con 0x55b0da1618e0 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2672f73640 1 -- 172.21.15.151:0/2980192025 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da1618e0 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b0da260690 0x55b0da262a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2631f0 con 0x55b0da260690 2024-09-13T19:08:30.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2671f71640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b0da260690 0x55b0da262a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.984+0000 7f2671f71640 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b0da260690 0x55b0da262a80 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2671f71640 1 -- 172.21.15.151:0/2980192025 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f266800e6c0 con 0x55b0da260690 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0da065800 con 0x55b0da270c80 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58296/0 (socket says 172.21.15.151:58296) 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2672772640 1 -- 172.21.15.151:0/399280888 learned_addr learned my addr 172.21.15.151:0/399280888 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2672772640 1 -- 172.21.15.151:0/399280888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da2715e0 con 0x55b0da270c80 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2672772640 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f266c0b8010 tx=0x7f266c0e2e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 -- 172.21.15.151:0/399280888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0054a0 con 0x55b0da270c80 2024-09-13T19:08:30.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 -- 172.21.15.151:0/399280888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0e4050 con 0x55b0da270c80 2024-09-13T19:08:30.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0da271870 con 0x55b0da270c80 2024-09-13T19:08:30.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 -- 172.21.15.151:0/399280888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0e4330 con 0x55b0da270c80 2024-09-13T19:08:30.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0da2744f0 con 0x55b0da270c80 2024-09-13T19:08:30.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 -- 172.21.15.151:0/399280888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f266c0e11a0 con 0x55b0da270c80 2024-09-13T19:08:30.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 0x7f254c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2557fff640 1 -- 172.21.15.151:0/399280888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f266c0de050 con 0x55b0da270c80 2024-09-13T19:08:30.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.988+0000 7f2671f71640 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 0x7f254c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2671f71640 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 0x7f254c036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55b0da2635f0 tx=0x7f266800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0da24a250 con 0x55b0da27d640 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58312/0 (socket says 172.21.15.151:58312) 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 -- 172.21.15.151:0/575426096 learned_addr learned my addr 172.21.15.151:0/575426096 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 -- 172.21.15.151:0/575426096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da27dff0 con 0x55b0da27d640 2024-09-13T19:08:30.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 --2- 172.21.15.151:0/575426096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f266c0dc790 tx=0x7f266c0c8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b359c1c2c68ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2555ffb640 1 -- 172.21.15.151:0/575426096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0e15c0 con 0x55b0da27d640 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2555ffb640 1 -- 172.21.15.151:0/575426096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0ba1d0 con 0x55b0da27d640 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2555ffb640 1 -- 172.21.15.151:0/575426096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0bf980 con 0x55b0da27d640 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- 172.21.15.151:0/575426096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 msgr2=0x55b0da27da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 --2- 172.21.15.151:0/575426096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f266c0dc790 tx=0x7f266c0c8f20 comp rx=0 tx=0).stop 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- 172.21.15.151:0/575426096 shutdown_connections 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 --2- 172.21.15.151:0/575426096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da27da20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- 172.21.15.151:0/575426096 >> 172.21.15.151:0/575426096 conn(0x55b0da279a20 msgr2=0x55b0da277b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- 172.21.15.151:0/575426096 shutdown_connections 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- 172.21.15.151:0/575426096 wait complete. 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 Processor -- start 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- start start 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da284780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2674c62980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0da27e490 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da284780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da284780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58324/0 (socket says 172.21.15.151:58324) 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.992+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 learned_addr learned my addr 172.21.15.151:0/1210863712 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0da284cc0 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672772640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da284780 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f266c0f0040 tx=0x7f266c0d7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 -- 172.21.15.151:0/1210863712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0fd040 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 -- 172.21.15.151:0/1210863712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c0e49d0 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0da284cc0 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 -- 172.21.15.151:0/1210863712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f266c0e4cb0 con 0x55b0da27d640 2024-09-13T19:08:31.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0da284cc0 con 0x55b0da27d640 2024-09-13T19:08:31.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 -- 172.21.15.151:0/1210863712 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f266c10a020 con 0x55b0da27d640 2024-09-13T19:08:31.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f253c034650 0x7f253c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2543fff640 1 -- 172.21.15.151:0/1210863712 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f266c108020 con 0x55b0da27d640 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2671f71640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f253c034650 0x7f253c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da28f850 0x55b0da291d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da292460 con 0x55b0da28f850 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672f73640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da28f850 0x55b0da291d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2671f71640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f253c034650 0x7f253c036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f266800bb60 tx=0x7f2668010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672f73640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da28f850 0x55b0da291d10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 realm 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da292870 con 0x55b0da28f850 2024-09-13T19:08:31.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da293110 con 0x55b0da28f850 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:30.996+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da294210 0x55b0da296600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da296b80 con 0x55b0da294210 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da294210 0x55b0da296600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da294210 0x55b0da296600 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 20 searching for the correct realm 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2983e0 con 0x55b0da294210 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f266c0d4030 0x7f266c0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2983e0 con 0x7f266c0d4030 2024-09-13T19:08:31.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f266c0d4030 0x7f266c0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f266c0d4030 0x7f266c0b5870 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266800e6c0 con 0x7f266c0d4030 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2983e0 con 0x7f266c0d4030 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266800e6c0 con 0x7f266c0d4030 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2983e0 con 0x55b0da28f850 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2664008790 0x7f2664018410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.000+0000 7f2672f73640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2664008790 0x7f2664018410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2664008790 0x7f2664018410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x7f2664008790 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x7f2664008790 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f266c0d4030 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f266800e6c0 con 0x7f266c0d4030 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x7f2664008790 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f266c0d4030 2024-09-13T19:08:31.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f266800e6c0 con 0x7f266c0d4030 2024-09-13T19:08:31.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.004+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x7f2664008790 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x7f2664008790 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f266c0d4030 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266800e6c0 con 0x7f266c0d4030 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26640083f0 con 0x55b0da28f850 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.008+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.019 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f266c0d4030 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da294210 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x7f2664008790 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2934b0 con 0x55b0da28f850 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f266403b040 con 0x7f266c0d4030 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:31.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.012+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2973d0 con 0x55b0da28f850 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2977c0 con 0x55b0da28f850 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2977c0 con 0x7f266c0d4030 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 zone default found 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 4 Realm: () 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 zonegroup default 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da298090 con 0x7f2664008790 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da298090 con 0x55b0da294210 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29a260 con 0x55b0da294210 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 started sync module instance, tier type = 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:31.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299700 con 0x7f266c0d4030 2024-09-13T19:08:31.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218062764784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29aab0 con 0x7f266c0d4030 2024-09-13T19:08:31.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.016+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29b300 con 0x55b0da28f850 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.020+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218062764784] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.020+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.020+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218062767616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29b340 con 0x55b0da28f850 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.020+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29be30 con 0x55b0da294210 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.020+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218062767616] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218062772480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29c220 con 0x55b0da294210 2024-09-13T19:08:31.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29cbe0 con 0x7f266c0d4030 2024-09-13T19:08:31.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218062776112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29d480 con 0x7f266c0d4030 2024-09-13T19:08:31.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29de80 con 0x55b0da28f850 2024-09-13T19:08:31.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218062772480] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218062776112] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218062778320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29d990 con 0x55b0da28f850 2024-09-13T19:08:31.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.024+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29e240 con 0x7f2664008790 2024-09-13T19:08:31.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.028+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218062778320] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.028+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.028+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218062769744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29de40 con 0x7f2664008790 2024-09-13T19:08:31.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.028+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29eb70 con 0x7f2664008790 2024-09-13T19:08:31.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218062769744] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218062780816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29ddb0 con 0x7f2664008790 2024-09-13T19:08:31.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29ddb0 con 0x7f2664008790 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218062780816] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218062785328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29f600 con 0x7f2664008790 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=0 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=1 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=2 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=3 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=4 2024-09-13T19:08:31.040 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=5 2024-09-13T19:08:31.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.032+0000 7f2674c62980 20 add_watcher() i=6 2024-09-13T19:08:31.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218062785328] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 add_watcher() i=7 2024-09-13T19:08:31.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:31.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2a2a00 con 0x55b0da28f850 2024-09-13T19:08:31.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218062787360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29ff20 con 0x55b0da28f850 2024-09-13T19:08:31.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218062787360] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 5 note: GC not initialized 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f24a37fe640 20 reqs_thread_entry: start 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 Filter name: none 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f24a17fa640 20 reqs_thread_entry: start 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.036+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2c5bb0 con 0x55b0da28f850 2024-09-13T19:08:31.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2674c62980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:08:31.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b0da2c7100 con 0x7f2664008790 2024-09-13T19:08:31.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218062787360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da289850 con 0x55b0da28f850 2024-09-13T19:08:31.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94218062787360] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.048 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.040+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218062764784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29f2f0 con 0x7f266c0d4030 2024-09-13T19:08:31.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94218062764784] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.049 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2674c62980 20 remove_watcher() i=0 2024-09-13T19:08:31.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2674c62980 2 removed watcher, disabling cache 2024-09-13T19:08:31.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218062767616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x55b0da28f850 2024-09-13T19:08:31.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94218062767616] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2674c62980 20 remove_watcher() i=1 2024-09-13T19:08:31.051 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.044+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218062772480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x55b0da294210 2024-09-13T19:08:31.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2672772640 1 -- 172.21.15.151:0/1210863712 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94218062772480] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f266c0eb070 con 0x55b0da294210 2024-09-13T19:08:31.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2674c62980 20 remove_watcher() i=2 2024-09-13T19:08:31.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218062776112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x7f266c0d4030 2024-09-13T19:08:31.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2671f71640 1 -- 172.21.15.151:0/1210863712 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94218062776112] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2668041040 con 0x7f266c0d4030 2024-09-13T19:08:31.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2674c62980 20 remove_watcher() i=3 2024-09-13T19:08:31.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.048+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218062778320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x55b0da28f850 2024-09-13T19:08:31.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94218062778320] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x55b0da28f850 2024-09-13T19:08:31.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2674c62980 20 remove_watcher() i=4 2024-09-13T19:08:31.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218062769744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x7f2664008790 2024-09-13T19:08:31.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94218062769744] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2674c62980 20 remove_watcher() i=5 2024-09-13T19:08:31.060 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.052+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218062780816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da29ae50 con 0x7f2664008790 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94218062780816] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 20 remove_watcher() i=6 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218062785328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b0da299af0 con 0x7f2664008790 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94218062785328] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2664036040 con 0x7f2664008790 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 20 remove_watcher() i=7 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2664008790 msgr2=0x7f2664018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f2664008790 0x7f2664018410 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da28f850 msgr2=0x55b0da291d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da28f850 0x55b0da291d10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f266c0d4030 msgr2=0x7f266c0b5870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f266c0d4030 0x7f266c0b5870 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da294210 msgr2=0x55b0da296600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da294210 0x55b0da296600 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f253c034650 msgr2=0x7f253c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f253c034650 0x7f253c036b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f266800bb60 tx=0x7f2668010000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 msgr2=0x55b0da284780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 --2- 172.21.15.151:0/1210863712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da27d640 0x55b0da284780 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f266c0f0040 tx=0x7f266c0d7f40 comp rx=0 tx=0).stop 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2672f73640 1 -- 172.21.15.151:0/1210863712 reap_dead start 2024-09-13T19:08:31.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 shutdown_connections 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 >> 172.21.15.151:0/1210863712 conn(0x55b0da279a20 msgr2=0x55b0da277af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 shutdown_connections 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.056+0000 7f2674c62980 1 -- 172.21.15.151:0/1210863712 wait complete. 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 msgr2=0x7f254c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 0x7f254c036b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55b0da2635f0 tx=0x7f266800f000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 msgr2=0x55b0da2710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f266c0b8010 tx=0x7f266c0e2e40 comp rx=0 tx=0).stop 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 shutdown_connections 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f254c034650 0x7f254c036b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/399280888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da270c80 0x55b0da2710a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 >> 172.21.15.151:0/399280888 conn(0x55b0da265dd0 msgr2=0x55b0da268850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 shutdown_connections 2024-09-13T19:08:31.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/399280888 wait complete. 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da1618e0 msgr2=0x55b0da25a010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55b0da1618e0 0x55b0da25a010 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b0da260690 msgr2=0x55b0da262a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55b0da260690 0x55b0da262a80 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da25c790 msgr2=0x55b0da25eb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55b0da25c790 0x55b0da25eb80 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2558034650 msgr2=0x7f2558036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2558034650 0x7f2558036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2668001da0 tx=0x7f2668001300 comp rx=0 tx=0).stop 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 msgr2=0x55b0da15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 --2- 172.21.15.151:0/2980192025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0da0d3290 0x55b0da15ec60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f266c01b870 tx=0x7f266c019810 comp rx=0 tx=0).stop 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2672f73640 1 -- 172.21.15.151:0/2980192025 reap_dead start 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 shutdown_connections 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 >> 172.21.15.151:0/2980192025 conn(0x55b0da159090 msgr2=0x55b0da244170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 shutdown_connections 2024-09-13T19:08:31.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.060+0000 7f2674c62980 1 -- 172.21.15.151:0/2980192025 wait complete. 2024-09-13T19:08:31.076 INFO:teuthology.orchestra.run.smithi151.stdout:{"entries":[],"summary":[]} 2024-09-13T19:08:31.077 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-13T19:08:31.077 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:08:31.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-13T19:08:31.077 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-13T19:08:31.159 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:31.160 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:31.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.152+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.152+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.152+0000 7fe938997980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ff7e24c8f0 0x55ff7e24ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.152+0000 7fe938997980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff7e0d2ae0 con 0x55ff7e24d240 2024-09-13T19:08:31.161 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.152+0000 7fe938997980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55ff7e0f6e30 con 0x55ff7e24c8f0 2024-09-13T19:08:31.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe9364a7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ff7e24c8f0 0x55ff7e24ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe935ca6640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55ff7e24d240 0x55ff7e251c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39708/0 (socket says 172.21.15.151:39708) 2024-09-13T19:08:31.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe935ca6640 1 -- 172.21.15.151:0/2800250153 learned_addr learned my addr 172.21.15.151:0/2800250153 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:31.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe9364a7640 1 -- 172.21.15.151:0/2800250153 >> v1:172.21.15.12:6789/0 conn(0x55ff7e24d240 legacy=0x55ff7e251c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe9364a7640 1 -- 172.21.15.151:0/2800250153 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e2544c0 con 0x55ff7e24c8f0 2024-09-13T19:08:31.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe9364a7640 1 --2- 172.21.15.151:0/2800250153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e24ccd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe92800a480 tx=0x7fe92801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1fd4c9eb194c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.156+0000 7fe9354a5640 1 -- 172.21.15.151:0/2800250153 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280af070 con 0x55ff7e24c8f0 2024-09-13T19:08:31.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe9354a5640 1 -- 172.21.15.151:0/2800250153 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280a3e50 con 0x55ff7e24c8f0 2024-09-13T19:08:31.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe9354a5640 1 -- 172.21.15.151:0/2800250153 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280aa680 con 0x55ff7e24c8f0 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 -- 172.21.15.151:0/2800250153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 msgr2=0x55ff7e24ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 --2- 172.21.15.151:0/2800250153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e24ccd0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe92800a480 tx=0x7fe92801b110 comp rx=0 tx=0).stop 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 -- 172.21.15.151:0/2800250153 shutdown_connections 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 --2- 172.21.15.151:0/2800250153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e24ccd0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 -- 172.21.15.151:0/2800250153 >> 172.21.15.151:0/2800250153 conn(0x55ff7e1c0240 msgr2=0x55ff7e1c0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 -- 172.21.15.151:0/2800250153 shutdown_connections 2024-09-13T19:08:31.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.160+0000 7fe938997980 1 -- 172.21.15.151:0/2800250153 wait complete. 2024-09-13T19:08:31.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.172+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.172+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ff7e0f8200 con 0x55ff7e24c8f0 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58352/0 (socket says 172.21.15.151:58352) 2024-09-13T19:08:31.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 -- 172.21.15.151:0/1890238218 learned_addr learned my addr 172.21.15.151:0/1890238218 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 -- 172.21.15.151:0/1890238218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e338230 con 0x55ff7e24c8f0 2024-09-13T19:08:31.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 --2- 172.21.15.151:0/1890238218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe9280ad040 tx=0x7fe928003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed15926a122c55f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe824608640 1 -- 172.21.15.151:0/1890238218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280af040 con 0x55ff7e24c8f0 2024-09-13T19:08:31.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe824608640 1 -- 172.21.15.151:0/1890238218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280aa870 con 0x55ff7e24c8f0 2024-09-13T19:08:31.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe824608640 1 -- 172.21.15.151:0/1890238218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280aab90 con 0x55ff7e24c8f0 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- 172.21.15.151:0/1890238218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 msgr2=0x55ff7e337c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 --2- 172.21.15.151:0/1890238218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe9280ad040 tx=0x7fe928003030 comp rx=0 tx=0).stop 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- 172.21.15.151:0/1890238218 shutdown_connections 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 --2- 172.21.15.151:0/1890238218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e337c60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- 172.21.15.151:0/1890238218 >> 172.21.15.151:0/1890238218 conn(0x55ff7e1c0240 msgr2=0x55ff7e333890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- 172.21.15.151:0/1890238218 shutdown_connections 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- 172.21.15.151:0/1890238218 wait complete. 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e33efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe938997980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ff7e253f00 con 0x55ff7e24c8f0 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e33efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e33efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58362/0 (socket says 172.21.15.151:58362) 2024-09-13T19:08:31.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.176+0000 7fe9364a7640 1 -- 172.21.15.151:0/554390644 learned_addr learned my addr 172.21.15.151:0/554390644 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe9364a7640 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e33f510 con 0x55ff7e24c8f0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe9364a7640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e33efd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b7040 tx=0x7fe928017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 -- 172.21.15.151:0/554390644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280c2070 con 0x55ff7e24c8f0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff7e33f7a0 con 0x55ff7e24c8f0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 -- 172.21.15.151:0/554390644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280b59b0 con 0x55ff7e24c8f0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 -- 172.21.15.151:0/554390644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280af050 con 0x55ff7e24c8f0 2024-09-13T19:08:31.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7e342480 con 0x55ff7e24c8f0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 -- 172.21.15.151:0/554390644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe9280c5070 con 0x55ff7e24c8f0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe81c034650 0x7fe81c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe822e05640 1 -- 172.21.15.151:0/554390644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9280ba070 con 0x55ff7e24c8f0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe935ca6640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe81c034650 0x7fe81c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e24d240 0x55ff7e345f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3464e0 con 0x55ff7e24d240 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe936ca8640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e24d240 0x55ff7e345f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe935ca6640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe81c034650 0x7fe81c036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe9200017b0 tx=0x7fe9200066a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe936ca8640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e24d240 0x55ff7e345f60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe936ca8640 1 -- 172.21.15.151:0/554390644 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e24d240 2024-09-13T19:08:31.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e343680 con 0x55ff7e24d240 2024-09-13T19:08:31.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe936ca8640 1 -- 172.21.15.151:0/554390644 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e24d240 2024-09-13T19:08:31.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3487b0 0x55ff7e34aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.180+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e34b270 con 0x55ff7e3487b0 2024-09-13T19:08:31.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3487b0 0x55ff7e34aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3487b0 0x55ff7e34aba0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 -- 172.21.15.151:0/554390644 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3487b0 2024-09-13T19:08:31.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e347620 con 0x55ff7e24d240 2024-09-13T19:08:31.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe936ca8640 1 -- 172.21.15.151:0/554390644 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e24d240 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ff7e34c6d0 0x55ff7e34eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e34f1b0 con 0x55ff7e34c6d0 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe935ca6640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ff7e34c6d0 0x55ff7e34eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe935ca6640 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ff7e34c6d0 0x55ff7e34eac0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe935ca6640 1 -- 172.21.15.151:0/554390644 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe92000f070 con 0x55ff7e34c6d0 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe938997980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ff7e151800 con 0x55ff7e35cc60 2024-09-13T19:08:31.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58364/0 (socket says 172.21.15.151:58364) 2024-09-13T19:08:31.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 -- 172.21.15.151:0/3442539674 learned_addr learned my addr 172.21.15.151:0/3442539674 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 -- 172.21.15.151:0/3442539674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e35d5c0 con 0x55ff7e35cc60 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.184+0000 7fe9364a7640 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe9280e2c70 tx=0x7fe9280b5c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 -- 172.21.15.151:0/3442539674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280b4880 con 0x55ff7e35cc60 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 -- 172.21.15.151:0/3442539674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280b4a20 con 0x55ff7e35cc60 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 -- 172.21.15.151:0/3442539674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280e4b90 con 0x55ff7e35cc60 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff7e35d850 con 0x55ff7e35cc60 2024-09-13T19:08:31.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7e35d850 con 0x55ff7e35cc60 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 -- 172.21.15.151:0/3442539674 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe9280a93a0 con 0x55ff7e35cc60 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 0x7fe810036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe81bfff640 1 -- 172.21.15.151:0/3442539674 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe928002000 con 0x55ff7e35cc60 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe935ca6640 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 0x7fe810036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.195 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe935ca6640 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 0x7fe810036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ff7e346d60 tx=0x7fe92000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe938997980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ff7e3384f0 con 0x55ff7e3693d0 2024-09-13T19:08:31.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58366/0 (socket says 172.21.15.151:58366) 2024-09-13T19:08:31.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe9364a7640 1 -- 172.21.15.151:0/542706482 learned_addr learned my addr 172.21.15.151:0/542706482 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe9364a7640 1 -- 172.21.15.151:0/542706482 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e369d80 con 0x55ff7e3693d0 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.188+0000 7fe9364a7640 1 --2- 172.21.15.151:0/542706482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b4fb0 tx=0x7fe9280c7ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8cf6f8d7222626 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe819ffb640 1 -- 172.21.15.151:0/542706482 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280fd070 con 0x55ff7e3693d0 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe819ffb640 1 -- 172.21.15.151:0/542706482 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280a97c0 con 0x55ff7e3693d0 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe819ffb640 1 -- 172.21.15.151:0/542706482 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280e1810 con 0x55ff7e3693d0 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/542706482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 msgr2=0x55ff7e3697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 --2- 172.21.15.151:0/542706482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b4fb0 tx=0x7fe9280c7ba0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/542706482 shutdown_connections 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 --2- 172.21.15.151:0/542706482 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3697b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/542706482 >> 172.21.15.151:0/542706482 conn(0x55ff7e3657b0 msgr2=0x55ff7e3638b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/542706482 shutdown_connections 2024-09-13T19:08:31.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/542706482 wait complete. 2024-09-13T19:08:31.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 Processor -- start 2024-09-13T19:08:31.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- start start 2024-09-13T19:08:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ff7e36a220 con 0x55ff7e3693d0 2024-09-13T19:08:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe9364a7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58380/0 (socket says 172.21.15.151:58380) 2024-09-13T19:08:31.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 learned_addr learned my addr 172.21.15.151:0/2981770525 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff7e370b10 con 0x55ff7e3693d0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe9364a7640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b4fb0 tx=0x7fe928006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe807fff640 1 -- 172.21.15.151:0/2981770525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe928108020 con 0x55ff7e3693d0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe807fff640 1 -- 172.21.15.151:0/2981770525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9280b6860 con 0x55ff7e3693d0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff7e370b10 con 0x55ff7e3693d0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe807fff640 1 -- 172.21.15.151:0/2981770525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9280fd030 con 0x55ff7e3693d0 2024-09-13T19:08:31.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.192+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff7e370b10 con 0x55ff7e3693d0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe807fff640 1 -- 172.21.15.151:0/2981770525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe92810b020 con 0x55ff7e3693d0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe807fff640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe800034650 0x7fe800036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe807fff640 1 -- 172.21.15.151:0/2981770525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9280fe070 con 0x55ff7e3693d0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe935ca6640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe800034650 0x7fe800036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e37b6e0 0x55ff7e37dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37e2f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e37b6e0 0x55ff7e37dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe935ca6640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe800034650 0x7fe800036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9200063c0 tx=0x7fe920010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e37b6e0 0x55ff7e37dba0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 realm 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37e700 con 0x55ff7e37b6e0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37efd0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3800d0 0x55ff7e3824c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e382b10 con 0x55ff7e3800d0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe9364a7640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3800d0 0x55ff7e3824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe9364a7640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3800d0 0x55ff7e3824c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:31.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 20 searching for the correct realm 2024-09-13T19:08:31.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384370 con 0x55ff7e3800d0 2024-09-13T19:08:31.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.196+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe9364a7640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe928118040 0x7fe928104430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384370 con 0x7fe928118040 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe928118040 0x7fe928104430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe928118040 0x7fe928104430 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384370 con 0x7fe928118040 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe930018410 0x7fe930018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe930018410 0x7fe930018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe930018410 0x7fe930018890 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x7fe930018410 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x7fe930018410 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.200+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe928118040 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x7fe930018410 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe928118040 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x7fe930018410 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.204+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x7fe930018410 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe928118040 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9300083f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.208+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe928118040 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e3800d0 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x7fe930018410 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e37f370 con 0x55ff7e37b6e0 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe93003b040 con 0x7fe928118040 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:31.222 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e383360 con 0x55ff7e37b6e0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e383700 con 0x55ff7e37b6e0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e383700 con 0x7fe928118040 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:31.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 zone default found 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 4 Realm: () 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 zonegroup default 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.212+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384010 con 0x7fe930018410 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e384010 con 0x55ff7e3800d0 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e386290 con 0x55ff7e3800d0 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 started sync module instance, tier type = 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:31.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e385650 con 0x7fe928118040 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94555822643776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3852b0 con 0x7fe928118040 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3871c0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.216+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94555822643776] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94555822648592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3875e0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e387eb0 con 0x55ff7e3800d0 2024-09-13T19:08:31.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94555822648592] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94555822649920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3882a0 con 0x55ff7e3800d0 2024-09-13T19:08:31.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.220+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e388c60 con 0x7fe928118040 2024-09-13T19:08:31.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94555822655408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3894b0 con 0x7fe928118040 2024-09-13T19:08:31.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e389eb0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94555822649920] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94555822655408] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94555822657536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3899c0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.224+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38a750 con 0x7fe930018410 2024-09-13T19:08:31.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94555822657536] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94555822651040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38a750 con 0x7fe930018410 2024-09-13T19:08:31.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38b110 con 0x7fe930018410 2024-09-13T19:08:31.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94555822664800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38b530 con 0x7fe930018410 2024-09-13T19:08:31.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38bf80 con 0x7fe930018410 2024-09-13T19:08:31.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.228+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94555822651040] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94555822664800] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94555822662304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38b530 con 0x7fe930018410 2024-09-13T19:08:31.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=0 2024-09-13T19:08:31.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=1 2024-09-13T19:08:31.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=2 2024-09-13T19:08:31.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=3 2024-09-13T19:08:31.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=4 2024-09-13T19:08:31.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=5 2024-09-13T19:08:31.239 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=6 2024-09-13T19:08:31.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94555822662304] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 20 add_watcher() i=7 2024-09-13T19:08:31.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:31.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38ef70 con 0x55ff7e37b6e0 2024-09-13T19:08:31.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.232+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94555822666320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e38c3f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94555822666320] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe7ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe938997980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:31.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe938997980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:31.242 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3977f0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.236+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e397ec0 con 0x7fe930018410 2024-09-13T19:08:31.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.240+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.247 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.240+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3982e0 con 0x55ff7e3800d0 2024-09-13T19:08:31.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.240+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.240+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3982b0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'233 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e398840 con 0x7fe928118040 2024-09-13T19:08:31.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e398cc0 con 0x55ff7e3800d0 2024-09-13T19:08:31.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.252 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.244+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e398d50 con 0x55ff7e37b6e0 2024-09-13T19:08:31.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.248+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.248+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e398de0 con 0x7fe930018410 2024-09-13T19:08:31.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.248+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.248+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e398f30 con 0x7fe928118040 2024-09-13T19:08:31.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399540 con 0x55ff7e3800d0 2024-09-13T19:08:31.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.259 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399540 con 0x7fe928118040 2024-09-13T19:08:31.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.260 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.252+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399ab0 con 0x7fe930018410 2024-09-13T19:08:31.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.256+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.256+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399ab0 con 0x7fe928118040 2024-09-13T19:08:31.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.256+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.256+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399cb0 con 0x7fe930018410 2024-09-13T19:08:31.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.260+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.260+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e399cb0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.260+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.260+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395640 con 0x55ff7e3800d0 2024-09-13T19:08:31.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.264+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.264+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395640 con 0x7fe928118040 2024-09-13T19:08:31.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.264+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.272 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.264+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395640 con 0x55ff7e3800d0 2024-09-13T19:08:31.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e37b6e0 2024-09-13T19:08:31.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e37b6e0 2024-09-13T19:08:31.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.268+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.272+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.272+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x7fe928118040 2024-09-13T19:08:31.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.272+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.272+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.276+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.280+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.280+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x7fe930018410 2024-09-13T19:08:31.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.280+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.280+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.284+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.284+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x7fe930018410 2024-09-13T19:08:31.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.284+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.284+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x55ff7e3800d0 2024-09-13T19:08:31.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.288+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.288+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x7fe930018410 2024-09-13T19:08:31.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.292+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.298 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.292+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e395470 con 0x7fe928118040 2024-09-13T19:08:31.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.292+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe7677fe640 20 reqs_thread_entry: start 2024-09-13T19:08:31.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:31.301 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 Filter name: none 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe7657fa640 20 reqs_thread_entry: start 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b5070 con 0x55ff7e37b6e0 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=391 2024-09-13T19:08:31.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-13T19:08:31.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-13T19:08:31.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:31.303 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b7b00 con 0x7fe928118040 2024-09-13T19:08:31.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv45 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 : miss 2024-09-13T19:08:31.305 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:96 8.1c 8:3f059f78:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b77d0 con 0x55ff7e3800d0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(96 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=379 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 info.flags=0x17 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 to cache LRU end 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 4.2c 4:36a9eb94:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434cd0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(97 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 4.36 4:6f4d24d6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x55ff7e37b6e0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(98 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:99 4.1 4:80b3f08e:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x7fe928118040 2024-09-13T19:08:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(99 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.296+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:100 4.31 4:8e005dd1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x55ff7e37b6e0 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(100 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:101 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x55ff7e3800d0 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(101 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:08:31.307 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:102 4.19 4:9830aee9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x7fe928118040 2024-09-13T19:08:31.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(102 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 4.1e 4:7b25bde5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434d10 con 0x7fe930018410 2024-09-13T19:08:31.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(103 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x7fe930018410 2024-09-13T19:08:31.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:104 4.12 4:4bedf3ad:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434c90 con 0x55ff7e37b6e0 2024-09-13T19:08:31.308 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(104 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 4.36 4:6d1a7946:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434c90 con 0x55ff7e37b6e0 2024-09-13T19:08:31.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(105 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930036040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 4.3b 4:dfa59557:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434c90 con 0x55ff7e3800d0 2024-09-13T19:08:31.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(106 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.309 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:107 4.2a 4:56379ee7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e434c90 con 0x55ff7e37b6e0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(107 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 20 get_obj_state: octx=0x7fe920004e30 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ff7e432d38 s->prefetch_data=0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.300+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 3.1bs0 3:d815c9e2:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e433bc0 con 0x55ff7e3800d0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(108 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 10 manifest: total_size = 6 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 20 get_obj_state: setting s->obj_tag to 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.10246794072018721365 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 20 get_obj_state: octx=0x7fe920004e30 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ff7e432d38 s->prefetch_data=0 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 20 prepare_atomic_modification: state is not atomic. state=0x55ff7e432d38 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 20 bucket index object: :.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 2024-09-13T19:08:31.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:109 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e4346d0 con 0x55ff7e3800d0 2024-09-13T19:08:31.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(109 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.304+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 3.1bs0 3:d815c9e2:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e4346d0 con 0x55ff7e3800d0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(110 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:111 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc580 con 0x55ff7e3800d0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 20 list_objects_ordered: starting attempt 1 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:112 4.2c 4:36a9eb94:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc580 con 0x55ff7e37b6e0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:113 4.36 4:6f4d24d6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c1830 con 0x55ff7e37b6e0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:114 4.1 4:80b3f08e:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c4190 con 0x7fe928118040 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:115 4.31 4:8e005dd1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c6d00 con 0x55ff7e37b6e0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:116 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c9ac0 con 0x55ff7e3800d0 2024-09-13T19:08:31.315 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:117 4.19 4:9830aee9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3cc860 con 0x7fe928118040 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:118 4.1e 4:7b25bde5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3cf6e0 con 0x7fe930018410 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:119 4.12 4:4bedf3ad:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d2090 con 0x55ff7e37b6e0 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:120 4.36 4:6d1a7946:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d4f10 con 0x55ff7e37b6e0 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:121 4.3b 4:dfa59557:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d78c0 con 0x55ff7e3800d0 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:122 4.2a 4:56379ee7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d78c0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(114 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(121 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(112 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(117 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe92000f070 con 0x7fe928118040 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(113 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(115 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(119 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(120 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(122 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.308+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(118 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(111 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe819ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(116 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7])"; uploads.size()=0; is_truncated=0 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:123 4.2c 4:36a9eb94:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3cc860 con 0x55ff7e37b6e0 2024-09-13T19:08:31.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:124 4.36 4:6f4d24d6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d78c0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:125 4.1 4:80b3f08e:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c6d00 con 0x7fe928118040 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:126 4.31 4:8e005dd1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3cc860 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:127 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d78c0 con 0x55ff7e3800d0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:128 4.19 4:9830aee9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3cc860 con 0x7fe928118040 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:129 4.1e 4:7b25bde5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x7fe930018410 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:130 4.12 4:4bedf3ad:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c6d00 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:131 4.36 4:6d1a7946:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3d78c0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:132 4.3b 4:dfa59557:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8ea0 con 0x55ff7e3800d0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:133 4.2a 4:56379ee7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bb8b0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(124 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(126 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(123 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(127 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(132 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(130 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(131 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(133 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe930046060 con 0x55ff7e37b6e0 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(125 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(128 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(129 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.312+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe928118040 2024-09-13T19:08:31.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(134 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-13T19:08:31.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe928118040 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv42 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 20 rados_obj.operate() r=0 bl.length=165 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8ea0 con 0x7fe928118040 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(136 myfoo [call,call,delete] v34'49 uv49 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.324 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.316+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94555822944016 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x7fe930018410 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== watch-notify(notify (1) cookie 94555822664800 notify 146028888107 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ff7e3971b0 con 0x7fe930018410 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(137 notify.6 [notify cookie 94555822944016 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe8197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94555822664800 notifier 4778 bl.length()=149 2024-09-13T19:08:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe8197fa640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe76c003330 con 0x7fe930018410 2024-09-13T19:08:31.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== watch-notify(notify_complete (2) cookie 94555822944016 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e35d5c0 con 0x7fe930018410 2024-09-13T19:08:31.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:139 8.1c 8:3f059f78:root::.bucket.meta.myfoo%3a56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8ea0 con 0x55ff7e3800d0 2024-09-13T19:08:31.327 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(139 .bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe938997980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 from cache 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7, ofs0, ns] 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94555822944016 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe930018410 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== watch-notify(notify (1) cookie 94555822664800 notify 146028888108 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ff7e35d5c0 con 0x7fe930018410 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe8197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94555822664800 notifier 4778 bl.length()=206 2024-09-13T19:08:31.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe8197fa640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe76c003330 con 0x7fe930018410 2024-09-13T19:08:31.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.320+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(140 notify.6 [notify cookie 94555822944016 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== watch-notify(notify_complete (2) cookie 94555822944016 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e397980 con 0x7fe930018410 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe930046060 con 0x7fe930018410 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:142 4.2c 4:36a9eb94:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x55ff7e37b6e0 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:143 4.36 4:6f4d24d6:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc440 con 0x55ff7e37b6e0 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 4.1 4:80b3f08e:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b6140 con 0x7fe928118040 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:145 4.31 4:8e005dd1:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c9f10 con 0x55ff7e37b6e0 2024-09-13T19:08:31.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:146 4.25 4:a4f5ac6d:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3ca7e0 con 0x55ff7e3800d0 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:147 4.19 4:9830aee9:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8340 con 0x7fe928118040 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:148 4.1e 4:7b25bde5:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b6140 con 0x7fe930018410 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:149 4.12 4:4bedf3ad:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x55ff7e37b6e0 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:150 4.36 4:6d1a7946:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3ca7e0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:151 4.3b 4:dfa59557:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8340 con 0x55ff7e3800d0 2024-09-13T19:08:31.331 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:152 4.2a 4:56379ee7:::.dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc440 con 0x55ff7e37b6e0 2024-09-13T19:08:31.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(147 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(144 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.324+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(142 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.333 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(146 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.4 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(145 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(151 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.9 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 48 ==== osd_op_reply(143 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.1 [delete] v34'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 49 ==== osd_op_reply(149 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.7 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 50 ==== osd_op_reply(150 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.8 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 51 ==== osd_op_reply(152 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.10 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(148 .dir.56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 : miss 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:153 6.19 6:9e23ffa8:::pubsub..bucket.myfoo%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3c9f10 con 0x55ff7e37b6e0 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 52 ==== osd_op_reply(153 pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 info.flags=0x0 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 10 adding default.rgw.log++pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 to cache LRU end 2024-09-13T19:08:31.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.328+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:154 6.19 6:9e23ffa8:::pubsub..bucket.myfoo%2f56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x55ff7e37b6e0 2024-09-13T19:08:31.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.332+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 53 ==== osd_op_reply(154 pubsub..bucket.myfoo/56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.7 [delete] v34'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.332+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe928118040 2024-09-13T19:08:31.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.332+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(155 foo.buckets [call] v34'50 uv50 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.332+0000 7fe938997980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-13T19:08:31.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.332+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe930018410 2024-09-13T19:08:31.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-13T19:08:31.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94555822847680 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x7fe928118040 2024-09-13T19:08:31.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== watch-notify(notify (1) cookie 94555822655408 notify 146028888083 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ff7e395c50 con 0x7fe928118040 2024-09-13T19:08:31.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe819ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94555822655408 notifier 4778 bl.length()=170 2024-09-13T19:08:31.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(157 notify.3 [notify cookie 94555822847680 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe819ffb640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe7fc003d70 con 0x7fe928118040 2024-09-13T19:08:31.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== watch-notify(notify_complete (2) cookie 94555822847680 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e398890 con 0x7fe928118040 2024-09-13T19:08:31.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe938997980 10 removing email index: foo@foo.com 2024-09-13T19:08:31.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.336+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x55ff7e37b6e0 2024-09-13T19:08:31.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 54 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-13T19:08:31.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94555822847680 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x7fe928118040 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== watch-notify(notify (1) cookie 94555822655408 notify 146028888084 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55ff7e398890 con 0x7fe928118040 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe819ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94555822655408 notifier 4778 bl.length()=162 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe819ffb640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe7fc003d70 con 0x7fe928118040 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(160 notify.3 [notify cookie 94555822847680 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== watch-notify(notify_complete (2) cookie 94555822847680 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e399370 con 0x7fe928118040 2024-09-13T19:08:31.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe938997980 10 removing user buckets index 2024-09-13T19:08:31.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.340+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc030 con 0x7fe928118040 2024-09-13T19:08:31.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(162 foo.buckets [delete] v34'51 uv51 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-13T19:08:31.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94555822847680 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x7fe930018410 2024-09-13T19:08:31.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== watch-notify(notify (1) cookie 94555822651040 notify 146028888109 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ff7e397980 con 0x7fe930018410 2024-09-13T19:08:31.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(163 notify.5 [notify cookie 94555822847680 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe8197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 94555822651040 notifier 4778 bl.length()=160 2024-09-13T19:08:31.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe8197fa640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe76c003330 con 0x7fe930018410 2024-09-13T19:08:31.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== watch-notify(notify_complete (2) cookie 94555822847680 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e3977b0 con 0x7fe930018410 2024-09-13T19:08:31.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe938997980 10 removing user index: foo 2024-09-13T19:08:31.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.344+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3b8e80 con 0x55ff7e37b6e0 2024-09-13T19:08:31.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 55 ==== osd_op_reply(165 foo [call,call,delete] v34'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe938997980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe938997980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94555822847632 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e3bc4e0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 56 ==== watch-notify(notify (1) cookie 94555822657536 notify 146028888094 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ff7e3977b0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 57 ==== osd_op_reply(166 notify.4 [notify cookie 94555822847632 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe8197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94555822657536 notifier 4778 bl.length()=152 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe8197fa640 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe76c003330 con 0x55ff7e37b6e0 2024-09-13T19:08:31.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 58 ==== watch-notify(notify_complete (2) cookie 94555822847632 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ff7e397b90 con 0x55ff7e37b6e0 2024-09-13T19:08:31.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 59 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe7ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.348+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94555822666320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 60 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94555822666320] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94555822643776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x7fe928118040 2024-09-13T19:08:31.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94555822643776] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe938997980 20 remove_watcher() i=0 2024-09-13T19:08:31.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe938997980 2 removed watcher, disabling cache 2024-09-13T19:08:31.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.352+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94555822648592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 61 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94555822648592] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe938997980 20 remove_watcher() i=1 2024-09-13T19:08:31.362 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94555822649920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x55ff7e3800d0 2024-09-13T19:08:31.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe9364a7640 1 -- 172.21.15.151:0/2981770525 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94555822649920] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9280ce070 con 0x55ff7e3800d0 2024-09-13T19:08:31.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe938997980 20 remove_watcher() i=2 2024-09-13T19:08:31.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.356+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94555822655408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x7fe928118040 2024-09-13T19:08:31.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe935ca6640 1 -- 172.21.15.151:0/2981770525 <== osd.2 v2:172.21.15.151:6808/3546065622 43 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94555822655408] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe920051060 con 0x7fe928118040 2024-09-13T19:08:31.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe938997980 20 remove_watcher() i=3 2024-09-13T19:08:31.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94555822657536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x55ff7e37b6e0 2024-09-13T19:08:31.368 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.1 v2:172.21.15.151:6816/4016279334 62 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94555822657536] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x55ff7e37b6e0 2024-09-13T19:08:31.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe938997980 20 remove_watcher() i=4 2024-09-13T19:08:31.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.360+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94555822651040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x7fe930018410 2024-09-13T19:08:31.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.364+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94555822651040] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.364+0000 7fe938997980 20 remove_watcher() i=5 2024-09-13T19:08:31.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.364+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94555822664800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x7fe930018410 2024-09-13T19:08:31.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94555822664800] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 20 remove_watcher() i=6 2024-09-13T19:08:31.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94555822662304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ff7e396dd0 con 0x7fe930018410 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94555822662304] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe93005c040 con 0x7fe930018410 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 20 remove_watcher() i=7 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe930018410 msgr2=0x7fe930018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe930018410 0x7fe930018890 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e37b6e0 msgr2=0x55ff7e37dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e37b6e0 0x55ff7e37dba0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe928118040 msgr2=0x7fe928104430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.379 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe928118040 0x7fe928104430 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3800d0 msgr2=0x55ff7e3824c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.368+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3800d0 0x55ff7e3824c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe800034650 msgr2=0x7fe800036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe800034650 0x7fe800036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe9200063c0 tx=0x7fe920010000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe936ca8640 1 -- 172.21.15.151:0/2981770525 reap_dead start 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 msgr2=0x55ff7e3705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b4fb0 tx=0x7fe928006ed0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 shutdown_connections 2024-09-13T19:08:31.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/2981770525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e3693d0 0x55ff7e3705d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 >> 172.21.15.151:0/2981770525 conn(0x55ff7e3657b0 msgr2=0x55ff7e363880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 shutdown_connections 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/2981770525 wait complete. 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 msgr2=0x7fe810036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 0x7fe810036b60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ff7e346d60 tx=0x7fe92000f000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 msgr2=0x55ff7e35d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe9280e2c70 tx=0x7fe9280b5c90 comp rx=0 tx=0).stop 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 shutdown_connections 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe8100346a0 0x7fe810036b60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/3442539674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e35cc60 0x55ff7e35d080 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 >> 172.21.15.151:0/3442539674 conn(0x55ff7e351db0 msgr2=0x55ff7e354830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 shutdown_connections 2024-09-13T19:08:31.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/3442539674 wait complete. 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e24d240 msgr2=0x55ff7e345f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ff7e24d240 0x55ff7e345f60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ff7e34c6d0 msgr2=0x55ff7e34eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ff7e34c6d0 0x55ff7e34eac0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3487b0 msgr2=0x55ff7e34aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ff7e3487b0 0x55ff7e34aba0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe81c034650 msgr2=0x7fe81c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe81c034650 0x7fe81c036b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe9200017b0 tx=0x7fe9200066a0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 msgr2=0x55ff7e33efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 --2- 172.21.15.151:0/554390644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ff7e24c8f0 0x55ff7e33efd0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b7040 tx=0x7fe928017eb0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe936ca8640 1 -- 172.21.15.151:0/554390644 reap_dead start 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 shutdown_connections 2024-09-13T19:08:31.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 >> 172.21.15.151:0/554390644 conn(0x55ff7e1c0240 msgr2=0x55ff7e332410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 shutdown_connections 2024-09-13T19:08:31.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.372+0000 7fe938997980 1 -- 172.21.15.151:0/554390644 wait complete. 2024-09-13T19:08:31.391 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-13T19:08:31.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-13T19:08:31.391 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-13T19:08:31.473 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa128714980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x562d51413a10 0x562d51415e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa128714980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d51297ae0 con 0x562d5140f690 2024-09-13T19:08:31.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa128714980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x562d512bbe30 con 0x562d51413a10 2024-09-13T19:08:31.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa125a23640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x562d51413a10 0x562d51415e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa125a23640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x562d51413a10 0x562d51415e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58388/0 (socket says 172.21.15.151:58388) 2024-09-13T19:08:31.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa125a23640 1 -- 172.21.15.151:0/1516583359 learned_addr learned my addr 172.21.15.151:0/1516583359 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa125a23640 1 -- 172.21.15.151:0/1516583359 >> v1:172.21.15.12:6789/0 conn(0x562d5140f690 legacy=0x562d5140fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.468+0000 7fa125a23640 1 -- 172.21.15.151:0/1516583359 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d51417350 con 0x562d51413a10 2024-09-13T19:08:31.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa125a23640 1 --2- 172.21.15.151:0/1516583359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51413a10 0x562d51415e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00a5c0 tx=0x7fa11c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9aae1b41d1e89c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa125222640 1 -- 172.21.15.151:0/1516583359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c0a6070 con 0x562d51413a10 2024-09-13T19:08:31.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa125222640 1 -- 172.21.15.151:0/1516583359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c0af070 con 0x562d51413a10 2024-09-13T19:08:31.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa125222640 1 -- 172.21.15.151:0/1516583359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c0aa5c0 con 0x562d51413a10 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 -- 172.21.15.151:0/1516583359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51413a10 msgr2=0x562d51415e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 --2- 172.21.15.151:0/1516583359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51413a10 0x562d51415e00 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00a5c0 tx=0x7fa11c01b340 comp rx=0 tx=0).stop 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 -- 172.21.15.151:0/1516583359 shutdown_connections 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 --2- 172.21.15.151:0/1516583359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51413a10 0x562d51415e00 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 -- 172.21.15.151:0/1516583359 >> 172.21.15.151:0/1516583359 conn(0x562d5140b1b0 msgr2=0x562d5140d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 -- 172.21.15.151:0/1516583359 shutdown_connections 2024-09-13T19:08:31.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.472+0000 7fa128714980 1 -- 172.21.15.151:0/1516583359 wait complete. 2024-09-13T19:08:31.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d512bd200 con 0x562d5140f690 2024-09-13T19:08:31.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58396/0 (socket says 172.21.15.151:58396) 2024-09-13T19:08:31.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa126224640 1 -- 172.21.15.151:0/2317540339 learned_addr learned my addr 172.21.15.151:0/2317540339 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa126224640 1 -- 172.21.15.151:0/2317540339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d514fafc0 con 0x562d5140f690 2024-09-13T19:08:31.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa126224640 1 --2- 172.21.15.151:0/2317540339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa1200015f0 tx=0x7fa120001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccacd6ff9c20e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa014608640 1 -- 172.21.15.151:0/2317540339 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120016070 con 0x562d5140f690 2024-09-13T19:08:31.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa014608640 1 -- 172.21.15.151:0/2317540339 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12000f640 con 0x562d5140f690 2024-09-13T19:08:31.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa014608640 1 -- 172.21.15.151:0/2317540339 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa12000f960 con 0x562d5140f690 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- 172.21.15.151:0/2317540339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 msgr2=0x562d514fa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 --2- 172.21.15.151:0/2317540339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa1200015f0 tx=0x7fa120001ab0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- 172.21.15.151:0/2317540339 shutdown_connections 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 --2- 172.21.15.151:0/2317540339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d514fa9f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- 172.21.15.151:0/2317540339 >> 172.21.15.151:0/2317540339 conn(0x562d5140b1b0 msgr2=0x562d514f6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- 172.21.15.151:0/2317540339 shutdown_connections 2024-09-13T19:08:31.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.488+0000 7fa128714980 1 -- 172.21.15.151:0/2317540339 wait complete. 2024-09-13T19:08:31.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d513864f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d51416e50 con 0x562d5140f690 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d513864f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d513864f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58404/0 (socket says 172.21.15.151:58404) 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa126224640 1 -- 172.21.15.151:0/2086510194 learned_addr learned my addr 172.21.15.151:0/2086510194 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa126224640 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d51386a30 con 0x562d5140f690 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa126224640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d513864f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa120001af0 tx=0x7fa120000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 -- 172.21.15.151:0/2086510194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120016040 con 0x562d5140f690 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d51384c10 con 0x562d5140f690 2024-09-13T19:08:31.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 -- 172.21.15.151:0/2086510194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120022070 con 0x562d5140f690 2024-09-13T19:08:31.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 -- 172.21.15.151:0/2086510194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120006180 con 0x562d5140f690 2024-09-13T19:08:31.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d51385100 con 0x562d5140f690 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 -- 172.21.15.151:0/2086510194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1200117c0 con 0x562d5140f690 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa00c034650 0x7fa00c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa012e05640 1 -- 172.21.15.151:0/2086510194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa120049820 con 0x562d5140f690 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa125a23640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa00c034650 0x7fa00c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51413a10 0x562d5150b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.492+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d5150b6f0 con 0x562d51413a10 2024-09-13T19:08:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126a25640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51413a10 0x562d5150b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa125a23640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa00c034650 0x7fa00c036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae000 tx=0x7fa11c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126a25640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51413a10 0x562d5150b1b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126a25640 1 -- 172.21.15.151:0/2086510194 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51413a10 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d5150ba90 con 0x562d51413a10 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126a25640 1 -- 172.21.15.151:0/2086510194 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51413a10 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d5150d880 0x562d5150fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51510360 con 0x562d5150d880 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126224640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d5150d880 0x562d5150fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126224640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d5150d880 0x562d5150fc70 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126224640 1 -- 172.21.15.151:0/2086510194 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa12000f070 con 0x562d5150d880 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d5150c6f0 con 0x562d51413a10 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa126a25640 1 -- 172.21.15.151:0/2086510194 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51413a10 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x562d515117c0 0x562d51513bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d515142f0 con 0x562d515117c0 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa125a23640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x562d515117c0 0x562d51513bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa125a23640 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x562d515117c0 0x562d51513bb0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa125a23640 1 -- 172.21.15.151:0/2086510194 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa11c0aaae0 con 0x562d515117c0 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.496+0000 7fa128714980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d51316800 con 0x562d51521d80 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58408/0 (socket says 172.21.15.151:58408) 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa126224640 1 -- 172.21.15.151:0/1813631684 learned_addr learned my addr 172.21.15.151:0/1813631684 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa126224640 1 -- 172.21.15.151:0/1813631684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d515226e0 con 0x562d51521d80 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa126224640 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa1200313f0 tx=0x7fa120026430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 -- 172.21.15.151:0/1813631684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120041200 con 0x562d51521d80 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 -- 172.21.15.151:0/1813631684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1200413a0 con 0x562d51521d80 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d51522970 con 0x562d51521d80 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 -- 172.21.15.151:0/1813631684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120041680 con 0x562d51521d80 2024-09-13T19:08:31.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d515255f0 con 0x562d51521d80 2024-09-13T19:08:31.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 -- 172.21.15.151:0/1813631684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa1200490b0 con 0x562d51521d80 2024-09-13T19:08:31.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 0x7fa000036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa00bfff640 1 -- 172.21.15.151:0/1813631684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa120040070 con 0x562d51521d80 2024-09-13T19:08:31.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa125a23640 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 0x7fa000036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa125a23640 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 0x7fa000036b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c10 tx=0x7fa11c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.500+0000 7fa128714980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d514fb340 con 0x562d5152e600 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58420/0 (socket says 172.21.15.151:58420) 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 -- 172.21.15.151:0/2268001159 learned_addr learned my addr 172.21.15.151:0/2268001159 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 -- 172.21.15.151:0/2268001159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d5152efd0 con 0x562d5152e600 2024-09-13T19:08:31.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- 172.21.15.151:0/2268001159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa120042010 tx=0x7fa1200523a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86341d53764649b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa009ffb640 1 -- 172.21.15.151:0/2268001159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120018320 con 0x562d5152e600 2024-09-13T19:08:31.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa009ffb640 1 -- 172.21.15.151:0/2268001159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120032e10 con 0x562d5152e600 2024-09-13T19:08:31.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa009ffb640 1 -- 172.21.15.151:0/2268001159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa12000c150 con 0x562d5152e600 2024-09-13T19:08:31.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- 172.21.15.151:0/2268001159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 msgr2=0x562d5152ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 --2- 172.21.15.151:0/2268001159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa120042010 tx=0x7fa1200523a0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- 172.21.15.151:0/2268001159 shutdown_connections 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 --2- 172.21.15.151:0/2268001159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d5152ea00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- 172.21.15.151:0/2268001159 >> 172.21.15.151:0/2268001159 conn(0x562d5152aa30 msgr2=0x562d51528b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- 172.21.15.151:0/2268001159 shutdown_connections 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- 172.21.15.151:0/2268001159 wait complete. 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 Processor -- start 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- start start 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d51535830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa128714980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x562d5152f4a0 con 0x562d5152e600 2024-09-13T19:08:31.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d51535830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d51535830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58426/0 (socket says 172.21.15.151:58426) 2024-09-13T19:08:31.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 learned_addr learned my addr 172.21.15.151:0/2090990107 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d51535d70 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.504+0000 7fa126224640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d51535830 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c010 tx=0x7fa120058000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 -- 172.21.15.151:0/2090990107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120026a50 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 -- 172.21.15.151:0/2090990107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa120026bf0 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d51535d70 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 -- 172.21.15.151:0/2090990107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa120035ba0 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d515361e0 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 -- 172.21.15.151:0/2090990107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa120069020 con 0x562d5152e600 2024-09-13T19:08:31.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ff0034650 0x7f9ff0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7f9ff7fff640 1 -- 172.21.15.151:0/2090990107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa120059070 con 0x562d5152e600 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa125a23640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ff0034650 0x7f9ff0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51540900 0x562d51542dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51543510 con 0x562d51540900 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51540900 0x562d51542dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa125a23640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ff0034650 0x7f9ff0036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0aa910 tx=0x7fa11c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51540900 0x562d51542dc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 realm 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51543920 con 0x562d51540900 2024-09-13T19:08:31.518 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d515441c0 con 0x562d51540900 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d515452c0 0x562d515476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51547c30 con 0x562d515452c0 2024-09-13T19:08:31.519 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.508+0000 7fa126224640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d515452c0 0x562d515476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.520 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126224640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d515452c0 0x562d515476b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa128714980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa128714980 20 searching for the correct realm 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51549490 con 0x562d515452c0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126224640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa120023bc0 0x7fa12002a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51549490 con 0x7fa120023bc0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa120023bc0 0x7fa12002a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa120023bc0 0x7fa12002a100 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa11c0aaae0 con 0x7fa120023bc0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51549490 con 0x7fa120023bc0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa11c0aaae0 con 0x7fa120023bc0 2024-09-13T19:08:31.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51549490 con 0x562d51540900 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa118018410 0x7fa118018870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa118018410 0x7fa118018870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.512+0000 7fa126a25640 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa118018410 0x7fa118018870 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x7fa118018410 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x7fa118018410 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa120023bc0 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa11c0aaae0 con 0x7fa120023bc0 2024-09-13T19:08:31.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x7fa118018410 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa120023bc0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa11c0aaae0 con 0x7fa120023bc0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.516+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x7fa118018410 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x7fa118018410 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa120023bc0 2024-09-13T19:08:31.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa11c0aaae0 con 0x7fa120023bc0 2024-09-13T19:08:31.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1180083f0 con 0x562d51540900 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.520+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa120023bc0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d515452c0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562d51544560 con 0x562d51540900 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa11803b040 con 0x7fa120023bc0 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:31.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51548480 con 0x562d51540900 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51548870 con 0x562d51540900 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.524+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51548870 con 0x7fa120023bc0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 zone default found 2024-09-13T19:08:31.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 4 Realm: () 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 zonegroup default 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51549140 con 0x7fa118018410 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51549140 con 0x562d515452c0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d5154b320 con 0x562d515452c0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 started sync module instance, tier type = 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154a7c0 con 0x7fa120023bc0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94752638020528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154bb70 con 0x7fa120023bc0 2024-09-13T19:08:31.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.528+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154c3c0 con 0x562d51540900 2024-09-13T19:08:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.532+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94752638020528] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.532+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.532+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94752638023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154c3c0 con 0x562d51540900 2024-09-13T19:08:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.532+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154ce00 con 0x562d515452c0 2024-09-13T19:08:31.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.532+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94752638023360] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94752638025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154c330 con 0x562d515452c0 2024-09-13T19:08:31.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154dbd0 con 0x7fa120023bc0 2024-09-13T19:08:31.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94752638031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154e470 con 0x7fa120023bc0 2024-09-13T19:08:31.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154ee90 con 0x562d51540900 2024-09-13T19:08:31.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94752638025488] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94752638031520] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94752638036352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154dfc0 con 0x562d51540900 2024-09-13T19:08:31.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.536+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154f730 con 0x7fa118018410 2024-09-13T19:08:31.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.540+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94752638036352] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.540+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.540+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94752638030320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154dfc0 con 0x7fa118018410 2024-09-13T19:08:31.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.540+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154fc20 con 0x7fa118018410 2024-09-13T19:08:31.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94752638039856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51550040 con 0x7fa118018410 2024-09-13T19:08:31.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51550b50 con 0x7fa118018410 2024-09-13T19:08:31.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94752638030320] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94752638039856] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94752638043648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d5154fb50 con 0x7fa118018410 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=0 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=1 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=2 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=3 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=4 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=5 2024-09-13T19:08:31.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.544+0000 7fa128714980 20 add_watcher() i=6 2024-09-13T19:08:31.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94752638043648] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 add_watcher() i=7 2024-09-13T19:08:31.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:31.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51553b40 con 0x562d51540900 2024-09-13T19:08:31.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94752638038656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51550fc0 con 0x562d51540900 2024-09-13T19:08:31.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94752638038656] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7f9fdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:31.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:31.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 5 note: GC not initialized 2024-09-13T19:08:31.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7f9f577fe640 20 reqs_thread_entry: start 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 Filter name: none 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7f9f557fa640 20 reqs_thread_entry: start 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 rados->read ofs=0 len=0 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b90 con 0x562d51540900 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.548+0000 7fa128714980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:31.557 INFO:teuthology.orchestra.run.smithi151.stderr:could not fetch user info: no user info saved 2024-09-13T19:08:31.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7f9fdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:31.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94752638038656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x562d51540900 2024-09-13T19:08:31.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94752638038656] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94752638020528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x7fa120023bc0 2024-09-13T19:08:31.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94752638020528] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa128714980 20 remove_watcher() i=0 2024-09-13T19:08:31.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa128714980 2 removed watcher, disabling cache 2024-09-13T19:08:31.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.552+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94752638023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x562d51540900 2024-09-13T19:08:31.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94752638023360] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa128714980 20 remove_watcher() i=1 2024-09-13T19:08:31.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94752638025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x562d515452c0 2024-09-13T19:08:31.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa126224640 1 -- 172.21.15.151:0/2090990107 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94752638025488] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa12000f070 con 0x562d515452c0 2024-09-13T19:08:31.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa128714980 20 remove_watcher() i=2 2024-09-13T19:08:31.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.556+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94752638031520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x7fa120023bc0 2024-09-13T19:08:31.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa125a23640 1 -- 172.21.15.151:0/2090990107 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94752638031520] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa11c0e7040 con 0x7fa120023bc0 2024-09-13T19:08:31.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa128714980 20 remove_watcher() i=3 2024-09-13T19:08:31.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94752638036352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x562d51540900 2024-09-13T19:08:31.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94752638036352] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x562d51540900 2024-09-13T19:08:31.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa128714980 20 remove_watcher() i=4 2024-09-13T19:08:31.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.560+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94752638030320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x7fa118018410 2024-09-13T19:08:31.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.564+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94752638030320] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.564+0000 7fa128714980 20 remove_watcher() i=5 2024-09-13T19:08:31.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.564+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94752638039856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x7fa118018410 2024-09-13T19:08:31.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94752638039856] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 20 remove_watcher() i=6 2024-09-13T19:08:31.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94752638043648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562d51576b50 con 0x7fa118018410 2024-09-13T19:08:31.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94752638043648] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa118036040 con 0x7fa118018410 2024-09-13T19:08:31.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 20 remove_watcher() i=7 2024-09-13T19:08:31.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa118018410 msgr2=0x7fa118018870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fa118018410 0x7fa118018870 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51540900 msgr2=0x562d51542dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51540900 0x562d51542dc0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa120023bc0 msgr2=0x7fa12002a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fa120023bc0 0x7fa12002a100 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d515452c0 msgr2=0x562d515476b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d515452c0 0x562d515476b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ff0034650 msgr2=0x7f9ff0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f9ff0034650 0x7f9ff0036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0aa910 tx=0x7fa11c0c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 msgr2=0x562d51535830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/2090990107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5152e600 0x562d51535830 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c010 tx=0x7fa120058000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 reap_dead start 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa126a25640 1 -- 172.21.15.151:0/2090990107 reap_dead start 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 shutdown_connections 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 >> 172.21.15.151:0/2090990107 conn(0x562d5152aa30 msgr2=0x562d51528b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 shutdown_connections 2024-09-13T19:08:31.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/2090990107 wait complete. 2024-09-13T19:08:31.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 msgr2=0x7fa000036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 0x7fa000036b60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa11c000c10 tx=0x7fa11c005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 msgr2=0x562d515221a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa1200313f0 tx=0x7fa120026430 comp rx=0 tx=0).stop 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 shutdown_connections 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa0000346a0 0x7fa000036b60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 --2- 172.21.15.151:0/1813631684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d51521d80 0x562d515221a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.568+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 >> 172.21.15.151:0/1813631684 conn(0x562d51516ed0 msgr2=0x562d51519950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 shutdown_connections 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/1813631684 wait complete. 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51413a10 msgr2=0x562d5150b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x562d51413a10 0x562d5150b1b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x562d515117c0 msgr2=0x562d51513bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x562d515117c0 0x562d51513bb0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d5150d880 msgr2=0x562d5150fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x562d5150d880 0x562d5150fc70 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa00c034650 msgr2=0x7fa00c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fa00c034650 0x7fa00c036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ae000 tx=0x7fa11c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 msgr2=0x562d513864f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 --2- 172.21.15.151:0/2086510194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x562d5140f690 0x562d513864f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa120001af0 tx=0x7fa120000f50 comp rx=0 tx=0).stop 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa126a25640 1 -- 172.21.15.151:0/2086510194 reap_dead start 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 shutdown_connections 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 >> 172.21.15.151:0/2086510194 conn(0x562d5140b1b0 msgr2=0x562d514f51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 shutdown_connections 2024-09-13T19:08:31.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.572+0000 7fa128714980 1 -- 172.21.15.151:0/2086510194 wait complete. 2024-09-13T19:08:31.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-13T19:08:31.589 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:08:31.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-13T19:08:31.590 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-13T19:08:31.665 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:31.665 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e3509980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559e6a31b990 0x559e6a31bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e3509980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559e6a1a1ae0 con 0x559e6a31c2e0 2024-09-13T19:08:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e3509980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559e6a1c5e30 con 0x559e6a31b990 2024-09-13T19:08:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e1019640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559e6a31b990 0x559e6a31bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e0818640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x559e6a31c2e0 0x559e6a320cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39738/0 (socket says 172.21.15.151:39738) 2024-09-13T19:08:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e0818640 1 -- 172.21.15.151:0/568578915 learned_addr learned my addr 172.21.15.151:0/568578915 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e1019640 1 -- 172.21.15.151:0/568578915 >> v1:172.21.15.12:6789/0 conn(0x559e6a31c2e0 legacy=0x559e6a320cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.660+0000 7f66e1019640 1 -- 172.21.15.151:0/568578915 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a323500 con 0x559e6a31b990 2024-09-13T19:08:31.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e1019640 1 --2- 172.21.15.151:0/568578915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a31bd70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f66d400a420 tx=0x7f66d401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60a4ad5c348a050 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66dbfff640 1 -- 172.21.15.151:0/568578915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40af070 con 0x559e6a31b990 2024-09-13T19:08:31.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66dbfff640 1 -- 172.21.15.151:0/568578915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d40aa530 con 0x559e6a31b990 2024-09-13T19:08:31.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66dbfff640 1 -- 172.21.15.151:0/568578915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40aa850 con 0x559e6a31b990 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 -- 172.21.15.151:0/568578915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 msgr2=0x559e6a31bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 --2- 172.21.15.151:0/568578915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a31bd70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f66d400a420 tx=0x7f66d401afd0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 -- 172.21.15.151:0/568578915 shutdown_connections 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 --2- 172.21.15.151:0/568578915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a31bd70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 -- 172.21.15.151:0/568578915 >> 172.21.15.151:0/568578915 conn(0x559e6a28f2e0 msgr2=0x559e6a28f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 -- 172.21.15.151:0/568578915 shutdown_connections 2024-09-13T19:08:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.664+0000 7f66e3509980 1 -- 172.21.15.151:0/568578915 wait complete. 2024-09-13T19:08:31.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e3509980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e3509980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e6a1c7200 con 0x559e6a31b990 2024-09-13T19:08:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58442/0 (socket says 172.21.15.151:58442) 2024-09-13T19:08:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e1019640 1 -- 172.21.15.151:0/3234694685 learned_addr learned my addr 172.21.15.151:0/3234694685 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e1019640 1 -- 172.21.15.151:0/3234694685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a407290 con 0x559e6a31b990 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f66e1019640 1 --2- 172.21.15.151:0/3234694685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f66d40aa500 tx=0x7f66d40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3498b1dd5760a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f65cf606640 1 -- 172.21.15.151:0/3234694685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40af040 con 0x559e6a31b990 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f65cf606640 1 -- 172.21.15.151:0/3234694685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d40abb80 con 0x559e6a31b990 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.680+0000 7f65cf606640 1 -- 172.21.15.151:0/3234694685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40b5470 con 0x559e6a31b990 2024-09-13T19:08:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3234694685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 msgr2=0x559e6a406cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 --2- 172.21.15.151:0/3234694685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f66d40aa500 tx=0x7f66d40033b0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3234694685 shutdown_connections 2024-09-13T19:08:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 --2- 172.21.15.151:0/3234694685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31b990 0x559e6a406cc0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3234694685 >> 172.21.15.151:0/3234694685 conn(0x559e6a28f2e0 msgr2=0x559e6a4028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3234694685 shutdown_connections 2024-09-13T19:08:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3234694685 wait complete. 2024-09-13T19:08:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e6a322f40 con 0x559e6a31c2e0 2024-09-13T19:08:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58444/0 (socket says 172.21.15.151:58444) 2024-09-13T19:08:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e1019640 1 -- 172.21.15.151:0/3156599692 learned_addr learned my addr 172.21.15.151:0/3156599692 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e1019640 1 -- 172.21.15.151:0/3156599692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a40e630 con 0x559e6a31c2e0 2024-09-13T19:08:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e1019640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f66d40aa500 tx=0x7f66d4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f65cde03640 1 -- 172.21.15.151:0/3156599692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40b57b0 con 0x559e6a31c2e0 2024-09-13T19:08:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f65cde03640 1 -- 172.21.15.151:0/3156599692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d40c6070 con 0x559e6a31c2e0 2024-09-13T19:08:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e6a40e8c0 con 0x559e6a31c2e0 2024-09-13T19:08:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f65cde03640 1 -- 172.21.15.151:0/3156599692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40b5ac0 con 0x559e6a31c2e0 2024-09-13T19:08:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e6a4115a0 con 0x559e6a31c2e0 2024-09-13T19:08:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.684+0000 7f66e3509980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e6a220800 con 0x559e6a41b2a0 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65cde03640 1 -- 172.21.15.151:0/3156599692 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f66d40b5c60 con 0x559e6a31c2e0 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58460/0 (socket says 172.21.15.151:58460) 2024-09-13T19:08:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 -- 172.21.15.151:0/1580393655 learned_addr learned my addr 172.21.15.151:0/1580393655 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65cde03640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 0x7f65c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65cde03640 1 -- 172.21.15.151:0/3156599692 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f66d40bb070 con 0x559e6a31c2e0 2024-09-13T19:08:31.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e1019640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 0x7f65c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 -- 172.21.15.151:0/1580393655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a41bbe0 con 0x559e6a41b2a0 2024-09-13T19:08:31.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e1019640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 0x7f65c8036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d4005c00 tx=0x7f66d4005b90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- 172.21.15.151:0/1580393655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a440 tx=0x7f66dc00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39ffc1f2a467995 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65c77fe640 1 -- 172.21.15.151:0/1580393655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc008850 con 0x559e6a41b2a0 2024-09-13T19:08:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65c77fe640 1 -- 172.21.15.151:0/1580393655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc008a10 con 0x559e6a41b2a0 2024-09-13T19:08:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65c77fe640 1 -- 172.21.15.151:0/1580393655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc008d30 con 0x559e6a41b2a0 2024-09-13T19:08:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/1580393655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 msgr2=0x559e6a41b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 --2- 172.21.15.151:0/1580393655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a440 tx=0x7f66dc00a900 comp rx=0 tx=0).stop 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/1580393655 shutdown_connections 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 --2- 172.21.15.151:0/1580393655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a41b6a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/1580393655 >> 172.21.15.151:0/1580393655 conn(0x559e6a4167a0 msgr2=0x559e6a4195f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/1580393655 shutdown_connections 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/1580393655 wait complete. 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e6a41be70 con 0x559e6a41b2a0 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58464/0 (socket says 172.21.15.151:58464) 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 -- 172.21.15.151:0/125395870 learned_addr learned my addr 172.21.15.151:0/125395870 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 -- 172.21.15.151:0/125395870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a422b50 con 0x559e6a41b2a0 2024-09-13T19:08:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e181a640 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x559e6a41c050 tx=0x7f66dc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65c5ffb640 1 -- 172.21.15.151:0/125395870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc013a70 con 0x559e6a41b2a0 2024-09-13T19:08:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f65c5ffb640 1 -- 172.21.15.151:0/125395870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc023070 con 0x559e6a41b2a0 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.688+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e6a422de0 con 0x559e6a41b2a0 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65c5ffb640 1 -- 172.21.15.151:0/125395870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66dc013d40 con 0x559e6a41b2a0 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e6a425ac0 con 0x559e6a41b2a0 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65c5ffb640 1 -- 172.21.15.151:0/125395870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f66dc028460 con 0x559e6a41b2a0 2024-09-13T19:08:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 1 Processor -- start 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65c5ffb640 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 0x7f65b8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65c5ffb640 1 -- 172.21.15.151:0/125395870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f66dc04a030 con 0x559e6a41b2a0 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 1 -- start start 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e181a640 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 0x7f65b8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e3509980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559e6a407550 con 0x559e6a43bf30 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e181a640 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 0x7f65b8036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0056a0 tx=0x7f66dc013f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e1019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58480/0 (socket says 172.21.15.151:58480) 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e1019640 1 -- 172.21.15.151:0/4145518140 learned_addr learned my addr 172.21.15.151:0/4145518140 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e1019640 1 -- 172.21.15.151:0/4145518140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6a43c920 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f66e1019640 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f66d401ae00 tx=0x7f66d40e3430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65a5fe3640 1 -- 172.21.15.151:0/4145518140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40bf5b0 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.692+0000 7f65a5fe3640 1 -- 172.21.15.151:0/4145518140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d40bf790 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559e6a43f480 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f65a5fe3640 1 -- 172.21.15.151:0/4145518140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66d40a8b60 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e6a43f830 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f65a5fe3640 1 -- 172.21.15.151:0/4145518140 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f66d40f0060 con 0x559e6a43bf30 2024-09-13T19:08:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f65a5fe3640 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 0x7f6524036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f65a5fe3640 1 -- 172.21.15.151:0/4145518140 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f66d40ead30 con 0x559e6a43bf30 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e0818640 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 0x7f6524036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f651f7fe640 20 reqs_thread_entry: start 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 0x559e6a443e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e6a4444d0 con 0x559e6a441990 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e0818640 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 0x7f6524036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f70 tx=0x7f66cc001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e181a640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 0x559e6a443e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e181a640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 0x559e6a443e00 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e181a640 1 -- 172.21.15.151:0/3156599692 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66dc01e7a0 con 0x559e6a441990 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 0x559e6a448690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:2 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559e6a448ce0 con 0x559e6a4462a0 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e1019640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 0x559e6a448690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e1019640 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 0x559e6a448690 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.696+0000 7f66e1019640 1 -- 172.21.15.151:0/3156599692 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(2 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66d40d2070 con 0x559e6a4462a0 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 msgr2=0x7f65b8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 0x7f65b8036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0056a0 tx=0x7f66dc013f60 comp rx=0 tx=0).stop 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 msgr2=0x559e6a422610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x559e6a41c050 tx=0x7f66dc003000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 shutdown_connections 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65b8034650 0x7f65b8036b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/125395870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a41b2a0 0x559e6a422610 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 >> 172.21.15.151:0/125395870 conn(0x559e6a4167a0 msgr2=0x559e6a414c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 shutdown_connections 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/125395870 wait complete. 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 msgr2=0x7f6524036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 0x7f6524036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000f70 tx=0x7f66cc001240 comp rx=0 tx=0).stop 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 msgr2=0x559e6a43c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f66d401ae00 tx=0x7f66d40e3430 comp rx=0 tx=0).stop 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 shutdown_connections 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6524034650 0x7f6524036b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/4145518140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a43bf30 0x559e6a43c350 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 >> 172.21.15.151:0/4145518140 conn(0x559e6a430f00 msgr2=0x559e6a4337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 shutdown_connections 2024-09-13T19:08:31.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/4145518140 wait complete. 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 msgr2=0x559e6a443e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 0x559e6a443e00 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 msgr2=0x559e6a448690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 0x559e6a448690 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 msgr2=0x7f65c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 0x7f65c8036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d4005c00 tx=0x7f66d4005b90 comp rx=0 tx=0).stop 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 msgr2=0x559e6a40e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f66d40aa500 tx=0x7f66d4017d70 comp rx=0 tx=0).stop 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 shutdown_connections 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559e6a4462a0 0x559e6a448690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f65c8034650 0x7f65c8036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559e6a441990 0x559e6a443e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 --2- 172.21.15.151:0/3156599692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559e6a31c2e0 0x559e6a40e0f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 >> 172.21.15.151:0/3156599692 conn(0x559e6a28f2e0 msgr2=0x559e6a401470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 shutdown_connections 2024-09-13T19:08:31.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.700+0000 7f66e3509980 1 -- 172.21.15.151:0/3156599692 wait complete. 2024-09-13T19:08:31.735 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:08:31.735 DEBUG:tasks.util.rgw: json result: {'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:08:31.735 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-13T19:08:31.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-13T19:08:31.736 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-13T19:08:31.814 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:31.815 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:31.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf09fc3980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e0d6b50ab0 0x55e0d6b52ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf09fc3980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0d69d4ae0 con 0x55e0d6ac1280 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf09fc3980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55e0d69f8e30 con 0x55e0d6b50ab0 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf072d2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e0d6b50ab0 0x55e0d6b52ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf07ad3640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55e0d6ac1280 0x55e0d6b4f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39748/0 (socket says 172.21.15.151:39748) 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf072d2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55e0d6b50ab0 0x55e0d6b52ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58482/0 (socket says 172.21.15.151:58482) 2024-09-13T19:08:31.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf07ad3640 1 -- 172.21.15.151:0/3471443396 learned_addr learned my addr 172.21.15.151:0/3471443396 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:31.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf072d2640 1 -- 172.21.15.151:0/3471443396 >> v1:172.21.15.12:6789/0 conn(0x55e0d6ac1280 legacy=0x55e0d6b4f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.808+0000 7fcf072d2640 1 -- 172.21.15.151:0/3471443396 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6ac1810 con 0x55e0d6b50ab0 2024-09-13T19:08:31.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf072d2640 1 --2- 172.21.15.151:0/3471443396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6b50ab0 0x55e0d6b52ea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcef800a480 tx=0x7fcef801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f676292bb7dc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf06ad1640 1 -- 172.21.15.151:0/3471443396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef80b0070 con 0x55e0d6b50ab0 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf06ad1640 1 -- 172.21.15.151:0/3471443396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef80ab540 con 0x55e0d6b50ab0 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf06ad1640 1 -- 172.21.15.151:0/3471443396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef80ab840 con 0x55e0d6b50ab0 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3471443396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6b50ab0 msgr2=0x55e0d6b52ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3471443396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6b50ab0 0x55e0d6b52ea0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcef800a480 tx=0x7fcef801b280 comp rx=0 tx=0).stop 2024-09-13T19:08:31.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3471443396 shutdown_connections 2024-09-13T19:08:31.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3471443396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6b50ab0 0x55e0d6b52ea0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3471443396 >> 172.21.15.151:0/3471443396 conn(0x55e0d6b47080 msgr2=0x55e0d6b494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3471443396 shutdown_connections 2024-09-13T19:08:31.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.812+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3471443396 wait complete. 2024-09-13T19:08:31.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf09fc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf09fc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0d69fa200 con 0x55e0d6ac1280 2024-09-13T19:08:31.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58496/0 (socket says 172.21.15.151:58496) 2024-09-13T19:08:31.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.828+0000 7fcf07ad3640 1 -- 172.21.15.151:0/3637792275 learned_addr learned my addr 172.21.15.151:0/3637792275 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 -- 172.21.15.151:0/3637792275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6c38030 con 0x55e0d6ac1280 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/3637792275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcef00015f0 tx=0x7fcef0001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c574e289e770d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcdf5e0b640 1 -- 172.21.15.151:0/3637792275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef0004530 con 0x55e0d6ac1280 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcdf5e0b640 1 -- 172.21.15.151:0/3637792275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00046f0 con 0x55e0d6ac1280 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcdf5e0b640 1 -- 172.21.15.151:0/3637792275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef0004a90 con 0x55e0d6ac1280 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3637792275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 msgr2=0x55e0d6c37a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3637792275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcef00015f0 tx=0x7fcef0001ab0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3637792275 shutdown_connections 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3637792275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c37a60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3637792275 >> 172.21.15.151:0/3637792275 conn(0x55e0d6b47080 msgr2=0x55e0d6c33690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3637792275 shutdown_connections 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3637792275 wait complete. 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c3ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf09fc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0d6b53ef0 con 0x55e0d6ac1280 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c3ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c3ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58508/0 (socket says 172.21.15.151:58508) 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 learned_addr learned my addr 172.21.15.151:0/1065894890 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.841 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.832+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6c3f340 con 0x55e0d6ac1280 2024-09-13T19:08:31.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c3ee00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcef0001af0 tx=0x7fcef0000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 -- 172.21.15.151:0/1065894890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef0013630 con 0x55e0d6ac1280 2024-09-13T19:08:31.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 -- 172.21.15.151:0/1065894890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00137d0 con 0x55e0d6ac1280 2024-09-13T19:08:31.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d6c3f5d0 con 0x55e0d6ac1280 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 -- 172.21.15.151:0/1065894890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef0013ad0 con 0x55e0d6ac1280 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d6c422b0 con 0x55e0d6ac1280 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0d6a53800 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 -- 172.21.15.151:0/1065894890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcef0010070 con 0x55e0d6ac1280 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf082d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf082d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58520/0 (socket says 172.21.15.151:58520) 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf082d4640 1 -- 172.21.15.151:0/3694626593 learned_addr learned my addr 172.21.15.151:0/3694626593 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcdf00346a0 0x7fcdf0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdeffff640 1 -- 172.21.15.151:0/1065894890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcef0018070 con 0x55e0d6ac1280 2024-09-13T19:08:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcdf00346a0 0x7fcdf0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf082d4640 1 -- 172.21.15.151:0/3694626593 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6c4c500 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcdf00346a0 0x7fcdf0036b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcef0028f90 tx=0x7fcef001af90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf082d4640 1 --2- 172.21.15.151:0/3694626593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000a440 tx=0x7fcf0000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa31739c808d8bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdedffb640 1 -- 172.21.15.151:0/3694626593 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf00008850 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdedffb640 1 -- 172.21.15.151:0/3694626593 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf00008a10 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcdedffb640 1 -- 172.21.15.151:0/3694626593 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf00008d30 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3694626593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 msgr2=0x55e0d6c4bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.847 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3694626593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000a440 tx=0x7fcf0000a900 comp rx=0 tx=0).stop 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3694626593 shutdown_connections 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3694626593 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6c4bfc0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3694626593 >> 172.21.15.151:0/3694626593 conn(0x55e0d6b50ab0 msgr2=0x55e0d6c474d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3694626593 shutdown_connections 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3694626593 wait complete. 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.836+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0d6c4cee0 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf082d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf082d4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58528/0 (socket says 172.21.15.151:58528) 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf082d4640 1 -- 172.21.15.151:0/1370201242 learned_addr learned my addr 172.21.15.151:0/1370201242 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.848 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf082d4640 1 -- 172.21.15.151:0/1370201242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6b4b3b0 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55e0d6c4c970 tx=0x7fcf00003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 -- 172.21.15.151:0/1370201242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf00013a70 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d6b4b640 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 -- 172.21.15.151:0/1370201242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf00023070 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 -- 172.21.15.151:0/1370201242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf00013d40 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d6b4bab0 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 -- 172.21.15.151:0/1370201242 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcf00028460 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 0x7fcde0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcde7fff640 1 -- 172.21.15.151:0/1370201242 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcf0004a030 con 0x55e0d6c4bbc0 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf072d2640 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 0x7fcde0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 Processor -- start 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.840+0000 7fcf09fc3980 1 -- start start 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55e0d6c383b0 con 0x55e0d6c6e930 2024-09-13T19:08:31.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf072d2640 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 0x7fcde0036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcef80ad000 tx=0x7fcef80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf07ad3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58536/0 (socket says 172.21.15.151:58536) 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf07ad3640 1 -- 172.21.15.151:0/3006075015 learned_addr learned my addr 172.21.15.151:0/3006075015 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf07ad3640 1 -- 172.21.15.151:0/3006075015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d6c6f300 con 0x55e0d6c6e930 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcef001efb0 tx=0x7fcef0010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 -- 172.21.15.151:0/3006075015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00283d0 con 0x55e0d6c6e930 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 -- 172.21.15.151:0/3006075015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef0047020 con 0x55e0d6c6e930 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0d6c71fa0 con 0x55e0d6c6e930 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 -- 172.21.15.151:0/3006075015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef001a490 con 0x55e0d6c6e930 2024-09-13T19:08:31.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d6c72350 con 0x55e0d6c6e930 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 -- 172.21.15.151:0/3006075015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcef0012810 con 0x55e0d6c6e930 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 0x7fcd48036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6ffff640 1 -- 172.21.15.151:0/3006075015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcef0048030 con 0x55e0d6c6e930 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf072d2640 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 0x7fcd48036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcd6dffb640 20 reqs_thread_entry: start 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e0d6c744c0 0x55e0d6c76910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c76f90 con 0x55e0d6c744c0 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf072d2640 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 0x7fcd48036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcef801b2c0 tx=0x7fcef8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e0d6c744c0 0x55e0d6c76910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.844+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e0d6c744c0 0x55e0d6c76910 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c77840 con 0x55e0d6c744c0 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e0d6c79150 0x55e0d6c7b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7bcb0 con 0x55e0d6c79150 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e0d6c79150 0x55e0d6c7b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e0d6c79150 0x55e0d6c7b5c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.856 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c86890 con 0x55e0d6c744c0 2024-09-13T19:08:31.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.858 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: set zone's realm_id= 2024-09-13T19:08:31.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcef001d760 0x7fcef0035680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcef001d760 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcef001d760 0x7fcef0035680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcef001d760 0x7fcef0035680 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcef001d760 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.848+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf000273c0 0x7fcf00028980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcf000273c0 2024-09-13T19:08:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf000273c0 0x7fcf00028980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf000273c0 0x7fcf00028980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcf000273c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcef001d760 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.852+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcf000273c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcef001d760 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcf000273c0 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c79150 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c7c0e0 con 0x7fcf000273c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.856+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x55e0d6c79150 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcef001d760 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x55e0d6c744c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcf000273c0 2024-09-13T19:08:31.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x55e0d6c79150 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef001b030 con 0x55e0d6c79150 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcf000273c0 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcef001d760 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x55e0d6c79150 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(33 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcef006e040 con 0x55e0d6c79150 2024-09-13T19:08:31.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcf000273c0 2024-09-13T19:08:31.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcf0001e7a0 con 0x7fcf000273c0 2024-09-13T19:08:31.870 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.860+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x55e0d6c744c0 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fcf00055040 con 0x7fcef001d760 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf072d2640 1 -- 172.21.15.151:0/1065894890 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef80c0030 con 0x7fcef001d760 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c85210 con 0x55e0d6c744c0 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:38 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c82120 con 0x55e0d6c79150 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(38 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcef006e040 con 0x55e0d6c79150 2024-09-13T19:08:31.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:39 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c83e60 con 0x55e0d6c79150 2024-09-13T19:08:31.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf07ad3640 1 -- 172.21.15.151:0/1065894890 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(39 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fcef006e040 con 0x55e0d6c79150 2024-09-13T19:08:31.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.864+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c813e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.868+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.868+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e0d6c846e0 con 0x55e0d6c744c0 2024-09-13T19:08:31.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.868+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fcf0001e7a0 con 0x55e0d6c744c0 2024-09-13T19:08:31.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 msgr2=0x7fcde0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 0x7fcde0036b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcef80ad000 tx=0x7fcef80a5040 comp rx=0 tx=0).stop 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 msgr2=0x55e0d6b4cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55e0d6c4c970 tx=0x7fcf00003000 comp rx=0 tx=0).stop 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 shutdown_connections 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcde0034650 0x7fcde0036b10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1370201242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c4bbc0 0x55e0d6b4cc90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 >> 172.21.15.151:0/1370201242 conn(0x55e0d6b50ab0 msgr2=0x55e0d6c47040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 shutdown_connections 2024-09-13T19:08:31.881 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1370201242 wait complete. 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 msgr2=0x7fcd48036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 0x7fcd48036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcef801b2c0 tx=0x7fcef8005a10 comp rx=0 tx=0).stop 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 msgr2=0x55e0d6c6ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fcef001efb0 tx=0x7fcef0010960 comp rx=0 tx=0).stop 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 shutdown_connections 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcd48034650 0x7fcd48036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/3006075015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6c6e930 0x55e0d6c6ed30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 >> 172.21.15.151:0/3006075015 conn(0x55e0d6c639c0 msgr2=0x55e0d6c662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 shutdown_connections 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/3006075015 wait complete. 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf000273c0 msgr2=0x7fcf00028980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fcf000273c0 0x7fcf00028980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e0d6c744c0 msgr2=0x55e0d6c76910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55e0d6c744c0 0x55e0d6c76910 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcef001d760 msgr2=0x7fcef0035680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fcef001d760 0x7fcef0035680 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e0d6c79150 msgr2=0x55e0d6c7b5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55e0d6c79150 0x55e0d6c7b5c0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcdf00346a0 msgr2=0x7fcdf0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fcdf00346a0 0x7fcdf0036b60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcef0028f90 tx=0x7fcef001af90 comp rx=0 tx=0).stop 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 msgr2=0x55e0d6c3ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 --2- 172.21.15.151:0/1065894890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55e0d6ac1280 0x55e0d6c3ee00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcef0001af0 tx=0x7fcef0000f50 comp rx=0 tx=0).stop 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 reap_dead start 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf082d4640 1 -- 172.21.15.151:0/1065894890 reap_dead start 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 shutdown_connections 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 >> 172.21.15.151:0/1065894890 conn(0x55e0d6b47080 msgr2=0x55e0d6c32210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 shutdown_connections 2024-09-13T19:08:31.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.872+0000 7fcf09fc3980 1 -- 172.21.15.151:0/1065894890 wait complete. 2024-09-13T19:08:31.889 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:08:31.889 DEBUG:tasks.util.rgw: json result: {'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:08:31.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-13T19:08:31.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-13T19:08:31.890 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-13T19:08:31.968 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:31.969 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff774729980 1 -- start start 2024-09-13T19:08:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff774729980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a23039bb80 0x55a23039a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff774729980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2302adae0 con 0x55a23039bf90 2024-09-13T19:08:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff774729980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55a2302d1e30 con 0x55a23039bb80 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff772239640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a23039bb80 0x55a23039a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff772239640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a23039bb80 0x55a23039a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58544/0 (socket says 172.21.15.151:58544) 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff771a38640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55a23039bf90 0x55a23039a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39754/0 (socket says 172.21.15.151:39754) 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff772239640 1 -- 172.21.15.151:0/3922156235 learned_addr learned my addr 172.21.15.151:0/3922156235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff772239640 1 -- 172.21.15.151:0/3922156235 >> v1:172.21.15.12:6789/0 conn(0x55a23039bf90 legacy=0x55a23039a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.964+0000 7ff772239640 1 -- 172.21.15.151:0/3922156235 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23039b0b0 con 0x55a23039bb80 2024-09-13T19:08:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff772239640 1 --2- 172.21.15.151:0/3922156235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a23039a340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff76400a4e0 tx=0x7ff76401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bf628158be3a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff771237640 1 -- 172.21.15.151:0/3922156235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640aa540 con 0x55a23039bb80 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff771237640 1 -- 172.21.15.151:0/3922156235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640aa6e0 con 0x55a23039bb80 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff771237640 1 -- 172.21.15.151:0/3922156235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640aaa40 con 0x55a23039bb80 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 -- 172.21.15.151:0/3922156235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 msgr2=0x55a23039a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 --2- 172.21.15.151:0/3922156235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a23039a340 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff76400a4e0 tx=0x7ff76401b090 comp rx=0 tx=0).stop 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 -- 172.21.15.151:0/3922156235 shutdown_connections 2024-09-13T19:08:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 --2- 172.21.15.151:0/3922156235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a23039a340 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 -- 172.21.15.151:0/3922156235 >> 172.21.15.151:0/3922156235 conn(0x55a230421160 msgr2=0x55a230423580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 -- 172.21.15.151:0/3922156235 shutdown_connections 2024-09-13T19:08:31.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.968+0000 7ff774729980 1 -- 172.21.15.151:0/3922156235 wait complete. 2024-09-13T19:08:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff774729980 1 -- start start 2024-09-13T19:08:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff774729980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff774729980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2302d3200 con 0x55a23039bb80 2024-09-13T19:08:31.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58550/0 (socket says 172.21.15.151:58550) 2024-09-13T19:08:31.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff772239640 1 -- 172.21.15.151:0/3391240877 learned_addr learned my addr 172.21.15.151:0/3391240877 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff772239640 1 -- 172.21.15.151:0/3391240877 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a230513180 con 0x55a23039bb80 2024-09-13T19:08:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff772239640 1 --2- 172.21.15.151:0/3391240877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff764018cc0 tx=0x7ff7640033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee0ad4a059fa8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff660608640 1 -- 172.21.15.151:0/3391240877 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640b9070 con 0x55a23039bb80 2024-09-13T19:08:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff660608640 1 -- 172.21.15.151:0/3391240877 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640aab00 con 0x55a23039bb80 2024-09-13T19:08:31.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.984+0000 7ff660608640 1 -- 172.21.15.151:0/3391240877 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640aae20 con 0x55a23039bb80 2024-09-13T19:08:31.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/3391240877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 msgr2=0x55a230512bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 --2- 172.21.15.151:0/3391240877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff764018cc0 tx=0x7ff7640033b0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/3391240877 shutdown_connections 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 --2- 172.21.15.151:0/3391240877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230512bb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/3391240877 >> 172.21.15.151:0/3391240877 conn(0x55a230421160 msgr2=0x55a23050e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/3391240877 shutdown_connections 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/3391240877 wait complete. 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- start start 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a2304311b0 con 0x55a23039bb80 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58562/0 (socket says 172.21.15.151:58562) 2024-09-13T19:08:31.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff772239640 1 -- 172.21.15.151:0/514829324 learned_addr learned my addr 172.21.15.151:0/514829324 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff772239640 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23051a380 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff772239640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff764005cc0 tx=0x7ff764017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff65ee05640 1 -- 172.21.15.151:0/514829324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640b9070 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a23051a610 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff65ee05640 1 -- 172.21.15.151:0/514829324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640c8420 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff65ee05640 1 -- 172.21.15.151:0/514829324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640c8700 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23051d2f0 con 0x55a23039bb80 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:31.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- start start 2024-09-13T19:08:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.988+0000 7ff774729980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a23032c800 con 0x55a230526c00 2024-09-13T19:08:31.998 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ee05640 1 -- 172.21.15.151:0/514829324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7640b3040 con 0x55a23039bb80 2024-09-13T19:08:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58570/0 (socket says 172.21.15.151:58570) 2024-09-13T19:08:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 -- 172.21.15.151:0/3035687116 learned_addr learned my addr 172.21.15.151:0/3035687116 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ee05640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 0x7ff658036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.000 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ee05640 1 -- 172.21.15.151:0/514829324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff7640c4070 con 0x55a23039bb80 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772239640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 0x7ff658036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 -- 172.21.15.151:0/3035687116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a230527540 con 0x55a230526c00 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772239640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 0x7ff658036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7640a3cb0 tx=0x7ff7640a3c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- 172.21.15.151:0/3035687116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a440 tx=0x7ff76c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb59cefc1ce3d7db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ce01640 1 -- 172.21.15.151:0/3035687116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76c008850 con 0x55a230526c00 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ce01640 1 -- 172.21.15.151:0/3035687116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76c008a10 con 0x55a230526c00 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff65ce01640 1 -- 172.21.15.151:0/3035687116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76c008d30 con 0x55a230526c00 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- 172.21.15.151:0/3035687116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 msgr2=0x55a230527000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 --2- 172.21.15.151:0/3035687116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00a440 tx=0x7ff76c00a900 comp rx=0 tx=0).stop 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- 172.21.15.151:0/3035687116 shutdown_connections 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 --2- 172.21.15.151:0/3035687116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a230527000 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- 172.21.15.151:0/3035687116 >> 172.21.15.151:0/3035687116 conn(0x55a23039bf90 msgr2=0x55a230522510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- 172.21.15.151:0/3035687116 shutdown_connections 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- 172.21.15.151:0/3035687116 wait complete. 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- start start 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff774729980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a230527f20 con 0x55a230526c00 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58574/0 (socket says 172.21.15.151:58574) 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 -- 172.21.15.151:0/73897873 learned_addr learned my addr 172.21.15.151:0/73897873 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 -- 172.21.15.151:0/73897873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23052e4e0 con 0x55a230526c00 2024-09-13T19:08:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.992+0000 7ff772a3a640 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55a2305279b0 tx=0x7ff76c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 -- 172.21.15.151:0/73897873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76c013a70 con 0x55a230526c00 2024-09-13T19:08:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 -- 172.21.15.151:0/73897873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff76c023070 con 0x55a230526c00 2024-09-13T19:08:32.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a23052e770 con 0x55a230526c00 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 -- 172.21.15.151:0/73897873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff76c013d40 con 0x55a230526c00 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a230531450 con 0x55a230526c00 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 -- 172.21.15.151:0/73897873 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff76c028460 con 0x55a230526c00 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 0x7ff64c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff656ffd640 1 -- 172.21.15.151:0/73897873 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff76c04a0f0 con 0x55a230526c00 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff771a38640 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 0x7ff64c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 Processor -- start 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- start start 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a230513440 con 0x55a2305477e0 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff771a38640 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 0x7ff64c036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55a2305230b0 tx=0x7ff75c001330 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff772239640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58576/0 (socket says 172.21.15.151:58576) 2024-09-13T19:08:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff772239640 1 -- 172.21.15.151:0/1249061158 learned_addr learned my addr 172.21.15.151:0/1249061158 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff772239640 1 -- 172.21.15.151:0/1249061158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2305481d0 con 0x55a2305477e0 2024-09-13T19:08:32.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff772239640 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff76401b0d0 tx=0x7ff7640c76c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff6377e6640 1 -- 172.21.15.151:0/1249061158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640b4b70 con 0x55a2305477e0 2024-09-13T19:08:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a23054ae50 con 0x55a2305477e0 2024-09-13T19:08:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff6377e6640 1 -- 172.21.15.151:0/1249061158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7640b4d10 con 0x55a2305477e0 2024-09-13T19:08:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff6377e6640 1 -- 172.21.15.151:0/1249061158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7640c88a0 con 0x55a2305477e0 2024-09-13T19:08:32.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:31.996+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23054b200 con 0x55a2305477e0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff6377e6640 1 -- 172.21.15.151:0/1249061158 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff7640c8a40 con 0x55a2305477e0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff6377e6640 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 0x7ff5a8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff6377e6640 1 -- 172.21.15.151:0/1249061158 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff7640d8050 con 0x55a2305477e0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff771a38640 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 0x7ff5a8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff6357e2640 20 reqs_thread_entry: start 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 0x55a23054f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff771a38640 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 0x7ff5a8036b60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000f70 tx=0x7ff75c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a23054fe50 con 0x55a23054d3c0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772a3a640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 0x55a23054f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772a3a640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 0x55a23054f7d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772a3a640 1 -- 172.21.15.151:0/514829324 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff76c01e7a0 con 0x55a23054d3c0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a230550730 con 0x55a23054d3c0 2024-09-13T19:08:32.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772a3a640 1 -- 172.21.15.151:0/514829324 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff76c01e7a0 con 0x55a23054d3c0 2024-09-13T19:08:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 0x55a230554470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a230554b60 con 0x55a230552040 2024-09-13T19:08:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772239640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 0x55a230554470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772239640 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 0x55a230554470 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.000+0000 7ff772239640 1 -- 172.21.15.151:0/514829324 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7ff7640eb020 con 0x55a230552040 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 msgr2=0x7ff64c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 0x7ff64c036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55a2305230b0 tx=0x7ff75c001330 comp rx=0 tx=0).stop 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 msgr2=0x55a23052dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x55a2305279b0 tx=0x7ff76c003000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 shutdown_connections 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff64c034650 0x7ff64c036b10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.012 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/73897873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a230526c00 0x55a23052dfa0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 >> 172.21.15.151:0/73897873 conn(0x55a23039bf90 msgr2=0x55a230522080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 shutdown_connections 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/73897873 wait complete. 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 msgr2=0x7ff5a8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 0x7ff5a8036b60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff75c000f70 tx=0x7ff75c00f000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 msgr2=0x55a230547c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff76401b0d0 tx=0x7ff7640c76c0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 shutdown_connections 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff5a80346a0 0x7ff5a8036b60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/1249061158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a2305477e0 0x55a230547c00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 >> 172.21.15.151:0/1249061158 conn(0x55a23053c890 msgr2=0x55a23053f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 shutdown_connections 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/1249061158 wait complete. 2024-09-13T19:08:32.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 msgr2=0x55a23054f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 0x55a23054f7d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 msgr2=0x55a230554470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 0x55a230554470 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 msgr2=0x7ff658036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 0x7ff658036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff7640a3cb0 tx=0x7ff7640a3c40 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 msgr2=0x55a230519e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff764005cc0 tx=0x7ff764017e30 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 shutdown_connections 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a230552040 0x55a230554470 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff658034650 0x7ff658036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a23054d3c0 0x55a23054f7d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 --2- 172.21.15.151:0/514829324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a23039bb80 0x55a230519e40 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 >> 172.21.15.151:0/514829324 conn(0x55a230421160 msgr2=0x55a23050d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 shutdown_connections 2024-09-13T19:08:32.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.004+0000 7ff774729980 1 -- 172.21.15.151:0/514829324 wait complete. 2024-09-13T19:08:32.022 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-13T19:08:32.022 DEBUG:tasks.util.rgw: json result: {'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-13T19:08:32.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:08:32.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-13T19:08:32.022 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-13T19:08:32.104 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:32.104 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:32.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.096+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.104 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.096+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfe027980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7c3fd2520 0x55c7c3fd2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfe027980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7c3e5bae0 con 0x55c7c3fd2e70 2024-09-13T19:08:32.105 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfe027980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55c7c3e7fe30 con 0x55c7c3fd2520 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7c3fd2520 0x55c7c3fd2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55c7c3fd2520 0x55c7c3fd2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58588/0 (socket says 172.21.15.151:58588) 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3587144341 learned_addr learned my addr 172.21.15.151:0/3587144341 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfb336640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55c7c3fd2e70 0x55c7c3fd78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39768/0 (socket says 172.21.15.151:39768) 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3587144341 >> v1:172.21.15.12:6789/0 conn(0x55c7c3fd2e70 legacy=0x55c7c3fd78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3587144341 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c3fda140 con 0x55c7c3fd2520 2024-09-13T19:08:32.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3587144341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c3fd2900 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a4e0 tx=0x7fbbf401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320fb35e8153eb77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfab35640 1 -- 172.21.15.151:0/3587144341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40aa540 con 0x55c7c3fd2520 2024-09-13T19:08:32.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfab35640 1 -- 172.21.15.151:0/3587144341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40aa6e0 con 0x55c7c3fd2520 2024-09-13T19:08:32.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.100+0000 7fbbfab35640 1 -- 172.21.15.151:0/3587144341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40aaa40 con 0x55c7c3fd2520 2024-09-13T19:08:32.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 -- 172.21.15.151:0/3587144341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 msgr2=0x55c7c3fd2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3587144341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c3fd2900 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a4e0 tx=0x7fbbf401b090 comp rx=0 tx=0).stop 2024-09-13T19:08:32.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 -- 172.21.15.151:0/3587144341 shutdown_connections 2024-09-13T19:08:32.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3587144341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c3fd2900 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 -- 172.21.15.151:0/3587144341 >> 172.21.15.151:0/3587144341 conn(0x55c7c3fce040 msgr2=0x55c7c3fd0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 -- 172.21.15.151:0/3587144341 shutdown_connections 2024-09-13T19:08:32.110 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.104+0000 7fbbfe027980 1 -- 172.21.15.151:0/3587144341 wait complete. 2024-09-13T19:08:32.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfe027980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfe027980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7c3e81200 con 0x55c7c3fd2520 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58602/0 (socket says 172.21.15.151:58602) 2024-09-13T19:08:32.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.116+0000 7fbbfbb37640 1 -- 172.21.15.151:0/445206235 learned_addr learned my addr 172.21.15.151:0/445206235 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 -- 172.21.15.151:0/445206235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c40bce40 con 0x55c7c3fd2520 2024-09-13T19:08:32.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/445206235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4017ca0 tx=0x7fbbf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec36931f35132864 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbae9e0b640 1 -- 172.21.15.151:0/445206235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40b9070 con 0x55c7c3fd2520 2024-09-13T19:08:32.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbae9e0b640 1 -- 172.21.15.151:0/445206235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40aaa80 con 0x55c7c3fd2520 2024-09-13T19:08:32.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbae9e0b640 1 -- 172.21.15.151:0/445206235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40aad60 con 0x55c7c3fd2520 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- 172.21.15.151:0/445206235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 msgr2=0x55c7c40bc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 --2- 172.21.15.151:0/445206235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4017ca0 tx=0x7fbbf40033b0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- 172.21.15.151:0/445206235 shutdown_connections 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 --2- 172.21.15.151:0/445206235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40bc870 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- 172.21.15.151:0/445206235 >> 172.21.15.151:0/445206235 conn(0x55c7c3fce040 msgr2=0x55c7c40b84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- 172.21.15.151:0/445206235 shutdown_connections 2024-09-13T19:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- 172.21.15.151:0/445206235 wait complete. 2024-09-13T19:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfe027980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7c3fd9b80 con 0x55c7c3fd2520 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58612/0 (socket says 172.21.15.151:58612) 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3999443629 learned_addr learned my addr 172.21.15.151:0/3999443629 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c40c4100 con 0x55c7c3fd2520 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4018cc0 tx=0x7fbbf4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.120+0000 7fbae3fff640 1 -- 172.21.15.151:0/3999443629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40cc070 con 0x55c7c3fd2520 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae3fff640 1 -- 172.21.15.151:0/3999443629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40c7410 con 0x55c7c3fd2520 2024-09-13T19:08:32.129 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7c40c4390 con 0x55c7c3fd2520 2024-09-13T19:08:32.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae3fff640 1 -- 172.21.15.151:0/3999443629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40b9070 con 0x55c7c3fd2520 2024-09-13T19:08:32.130 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7c40c7070 con 0x55c7c3fd2520 2024-09-13T19:08:32.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.131 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7c3eda800 con 0x55c7c40d09d0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae3fff640 1 -- 172.21.15.151:0/3999443629 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbbf40b3040 con 0x55c7c3fd2520 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfc338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfc338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58622/0 (socket says 172.21.15.151:58622) 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfc338640 1 -- 172.21.15.151:0/1866156099 learned_addr learned my addr 172.21.15.151:0/1866156099 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae3fff640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 0x7fbae4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae3fff640 1 -- 172.21.15.151:0/3999443629 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbf40c4070 con 0x55c7c3fd2520 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 0x7fbae4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfc338640 1 -- 172.21.15.151:0/1866156099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c40d1310 con 0x55c7c40d09d0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 0x7fbae4036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40c6940 tx=0x7fbbf40b7fc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfc338640 1 --2- 172.21.15.151:0/1866156099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00a440 tx=0x7fbbec00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8fe509edcd1556 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.132 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae1ffb640 1 -- 172.21.15.151:0/1866156099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec008850 con 0x55c7c40d09d0 2024-09-13T19:08:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae1ffb640 1 -- 172.21.15.151:0/1866156099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec008a10 con 0x55c7c40d09d0 2024-09-13T19:08:32.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbae1ffb640 1 -- 172.21.15.151:0/1866156099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec008d30 con 0x55c7c40d09d0 2024-09-13T19:08:32.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/1866156099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 msgr2=0x55c7c40d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1866156099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00a440 tx=0x7fbbec00a900 comp rx=0 tx=0).stop 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/1866156099 shutdown_connections 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1866156099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40d0dd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/1866156099 >> 172.21.15.151:0/1866156099 conn(0x55c7c3fd2e70 msgr2=0x55c7c40cc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/1866156099 shutdown_connections 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- 172.21.15.151:0/1866156099 wait complete. 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.124+0000 7fbbfe027980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7c40d1cf0 con 0x55c7c40d09d0 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58636/0 (socket says 172.21.15.151:58636) 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 -- 172.21.15.151:0/1922144120 learned_addr learned my addr 172.21.15.151:0/1922144120 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 -- 172.21.15.151:0/1922144120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c40dc6c0 con 0x55c7c40d09d0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55c7c40d1780 tx=0x7fbbec003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 -- 172.21.15.151:0/1922144120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec013a70 con 0x55c7c40d09d0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7c40dc950 con 0x55c7c40d09d0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 -- 172.21.15.151:0/1922144120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec023070 con 0x55c7c40d09d0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 -- 172.21.15.151:0/1922144120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec013d40 con 0x55c7c40d09d0 2024-09-13T19:08:32.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7c40df630 con 0x55c7c40d09d0 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 -- 172.21.15.151:0/1922144120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbbec028460 con 0x55c7c40d09d0 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 0x7fbad4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbadbfff640 1 -- 172.21.15.151:0/1922144120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbec04a0b0 con 0x55c7c40d09d0 2024-09-13T19:08:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 Processor -- start 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 0x7fbad4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 -- start start 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfe027980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55c7c40bd100 con 0x55c7c40f5ab0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfc338640 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 0x7fbad4036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01da90 tx=0x7fbbec027eb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfbb37640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58652/0 (socket says 172.21.15.151:58652) 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfbb37640 1 -- 172.21.15.151:0/2128316124 learned_addr learned my addr 172.21.15.151:0/2128316124 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.128+0000 7fbbfbb37640 1 -- 172.21.15.151:0/2128316124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7c40f64a0 con 0x55c7c40f5ab0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40e2e50 tx=0x7fbbf40ce7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 -- 172.21.15.151:0/2128316124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40e8020 con 0x55c7c40f5ab0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7c40f9000 con 0x55c7c40f5ab0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 -- 172.21.15.151:0/2128316124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf40e0040 con 0x55c7c40f5ab0 2024-09-13T19:08:32.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 -- 172.21.15.151:0/2128316124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbf40df070 con 0x55c7c40f5ab0 2024-09-13T19:08:32.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7c40f9400 con 0x55c7c40f5ab0 2024-09-13T19:08:32.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 -- 172.21.15.151:0/2128316124 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbbf40eb020 con 0x55c7c40f5ab0 2024-09-13T19:08:32.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 0x7fba3c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba53fff640 1 -- 172.21.15.151:0/2128316124 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbbf40d6040 con 0x55c7c40f5ab0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfb336640 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 0x7fba3c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fba51ffb640 20 reqs_thread_entry: start 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 0x55c7c40fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7c40fe100 con 0x55c7c40fb5c0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfb336640 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 0x7fba3c036ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f70 tx=0x7fbbf0001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfc338640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 0x55c7c40fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfc338640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 0x55c7c40fda30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfc338640 1 -- 172.21.15.151:0/3999443629 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbec01e7a0 con 0x55c7c40fb5c0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 0x55c7c4102310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:2 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7c4102960 con 0x55c7c40fff20 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 0x55c7c4102310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.142 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.132+0000 7fbbfbb37640 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 0x55c7c4102310 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3999443629 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(2 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fbbf40e2070 con 0x55c7c40fff20 2024-09-13T19:08:32.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7c40ff3d0 con 0x55c7c40fff20 2024-09-13T19:08:32.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfbb37640 1 -- 172.21.15.151:0/3999443629 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fbbf40e2070 con 0x55c7c40fff20 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 msgr2=0x7fbad4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 0x7fbad4036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbbec01da90 tx=0x7fbbec027eb0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 msgr2=0x55c7c40dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x55c7c40d1780 tx=0x7fbbec003000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 shutdown_connections 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbad4034650 0x7fbad4036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 --2- 172.21.15.151:0/1922144120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40d09d0 0x55c7c40dc180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 >> 172.21.15.151:0/1922144120 conn(0x55c7c3fd2e70 msgr2=0x55c7c40cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 shutdown_connections 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.136+0000 7fbbfe027980 1 -- 172.21.15.151:0/1922144120 wait complete. 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 msgr2=0x7fba3c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 0x7fba3c036ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0000f70 tx=0x7fbbf0001300 comp rx=0 tx=0).stop 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 msgr2=0x55c7c40f5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40e2e50 tx=0x7fbbf40ce7e0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 shutdown_connections 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fba3c034600 0x7fba3c036ac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/2128316124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c40f5ab0 0x55c7c40f5ed0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 >> 172.21.15.151:0/2128316124 conn(0x55c7c40eaa80 msgr2=0x55c7c40ed370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 shutdown_connections 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/2128316124 wait complete. 2024-09-13T19:08:32.147 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 msgr2=0x55c7c40fda30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 0x55c7c40fda30 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 msgr2=0x55c7c4102310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 0x55c7c4102310 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 msgr2=0x7fbae4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 0x7fbae4036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40c6940 tx=0x7fbbf40b7fc0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 msgr2=0x55c7c40c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4018cc0 tx=0x7fbbf4017e30 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 shutdown_connections 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55c7c40fff20 0x55c7c4102310 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fbae4034650 0x7fbae4036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55c7c40fb5c0 0x55c7c40fda30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 --2- 172.21.15.151:0/3999443629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55c7c3fd2520 0x55c7c40c3bc0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 >> 172.21.15.151:0/3999443629 conn(0x55c7c3fce040 msgr2=0x55c7c40b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 shutdown_connections 2024-09-13T19:08:32.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.140+0000 7fbbfe027980 1 -- 172.21.15.151:0/3999443629 wait complete. 2024-09-13T19:08:32.155 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-13T19:08:32.156 DEBUG:tasks.util.rgw: json result: {'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-13T19:08:32.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-13T19:08:32.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-13T19:08:32.156 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-13T19:08:32.226 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:32.226 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80be383980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f3dc126eb0 0x55f3dc1292a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80be383980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f3dbfa8ae0 con 0x55f3dc095280 2024-09-13T19:08:32.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80be383980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55f3dbfcce30 con 0x55f3dc126eb0 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bb692640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f3dc126eb0 0x55f3dc1292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bb692640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f3dc126eb0 0x55f3dc1292a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58664/0 (socket says 172.21.15.151:58664) 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bb692640 1 -- 172.21.15.151:0/465020302 learned_addr learned my addr 172.21.15.151:0/465020302 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bbe93640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55f3dc095280 0x55f3dc125790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39772/0 (socket says 172.21.15.151:39772) 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bb692640 1 -- 172.21.15.151:0/465020302 >> v1:172.21.15.12:6789/0 conn(0x55f3dc095280 legacy=0x55f3dc125790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.220+0000 7f80bb692640 1 -- 172.21.15.151:0/465020302 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc095660 con 0x55f3dc126eb0 2024-09-13T19:08:32.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80bb692640 1 --2- 172.21.15.151:0/465020302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc126eb0 0x55f3dc1292a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f80a400a5c0 tx=0x7f80a401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea0578307230e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80bae91640 1 -- 172.21.15.151:0/465020302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a40a6070 con 0x55f3dc126eb0 2024-09-13T19:08:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80bae91640 1 -- 172.21.15.151:0/465020302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80a40af070 con 0x55f3dc126eb0 2024-09-13T19:08:32.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80bae91640 1 -- 172.21.15.151:0/465020302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80a40aa5c0 con 0x55f3dc126eb0 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 -- 172.21.15.151:0/465020302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc126eb0 msgr2=0x55f3dc1292a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 --2- 172.21.15.151:0/465020302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc126eb0 0x55f3dc1292a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f80a400a5c0 tx=0x7f80a401b340 comp rx=0 tx=0).stop 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 -- 172.21.15.151:0/465020302 shutdown_connections 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 --2- 172.21.15.151:0/465020302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc126eb0 0x55f3dc1292a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 -- 172.21.15.151:0/465020302 >> 172.21.15.151:0/465020302 conn(0x55f3dc11b080 msgr2=0x55f3dc11d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 -- 172.21.15.151:0/465020302 shutdown_connections 2024-09-13T19:08:32.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.224+0000 7f80be383980 1 -- 172.21.15.151:0/465020302 wait complete. 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80be383980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80be383980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3dbfce200 con 0x55f3dc095280 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58670/0 (socket says 172.21.15.151:58670) 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80bbe93640 1 -- 172.21.15.151:0/3883258424 learned_addr learned my addr 172.21.15.151:0/3883258424 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80bbe93640 1 -- 172.21.15.151:0/3883258424 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc20e220 con 0x55f3dc095280 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f80bbe93640 1 --2- 172.21.15.151:0/3883258424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f80b4001690 tx=0x7f80b4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5207870610467479 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f7fa9e0b640 1 -- 172.21.15.151:0/3883258424 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4003460 con 0x55f3dc095280 2024-09-13T19:08:32.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f7fa9e0b640 1 -- 172.21.15.151:0/3883258424 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b4003600 con 0x55f3dc095280 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.240+0000 7f7fa9e0b640 1 -- 172.21.15.151:0/3883258424 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4003920 con 0x55f3dc095280 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/3883258424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 msgr2=0x55f3dc20dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 --2- 172.21.15.151:0/3883258424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f80b4001690 tx=0x7f80b4001b50 comp rx=0 tx=0).stop 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/3883258424 shutdown_connections 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 --2- 172.21.15.151:0/3883258424 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc20dc50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/3883258424 >> 172.21.15.151:0/3883258424 conn(0x55f3dc11b080 msgr2=0x55f3dc209880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/3883258424 shutdown_connections 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/3883258424 wait complete. 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc12c210 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58680/0 (socket says 172.21.15.151:58680) 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bbe93640 1 -- 172.21.15.151:0/1166967950 learned_addr learned my addr 172.21.15.151:0/1166967950 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bbe93640 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc215460 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bbe93640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000f90 tx=0x7f80b4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 -- 172.21.15.151:0/1166967950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4022020 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3dc2156f0 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 -- 172.21.15.151:0/1166967950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b4006840 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 -- 172.21.15.151:0/1166967950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b401e800 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3dc2183d0 con 0x55f3dc095280 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80be383980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc027800 con 0x55f3dc221ce0 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 -- 172.21.15.151:0/1166967950 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80b4025020 con 0x55f3dc095280 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bc694640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bc694640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58690/0 (socket says 172.21.15.151:58690) 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f80bc694640 1 -- 172.21.15.151:0/2829085291 learned_addr learned my addr 172.21.15.151:0/2829085291 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 0x7f7fa4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.276 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.244+0000 7f7fa3fff640 1 -- 172.21.15.151:0/1166967950 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f80b4049c70 con 0x55f3dc095280 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bbe93640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 0x7f7fa4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 -- 172.21.15.151:0/2829085291 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc222620 con 0x55f3dc221ce0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bbe93640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 0x7f7fa4036ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f80b4011ff0 tx=0x7f80b401ded0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 --2- 172.21.15.151:0/2829085291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00a440 tx=0x7f80ac00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97c872ab72c8cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7fa1ffb640 1 -- 172.21.15.151:0/2829085291 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac008850 con 0x55f3dc221ce0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7fa1ffb640 1 -- 172.21.15.151:0/2829085291 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac008a10 con 0x55f3dc221ce0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7fa1ffb640 1 -- 172.21.15.151:0/2829085291 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac008d30 con 0x55f3dc221ce0 2024-09-13T19:08:32.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/2829085291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 msgr2=0x55f3dc2220e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 --2- 172.21.15.151:0/2829085291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00a440 tx=0x7f80ac00a900 comp rx=0 tx=0).stop 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/2829085291 shutdown_connections 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 --2- 172.21.15.151:0/2829085291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc2220e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/2829085291 >> 172.21.15.151:0/2829085291 conn(0x55f3dc126eb0 msgr2=0x55f3dc21d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/2829085291 shutdown_connections 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/2829085291 wait complete. 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc223000 con 0x55f3dc221ce0 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58700/0 (socket says 172.21.15.151:58700) 2024-09-13T19:08:32.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 -- 172.21.15.151:0/1050558684 learned_addr learned my addr 172.21.15.151:0/1050558684 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 -- 172.21.15.151:0/1050558684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc229560 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80bc694640 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55f3dc222a90 tx=0x7f80ac003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7f9bfff640 1 -- 172.21.15.151:0/1050558684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac013a70 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3dc2297f0 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7f9bfff640 1 -- 172.21.15.151:0/1050558684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80ac023070 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3dc22c4d0 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.248+0000 7f7f9bfff640 1 -- 172.21.15.151:0/1050558684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80ac013d40 con 0x55f3dc221ce0 2024-09-13T19:08:32.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f9bfff640 1 -- 172.21.15.151:0/1050558684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80ac028460 con 0x55f3dc221ce0 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f9bfff640 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 0x7f7f94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f9bfff640 1 -- 172.21.15.151:0/1050558684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f80ac04a0e0 con 0x55f3dc221ce0 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bb692640 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 0x7f7f94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 Processor -- start 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 -- start start 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bb692640 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 0x7f7f94036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f80a40ae000 tx=0x7f80a40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f3dc20e540 con 0x55f3dc242800 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bbe93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58702/0 (socket says 172.21.15.151:58702) 2024-09-13T19:08:32.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bbe93640 1 -- 172.21.15.151:0/2331610856 learned_addr learned my addr 172.21.15.151:0/2331610856 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bbe93640 1 -- 172.21.15.151:0/2331610856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3dc2431f0 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80bbe93640 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80b4047fc0 tx=0x7f80b401ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f33fff640 1 -- 172.21.15.151:0/2331610856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b40263b0 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f33fff640 1 -- 172.21.15.151:0/2331610856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b4010ca0 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f3dc245e70 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f7f33fff640 1 -- 172.21.15.151:0/2331610856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b4026550 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.252+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3dc246220 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f7f33fff640 1 -- 172.21.15.151:0/2331610856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f80b4010910 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f7f33fff640 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 0x7f7ef4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f7f33fff640 1 -- 172.21.15.151:0/2331610856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f80b4043070 con 0x55f3dc242800 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bb692640 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 0x7f7ef4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f7f31ffb640 20 reqs_thread_entry: start 2024-09-13T19:08:32.281 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 0x55f3dc24a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3dc24ae70 con 0x55f3dc248380 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bb692640 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 0x7f7ef4036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a4017f50 tx=0x7f80a4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bc694640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 0x55f3dc24a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bc694640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 0x55f3dc24a7f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bc694640 1 -- 172.21.15.151:0/1166967950 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f80ac027ce0 con 0x55f3dc248380 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3dc24b720 con 0x55f3dc248380 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bc694640 1 -- 172.21.15.151:0/1166967950 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f80ac027ce0 con 0x55f3dc248380 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 0x55f3dc24f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:3 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f3dc24fb90 con 0x55f3dc24cfe0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bbe93640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 0x55f3dc24f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bbe93640 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 0x55f3dc24f4a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80bbe93640 1 -- 172.21.15.151:0/1166967950 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(3 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f80b405c040 con 0x55f3dc24cfe0 2024-09-13T19:08:32.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 msgr2=0x7f7f94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 0x7f7f94036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f80a40ae000 tx=0x7f80a40a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 msgr2=0x55f3dc229020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x55f3dc222a90 tx=0x7f80ac003000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 shutdown_connections 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7f94034650 0x7f7f94036b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 --2- 172.21.15.151:0/1050558684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc221ce0 0x55f3dc229020 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 >> 172.21.15.151:0/1050558684 conn(0x55f3dc126eb0 msgr2=0x55f3dc21d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 shutdown_connections 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.256+0000 7f80be383980 1 -- 172.21.15.151:0/1050558684 wait complete. 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 msgr2=0x7f7ef4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 0x7f7ef4036b60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a4017f50 tx=0x7f80a4005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 msgr2=0x55f3dc242c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80b4047fc0 tx=0x7f80b401ee30 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 shutdown_connections 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7ef40346a0 0x7f7ef4036b60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/2331610856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc242800 0x55f3dc242c20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 >> 172.21.15.151:0/2331610856 conn(0x55f3dc237810 msgr2=0x55f3dc23a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 shutdown_connections 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/2331610856 wait complete. 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 msgr2=0x55f3dc24a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 0x55f3dc24a7f0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 msgr2=0x55f3dc24f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 0x55f3dc24f4a0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 msgr2=0x7f7fa4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 0x7f7fa4036ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f80b4011ff0 tx=0x7f80b401ded0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 msgr2=0x55f3dc214f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000f90 tx=0x7f80b4001260 comp rx=0 tx=0).stop 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 shutdown_connections 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f3dc24cfe0 0x55f3dc24f4a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f7fa4034600 0x7f7fa4036ac0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f3dc248380 0x55f3dc24a7f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 --2- 172.21.15.151:0/1166967950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f3dc095280 0x55f3dc214f20 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 >> 172.21.15.151:0/1166967950 conn(0x55f3dc11b080 msgr2=0x55f3dc208400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 shutdown_connections 2024-09-13T19:08:32.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.260+0000 7f80be383980 1 -- 172.21.15.151:0/1166967950 wait complete. 2024-09-13T19:08:32.290 INFO:teuthology.orchestra.run.smithi151.stdout:{"id":"ef9ca8b0-9ae4-481e-ba9d-bc0942310d85","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","zones":[{"id":"56657ff8-3f1d-4de3-ac6b-fca799f3ee55","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-13T19:08:32.291 DEBUG:tasks.util.rgw: json result: {'id': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'zones': [{'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-13T19:08:32.294 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-13T19:08:32.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:08:32.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-13T19:08:32.423 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-13T19:08:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:32.473 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bdc02980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ce95aab880 0x55ce95aabc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bdc02980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce95931ae0 con 0x55ce95aac1d0 2024-09-13T19:08:32.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bdc02980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55ce95955e30 con 0x55ce95aab880 2024-09-13T19:08:32.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bb712640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55ce95aab880 0x55ce95aabc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3baf11640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55ce95aac1d0 0x55ce95ab0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39786/0 (socket says 172.21.15.151:39786) 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3baf11640 1 -- 172.21.15.151:0/2470268329 learned_addr learned my addr 172.21.15.151:0/2470268329 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3ba710640 1 -- 172.21.15.151:0/2470268329 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823057021 0 0) 0x55ce95931ae0 con 0x55ce95aac1d0 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3ba710640 1 -- 172.21.15.151:0/2470268329 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3a4001e20 con 0x55ce95aac1d0 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bb712640 1 -- 172.21.15.151:0/2470268329 >> v1:172.21.15.12:6789/0 conn(0x55ce95aac1d0 legacy=0x55ce95ab0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.476 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.468+0000 7fd3bb712640 1 -- 172.21.15.151:0/2470268329 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95ab3450 con 0x55ce95aab880 2024-09-13T19:08:32.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2470268329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95aabc60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00a480 tx=0x7fd3ac01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39b2bb3923ae5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3ba710640 1 -- 172.21.15.151:0/2470268329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0b0070 con 0x55ce95aab880 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3ba710640 1 -- 172.21.15.151:0/2470268329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0ab540 con 0x55ce95aab880 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3ba710640 1 -- 172.21.15.151:0/2470268329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0ab820 con 0x55ce95aab880 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2470268329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 msgr2=0x55ce95aabc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2470268329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95aabc60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00a480 tx=0x7fd3ac01b280 comp rx=0 tx=0).stop 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2470268329 shutdown_connections 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2470268329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95aabc60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2470268329 >> 172.21.15.151:0/2470268329 conn(0x55ce95a1f1d0 msgr2=0x55ce95a1f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2470268329 shutdown_connections 2024-09-13T19:08:32.481 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.472+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2470268329 wait complete. 2024-09-13T19:08:32.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bdc02980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bdc02980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce95957200 con 0x55ce95aab880 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58734/0 (socket says 172.21.15.151:58734) 2024-09-13T19:08:32.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.488+0000 7fd3bb712640 1 -- 172.21.15.151:0/2857383339 learned_addr learned my addr 172.21.15.151:0/2857383339 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 -- 172.21.15.151:0/2857383339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95b97060 con 0x55ce95aab880 2024-09-13T19:08:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2857383339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac017e90 tx=0x7fd3ac003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71d8ba2cd023343 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd2a960a640 1 -- 172.21.15.151:0/2857383339 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0b0040 con 0x55ce95aab880 2024-09-13T19:08:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd2a960a640 1 -- 172.21.15.151:0/2857383339 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0aca40 con 0x55ce95aab880 2024-09-13T19:08:32.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd2a960a640 1 -- 172.21.15.151:0/2857383339 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0acd20 con 0x55ce95aab880 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2857383339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 msgr2=0x55ce95b96a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2857383339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac017e90 tx=0x7fd3ac003030 comp rx=0 tx=0).stop 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2857383339 shutdown_connections 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2857383339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b96a90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2857383339 >> 172.21.15.151:0/2857383339 conn(0x55ce95a1f1d0 msgr2=0x55ce95b926c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2857383339 shutdown_connections 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2857383339 wait complete. 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b9dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bdc02980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce95ab2e90 con 0x55ce95aab880 2024-09-13T19:08:32.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b9dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b9dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58744/0 (socket says 172.21.15.151:58744) 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 -- 172.21.15.151:0/1978563319 learned_addr learned my addr 172.21.15.151:0/1978563319 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95b9e280 con 0x55ce95aab880 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.492+0000 7fd3bb712640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b9dd40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac01bb20 tx=0x7fd3ac018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 -- 172.21.15.151:0/1978563319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0c5030 con 0x55ce95aab880 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce95b9e510 con 0x55ce95aab880 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 -- 172.21.15.151:0/1978563319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0b6c60 con 0x55ce95aab880 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 -- 172.21.15.151:0/1978563319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0b0070 con 0x55ce95aab880 2024-09-13T19:08:32.502 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce95ba11f0 con 0x55ce95aab880 2024-09-13T19:08:32.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 -- 172.21.15.151:0/1978563319 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3ac0c8070 con 0x55ce95aab880 2024-09-13T19:08:32.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd2a0034650 0x7fd2a0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd2a7e07640 1 -- 172.21.15.151:0/1978563319 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd3ac0c6070 con 0x55ce95aab880 2024-09-13T19:08:32.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd2a0034650 0x7fd2a0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95aac1d0 0x55ce95ba4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95ba5380 con 0x55ce95aac1d0 2024-09-13T19:08:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95aac1d0 0x55ce95ba4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd2a0034650 0x7fd2a0036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0006fc0 tx=0x7fd3b00065f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95aac1d0 0x55ce95ba4e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bbf13640 1 -- 172.21.15.151:0/1978563319 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95aac1d0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95ba23f0 con 0x55ce95aac1d0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bbf13640 1 -- 172.21.15.151:0/1978563319 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95aac1d0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95ba76b0 0x55ce95ba9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95baa190 con 0x55ce95ba76b0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bb712640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95ba76b0 0x55ce95ba9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.496+0000 7fd3bb712640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95ba76b0 0x55ce95ba9aa0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 -- 172.21.15.151:0/1978563319 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3ac0b3040 con 0x55ce95ba76b0 2024-09-13T19:08:32.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95ba6550 con 0x55ce95aac1d0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bbf13640 1 -- 172.21.15.151:0/1978563319 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95aac1d0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ce95bab5f0 0x55ce95bad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bae120 con 0x55ce95bab5f0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ce95bab5f0 0x55ce95bad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ce95bab5f0 0x55ce95bad9e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3baf11640 1 -- 172.21.15.151:0/1978563319 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3b000f070 con 0x55ce95bab5f0 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce959b0800 con 0x55ce95bbbbf0 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58754/0 (socket says 172.21.15.151:58754) 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 -- 172.21.15.151:0/1867136836 learned_addr learned my addr 172.21.15.151:0/1867136836 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 -- 172.21.15.151:0/1867136836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95bbc550 con 0x55ce95bbbbf0 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bb712640 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cafd0 tx=0x7fd3ac0ca6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd2a5602640 1 -- 172.21.15.151:0/1867136836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0aae50 con 0x55ce95bbbbf0 2024-09-13T19:08:32.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd2a5602640 1 -- 172.21.15.151:0/1867136836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0c9a60 con 0x55ce95bbbbf0 2024-09-13T19:08:32.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce95bbc780 con 0x55ce95bbbbf0 2024-09-13T19:08:32.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd2a5602640 1 -- 172.21.15.151:0/1867136836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0c9d40 con 0x55ce95bbbbf0 2024-09-13T19:08:32.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.500+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce95bbf400 con 0x55ce95bbbbf0 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd2a5602640 1 -- 172.21.15.151:0/1867136836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3ac0eb060 con 0x55ce95bbbbf0 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd2a5602640 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 0x7fd294036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd2a5602640 1 -- 172.21.15.151:0/1867136836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd3ac0de070 con 0x55ce95bbbbf0 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 0x7fd294036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3baf11640 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 0x7fd294036ac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ce95ba5850 tx=0x7fd3b000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce95b97320 con 0x55ce95bc84b0 2024-09-13T19:08:32.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58760/0 (socket says 172.21.15.151:58760) 2024-09-13T19:08:32.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bb712640 1 -- 172.21.15.151:0/3509690176 learned_addr learned my addr 172.21.15.151:0/3509690176 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bb712640 1 -- 172.21.15.151:0/3509690176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95bc8e60 con 0x55ce95bc84b0 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bb712640 1 --2- 172.21.15.151:0/3509690176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0b4680 tx=0x7fd3ac0c1710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ad2ce41a0afd0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd29effd640 1 -- 172.21.15.151:0/3509690176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0fb020 con 0x55ce95bc84b0 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd29effd640 1 -- 172.21.15.151:0/3509690176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0e2e50 con 0x55ce95bc84b0 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd29effd640 1 -- 172.21.15.151:0/3509690176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0b5cb0 con 0x55ce95bc84b0 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- 172.21.15.151:0/3509690176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 msgr2=0x55ce95bc8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/3509690176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0b4680 tx=0x7fd3ac0c1710 comp rx=0 tx=0).stop 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- 172.21.15.151:0/3509690176 shutdown_connections 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/3509690176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bc8890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- 172.21.15.151:0/3509690176 >> 172.21.15.151:0/3509690176 conn(0x55ce95bc4890 msgr2=0x55ce95bc2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- 172.21.15.151:0/3509690176 shutdown_connections 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.504+0000 7fd3bdc02980 1 -- 172.21.15.151:0/3509690176 wait complete. 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 Processor -- start 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 -- start start 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55ce95bc8e60 con 0x55ce95bc84b0 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bb712640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58764/0 (socket says 172.21.15.151:58764) 2024-09-13T19:08:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 learned_addr learned my addr 172.21.15.151:0/2161935604 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce95bcfa90 con 0x55ce95bc84b0 2024-09-13T19:08:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0e1f60 tx=0x7fd3ac0f6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 -- 172.21.15.151:0/2161935604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac10f070 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 -- 172.21.15.151:0/2161935604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0dca10 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce95bcfa90 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 -- 172.21.15.151:0/2161935604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3ac0dcbc0 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce95bcfa90 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 -- 172.21.15.151:0/2161935604 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3ac112070 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd284034650 0x7fd284036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd29d7fa640 1 -- 172.21.15.151:0/2161935604 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd3ac107050 con 0x55ce95bc84b0 2024-09-13T19:08:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.508+0000 7fd3baf11640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd284034650 0x7fd284036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95bda3f0 0x55ce95bdc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bdd000 con 0x55ce95bda3f0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95bda3f0 0x55ce95bdc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd284034650 0x7fd284036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004fd0 tx=0x7fd3b0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95bda3f0 0x55ce95bdc8b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 realm 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bdd410 con 0x55ce95bda3f0 2024-09-13T19:08:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bddce0 con 0x55ce95bda3f0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95bdede0 0x55ce95be11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be17a0 con 0x55ce95bdede0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95bdede0 0x55ce95be11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95bdede0 0x55ce95be11d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 20 searching for the correct realm 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be3070 con 0x55ce95bdede0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd3ac114060 0x7fd3ac0e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be3070 con 0x7fd3ac114060 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd3ac114060 0x7fd3ac0e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd3ac114060 0x7fd3ac0e9730 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b000f070 con 0x7fd3ac114060 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be3070 con 0x7fd3ac114060 2024-09-13T19:08:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b000f070 con 0x7fd3ac114060 2024-09-13T19:08:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.512+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be3070 con 0x55ce95bda3f0 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd3b4018410 0x7fd3b4018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd3b4018410 0x7fd3b4018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd3b4018410 0x7fd3b4018890 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x7fd3b4018410 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x7fd3b4018410 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3ac114060 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd3b000f070 con 0x7fd3ac114060 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.516+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x7fd3b4018410 2024-09-13T19:08:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3ac114060 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x7fd3b4018410 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.520+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x7fd3b4018410 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3ac114060 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b40083f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3ac114060 2024-09-13T19:08:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.524+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bdede0 2024-09-13T19:08:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x7fd3b4018410 2024-09-13T19:08:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bde080 con 0x55ce95bda3f0 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd3b403b040 con 0x7fd3ac114060 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be2060 con 0x55ce95bda3f0 2024-09-13T19:08:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be2450 con 0x55ce95bda3f0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be2450 con 0x7fd3ac114060 2024-09-13T19:08:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 zone default found 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 4 Realm: () 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 zonegroup default 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be2d20 con 0x7fd3b4018410 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.528+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be2d20 con 0x55ce95bdede0 2024-09-13T19:08:32.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be5000 con 0x55ce95bdede0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 20 started sync module instance, tier type = 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be4320 con 0x7fd3ac114060 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345763899152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be5910 con 0x7fd3ac114060 2024-09-13T19:08:32.541 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be6160 con 0x55ce95bda3f0 2024-09-13T19:08:32.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.532+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345763899152] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345763902560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be6160 con 0x55ce95bda3f0 2024-09-13T19:08:32.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be6b80 con 0x55ce95bdede0 2024-09-13T19:08:32.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345763902560] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345763904688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be60d0 con 0x55ce95bdede0 2024-09-13T19:08:32.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.536+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be78d0 con 0x7fd3ac114060 2024-09-13T19:08:32.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345763912896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be8590 con 0x7fd3ac114060 2024-09-13T19:08:32.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be8f50 con 0x55ce95bda3f0 2024-09-13T19:08:32.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345763904688] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345763912896] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345763909488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be8f50 con 0x55ce95bda3f0 2024-09-13T19:08:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.540+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be97f0 con 0x7fd3b4018410 2024-09-13T19:08:32.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345763918656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be9c10 con 0x7fd3b4018410 2024-09-13T19:08:32.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bea610 con 0x7fd3b4018410 2024-09-13T19:08:32.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345763909488] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345763918656] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345763916448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be97a0 con 0x7fd3b4018410 2024-09-13T19:08:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.544+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95beaca0 con 0x7fd3b4018410 2024-09-13T19:08:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345763916448] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345763922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95beaca0 con 0x7fd3b4018410 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=0 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=1 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=2 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=3 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=4 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=5 2024-09-13T19:08:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=6 2024-09-13T19:08:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345763922208] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 20 add_watcher() i=7 2024-09-13T19:08:32.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:32.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.548+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95bede30 con 0x55ce95bda3f0 2024-09-13T19:08:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345763923952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95beb0c0 con 0x55ce95bda3f0 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345763923952] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 5 note: GC not initialized 2024-09-13T19:08:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd270fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 Filter name: none 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd1ea7fc640 20 reqs_thread_entry: start 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c115b0 con 0x7fd3b4018410 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c0fd50 con 0x55ce95bda3f0 2024-09-13T19:08:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-13T19:08:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.552+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c10750 con 0x7fd3b4018410 2024-09-13T19:08:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bdc02980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bdc02980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bdc02980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94345764077936 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c150b0 con 0x55ce95bda3f0 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== watch-notify(notify (1) cookie 94345763909488 notify 146028888095 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ce95c10af0 con 0x55ce95bda3f0 2024-09-13T19:08:32.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd29effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94345763909488 notifier 4827 bl.length()=649 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd29effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd29effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify cookie 94345764077936 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd29effd640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd280003eb0 con 0x55ce95bda3f0 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== watch-notify(notify_complete (2) cookie 94345764077936 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce95c111d0 con 0x55ce95bda3f0 2024-09-13T19:08:32.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.556+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c100f0 con 0x55ce95bda3f0 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94345764077808 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c154e0 con 0x55ce95bdede0 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== watch-notify(notify (1) cookie 94345763904688 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ce95bbc780 con 0x55ce95bdede0 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd29effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 94345763904688 notifier 4827 bl.length()=177 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd29effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-13T19:08:32.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd29effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-13T19:08:32.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd29effd640 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd280003eb0 con 0x55ce95bdede0 2024-09-13T19:08:32.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(68 notify.2 [notify cookie 94345764077808 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== watch-notify(notify_complete (2) cookie 94345764077808 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce95bbc550 con 0x55ce95bdede0 2024-09-13T19:08:32.570 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345763923952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c0f350 con 0x55ce95bda3f0 2024-09-13T19:08:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94345763923952] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.560+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345763899152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c0f350 con 0x7fd3ac114060 2024-09-13T19:08:32.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94345763899152] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bdc02980 20 remove_watcher() i=0 2024-09-13T19:08:32.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bdc02980 2 removed watcher, disabling cache 2024-09-13T19:08:32.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345763902560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be4710 con 0x55ce95bda3f0 2024-09-13T19:08:32.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94345763902560] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bdc02980 20 remove_watcher() i=1 2024-09-13T19:08:32.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.564+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345763904688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c0f350 con 0x55ce95bdede0 2024-09-13T19:08:32.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3bb712640 1 -- 172.21.15.151:0/2161935604 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94345763904688] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3ac111030 con 0x55ce95bdede0 2024-09-13T19:08:32.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3bdc02980 20 remove_watcher() i=2 2024-09-13T19:08:32.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345763912896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be4710 con 0x7fd3ac114060 2024-09-13T19:08:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3baf11640 1 -- 172.21.15.151:0/2161935604 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94345763912896] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b003f040 con 0x7fd3ac114060 2024-09-13T19:08:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3bdc02980 20 remove_watcher() i=3 2024-09-13T19:08:32.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.568+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345763909488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be5cb0 con 0x55ce95bda3f0 2024-09-13T19:08:32.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94345763909488] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x55ce95bda3f0 2024-09-13T19:08:32.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bdc02980 20 remove_watcher() i=4 2024-09-13T19:08:32.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345763918656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95c0f350 con 0x7fd3b4018410 2024-09-13T19:08:32.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94345763918656] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bdc02980 20 remove_watcher() i=5 2024-09-13T19:08:32.581 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.572+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345763916448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be7cc0 con 0x7fd3b4018410 2024-09-13T19:08:32.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.576+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94345763916448] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.576+0000 7fd3bdc02980 20 remove_watcher() i=6 2024-09-13T19:08:32.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.576+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345763922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ce95be4710 con 0x7fd3b4018410 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.576+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94345763922208] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3b4036040 con 0x7fd3b4018410 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.576+0000 7fd3bdc02980 20 remove_watcher() i=7 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd3b4018410 msgr2=0x7fd3b4018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd3b4018410 0x7fd3b4018890 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95bda3f0 msgr2=0x55ce95bdc8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95bda3f0 0x55ce95bdc8b0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd3ac114060 msgr2=0x7fd3ac0e9730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd3ac114060 0x7fd3ac0e9730 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95bdede0 msgr2=0x55ce95be11d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95bdede0 0x55ce95be11d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd284034650 msgr2=0x7fd284036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd284034650 0x7fd284036b10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0004fd0 tx=0x7fd3b0010000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 msgr2=0x55ce95bcf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bbf13640 1 -- 172.21.15.151:0/2161935604 reap_dead start 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0e1f60 tx=0x7fd3ac0f6000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 shutdown_connections 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/2161935604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bc84b0 0x55ce95bcf550 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 >> 172.21.15.151:0/2161935604 conn(0x55ce95bc4890 msgr2=0x55ce95bc2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 shutdown_connections 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/2161935604 wait complete. 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 msgr2=0x7fd294036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 0x7fd294036ac0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ce95ba5850 tx=0x7fd3b000f000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 msgr2=0x55ce95bbc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0cafd0 tx=0x7fd3ac0ca6e0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 shutdown_connections 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd294034600 0x7fd294036ac0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1867136836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95bbbbf0 0x55ce95bbc010 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 >> 172.21.15.151:0/1867136836 conn(0x55ce95bb0d40 msgr2=0x55ce95bb37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 shutdown_connections 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1867136836 wait complete. 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95aac1d0 msgr2=0x55ce95ba4e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55ce95aac1d0 0x55ce95ba4e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ce95bab5f0 msgr2=0x55ce95bad9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55ce95bab5f0 0x55ce95bad9e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95ba76b0 msgr2=0x55ce95ba9aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55ce95ba76b0 0x55ce95ba9aa0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd2a0034650 msgr2=0x7fd2a0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd2a0034650 0x7fd2a0036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0006fc0 tx=0x7fd3b00065f0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 msgr2=0x55ce95b9dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 --2- 172.21.15.151:0/1978563319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ce95aab880 0x55ce95b9dd40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac01bb20 tx=0x7fd3ac018020 comp rx=0 tx=0).stop 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bbf13640 1 -- 172.21.15.151:0/1978563319 reap_dead start 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 shutdown_connections 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 >> 172.21.15.151:0/1978563319 conn(0x55ce95a1f1d0 msgr2=0x55ce95b91240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 shutdown_connections 2024-09-13T19:08:32.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.580+0000 7fd3bdc02980 1 -- 172.21.15.151:0/1978563319 wait complete. 2024-09-13T19:08:32.598 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:32.598 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:32.598 ERROR:root:0 2024-09-13T19:08:32.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:32.614 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000020075a03853073a9-0066e48db0-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:08:32.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-13T19:08:32.637 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:32.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-13T19:08:32.667 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-13T19:08:32.668 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-13T19:08:32.702 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:08:32.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-13T19:08:32.725 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-13T19:08:32.726 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:32.739 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:32.739 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-13T19:08:32.753 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:32.753 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:32.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:32.754 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-13T19:08:32.795 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:32.795 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:32.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe141a52980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f1557cae90 0x55f1557cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe141a52980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f15564cae0 con 0x55f1557392e0 2024-09-13T19:08:32.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe141a52980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55f155670e30 con 0x55f1557cae90 2024-09-13T19:08:32.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe13ed61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f1557cae90 0x55f1557cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe13ed61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f1557cae90 0x55f1557cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58780/0 (socket says 172.21.15.151:58780) 2024-09-13T19:08:32.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe13ed61640 1 -- 172.21.15.151:0/4040837084 learned_addr learned my addr 172.21.15.151:0/4040837084 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe13f562640 1 --1- 172.21.15.151:0/4040837084 >> v1:172.21.15.12:6789/0 conn(0x55f1557392e0 0x55f1557c9770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39788/0 (socket says 172.21.15.151:39788) 2024-09-13T19:08:32.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.788+0000 7fe13ed61640 1 -- 172.21.15.151:0/4040837084 >> v1:172.21.15.12:6789/0 conn(0x55f1557392e0 legacy=0x55f1557c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe13ed61640 1 -- 172.21.15.151:0/4040837084 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1557396c0 con 0x55f1557cae90 2024-09-13T19:08:32.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe13ed61640 1 --2- 172.21.15.151:0/4040837084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557cae90 0x55f1557cd280 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe13400a5c0 tx=0x7fe13401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccc45be7ac06999 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe13e560640 1 -- 172.21.15.151:0/4040837084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1340a6070 con 0x55f1557cae90 2024-09-13T19:08:32.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe13e560640 1 -- 172.21.15.151:0/4040837084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1340af070 con 0x55f1557cae90 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe13e560640 1 -- 172.21.15.151:0/4040837084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1340aa5c0 con 0x55f1557cae90 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 -- 172.21.15.151:0/4040837084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557cae90 msgr2=0x55f1557cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 --2- 172.21.15.151:0/4040837084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557cae90 0x55f1557cd280 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe13400a5c0 tx=0x7fe13401b340 comp rx=0 tx=0).stop 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 -- 172.21.15.151:0/4040837084 shutdown_connections 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 --2- 172.21.15.151:0/4040837084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557cae90 0x55f1557cd280 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 -- 172.21.15.151:0/4040837084 >> 172.21.15.151:0/4040837084 conn(0x55f1557bf0a0 msgr2=0x55f1557c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 -- 172.21.15.151:0/4040837084 shutdown_connections 2024-09-13T19:08:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.792+0000 7fe141a52980 1 -- 172.21.15.151:0/4040837084 wait complete. 2024-09-13T19:08:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe141a52980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe141a52980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f155672200 con 0x55f1557392e0 2024-09-13T19:08:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58796/0 (socket says 172.21.15.151:58796) 2024-09-13T19:08:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.808+0000 7fe13f562640 1 -- 172.21.15.151:0/1607640562 learned_addr learned my addr 172.21.15.151:0/1607640562 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 -- 172.21.15.151:0/1607640562 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1558b2220 con 0x55f1557392e0 2024-09-13T19:08:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 --2- 172.21.15.151:0/1607640562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe130001e50 tx=0x7fe130001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fbd1d4252b6c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02d60a640 1 -- 172.21.15.151:0/1607640562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13000e5d0 con 0x55f1557392e0 2024-09-13T19:08:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02d60a640 1 -- 172.21.15.151:0/1607640562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13000e770 con 0x55f1557392e0 2024-09-13T19:08:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02d60a640 1 -- 172.21.15.151:0/1607640562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13000eab0 con 0x55f1557392e0 2024-09-13T19:08:32.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/1607640562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 msgr2=0x55f1558b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 --2- 172.21.15.151:0/1607640562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe130001e50 tx=0x7fe130001e80 comp rx=0 tx=0).stop 2024-09-13T19:08:32.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/1607640562 shutdown_connections 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 --2- 172.21.15.151:0/1607640562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b1c50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/1607640562 >> 172.21.15.151:0/1607640562 conn(0x55f1557bf0a0 msgr2=0x55f1558ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/1607640562 shutdown_connections 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/1607640562 wait complete. 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1557d0220 con 0x55f1557392e0 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58804/0 (socket says 172.21.15.151:58804) 2024-09-13T19:08:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 -- 172.21.15.151:0/526863172 learned_addr learned my addr 172.21.15.151:0/526863172 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1558b94e0 con 0x55f1557392e0 2024-09-13T19:08:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe13f562640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b8fa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55f1558b2e30 tx=0x7fe130000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02be07640 1 -- 172.21.15.151:0/526863172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe130001260 con 0x55f1557392e0 2024-09-13T19:08:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02be07640 1 -- 172.21.15.151:0/526863172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe13000fa40 con 0x55f1557392e0 2024-09-13T19:08:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1558b9770 con 0x55f1557392e0 2024-09-13T19:08:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.812+0000 7fe02be07640 1 -- 172.21.15.151:0/526863172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13000fd80 con 0x55f1557392e0 2024-09-13T19:08:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1558bc450 con 0x55f1557392e0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe02be07640 1 -- 172.21.15.151:0/526863172 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe130017070 con 0x55f1557392e0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe02be07640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe024034650 0x7fe024036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe02be07640 1 -- 172.21.15.151:0/526863172 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe130015020 con 0x55f1557392e0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13ed61640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe024034650 0x7fe024036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1557cae90 0x55f1558bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558c0600 con 0x55f1557cae90 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13fd63640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1557cae90 0x55f1558bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13ed61640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe024034650 0x7fe024036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ae000 tx=0x7fe1340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13fd63640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1557cae90 0x55f1558bff90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13fd63640 1 -- 172.21.15.151:0/526863172 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1557cae90 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558bd670 con 0x55f1557cae90 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13fd63640 1 -- 172.21.15.151:0/526863172 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1557cae90 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558c2930 0x55f1558c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558c5410 con 0x55f1558c2930 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13f562640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558c2930 0x55f1558c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13f562640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558c2930 0x55f1558c4d20 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe13f562640 1 -- 172.21.15.151:0/526863172 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558c2930 2024-09-13T19:08:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.816+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558c17d0 con 0x55f1557cae90 2024-09-13T19:08:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13fd63640 1 -- 172.21.15.151:0/526863172 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1557cae90 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f1558c6870 0x55f1558c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558c93d0 con 0x55f1558c6870 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13ed61640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f1558c6870 0x55f1558c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13ed61640 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f1558c6870 0x55f1558c8c60 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13ed61640 1 -- 172.21.15.151:0/526863172 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1340aaae0 con 0x55f1558c6870 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1556cb800 con 0x55f1558d6e40 2024-09-13T19:08:32.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58806/0 (socket says 172.21.15.151:58806) 2024-09-13T19:08:32.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13f562640 1 -- 172.21.15.151:0/640219168 learned_addr learned my addr 172.21.15.151:0/640219168 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13f562640 1 -- 172.21.15.151:0/640219168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1558d77a0 con 0x55f1558d6e40 2024-09-13T19:08:32.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe13f562640 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe130024000 tx=0x7fe13001ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe029602640 1 -- 172.21.15.151:0/640219168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe130041020 con 0x55f1558d6e40 2024-09-13T19:08:32.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe029602640 1 -- 172.21.15.151:0/640219168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130036070 con 0x55f1558d6e40 2024-09-13T19:08:32.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe029602640 1 -- 172.21.15.151:0/640219168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13001a810 con 0x55f1558d6e40 2024-09-13T19:08:32.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1558d7a30 con 0x55f1558d6e40 2024-09-13T19:08:32.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.820+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1558d7a30 con 0x55f1558d6e40 2024-09-13T19:08:32.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe029602640 1 -- 172.21.15.151:0/640219168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe13004ad10 con 0x55f1558d6e40 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe029602640 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 0x7fe018036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe029602640 1 -- 172.21.15.151:0/640219168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe1300291d0 con 0x55f1558d6e40 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13ed61640 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 0x7fe018036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13ed61640 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 0x7fe018036b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c10 tx=0x7fe134005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1558b25a0 con 0x55f1558e3520 2024-09-13T19:08:32.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58812/0 (socket says 172.21.15.151:58812) 2024-09-13T19:08:32.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13f562640 1 -- 172.21.15.151:0/2434390892 learned_addr learned my addr 172.21.15.151:0/2434390892 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13f562640 1 -- 172.21.15.151:0/2434390892 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1558e3ed0 con 0x55f1558e3520 2024-09-13T19:08:32.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe13f562640 1 --2- 172.21.15.151:0/2434390892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe130033fd0 tx=0x7fe130046680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca33bece6d9c3317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe022ffd640 1 -- 172.21.15.151:0/2434390892 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe130046860 con 0x55f1558e3520 2024-09-13T19:08:32.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe022ffd640 1 -- 172.21.15.151:0/2434390892 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130046ca0 con 0x55f1558e3520 2024-09-13T19:08:32.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe022ffd640 1 -- 172.21.15.151:0/2434390892 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe130019860 con 0x55f1558e3520 2024-09-13T19:08:32.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- 172.21.15.151:0/2434390892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 msgr2=0x55f1558e3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 --2- 172.21.15.151:0/2434390892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe130033fd0 tx=0x7fe130046680 comp rx=0 tx=0).stop 2024-09-13T19:08:32.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- 172.21.15.151:0/2434390892 shutdown_connections 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 --2- 172.21.15.151:0/2434390892 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558e3900 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- 172.21.15.151:0/2434390892 >> 172.21.15.151:0/2434390892 conn(0x55f1558df900 msgr2=0x55f1558dda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- 172.21.15.151:0/2434390892 shutdown_connections 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.824+0000 7fe141a52980 1 -- 172.21.15.151:0/2434390892 wait complete. 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 Processor -- start 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 -- start start 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1558e4370 con 0x55f1558e3520 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13f562640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58814/0 (socket says 172.21.15.151:58814) 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 learned_addr learned my addr 172.21.15.151:0/2215125895 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:32.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1558eac60 con 0x55f1558e3520 2024-09-13T19:08:32.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13f562640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe13001ab10 tx=0x7fe130014ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 -- 172.21.15.151:0/2215125895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13006d020 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 -- 172.21.15.151:0/2215125895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130046860 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1558eac60 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 -- 172.21.15.151:0/2215125895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe13004ce00 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1558eac60 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 -- 172.21.15.151:0/2215125895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe130070020 con 0x55f1558e3520 2024-09-13T19:08:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe008034650 0x7fe008036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe0217fa640 1 -- 172.21.15.151:0/2215125895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe130064050 con 0x55f1558e3520 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe13ed61640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe008034650 0x7fe008036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.828+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1558f57e0 0x55f1558f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f83f0 con 0x55f1558f57e0 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1558f57e0 0x55f1558f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13ed61640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe008034650 0x7fe008036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1340aa910 tx=0x7fe1340c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1558f57e0 0x55f1558f7ca0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 realm 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f8800 con 0x55f1558f57e0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f90d0 con 0x55f1558f57e0 2024-09-13T19:08:32.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558fa1d0 0x55f1558fc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fcb80 con 0x55f1558fa1d0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558fa1d0 0x55f1558fc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558fa1d0 0x55f1558fc5c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 20 searching for the correct realm 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fe450 con 0x55f1558fa1d0 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe130072020 0x7fe13006e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fe450 con 0x7fe130072020 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13ed61640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe130072020 0x7fe13006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.832+0000 7fe13ed61640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe130072020 0x7fe13006e930 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1340aaae0 con 0x7fe130072020 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fe450 con 0x7fe130072020 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1340aaae0 con 0x7fe130072020 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fe450 con 0x55f1558f57e0 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe138016440 0x7fe1380168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe138016440 0x7fe1380168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe138016440 0x7fe1380168c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe130072020 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1340aaae0 con 0x7fe130072020 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.836+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe130072020 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1340aaae0 con 0x7fe130072020 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.840+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe130072020 2024-09-13T19:08:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1340aaae0 con 0x7fe130072020 2024-09-13T19:08:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe130072020 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558fa1d0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.844+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe138016440 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x55f1558f57e0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1558f9470 con 0x7fe130072020 2024-09-13T19:08:32.858 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:32.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.860 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fd540 con 0x55f1558f57e0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fd990 con 0x55f1558f57e0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fddb0 con 0x7fe130072020 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 zone default found 2024-09-13T19:08:32.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 4 Realm: () 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 zonegroup default 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1558fe880 con 0x7fe138016440 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f155900260 con 0x55f1558fa1d0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1559006c0 con 0x55f1558fa1d0 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 started sync module instance, tier type = 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:32.863 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.848+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1558ff700 con 0x7fe130072020 2024-09-13T19:08:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94495010978544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1558ff360 con 0x7fe130072020 2024-09-13T19:08:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559015f0 con 0x55f1558f57e0 2024-09-13T19:08:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94495010978544] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94495010984256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155901a10 con 0x55f1558f57e0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.852+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559023d0 con 0x55f1558fa1d0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94495010984256] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94495010985312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155901980 con 0x55f1558fa1d0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559030d0 con 0x7fe130072020 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94495010993344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155903d90 con 0x7fe130072020 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.856+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155904750 con 0x55f1558f57e0 2024-09-13T19:08:32.866 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94495010985312] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94495010993344] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94495010996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155903d90 con 0x55f1558f57e0 2024-09-13T19:08:32.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559046c0 con 0x7fe138016440 2024-09-13T19:08:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.860+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94495010996896] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94495010994400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155903d00 con 0x7fe138016440 2024-09-13T19:08:32.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559054a0 con 0x7fe138016440 2024-09-13T19:08:32.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94495011000304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559058c0 con 0x7fe138016440 2024-09-13T19:08:32.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559063e0 con 0x7fe138016440 2024-09-13T19:08:32.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.864+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94495010994400] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94495011004080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559063a0 con 0x7fe138016440 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=0 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=1 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=2 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=3 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=4 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=5 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94495011000304] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=6 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94495011004080] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 20 add_watcher() i=7 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f155905410 con 0x55f1558f57e0 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.868+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94495011001360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155906810 con 0x55f1558f57e0 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94495011001360] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x55f1558f57e0 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fdff5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 5 note: GC not initialized 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fdff4fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:32.878 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 20 Filter name: none 2024-09-13T19:08:32.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fdf6e7fc640 20 reqs_thread_entry: start 2024-09-13T19:08:32.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:32.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 20 rados->read ofs=0 len=0 2024-09-13T19:08:32.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.872+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f15592c950 con 0x7fe138016440 2024-09-13T19:08:32.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:08:32.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:32.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:32.883 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155933250 con 0x7fe138016440 2024-09-13T19:08:32.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe13800a4d0 con 0x7fe138016440 2024-09-13T19:08:32.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:32.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:32.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.876+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94495011187904 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f15592e960 con 0x55f1558f57e0 2024-09-13T19:08:32.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94495010996896 notify 146028888097 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fe138030040 con 0x55f1558f57e0 2024-09-13T19:08:32.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe022ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94495010996896 notifier 4834 bl.length()=636 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe022ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe022ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94495011187904 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe13804a020 con 0x55f1558f57e0 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe022ffd640 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe004003eb0 con 0x55f1558f57e0 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x55f1558f57e0 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94495011187904 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe13802a5e0 con 0x55f1558f57e0 2024-09-13T19:08:32.887 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:32.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fdff5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:32.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94495011001360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x55f1558f57e0 2024-09-13T19:08:32.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94495011001360] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x55f1558f57e0 2024-09-13T19:08:32.888 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.880+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94495010978544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x7fe130072020 2024-09-13T19:08:32.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94495010978544] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe141a52980 20 remove_watcher() i=0 2024-09-13T19:08:32.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe141a52980 2 removed watcher, disabling cache 2024-09-13T19:08:32.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94495010984256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x55f1558f57e0 2024-09-13T19:08:32.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94495010984256] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x55f1558f57e0 2024-09-13T19:08:32.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe141a52980 20 remove_watcher() i=1 2024-09-13T19:08:32.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.884+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94495010985312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f155901140 con 0x55f1558fa1d0 2024-09-13T19:08:32.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe13f562640 1 -- 172.21.15.151:0/2215125895 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94495010985312] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13002e070 con 0x55f1558fa1d0 2024-09-13T19:08:32.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe141a52980 20 remove_watcher() i=2 2024-09-13T19:08:32.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94495010993344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x7fe130072020 2024-09-13T19:08:32.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe13ed61640 1 -- 172.21.15.151:0/2215125895 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94495010993344] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1340e7040 con 0x7fe130072020 2024-09-13T19:08:32.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe141a52980 20 remove_watcher() i=3 2024-09-13T19:08:32.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.888+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94495010996896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559034c0 con 0x55f1558f57e0 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94495010996896] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x55f1558f57e0 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe141a52980 20 remove_watcher() i=4 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94495010994400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x7fe138016440 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94495010994400] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x7fe138016440 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe141a52980 20 remove_watcher() i=5 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.892+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94495011000304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1559042a0 con 0x7fe138016440 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94495011000304] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x7fe138016440 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 20 remove_watcher() i=6 2024-09-13T19:08:32.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94495011004080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f15592a750 con 0x7fe138016440 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94495011004080] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe13804a020 con 0x7fe138016440 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 20 remove_watcher() i=7 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe138016440 msgr2=0x7fe1380168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe138016440 0x7fe1380168c0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1558f57e0 msgr2=0x55f1558f7ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1558f57e0 0x55f1558f7ca0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe130072020 msgr2=0x7fe13006e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe130072020 0x7fe13006e930 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558fa1d0 msgr2=0x55f1558fc5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558fa1d0 0x55f1558fc5c0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe008034650 msgr2=0x7fe008036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe008034650 0x7fe008036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe1340aa910 tx=0x7fe1340c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 msgr2=0x55f1558ea720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe13001ab10 tx=0x7fe130014ed0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe13fd63640 1 -- 172.21.15.151:0/2215125895 reap_dead start 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 shutdown_connections 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/2215125895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558e3520 0x55f1558ea720 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 >> 172.21.15.151:0/2215125895 conn(0x55f1558df900 msgr2=0x55f1558dd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 shutdown_connections 2024-09-13T19:08:32.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/2215125895 wait complete. 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 msgr2=0x7fe018036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 0x7fe018036b60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe134000c10 tx=0x7fe134005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 msgr2=0x55f1558d7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe130024000 tx=0x7fe13001ba20 comp rx=0 tx=0).stop 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 shutdown_connections 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0180346a0 0x7fe018036b60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 --2- 172.21.15.151:0/640219168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1558d6e40 0x55f1558d7260 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 >> 172.21.15.151:0/640219168 conn(0x55f1558cbf90 msgr2=0x55f1558cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 shutdown_connections 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.896+0000 7fe141a52980 1 -- 172.21.15.151:0/640219168 wait complete. 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1557cae90 msgr2=0x55f1558bff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f1557cae90 0x55f1558bff90 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f1558c6870 msgr2=0x55f1558c8c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f1558c6870 0x55f1558c8c60 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558c2930 msgr2=0x55f1558c4d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f1558c2930 0x55f1558c4d20 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe024034650 msgr2=0x7fe024036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe024034650 0x7fe024036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1340ae000 tx=0x7fe1340a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 msgr2=0x55f1558b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 --2- 172.21.15.151:0/526863172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1557392e0 0x55f1558b8fa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x55f1558b2e30 tx=0x7fe130000bd0 comp rx=0 tx=0).stop 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe13fd63640 1 -- 172.21.15.151:0/526863172 reap_dead start 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 shutdown_connections 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 >> 172.21.15.151:0/526863172 conn(0x55f1557bf0a0 msgr2=0x55f1558ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 shutdown_connections 2024-09-13T19:08:32.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.900+0000 7fe141a52980 1 -- 172.21.15.151:0/526863172 wait complete. 2024-09-13T19:08:32.917 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:32.917 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:32.917 ERROR:root:0 2024-09-13T19:08:32.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:08:32.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-13T19:08:32.918 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-13T19:08:33.004 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:33.004 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:33.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.996+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:32.996+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb802239980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559537d55a60 0x559537de4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb802239980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559537c69ae0 con 0x559537de4850 2024-09-13T19:08:33.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb802239980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559537c8de30 con 0x559537d55a60 2024-09-13T19:08:33.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ffd49640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559537d55a60 0x559537de4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ff548640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x559537de4850 0x559537de6c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39794/0 (socket says 172.21.15.151:39794) 2024-09-13T19:08:33.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ff548640 1 -- 172.21.15.151:0/3733712141 learned_addr learned my addr 172.21.15.151:0/3733712141 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:33.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ffd49640 1 -- 172.21.15.151:0/3733712141 >> v1:172.21.15.12:6789/0 conn(0x559537de4850 legacy=0x559537de6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ffd49640 1 -- 172.21.15.151:0/3733712141 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537de9370 con 0x559537d55a60 2024-09-13T19:08:33.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.000+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/3733712141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537de4310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000a480 tx=0x7fb7f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7ff90d2570433d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb7fed47640 1 -- 172.21.15.151:0/3733712141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b0070 con 0x559537d55a60 2024-09-13T19:08:33.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb7fed47640 1 -- 172.21.15.151:0/3733712141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00ab540 con 0x559537d55a60 2024-09-13T19:08:33.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb7fed47640 1 -- 172.21.15.151:0/3733712141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00ab840 con 0x559537d55a60 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 -- 172.21.15.151:0/3733712141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 msgr2=0x559537de4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 --2- 172.21.15.151:0/3733712141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537de4310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000a480 tx=0x7fb7f001b280 comp rx=0 tx=0).stop 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 -- 172.21.15.151:0/3733712141 shutdown_connections 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 --2- 172.21.15.151:0/3733712141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537de4310 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 -- 172.21.15.151:0/3733712141 >> 172.21.15.151:0/3733712141 conn(0x559537ddc000 msgr2=0x559537dde420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 -- 172.21.15.151:0/3733712141 shutdown_connections 2024-09-13T19:08:33.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.004+0000 7fb802239980 1 -- 172.21.15.151:0/3733712141 wait complete. 2024-09-13T19:08:33.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559537c8f200 con 0x559537d55a60 2024-09-13T19:08:33.026 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58822/0 (socket says 172.21.15.151:58822) 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb7ffd49640 1 -- 172.21.15.151:0/36499419 learned_addr learned my addr 172.21.15.151:0/36499419 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb7ffd49640 1 -- 172.21.15.151:0/36499419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537eccfd0 con 0x559537d55a60 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/36499419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ae040 tx=0x7fb7f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9231e8b14c827950 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb6ede0b640 1 -- 172.21.15.151:0/36499419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b0040 con 0x559537d55a60 2024-09-13T19:08:33.027 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb6ede0b640 1 -- 172.21.15.151:0/36499419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00ab9b0 con 0x559537d55a60 2024-09-13T19:08:33.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb6ede0b640 1 -- 172.21.15.151:0/36499419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00abc90 con 0x559537d55a60 2024-09-13T19:08:33.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- 172.21.15.151:0/36499419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 msgr2=0x559537ecca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 --2- 172.21.15.151:0/36499419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ae040 tx=0x7fb7f0003030 comp rx=0 tx=0).stop 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- 172.21.15.151:0/36499419 shutdown_connections 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 --2- 172.21.15.151:0/36499419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ecca00 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- 172.21.15.151:0/36499419 >> 172.21.15.151:0/36499419 conn(0x559537ddc000 msgr2=0x559537ec8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- 172.21.15.151:0/36499419 shutdown_connections 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- 172.21.15.151:0/36499419 wait complete. 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.020+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ed3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559537de8db0 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ed3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ed3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58836/0 (socket says 172.21.15.151:58836) 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1545747106 learned_addr learned my addr 172.21.15.151:0/1545747106 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537ed4210 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ed3cd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ab510 tx=0x7fb7f0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 -- 172.21.15.151:0/1545747106 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b0070 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 -- 172.21.15.151:0/1545747106 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00b6970 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559537ed44a0 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 -- 172.21.15.151:0/1545747106 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b6c50 con 0x559537d55a60 2024-09-13T19:08:33.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537ed7180 con 0x559537d55a60 2024-09-13T19:08:33.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 -- 172.21.15.151:0/1545747106 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7f00bf3f0 con 0x559537d55a60 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6e8034650 0x7fb6e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb6e7fff640 1 -- 172.21.15.151:0/1545747106 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb7f00bc070 con 0x559537d55a60 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6e8034650 0x7fb6e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537de4850 0x559537edac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537edb280 con 0x559537de4850 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb80054a640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537de4850 0x559537edac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.024+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6e8034650 0x7fb6e8036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4001da0 tx=0x7fb7f4001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb80054a640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537de4850 0x559537edac60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb80054a640 1 -- 172.21.15.151:0/1545747106 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537de4850 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537edbb20 con 0x559537de4850 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb80054a640 1 -- 172.21.15.151:0/1545747106 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537de4850 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537edd430 0x559537edf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537ee0060 con 0x559537edd430 2024-09-13T19:08:33.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537edd430 0x559537edf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537edd430 0x559537edf8d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1545747106 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7f00b3040 con 0x559537edd430 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537edc370 con 0x559537de4850 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb80054a640 1 -- 172.21.15.151:0/1545747106 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537de4850 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559537ee14c0 0x559537ee38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537ee4020 con 0x559537ee14c0 2024-09-13T19:08:33.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559537ee14c0 0x559537ee38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559537ee14c0 0x559537ee38b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb7ff548640 1 -- 172.21.15.151:0/1545747106 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7f400e6c0 con 0x559537ee14c0 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.028+0000 7fb802239980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559537ce8800 con 0x559537ef1ad0 2024-09-13T19:08:33.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58852/0 (socket says 172.21.15.151:58852) 2024-09-13T19:08:33.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1657713336 learned_addr learned my addr 172.21.15.151:0/1657713336 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1657713336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537ef2430 con 0x559537ef1ad0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00e2d30 tx=0x7fb7f00b4370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 -- 172.21.15.151:0/1657713336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b5890 con 0x559537ef1ad0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 -- 172.21.15.151:0/1657713336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00b5a30 con 0x559537ef1ad0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 -- 172.21.15.151:0/1657713336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00b4b60 con 0x559537ef1ad0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559537ef26c0 con 0x559537ef1ad0 2024-09-13T19:08:33.039 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537ef5340 con 0x559537ef1ad0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 -- 172.21.15.151:0/1657713336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7f00b4d00 con 0x559537ef1ad0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 0x7fb6d8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb6e57fa640 1 -- 172.21.15.151:0/1657713336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb7f00a8070 con 0x559537ef1ad0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 0x7fb6d8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 0x7fb6d8036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559537ee0400 tx=0x7fb7f400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb802239980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559537ecd290 con 0x559537de1560 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58858/0 (socket says 172.21.15.151:58858) 2024-09-13T19:08:33.041 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.032+0000 7fb7ffd49640 1 -- 172.21.15.151:0/2289316609 learned_addr learned my addr 172.21.15.151:0/2289316609 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 -- 172.21.15.151:0/2289316609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537de1f10 con 0x559537de1560 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/2289316609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf80 tx=0x7fb7f00e4f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab85157aae7f8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6deffd640 1 -- 172.21.15.151:0/2289316609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00dbe30 con 0x559537de1560 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6deffd640 1 -- 172.21.15.151:0/2289316609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00f3070 con 0x559537de1560 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6deffd640 1 -- 172.21.15.151:0/2289316609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00dc610 con 0x559537de1560 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/2289316609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 msgr2=0x559537de1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 --2- 172.21.15.151:0/2289316609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf80 tx=0x7fb7f00e4f30 comp rx=0 tx=0).stop 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/2289316609 shutdown_connections 2024-09-13T19:08:33.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 --2- 172.21.15.151:0/2289316609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537de1940 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/2289316609 >> 172.21.15.151:0/2289316609 conn(0x559537efa7f0 msgr2=0x559537ef88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/2289316609 shutdown_connections 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/2289316609 wait complete. 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 Processor -- start 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- start start 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559537de1f10 con 0x559537de1560 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58860/0 (socket says 172.21.15.151:58860) 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 learned_addr learned my addr 172.21.15.151:0/1466881532 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559537f07b40 con 0x559537de1560 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf80 tx=0x7fb7f00d1030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6dd7fa640 1 -- 172.21.15.151:0/1466881532 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f0108070 con 0x559537de1560 2024-09-13T19:08:33.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559537f07b40 con 0x559537de1560 2024-09-13T19:08:33.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6dd7fa640 1 -- 172.21.15.151:0/1466881532 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00aa850 con 0x559537de1560 2024-09-13T19:08:33.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb6dd7fa640 1 -- 172.21.15.151:0/1466881532 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7f00aab70 con 0x559537de1560 2024-09-13T19:08:33.047 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.036+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559537f07b40 con 0x559537de1560 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb6dd7fa640 1 -- 172.21.15.151:0/1466881532 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb7f010b070 con 0x559537de1560 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb6dd7fa640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6c8034650 0x7fb6c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb6dd7fa640 1 -- 172.21.15.151:0/1466881532 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb7f010ed60 con 0x559537de1560 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6c8034650 0x7fb6c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537f12590 0x559537f14a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.052 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f151a0 con 0x559537f12590 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537f12590 0x559537f14a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6c8034650 0x7fb6c8036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559537ee4400 tx=0x7fb7f4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537f12590 0x559537f14a50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 realm 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f155b0 con 0x559537f12590 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:33.053 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f15e80 con 0x559537f12590 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537f16f80 0x559537f19370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f19940 con 0x559537f16f80 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537f16f80 0x559537f19370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.040+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537f16f80 0x559537f19370 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb802239980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb802239980 20 searching for the correct realm 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f1b210 con 0x559537f16f80 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ffd49640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb7f010d060 0x7fb7f00fe190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f1b210 con 0x7fb7f010d060 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb7f010d060 0x7fb7f00fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb7f010d060 0x7fb7f00fe190 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f400e6c0 con 0x7fb7f010d060 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f1b210 con 0x7fb7f010d060 2024-09-13T19:08:33.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f400e6c0 con 0x7fb7f010d060 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f1b210 con 0x559537f12590 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb7f8016440 0x7fb7f80168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb7f8016440 0x7fb7f80168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.044+0000 7fb80054a640 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb7f8016440 0x7fb7f80168c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f010d060 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7f400e6c0 con 0x7fb7f010d060 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.061 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f010d060 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7f400e6c0 con 0x7fb7f010d060 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.062 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.048+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.063 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f010d060 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f400e6c0 con 0x7fb7f010d060 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.064 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.052+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f010d060 2024-09-13T19:08:33.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f16f80 2024-09-13T19:08:33.068 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f8016440 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x559537f12590 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559537f16220 con 0x7fb7f010d060 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:33.069 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f1a330 con 0x559537f12590 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f19f70 con 0x559537f12590 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f1ac50 con 0x7fb7f010d060 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 zone default found 2024-09-13T19:08:33.070 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 4 Realm: () 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 zonegroup default 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.056+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f1b640 con 0x7fb7f8016440 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f1d0d0 con 0x559537f16f80 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.071 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f1d5a0 con 0x559537f16f80 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 started sync module instance, tier type = 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1c4c0 con 0x7fb7f010d060 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94099377080496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1c120 con 0x7fb7f010d060 2024-09-13T19:08:33.072 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1e4d0 con 0x559537f12590 2024-09-13T19:08:33.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.060+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94099377080496] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94099377086496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1e440 con 0x559537f12590 2024-09-13T19:08:33.073 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1f280 con 0x559537f16f80 2024-09-13T19:08:33.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94099377086496] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94099377088704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1f670 con 0x559537f16f80 2024-09-13T19:08:33.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.064+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f20030 con 0x7fb7f010d060 2024-09-13T19:08:33.074 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94099377093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f208d0 con 0x7fb7f010d060 2024-09-13T19:08:33.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f212d0 con 0x559537f12590 2024-09-13T19:08:33.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94099377088704] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.075 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94099377093504] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94099377089760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f20420 con 0x559537f12590 2024-09-13T19:08:33.076 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.068+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f21b70 con 0x7fb7f8016440 2024-09-13T19:08:33.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94099377089760] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94099377098208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f20420 con 0x7fb7f8016440 2024-09-13T19:08:33.078 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f22020 con 0x7fb7f8016440 2024-09-13T19:08:33.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94099377101680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f22440 con 0x7fb7f8016440 2024-09-13T19:08:33.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.072+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f22f60 con 0x7fb7f8016440 2024-09-13T19:08:33.081 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94099377098208] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94099377101680] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94099377105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f216c0 con 0x7fb7f8016440 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=0 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=1 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=2 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=3 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=4 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=5 2024-09-13T19:08:33.083 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=6 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94099377105456] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 20 add_watcher() i=7 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.076+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f25f50 con 0x559537f12590 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.085 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94099377102736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f233d0 con 0x559537f12590 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94099377102736] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 5 note: GC not initialized 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb6b4fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:33.087 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 Filter name: none 2024-09-13T19:08:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb62e7fc640 20 reqs_thread_entry: start 2024-09-13T19:08:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:08:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f494c0 con 0x7fb7f8016440 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f47c60 con 0x559537f16f80 2024-09-13T19:08:33.089 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-13T19:08:33.090 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.080+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f48500 con 0x7fb7f8016440 2024-09-13T19:08:33.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb802239980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:08:33.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb802239980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:08:33.092 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb802239980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94099377258576 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f4cf60 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== watch-notify(notify (1) cookie 94099377080496 notify 146028888087 ret 0) ==== 575+0+0 (crc 0 0 0) 0x559537c69ae0 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb6deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94099377080496 notifier 4841 bl.length()=533 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb6deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb6deffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(65 notify.0 [notify cookie 94099377258576 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb6deffd640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb6c4003eb0 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== watch-notify(notify_complete (2) cookie 94099377258576 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb7f4038840 con 0x7fb7f010d060 2024-09-13T19:08:33.093 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.084+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f48050 con 0x559537f16f80 2024-09-13T19:08:33.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb802239980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:08:33.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb802239980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb802239980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94099377258576 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559537f4d0c0 con 0x559537f12590 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94099377086496 notify 146028888098 ret 0) ==== 218+0+0 (crc 0 0 0) 0x559537f488a0 con 0x559537f12590 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb6de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94099377086496 notifier 4841 bl.length()=176 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb6de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb6de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb6de7fc640 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb634003410 con 0x559537f12590 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(68 notify.1 [notify cookie 94099377258576 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94099377258576 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559537f48f10 con 0x559537f12590 2024-09-13T19:08:33.096 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-13T19:08:33.088125Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:33.088107Z","tags":[],"group_ids":[]} 2024-09-13T19:08:33.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb6b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.088+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94099377102736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f472c0 con 0x559537f12590 2024-09-13T19:08:33.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94099377102736] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94099377080496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f472c0 con 0x7fb7f010d060 2024-09-13T19:08:33.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94099377080496] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 20 remove_watcher() i=0 2024-09-13T19:08:33.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 2 removed watcher, disabling cache 2024-09-13T19:08:33.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94099377086496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f472c0 con 0x559537f12590 2024-09-13T19:08:33.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94099377086496] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 20 remove_watcher() i=1 2024-09-13T19:08:33.100 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.092+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94099377088704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1e020 con 0x559537f16f80 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb7ffd49640 1 -- 172.21.15.151:0/1466881532 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94099377088704] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f010a030 con 0x559537f16f80 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb802239980 20 remove_watcher() i=2 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94099377093504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f472c0 con 0x7fb7f010d060 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb7ff548640 1 -- 172.21.15.151:0/1466881532 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94099377093504] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f4040040 con 0x7fb7f010d060 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb802239980 20 remove_watcher() i=3 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.096+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94099377089760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1e8c0 con 0x559537f12590 2024-09-13T19:08:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94099377089760] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x559537f12590 2024-09-13T19:08:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb802239980 20 remove_watcher() i=4 2024-09-13T19:08:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94099377098208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1e020 con 0x7fb7f8016440 2024-09-13T19:08:33.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94099377098208] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.108 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb802239980 20 remove_watcher() i=5 2024-09-13T19:08:33.109 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.100+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94099377101680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1ed70 con 0x7fb7f8016440 2024-09-13T19:08:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.104+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94099377101680] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.104+0000 7fb802239980 20 remove_watcher() i=6 2024-09-13T19:08:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.104+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94099377105456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559537f1ed70 con 0x7fb7f8016440 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94099377105456] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7f800a4d0 con 0x7fb7f8016440 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 20 remove_watcher() i=7 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb7f8016440 msgr2=0x7fb7f80168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb7f8016440 0x7fb7f80168c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537f12590 msgr2=0x559537f14a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537f12590 0x559537f14a50 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb7f010d060 msgr2=0x7fb7f00fe190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb7f010d060 0x7fb7f00fe190 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537f16f80 msgr2=0x559537f19370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537f16f80 0x559537f19370 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6c8034650 msgr2=0x7fb6c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6c8034650 0x7fb6c8036b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x559537ee4400 tx=0x7fb7f4010000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 msgr2=0x559537f07600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb80054a640 1 -- 172.21.15.151:0/1466881532 reap_dead start 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00acf80 tx=0x7fb7f00d1030 comp rx=0 tx=0).stop 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 shutdown_connections 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1466881532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537de1560 0x559537f07600 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 >> 172.21.15.151:0/1466881532 conn(0x559537efa7f0 msgr2=0x559537ef88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 shutdown_connections 2024-09-13T19:08:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1466881532 wait complete. 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 msgr2=0x7fb6d8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 0x7fb6d8036b60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x559537ee0400 tx=0x7fb7f400f000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 msgr2=0x559537ef1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00e2d30 tx=0x7fb7f00b4370 comp rx=0 tx=0).stop 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 shutdown_connections 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6d80346a0 0x7fb6d8036b60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1657713336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537ef1ad0 0x559537ef1ef0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 >> 172.21.15.151:0/1657713336 conn(0x559537ee6c20 msgr2=0x559537ee96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 shutdown_connections 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1657713336 wait complete. 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537de4850 msgr2=0x559537edac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559537de4850 0x559537edac60 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.117 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559537ee14c0 msgr2=0x559537ee38b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559537ee14c0 0x559537ee38b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537edd430 msgr2=0x559537edf8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559537edd430 0x559537edf8d0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6e8034650 msgr2=0x7fb6e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb6e8034650 0x7fb6e8036b10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4001da0 tx=0x7fb7f4001300 comp rx=0 tx=0).stop 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 msgr2=0x559537ed3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 --2- 172.21.15.151:0/1545747106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559537d55a60 0x559537ed3cd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ab510 tx=0x7fb7f0018020 comp rx=0 tx=0).stop 2024-09-13T19:08:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb80054a640 1 -- 172.21.15.151:0/1545747106 reap_dead start 2024-09-13T19:08:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 shutdown_connections 2024-09-13T19:08:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 >> 172.21.15.151:0/1545747106 conn(0x559537ddc000 msgr2=0x559537ec71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 shutdown_connections 2024-09-13T19:08:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.108+0000 7fb802239980 1 -- 172.21.15.151:0/1545747106 wait complete. 2024-09-13T19:08:33.126 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:08:33.088125Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:33.088107Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:33.126 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-13T19:08:33.088125Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:33.088107Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:33.126 ERROR:root:0 2024-09-13T19:08:33.127 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:33.139 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:33.140 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-13T19:08:33.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-13T19:08:33.140 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-13T19:08:33.201 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:33.201 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf5e33980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564373301e80 0x564373304270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf5e33980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564373183ae0 con 0x5643732702d0 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf5e33980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5643731a7e30 con 0x564373301e80 2024-09-13T19:08:33.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3142640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564373301e80 0x564373304270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3943640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x5643732702d0 0x564373300760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39810/0 (socket says 172.21.15.151:39810) 2024-09-13T19:08:33.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3142640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564373301e80 0x564373304270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58876/0 (socket says 172.21.15.151:58876) 2024-09-13T19:08:33.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3943640 1 -- 172.21.15.151:0/766096628 learned_addr learned my addr 172.21.15.151:0/766096628 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:33.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3142640 1 -- 172.21.15.151:0/766096628 >> v1:172.21.15.12:6789/0 conn(0x5643732702d0 legacy=0x564373300760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.196+0000 7f1bf3142640 1 -- 172.21.15.151:0/766096628 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643732706b0 con 0x564373301e80 2024-09-13T19:08:33.206 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf3142640 1 --2- 172.21.15.151:0/766096628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564373301e80 0x564373304270 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1be800a480 tx=0x7f1be801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a9986a2004a690 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf2941640 1 -- 172.21.15.151:0/766096628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be80b0070 con 0x564373301e80 2024-09-13T19:08:33.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf2941640 1 -- 172.21.15.151:0/766096628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be80ab540 con 0x564373301e80 2024-09-13T19:08:33.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf2941640 1 -- 172.21.15.151:0/766096628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be80ab840 con 0x564373301e80 2024-09-13T19:08:33.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 -- 172.21.15.151:0/766096628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564373301e80 msgr2=0x564373304270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.207 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/766096628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564373301e80 0x564373304270 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1be800a480 tx=0x7f1be801b280 comp rx=0 tx=0).stop 2024-09-13T19:08:33.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 -- 172.21.15.151:0/766096628 shutdown_connections 2024-09-13T19:08:33.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/766096628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564373301e80 0x564373304270 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 -- 172.21.15.151:0/766096628 >> 172.21.15.151:0/766096628 conn(0x5643732f6090 msgr2=0x5643732f84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 -- 172.21.15.151:0/766096628 shutdown_connections 2024-09-13T19:08:33.208 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.200+0000 7f1bf5e33980 1 -- 172.21.15.151:0/766096628 wait complete. 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf5e33980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf5e33980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5643731a9200 con 0x5643732702d0 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58886/0 (socket says 172.21.15.151:58886) 2024-09-13T19:08:33.223 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf3943640 1 -- 172.21.15.151:0/1930236872 learned_addr learned my addr 172.21.15.151:0/1930236872 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf3943640 1 -- 172.21.15.151:0/1930236872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643733e9220 con 0x5643732702d0 2024-09-13T19:08:33.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1bf3943640 1 --2- 172.21.15.151:0/1930236872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1bec001e20 tx=0x7f1bec00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb34791dd7292012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1ae1e0b640 1 -- 172.21.15.151:0/1930236872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec012020 con 0x5643732702d0 2024-09-13T19:08:33.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1ae1e0b640 1 -- 172.21.15.151:0/1930236872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec00e7c0 con 0x5643732702d0 2024-09-13T19:08:33.225 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.216+0000 7f1ae1e0b640 1 -- 172.21.15.151:0/1930236872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec00eb00 con 0x5643732702d0 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/1930236872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 msgr2=0x5643733e8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/1930236872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1bec001e20 tx=0x7f1bec00b790 comp rx=0 tx=0).stop 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/1930236872 shutdown_connections 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/1930236872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733e8c50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/1930236872 >> 172.21.15.151:0/1930236872 conn(0x5643732f6090 msgr2=0x5643733e4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/1930236872 shutdown_connections 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/1930236872 wait complete. 2024-09-13T19:08:33.226 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564373307210 con 0x5643732702d0 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733eff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733eff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58898/0 (socket says 172.21.15.151:58898) 2024-09-13T19:08:33.227 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf3943640 1 -- 172.21.15.151:0/2151389070 learned_addr learned my addr 172.21.15.151:0/2151389070 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf3943640 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643733f04c0 con 0x5643732702d0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf3943640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733eff80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1bec001e20 tx=0x7f1bec000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1adbfff640 1 -- 172.21.15.151:0/2151389070 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec012030 con 0x5643732702d0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643733f0750 con 0x5643732702d0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1adbfff640 1 -- 172.21.15.151:0/2151389070 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec001480 con 0x5643732702d0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1adbfff640 1 -- 172.21.15.151:0/2151389070 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec01a920 con 0x5643732702d0 2024-09-13T19:08:33.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643733f3430 con 0x5643732702d0 2024-09-13T19:08:33.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.220+0000 7f1adbfff640 1 -- 172.21.15.151:0/2151389070 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bec015020 con 0x5643732702d0 2024-09-13T19:08:33.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1adbfff640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1adc034650 0x7f1adc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1adbfff640 1 -- 172.21.15.151:0/2151389070 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bec020030 con 0x5643732702d0 2024-09-13T19:08:33.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1adc034650 0x7f1adc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564373301e80 0x5643733f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643733f7530 con 0x564373301e80 2024-09-13T19:08:33.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf4144640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564373301e80 0x5643733f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1adc034650 0x7f1adc036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ad000 tx=0x7f1be80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf4144640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564373301e80 0x5643733f6f10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf4144640 1 -- 172.21.15.151:0/2151389070 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x564373301e80 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643733f4650 con 0x564373301e80 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf4144640 1 -- 172.21.15.151:0/2151389070 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1be400a4d0 con 0x564373301e80 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5643733f9880 0x5643733fbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643733fc360 con 0x5643733f9880 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3943640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5643733f9880 0x5643733fbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3943640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5643733f9880 0x5643733fbc70 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3943640 1 -- 172.21.15.151:0/2151389070 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bec008030 con 0x5643733f9880 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643733f8720 con 0x564373301e80 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf4144640 1 -- 172.21.15.151:0/2151389070 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1be400a4d0 con 0x564373301e80 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5643733fd7c0 0x5643733ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373400320 con 0x5643733fd7c0 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5643733fd7c0 0x5643733ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5643733fd7c0 0x5643733ffbb0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf3142640 1 -- 172.21.15.151:0/2151389070 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1be80b3040 con 0x5643733fd7c0 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.224+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564373202800 con 0x56437340dd90 2024-09-13T19:08:33.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58904/0 (socket says 172.21.15.151:58904) 2024-09-13T19:08:33.234 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3943640 1 -- 172.21.15.151:0/2351416373 learned_addr learned my addr 172.21.15.151:0/2351416373 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3943640 1 -- 172.21.15.151:0/2351416373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437340e6f0 con 0x56437340dd90 2024-09-13T19:08:33.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3943640 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1bec01a740 tx=0x7f1bec00db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 -- 172.21.15.151:0/2351416373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec03d020 con 0x56437340dd90 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56437340e980 con 0x56437340dd90 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 -- 172.21.15.151:0/2351416373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec00d3e0 con 0x56437340dd90 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564373411600 con 0x56437340dd90 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 -- 172.21.15.151:0/2351416373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec04f060 con 0x56437340dd90 2024-09-13T19:08:33.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 -- 172.21.15.151:0/2351416373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bec040020 con 0x56437340dd90 2024-09-13T19:08:33.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 0x7f1acc036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1ad97fa640 1 -- 172.21.15.151:0/2351416373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bec005050 con 0x56437340dd90 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 0x7f1acc036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.228+0000 7f1bf5e33980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5643733e95a0 con 0x56437341a4c0 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3142640 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 0x7f1acc036a70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c10 tx=0x7f1be8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58906/0 (socket says 172.21.15.151:58906) 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 -- 172.21.15.151:0/2341828456 learned_addr learned my addr 172.21.15.151:0/2341828456 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.238 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 -- 172.21.15.151:0/2341828456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56437341ae70 con 0x56437341a4c0 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- 172.21.15.151:0/2341828456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1bec016d80 tx=0x7f1bec04a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32de2ed4665e623 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1ad2ffd640 1 -- 172.21.15.151:0/2341828456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec04cde0 con 0x56437341a4c0 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1ad2ffd640 1 -- 172.21.15.151:0/2341828456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec0199a0 con 0x56437341a4c0 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1ad2ffd640 1 -- 172.21.15.151:0/2341828456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec019290 con 0x56437341a4c0 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2341828456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 msgr2=0x56437341a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2341828456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1bec016d80 tx=0x7f1bec04a5f0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2341828456 shutdown_connections 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2341828456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x56437341a8a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2341828456 >> 172.21.15.151:0/2341828456 conn(0x5643734168a0 msgr2=0x5643734149a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2341828456 shutdown_connections 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2341828456 wait complete. 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 Processor -- start 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- start start 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf5e33980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56437341b310 con 0x56437341a4c0 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58914/0 (socket says 172.21.15.151:58914) 2024-09-13T19:08:33.241 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 learned_addr learned my addr 172.21.15.151:0/4292725120 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564373421cb0 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.232+0000 7f1bf3943640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1bec016d80 tx=0x7f1bec030210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 -- 172.21.15.151:0/4292725120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec06d020 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 -- 172.21.15.151:0/4292725120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec0413b0 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564373421cb0 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 -- 172.21.15.151:0/4292725120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec0165b0 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564373421cb0 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 -- 172.21.15.151:0/4292725120 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1bec070020 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1abc034650 0x7f1abc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1ad17fa640 1 -- 172.21.15.151:0/4292725120 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bec073d20 con 0x56437341a4c0 2024-09-13T19:08:33.243 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf3142640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1abc034650 0x7f1abc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56437342c790 0x56437342ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56437342f3a0 con 0x56437342c790 2024-09-13T19:08:33.244 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56437342c790 0x56437342ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf3142640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1abc034650 0x7f1abc036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ae040 tx=0x7f1be80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56437342c790 0x56437342ec50 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 realm 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56437342f7b0 con 0x56437342c790 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373430080 con 0x56437342c790 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564373431180 0x564373433570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373433b30 con 0x564373431180 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.236+0000 7f1bf3943640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564373431180 0x564373433570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3943640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564373431180 0x564373433570 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf5e33980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:33.249 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf5e33980 20 searching for the correct realm 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373435400 con 0x564373431180 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3943640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bec072020 0x7f1bec04c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373435400 con 0x7f1bec072020 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bec072020 0x7f1bec04c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bec072020 0x7f1bec04c500 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be80c9030 con 0x7f1bec072020 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373435400 con 0x7f1bec072020 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be80c9030 con 0x7f1bec072020 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373435400 con 0x56437342c790 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.250 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1be4016440 0x7f1be40168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.251 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1be4016440 0x7f1be40168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.253 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.240+0000 7f1bf4144640 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1be4016440 0x7f1be40168c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1bec072020 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1be80c9030 con 0x7f1bec072020 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.254 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1bec072020 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1be80c9030 con 0x7f1bec072020 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.244+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.255 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.256 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.257 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1bec072020 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be80c9030 con 0x7f1bec072020 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.248+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.258 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1bec072020 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x564373431180 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1be4016440 2024-09-13T19:08:33.261 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x56437342c790 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564373430420 con 0x7f1bec072020 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643734344f0 con 0x56437342c790 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.262 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373434940 con 0x56437342c790 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.252+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373434d60 con 0x7f1bec072020 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 zone default found 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 4 Realm: () 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:33.263 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:33.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 zonegroup default 2024-09-13T19:08:33.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.264 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373435830 con 0x7f1be4016440 2024-09-13T19:08:33.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.265 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373437210 con 0x564373431180 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373437690 con 0x564373431180 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 started sync module instance, tier type = 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643734366b0 con 0x7f1bec072020 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94847696595616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373437fa0 con 0x7f1bec072020 2024-09-13T19:08:33.266 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.256+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643734387f0 con 0x56437342c790 2024-09-13T19:08:33.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.260+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94847696595616] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.260+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.260+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94847696599792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643734387f0 con 0x56437342c790 2024-09-13T19:08:33.267 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.260+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373439290 con 0x564373431180 2024-09-13T19:08:33.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94847696599792] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94847696601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373438760 con 0x564373431180 2024-09-13T19:08:33.269 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373439fe0 con 0x7f1bec072020 2024-09-13T19:08:33.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94847696610256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343aca0 con 0x7f1bec072020 2024-09-13T19:08:33.270 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343b660 con 0x56437342c790 2024-09-13T19:08:33.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94847696601920] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.271 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94847696610256] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94847696606848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343a900 con 0x56437342c790 2024-09-13T19:08:33.273 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.264+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343b660 con 0x7f1be4016440 2024-09-13T19:08:33.274 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.268+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94847696606848] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.268+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.268+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94847696616560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343b660 con 0x7f1be4016440 2024-09-13T19:08:33.275 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.268+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343c810 con 0x7f1be4016440 2024-09-13T19:08:33.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94847696618336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343cc30 con 0x7f1be4016440 2024-09-13T19:08:33.277 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343d720 con 0x7f1be4016440 2024-09-13T19:08:33.278 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94847696616560] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.279 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94847696618336] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94847696622064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343c780 con 0x7f1be4016440 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=0 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=1 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=2 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=3 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=4 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=5 2024-09-13T19:08:33.280 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.272+0000 7f1bf5e33980 20 add_watcher() i=6 2024-09-13T19:08:33.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94847696622064] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 20 add_watcher() i=7 2024-09-13T19:08:33.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:33.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373440820 con 0x56437342c790 2024-09-13T19:08:33.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.283 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94847696613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437343dca0 con 0x56437342c790 2024-09-13T19:08:33.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94847696613808] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1aaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:33.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:33.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.276+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448f50 con 0x56437342c790 2024-09-13T19:08:33.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.280+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.286 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.280+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373449620 con 0x7f1be4016440 2024-09-13T19:08:33.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.280+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.280+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373449a40 con 0x564373431180 2024-09-13T19:08:33.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.289 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373449a10 con 0x56437342c790 2024-09-13T19:08:33.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'246 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.290 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373449fa0 con 0x7f1bec072020 2024-09-13T19:08:33.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.292 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.284+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344a510 con 0x564373431180 2024-09-13T19:08:33.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.288+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.293 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.288+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344a510 con 0x56437342c790 2024-09-13T19:08:33.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.288+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.295 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.288+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344a9c0 con 0x7f1be4016440 2024-09-13T19:08:33.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.297 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344a9c0 con 0x7f1bec072020 2024-09-13T19:08:33.299 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373446d80 con 0x564373431180 2024-09-13T19:08:33.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.300 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.292+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373446d80 con 0x7f1bec072020 2024-09-13T19:08:33.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.296+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.302 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.296+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1be4016440 2024-09-13T19:08:33.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.296+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.304 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.296+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1bec072020 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.300+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.300+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1be4016440 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.300+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.300+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x56437342c790 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.300+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.310 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.304+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.304+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.311 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.304+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1bec072020 2024-09-13T19:08:33.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.304+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.312 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.304+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.308+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.314 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.308+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x56437342c790 2024-09-13T19:08:33.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.308+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.316 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.308+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x56437342c790 2024-09-13T19:08:33.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.317 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1bec072020 2024-09-13T19:08:33.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.312+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.316+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.316+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.316+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.323 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.316+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.325 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1be4016440 2024-09-13T19:08:33.328 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.329 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.320+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.324+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.330 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.324+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1be4016440 2024-09-13T19:08:33.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.324+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.324+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x564373431180 2024-09-13T19:08:33.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.328+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.334 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.328+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1be4016440 2024-09-13T19:08:33.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.328+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.328+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56437344b520 con 0x7f1bec072020 2024-09-13T19:08:33.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1aa97e2640 20 reqs_thread_entry: start 2024-09-13T19:08:33.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:33.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 20 Filter name: none 2024-09-13T19:08:33.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1aa27fc640 20 reqs_thread_entry: start 2024-09-13T19:08:33.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-13T19:08:33.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643734461d0 con 0x7f1be4016440 2024-09-13T19:08:33.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 20 rados_obj.operate() r=0 bl.length=349 2024-09-13T19:08:33.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-13T19:08:33.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-13T19:08:33.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:33.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.332+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373445c90 con 0x7f1be4016440 2024-09-13T19:08:33.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 10 removing key index: system_akey 2024-09-13T19:08:33.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373445c90 con 0x564373431180 2024-09-13T19:08:33.342 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-13T19:08:33.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94847696796576 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373469580 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== watch-notify(notify (1) cookie 94847696599792 notify 146028888099 ret 0) ==== 203+0+0 (crc 0 0 0) 0x564373447460 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1ad2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94847696599792 notifier 4848 bl.length()=161 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(97 notify.1 [notify cookie 94847696796576 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1ad2ffd640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1ab8003d70 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== watch-notify(notify_complete (2) cookie 94847696796576 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56437340e6f0 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 10 removing email index: 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 10 removing user buckets index 2024-09-13T19:08:33.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.336+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373466ff0 con 0x7f1be4016440 2024-09-13T19:08:33.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf5e33980 10 removing user index: system_user 2024-09-13T19:08:33.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373468b60 con 0x7f1be4016440 2024-09-13T19:08:33.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf5e33980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf5e33980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94847696792384 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564373468460 con 0x7f1bec072020 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== watch-notify(notify (1) cookie 94847696595616 notify 146028888088 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564373446e60 con 0x7f1bec072020 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(101 notify.0 [notify cookie 94847696792384 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1ad27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94847696595616 notifier 4848 bl.length()=160 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.340+0000 7f1ad27fc640 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a1c0032d0 con 0x7f1bec072020 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== watch-notify(notify_complete (2) cookie 94847696792384 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564373449fa0 con 0x7f1bec072020 2024-09-13T19:08:33.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1aaa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94847696613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x56437342c790 2024-09-13T19:08:33.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94847696613808] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.351 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94847696595616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x7f1bec072020 2024-09-13T19:08:33.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94847696595616] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf5e33980 20 remove_watcher() i=0 2024-09-13T19:08:33.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf5e33980 2 removed watcher, disabling cache 2024-09-13T19:08:33.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.344+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94847696599792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x56437342c790 2024-09-13T19:08:33.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.348+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94847696599792] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.348+0000 7f1bf5e33980 20 remove_watcher() i=1 2024-09-13T19:08:33.355 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.348+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94847696601920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x564373431180 2024-09-13T19:08:33.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf3943640 1 -- 172.21.15.151:0/4292725120 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94847696601920] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bec051070 con 0x564373431180 2024-09-13T19:08:33.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 20 remove_watcher() i=2 2024-09-13T19:08:33.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94847696610256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x7f1bec072020 2024-09-13T19:08:33.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf3142640 1 -- 172.21.15.151:0/4292725120 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94847696610256] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be80e5040 con 0x7f1bec072020 2024-09-13T19:08:33.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 20 remove_watcher() i=3 2024-09-13T19:08:33.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94847696606848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x56437342c790 2024-09-13T19:08:33.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94847696606848] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x56437342c790 2024-09-13T19:08:33.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 20 remove_watcher() i=4 2024-09-13T19:08:33.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.352+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94847696616560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x7f1be4016440 2024-09-13T19:08:33.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.356+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94847696616560] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.356+0000 7f1bf5e33980 20 remove_watcher() i=5 2024-09-13T19:08:33.363 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.356+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94847696618336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x7f1be4016440 2024-09-13T19:08:33.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94847696618336] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 20 remove_watcher() i=6 2024-09-13T19:08:33.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94847696622064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564373448200 con 0x7f1be4016440 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94847696622064] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1be400a4d0 con 0x7f1be4016440 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 20 remove_watcher() i=7 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1be4016440 msgr2=0x7f1be40168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f1be4016440 0x7f1be40168c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56437342c790 msgr2=0x56437342ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56437342c790 0x56437342ec50 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bec072020 msgr2=0x7f1bec04c500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f1bec072020 0x7f1bec04c500 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564373431180 msgr2=0x564373433570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564373431180 0x564373433570 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1abc034650 msgr2=0x7f1abc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1abc034650 0x7f1abc036b10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ae040 tx=0x7f1be80a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 msgr2=0x564373421770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf4144640 1 -- 172.21.15.151:0/4292725120 reap_dead start 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1bec016d80 tx=0x7f1bec030210 comp rx=0 tx=0).stop 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 shutdown_connections 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/4292725120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437341a4c0 0x564373421770 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 >> 172.21.15.151:0/4292725120 conn(0x5643734168a0 msgr2=0x564373414970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 shutdown_connections 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/4292725120 wait complete. 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 msgr2=0x7f1acc036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 0x7f1acc036a70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1be8000c10 tx=0x7f1be8005a10 comp rx=0 tx=0).stop 2024-09-13T19:08:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 msgr2=0x56437340e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1bec01a740 tx=0x7f1bec00db30 comp rx=0 tx=0).stop 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 shutdown_connections 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1acc0345b0 0x7f1acc036a70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2351416373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56437340dd90 0x56437340e1b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 >> 172.21.15.151:0/2351416373 conn(0x564373402ee0 msgr2=0x564373405960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 shutdown_connections 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.360+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2351416373 wait complete. 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564373301e80 msgr2=0x5643733f6f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564373301e80 0x5643733f6f10 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5643733fd7c0 msgr2=0x5643733ffbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5643733fd7c0 0x5643733ffbb0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5643733f9880 msgr2=0x5643733fbc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5643733f9880 0x5643733fbc70 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1adc034650 msgr2=0x7f1adc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1adc034650 0x7f1adc036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1be80ad000 tx=0x7f1be80a5040 comp rx=0 tx=0).stop 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 msgr2=0x5643733eff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 --2- 172.21.15.151:0/2151389070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5643732702d0 0x5643733eff80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1bec001e20 tx=0x7f1bec000ee0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf4144640 1 -- 172.21.15.151:0/2151389070 reap_dead start 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 shutdown_connections 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 >> 172.21.15.151:0/2151389070 conn(0x5643732f6090 msgr2=0x5643733e3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 shutdown_connections 2024-09-13T19:08:33.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.364+0000 7f1bf5e33980 1 -- 172.21.15.151:0/2151389070 wait complete. 2024-09-13T19:08:33.381 ERROR:root:None 2024-09-13T19:08:33.381 ERROR:root:0 2024-09-13T19:08:33.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:08:33.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-13T19:08:33.382 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-13T19:08:33.472 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:33.473 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:33.473 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a6eec980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5588be95f630 0x5588be95fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a6eec980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5588be7e7ae0 con 0x5588be95ff80 2024-09-13T19:08:33.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a6eec980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5588be80be30 con 0x5588be95f630 2024-09-13T19:08:33.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a49fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5588be95f630 0x5588be95fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a49fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5588be95f630 0x5588be95fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58920/0 (socket says 172.21.15.151:58920) 2024-09-13T19:08:33.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a49fc640 1 -- 172.21.15.151:0/3854618157 learned_addr learned my addr 172.21.15.151:0/3854618157 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a49fc640 1 -- 172.21.15.151:0/3854618157 >> v1:172.21.15.12:6789/0 conn(0x5588be95ff80 legacy=0x5588be9649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.475 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.468+0000 7f01a49fc640 1 -- 172.21.15.151:0/3854618157 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588be967200 con 0x5588be95f630 2024-09-13T19:08:33.477 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3854618157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588be95fa10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f019c00a4e0 tx=0x7f019c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321cd062baf79c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a39fa640 1 -- 172.21.15.151:0/3854618157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0aa540 con 0x5588be95f630 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a39fa640 1 -- 172.21.15.151:0/3854618157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0aa6e0 con 0x5588be95f630 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a39fa640 1 -- 172.21.15.151:0/3854618157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0aaa40 con 0x5588be95f630 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 -- 172.21.15.151:0/3854618157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 msgr2=0x5588be95fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3854618157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588be95fa10 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f019c00a4e0 tx=0x7f019c01b090 comp rx=0 tx=0).stop 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 -- 172.21.15.151:0/3854618157 shutdown_connections 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3854618157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588be95fa10 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.478 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 -- 172.21.15.151:0/3854618157 >> 172.21.15.151:0/3854618157 conn(0x5588be95b150 msgr2=0x5588be95d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 -- 172.21.15.151:0/3854618157 shutdown_connections 2024-09-13T19:08:33.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.472+0000 7f01a6eec980 1 -- 172.21.15.151:0/3854618157 wait complete. 2024-09-13T19:08:33.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.484+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5588be80d200 con 0x5588be95f630 2024-09-13T19:08:33.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58926/0 (socket says 172.21.15.151:58926) 2024-09-13T19:08:33.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 -- 172.21.15.151:0/3036472296 learned_addr learned my addr 172.21.15.151:0/3036472296 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 -- 172.21.15.151:0/3036472296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bea4b010 con 0x5588be95f630 2024-09-13T19:08:33.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3036472296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f019c017ca0 tx=0x7f019c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d48f2b4ab49db8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f0092e0d640 1 -- 172.21.15.151:0/3036472296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0b9070 con 0x5588be95f630 2024-09-13T19:08:33.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f0092e0d640 1 -- 172.21.15.151:0/3036472296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0aaa80 con 0x5588be95f630 2024-09-13T19:08:33.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f0092e0d640 1 -- 172.21.15.151:0/3036472296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0aad60 con 0x5588be95f630 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- 172.21.15.151:0/3036472296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 msgr2=0x5588bea4aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3036472296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f019c017ca0 tx=0x7f019c0033b0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- 172.21.15.151:0/3036472296 shutdown_connections 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3036472296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea4aa40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- 172.21.15.151:0/3036472296 >> 172.21.15.151:0/3036472296 conn(0x5588be95b150 msgr2=0x5588bea46670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- 172.21.15.151:0/3036472296 shutdown_connections 2024-09-13T19:08:33.497 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- 172.21.15.151:0/3036472296 wait complete. 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea51c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a6eec980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5588be966c40 con 0x5588be95f630 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea51c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea51c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58928/0 (socket says 172.21.15.151:58928) 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.488+0000 7f01a49fc640 1 -- 172.21.15.151:0/3243837888 learned_addr learned my addr 172.21.15.151:0/3243837888 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a49fc640 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bea52180 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea51c40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f019c01aec0 tx=0x7f019c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 -- 172.21.15.151:0/3243837888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0cc070 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588bea52410 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 -- 172.21.15.151:0/3243837888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0c7410 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588bea550f0 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 -- 172.21.15.151:0/3243837888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0b9070 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 -- 172.21.15.151:0/3243837888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f019c0b3040 con 0x5588be95f630 2024-09-13T19:08:33.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f008c034650 0x7f008c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f009160a640 1 -- 172.21.15.151:0/3243837888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f019c0c4070 con 0x5588be95f630 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a41fb640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f008c034650 0x7f008c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588be95ff80 0x5588bea58d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea59280 con 0x5588be95ff80 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a51fd640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588be95ff80 0x5588bea58d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a41fb640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f008c034650 0x7f008c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0198001e20 tx=0x7f01980013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a51fd640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588be95ff80 0x5588bea58d40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a51fd640 1 -- 172.21.15.151:0/3243837888 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01940083f0 con 0x5588be95ff80 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea59b90 con 0x5588be95ff80 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a51fd640 1 -- 172.21.15.151:0/3243837888 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01940083f0 con 0x5588be95ff80 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea5b4e0 0x5588bea5d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea5e100 con 0x5588bea5b4e0 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.492+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea5b4e0 0x5588bea5d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea5b4e0 0x5588bea5d970 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 -- 172.21.15.151:0/3243837888 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f019c0bd460 con 0x5588bea5b4e0 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea5a3e0 con 0x5588be95ff80 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a51fd640 1 -- 172.21.15.151:0/3243837888 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01940083f0 con 0x5588be95ff80 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5588bea5f560 0x5588bea61950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea62090 con 0x5588bea5f560 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a41fb640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5588bea5f560 0x5588bea61950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a41fb640 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5588bea5f560 0x5588bea61950 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a41fb640 1 -- 172.21.15.151:0/3243837888 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f019800d040 con 0x5588bea5f560 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a6eec980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5588be866800 con 0x5588bea6fb40 2024-09-13T19:08:33.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58936/0 (socket says 172.21.15.151:58936) 2024-09-13T19:08:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 -- 172.21.15.151:0/1048562191 learned_addr learned my addr 172.21.15.151:0/1048562191 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 -- 172.21.15.151:0/1048562191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bea704a0 con 0x5588bea6fb40 2024-09-13T19:08:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.496+0000 7f01a49fc640 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f019c0e2ff0 tx=0x7f019c0a9d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 -- 172.21.15.151:0/1048562191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0a9700 con 0x5588bea6fb40 2024-09-13T19:08:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588bea70730 con 0x5588bea6fb40 2024-09-13T19:08:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 -- 172.21.15.151:0/1048562191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0c78d0 con 0x5588bea6fb40 2024-09-13T19:08:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588bea733b0 con 0x5588bea6fb40 2024-09-13T19:08:33.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 -- 172.21.15.151:0/1048562191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0c7a80 con 0x5588bea6fb40 2024-09-13T19:08:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 -- 172.21.15.151:0/1048562191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f019c0c7c20 con 0x5588bea6fb40 2024-09-13T19:08:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 0x7f007c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f008a7fc640 1 -- 172.21.15.151:0/1048562191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f019c0f2ac0 con 0x5588bea6fb40 2024-09-13T19:08:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 0x7f007c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 0x7f007c036b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5588bea56470 tx=0x7f0198006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a6eec980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5588bea4b2d0 con 0x5588bea7c430 2024-09-13T19:08:33.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58938/0 (socket says 172.21.15.151:58938) 2024-09-13T19:08:33.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a49fc640 1 -- 172.21.15.151:0/3566700465 learned_addr learned my addr 172.21.15.151:0/3566700465 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a49fc640 1 -- 172.21.15.151:0/3566700465 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bea7cde0 con 0x5588bea7c430 2024-09-13T19:08:33.514 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f01a49fc640 1 --2- 172.21.15.151:0/3566700465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ed4b0 tx=0x7f019c0bcc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f51d5b52e1bc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f007bfff640 1 -- 172.21.15.151:0/3566700465 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0e44e0 con 0x5588bea7c430 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f007bfff640 1 -- 172.21.15.151:0/3566700465 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c0e4740 con 0x5588bea7c430 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.500+0000 7f007bfff640 1 -- 172.21.15.151:0/3566700465 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0eec50 con 0x5588bea7c430 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/3566700465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 msgr2=0x5588bea7c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3566700465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ed4b0 tx=0x7f019c0bcc30 comp rx=0 tx=0).stop 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/3566700465 shutdown_connections 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3566700465 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea7c810 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/3566700465 >> 172.21.15.151:0/3566700465 conn(0x5588bea78810 msgr2=0x5588bea76910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/3566700465 shutdown_connections 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/3566700465 wait complete. 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 Processor -- start 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- start start 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5588bea7d280 con 0x5588bea7c430 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a49fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58948/0 (socket says 172.21.15.151:58948) 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 learned_addr learned my addr 172.21.15.151:0/1541552438 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588bea83ab0 con 0x5588bea7c430 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a49fc640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ed5c0 tx=0x7f019c0c3eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 -- 172.21.15.151:0/1541552438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0e19e0 con 0x5588bea7c430 2024-09-13T19:08:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5588bea83ab0 con 0x5588bea7c430 2024-09-13T19:08:33.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 -- 172.21.15.151:0/1541552438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019c10d070 con 0x5588bea7c430 2024-09-13T19:08:33.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 -- 172.21.15.151:0/1541552438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f019c0e11d0 con 0x5588bea7c430 2024-09-13T19:08:33.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588bea83f80 con 0x5588bea7c430 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 -- 172.21.15.151:0/1541552438 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f019c104040 con 0x5588bea7c430 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0070034650 0x7f0070036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.504+0000 7f007a7fc640 1 -- 172.21.15.151:0/1541552438 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f019c102020 con 0x5588bea7c430 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0070034650 0x7f0070036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588bea8e6a0 0x5588bea90b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea912b0 con 0x5588bea8e6a0 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588bea8e6a0 0x5588bea90b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0070034650 0x7f0070036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5588bea62470 tx=0x7f0198011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588bea8e6a0 0x5588bea90b60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 realm 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea916c0 con 0x5588bea8e6a0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea91f90 con 0x5588bea8e6a0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea93090 0x5588bea95480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea95a50 con 0x5588bea93090 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea93090 0x5588bea95480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea93090 0x5588bea95480 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:33.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 20 searching for the correct realm 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea97320 con 0x5588bea93090 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f019c0e40e0 0x7f019c0fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea97320 con 0x7f019c0e40e0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f019c0e40e0 0x7f019c0fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.508+0000 7f01a41fb640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f019c0e40e0 0x7f019c0fd8f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea97320 con 0x7f019c0e40e0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea97320 con 0x5588bea8e6a0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0194018410 0x7f0194018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0194018410 0x7f0194018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0194018410 0x7f0194018890 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x7f0194018410 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x7f0194018410 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f019c0e40e0 2024-09-13T19:08:33.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.512+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x7f0194018410 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f019c0e40e0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x7f0194018410 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.516+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x7f0194018410 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f019c0e40e0 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01940083f0 con 0x5588bea8e6a0 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.543 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f019c0e40e0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea93090 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.520+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x7f0194018410 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5588bea92330 con 0x5588bea8e6a0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f019403b040 con 0x7f019c0e40e0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:33.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea96310 con 0x5588bea8e6a0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea96700 con 0x5588bea8e6a0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.545 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea96700 con 0x7f019c0e40e0 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 zone default found 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 4 Realm: () 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 zonegroup default 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea96ff0 con 0x7f0194018410 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea96ff0 con 0x5588bea93090 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588bea99260 con 0x5588bea93090 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 started sync module instance, tier type = 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.524+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea985d0 con 0x7f019c0e40e0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94045802695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea98230 con 0x7f019c0e40e0 2024-09-13T19:08:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9a190 con 0x5588bea8e6a0 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94045802695104] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94045802700000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9a5b0 con 0x5588bea8e6a0 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.528+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9ae00 con 0x5588bea93090 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94045802702528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9b6d0 con 0x5588bea93090 2024-09-13T19:08:33.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9c0d0 con 0x7f019c0e40e0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94045802700000] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94045802701056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9c090 con 0x7f019c0e40e0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9cae0 con 0x5588bea8e6a0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.532+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94045802702528] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94045802701056] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94045802710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9c090 con 0x5588bea8e6a0 2024-09-13T19:08:33.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9ca50 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94045802710576] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94045802707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9c000 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.536+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9d830 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.540+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94045802707936] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.540+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.540+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94045802712784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9d7a0 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.540+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9e220 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94045802712784] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94045802713840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9d710 con 0x7f0194018410 2024-09-13T19:08:33.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=0 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=1 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=2 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=3 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=4 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=5 2024-09-13T19:08:33.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=6 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94045802713840] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 20 add_watcher() i=7 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588beaa16c0 con 0x5588bea8e6a0 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.544+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94045802717664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9eb80 con 0x5588bea8e6a0 2024-09-13T19:08:33.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94045802717664] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f005afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 5 note: GC not initialized 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f0059fe3640 20 reqs_thread_entry: start 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 Filter name: none 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7effcb7fe640 20 reqs_thread_entry: start 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588beac4d20 con 0x5588bea93090 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-13T19:08:33.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588beac34c0 con 0x5588bea93090 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-13T19:08:33.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac3d60 con 0x5588bea93090 2024-09-13T19:08:33.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:08:33.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:08:33.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94045802870960 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588beac8310 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== watch-notify(notify (1) cookie 94045802702528 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5588beac4770 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f007bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94045802702528 notifier 4855 bl.length()=542 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f007bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f007bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(65 notify.2 [notify cookie 94045802870960 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f007bfff640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0068003eb0 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.548+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== watch-notify(notify_complete (2) cookie 94045802870960 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5588bea704a0 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac3d10 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.560 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a6eec980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a6eec980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a6eec980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94045802870880 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5588beac8310 con 0x7f0194018410 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== watch-notify(notify (1) cookie 94045802707936 notify 146028888110 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f0194010040 con 0x7f0194018410 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(68 notify.5 [notify cookie 94045802870880 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f007b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888110 cookie 94045802707936 notifier 4855 bl.length()=175 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f007b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f007b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-13T19:08:33.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f007b7fe640 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7effd8003410 con 0x7f0194018410 2024-09-13T19:08:33.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== watch-notify(notify_complete (2) cookie 94045802870880 notify 146028888110 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0194007560 con 0x7f0194018410 2024-09-13T19:08:33.562 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.552+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.562 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-13T19:08:33.554567Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:33.554553Z","tags":[],"group_ids":[]} 2024-09-13T19:08:33.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f005afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94045802717664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x5588bea8e6a0 2024-09-13T19:08:33.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94045802717664] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94045802695104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x7f019c0e40e0 2024-09-13T19:08:33.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94045802695104] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a6eec980 20 remove_watcher() i=0 2024-09-13T19:08:33.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a6eec980 2 removed watcher, disabling cache 2024-09-13T19:08:33.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.556+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94045802700000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x5588bea8e6a0 2024-09-13T19:08:33.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94045802700000] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a6eec980 20 remove_watcher() i=1 2024-09-13T19:08:33.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94045802702528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea99ce0 con 0x5588bea93090 2024-09-13T19:08:33.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a49fc640 1 -- 172.21.15.151:0/1541552438 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94045802702528] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f019c0ea020 con 0x5588bea93090 2024-09-13T19:08:33.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a6eec980 20 remove_watcher() i=2 2024-09-13T19:08:33.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.560+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94045802701056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x7f019c0e40e0 2024-09-13T19:08:33.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a41fb640 1 -- 172.21.15.151:0/1541552438 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94045802701056] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x7f019c0e40e0 2024-09-13T19:08:33.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a6eec980 20 remove_watcher() i=3 2024-09-13T19:08:33.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94045802710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x5588bea8e6a0 2024-09-13T19:08:33.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94045802710576] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x5588bea8e6a0 2024-09-13T19:08:33.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a6eec980 20 remove_watcher() i=4 2024-09-13T19:08:33.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.564+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94045802707936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9c630 con 0x7f0194018410 2024-09-13T19:08:33.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94045802707936] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a6eec980 20 remove_watcher() i=5 2024-09-13T19:08:33.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94045802712784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588beac2b20 con 0x7f0194018410 2024-09-13T19:08:33.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94045802712784] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a6eec980 20 remove_watcher() i=6 2024-09-13T19:08:33.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.568+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94045802713840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5588bea9bbe0 con 0x7f0194018410 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94045802713840] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0194036040 con 0x7f0194018410 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 20 remove_watcher() i=7 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0194018410 msgr2=0x7f0194018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f0194018410 0x7f0194018890 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588bea8e6a0 msgr2=0x5588bea90b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588bea8e6a0 0x5588bea90b60 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f019c0e40e0 msgr2=0x7f019c0fd8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f019c0e40e0 0x7f019c0fd8f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea93090 msgr2=0x5588bea95480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea93090 0x5588bea95480 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0070034650 msgr2=0x7f0070036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0070034650 0x7f0070036b10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x5588bea62470 tx=0x7f0198011000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a51fd640 1 -- 172.21.15.151:0/1541552438 reap_dead start 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 msgr2=0x5588bea83570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f019c0ed5c0 tx=0x7f019c0c3eb0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 shutdown_connections 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1541552438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea7c430 0x5588bea83570 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 >> 172.21.15.151:0/1541552438 conn(0x5588bea78810 msgr2=0x5588bea768e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 shutdown_connections 2024-09-13T19:08:33.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1541552438 wait complete. 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 msgr2=0x7f007c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 0x7f007c036b60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x5588bea56470 tx=0x7f0198006000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 msgr2=0x5588bea6ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f019c0e2ff0 tx=0x7f019c0a9d50 comp rx=0 tx=0).stop 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 shutdown_connections 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f007c0346a0 0x7f007c036b60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/1048562191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588bea6fb40 0x5588bea6ff60 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 >> 172.21.15.151:0/1048562191 conn(0x5588bea64c90 msgr2=0x5588bea67710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 shutdown_connections 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/1048562191 wait complete. 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588be95ff80 msgr2=0x5588bea58d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5588be95ff80 0x5588bea58d40 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5588bea5f560 msgr2=0x5588bea61950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5588bea5f560 0x5588bea61950 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea5b4e0 msgr2=0x5588bea5d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5588bea5b4e0 0x5588bea5d970 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f008c034650 msgr2=0x7f008c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f008c034650 0x7f008c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0198001e20 tx=0x7f01980013a0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 msgr2=0x5588bea51c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 --2- 172.21.15.151:0/3243837888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5588be95f630 0x5588bea51c40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f019c01aec0 tx=0x7f019c017e30 comp rx=0 tx=0).stop 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a51fd640 1 -- 172.21.15.151:0/3243837888 reap_dead start 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 shutdown_connections 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 >> 172.21.15.151:0/3243837888 conn(0x5588be95b150 msgr2=0x5588bea451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 shutdown_connections 2024-09-13T19:08:33.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.572+0000 7f01a6eec980 1 -- 172.21.15.151:0/3243837888 wait complete. 2024-09-13T19:08:33.592 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:08:33.554567Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:33.554553Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:33.592 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-13T19:08:33.554567Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:33.554553Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:33.592 ERROR:root:0 2024-09-13T19:08:33.593 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:33.606 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:33.606 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-13T19:08:33.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-13T19:08:33.607 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-13T19:08:33.666 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:33.666 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:33.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f695a822980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559f9c4eda10 0x559f9c4efe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f695a822980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f9c371ae0 con 0x559f9c4e9690 2024-09-13T19:08:33.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f695a822980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x559f9c395e30 con 0x559f9c4eda10 2024-09-13T19:08:33.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f6957b31640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559f9c4eda10 0x559f9c4efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f6957b31640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x559f9c4eda10 0x559f9c4efe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58960/0 (socket says 172.21.15.151:58960) 2024-09-13T19:08:33.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f6957b31640 1 -- 172.21.15.151:0/1188528087 learned_addr learned my addr 172.21.15.151:0/1188528087 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f6957b31640 1 -- 172.21.15.151:0/1188528087 >> v1:172.21.15.12:6789/0 conn(0x559f9c4e9690 legacy=0x559f9c4e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.660+0000 7f6957b31640 1 -- 172.21.15.151:0/1188528087 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c4f1350 con 0x559f9c4eda10 2024-09-13T19:08:33.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f6957b31640 1 --2- 172.21.15.151:0/1188528087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4eda10 0x559f9c4efe00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f694c00a5c0 tx=0x7f694c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c8df335649a073 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f6957330640 1 -- 172.21.15.151:0/1188528087 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c0a6070 con 0x559f9c4eda10 2024-09-13T19:08:33.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f6957330640 1 -- 172.21.15.151:0/1188528087 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c0af070 con 0x559f9c4eda10 2024-09-13T19:08:33.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f6957330640 1 -- 172.21.15.151:0/1188528087 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c0aa5c0 con 0x559f9c4eda10 2024-09-13T19:08:33.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 -- 172.21.15.151:0/1188528087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4eda10 msgr2=0x559f9c4efe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 --2- 172.21.15.151:0/1188528087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4eda10 0x559f9c4efe00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f694c00a5c0 tx=0x7f694c01b340 comp rx=0 tx=0).stop 2024-09-13T19:08:33.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 -- 172.21.15.151:0/1188528087 shutdown_connections 2024-09-13T19:08:33.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 --2- 172.21.15.151:0/1188528087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4eda10 0x559f9c4efe00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 -- 172.21.15.151:0/1188528087 >> 172.21.15.151:0/1188528087 conn(0x559f9c4e51b0 msgr2=0x559f9c4e75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 -- 172.21.15.151:0/1188528087 shutdown_connections 2024-09-13T19:08:33.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.664+0000 7f695a822980 1 -- 172.21.15.151:0/1188528087 wait complete. 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f695a822980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f695a822980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f9c397200 con 0x559f9c4e9690 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.689 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58964/0 (socket says 172.21.15.151:58964) 2024-09-13T19:08:33.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.680+0000 7f6958332640 1 -- 172.21.15.151:0/1153213691 learned_addr learned my addr 172.21.15.151:0/1153213691 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 -- 172.21.15.151:0/1153213691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c5d5050 con 0x559f9c4e9690 2024-09-13T19:08:33.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 --2- 172.21.15.151:0/1153213691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6948001ea0 tx=0x7f694800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819ca26a1e658122 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f684660c640 1 -- 172.21.15.151:0/1153213691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694800a040 con 0x559f9c4e9690 2024-09-13T19:08:33.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f684660c640 1 -- 172.21.15.151:0/1153213691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694800f620 con 0x559f9c4e9690 2024-09-13T19:08:33.691 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f684660c640 1 -- 172.21.15.151:0/1153213691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694800f890 con 0x559f9c4e9690 2024-09-13T19:08:33.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- 172.21.15.151:0/1153213691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 msgr2=0x559f9c5d4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 --2- 172.21.15.151:0/1153213691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6948001ea0 tx=0x7f694800b680 comp rx=0 tx=0).stop 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- 172.21.15.151:0/1153213691 shutdown_connections 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 --2- 172.21.15.151:0/1153213691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c5d4a80 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- 172.21.15.151:0/1153213691 >> 172.21.15.151:0/1153213691 conn(0x559f9c4e51b0 msgr2=0x559f9c5d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- 172.21.15.151:0/1153213691 shutdown_connections 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- 172.21.15.151:0/1153213691 wait complete. 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c460510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f695a822980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f9c4f0e50 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c460510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c460510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58974/0 (socket says 172.21.15.151:58974) 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 -- 172.21.15.151:0/3848662585 learned_addr learned my addr 172.21.15.151:0/3848662585 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c45ec30 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.684+0000 7f6958332640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c460510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6948001fd0 tx=0x7f6948000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 -- 172.21.15.151:0/3848662585 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6948001520 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 -- 172.21.15.151:0/3848662585 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694801c9c0 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f9c45eec0 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 -- 172.21.15.151:0/3848662585 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694801cd00 con 0x559f9c4e9690 2024-09-13T19:08:33.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9c45f410 con 0x559f9c4e9690 2024-09-13T19:08:33.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 -- 172.21.15.151:0/3848662585 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6948017050 con 0x559f9c4e9690 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6844e09640 1 -- 172.21.15.151:0/3848662585 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6948015020 con 0x559f9c4e9690 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6957b31640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c4eda10 0x559f9c5e5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c5e5750 con 0x559f9c4eda10 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958b33640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c4eda10 0x559f9c5e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6957b31640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f694c0ae000 tx=0x7f694c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958b33640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c4eda10 0x559f9c5e5210 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958b33640 1 -- 172.21.15.151:0/3848662585 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c4eda10 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c5e5b70 con 0x559f9c4eda10 2024-09-13T19:08:33.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958b33640 1 -- 172.21.15.151:0/3848662585 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c4eda10 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c5e7980 0x559f9c5e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c5ea460 con 0x559f9c5e7980 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958332640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c5e7980 0x559f9c5e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.688+0000 7f6958332640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c5e7980 0x559f9c5e9d70 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 -- 172.21.15.151:0/3848662585 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f694802e070 con 0x559f9c5e7980 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c5e6820 con 0x559f9c4eda10 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958b33640 1 -- 172.21.15.151:0/3848662585 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c4eda10 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559f9c5eb8c0 0x559f9c5edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c5ee3f0 con 0x559f9c5eb8c0 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6957b31640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559f9c5eb8c0 0x559f9c5edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6957b31640 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559f9c5eb8c0 0x559f9c5edcb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6957b31640 1 -- 172.21.15.151:0/3848662585 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f694c0aab00 con 0x559f9c5eb8c0 2024-09-13T19:08:33.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.701 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f9c3f0800 con 0x559f9c5fbec0 2024-09-13T19:08:33.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58986/0 (socket says 172.21.15.151:58986) 2024-09-13T19:08:33.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 -- 172.21.15.151:0/323237839 learned_addr learned my addr 172.21.15.151:0/323237839 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 -- 172.21.15.151:0/323237839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c5fc820 con 0x559f9c5fbec0 2024-09-13T19:08:33.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f6958332640 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f694801dfd0 tx=0x7f694801a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f683dffb640 1 -- 172.21.15.151:0/323237839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694802f880 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f9c5fcab0 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f683dffb640 1 -- 172.21.15.151:0/323237839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6948013130 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f683dffb640 1 -- 172.21.15.151:0/323237839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6948013410 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.692+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9c5fcab0 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f683dffb640 1 -- 172.21.15.151:0/323237839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6948043040 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f683dffb640 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 0x7f6830036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f683dffb640 1 -- 172.21.15.151:0/323237839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f694803fd80 con 0x559f9c5fbec0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6957b31640 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 0x7f6830036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6957b31640 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 0x7f6830036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x559f9c45f730 tx=0x7f694c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f9c5d53d0 con 0x559f9c6085b0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:58996/0 (socket says 172.21.15.151:58996) 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6958332640 1 -- 172.21.15.151:0/4090412544 learned_addr learned my addr 172.21.15.151:0/4090412544 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6958332640 1 -- 172.21.15.151:0/4090412544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c608f60 con 0x559f9c6085b0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f6958332640 1 --2- 172.21.15.151:0/4090412544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f694801afd0 tx=0x7f694803d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe8310702388524 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f68377fe640 1 -- 172.21.15.151:0/4090412544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6948010e60 con 0x559f9c6085b0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f68377fe640 1 -- 172.21.15.151:0/4090412544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480135b0 con 0x559f9c6085b0 2024-09-13T19:08:33.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f68377fe640 1 -- 172.21.15.151:0/4090412544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6948048e00 con 0x559f9c6085b0 2024-09-13T19:08:33.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 -- 172.21.15.151:0/4090412544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 msgr2=0x559f9c608990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 --2- 172.21.15.151:0/4090412544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f694801afd0 tx=0x7f694803d6b0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 -- 172.21.15.151:0/4090412544 shutdown_connections 2024-09-13T19:08:33.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 --2- 172.21.15.151:0/4090412544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c608990 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.696+0000 7f695a822980 1 -- 172.21.15.151:0/4090412544 >> 172.21.15.151:0/4090412544 conn(0x559f9c604990 msgr2=0x559f9c602a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- 172.21.15.151:0/4090412544 shutdown_connections 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- 172.21.15.151:0/4090412544 wait complete. 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 Processor -- start 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- start start 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x559f9c609400 con 0x559f9c6085b0 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6958332640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59002/0 (socket says 172.21.15.151:59002) 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 learned_addr learned my addr 172.21.15.151:0/1180592522 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f9c60fc30 con 0x559f9c6085b0 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6958332640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f694803d580 tx=0x7f6948007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 -- 172.21.15.151:0/1180592522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694806f070 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 -- 172.21.15.151:0/1180592522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69480415a0 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f9c60fc30 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 -- 172.21.15.151:0/1180592522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6948031450 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f9c60fc30 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 -- 172.21.15.151:0/1180592522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6948072070 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68280346a0 0x7f6828036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6835ffb640 1 -- 172.21.15.151:0/1180592522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f694805b070 con 0x559f9c6085b0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.700+0000 7f6957b31640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68280346a0 0x7f6828036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c61a820 0x559f9c61cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61d430 con 0x559f9c61a820 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c61a820 0x559f9c61cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6957b31640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68280346a0 0x7f6828036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f694c0aafd0 tx=0x7f694c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c61a820 0x559f9c61cce0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 realm 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61d840 con 0x559f9c61a820 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e110 con 0x559f9c61a820 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c61f210 0x559f9c621600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c621c10 con 0x559f9c61f210 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c61f210 0x559f9c621600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c61f210 0x559f9c621600 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6948071030 con 0x559f9c61f210 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 20 searching for the correct realm 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6234e0 con 0x559f9c61f210 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948071030 con 0x559f9c61f210 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6948074060 0x7f694805a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6234e0 con 0x7f6948074060 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6957b31640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6948074060 0x7f694805a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.704+0000 7f6957b31640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6948074060 0x7f694805a820 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c0aab00 con 0x7f6948074060 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6234e0 con 0x7f6948074060 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c0aab00 con 0x7f6948074060 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6234e0 con 0x559f9c61a820 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6950016440 0x7f69500168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6950016440 0x7f69500168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6950016440 0x7f69500168c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6948074060 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f694c0aab00 con 0x7f6948074060 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.708+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6948074060 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f694c0aab00 con 0x7f6948074060 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.734 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.712+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6948074060 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c0aab00 con 0x7f6948074060 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6948074060 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.716+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61f210 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6950016440 2024-09-13T19:08:33.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x559f9c61a820 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f9c61e4b0 con 0x7f6948074060 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.737 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6225d0 con 0x559f9c61a820 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6221b0 con 0x559f9c61a820 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c622e70 con 0x7f6948074060 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 zone default found 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 4 Realm: () 2024-09-13T19:08:33.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 zonegroup default 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c623910 con 0x7f6950016440 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6252f0 con 0x559f9c61f210 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c625750 con 0x559f9c61f210 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.720+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 20 started sync module instance, tier type = 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c624790 con 0x7f6948074060 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94144011848576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6243f0 con 0x7f6948074060 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c626680 con 0x559f9c61a820 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94144011848576] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94144011854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c626aa0 con 0x559f9c61a820 2024-09-13T19:08:33.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.724+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c627460 con 0x559f9c61f210 2024-09-13T19:08:33.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94144011854288] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94144011855344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c626a10 con 0x559f9c61f210 2024-09-13T19:08:33.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c628160 con 0x7f6948074060 2024-09-13T19:08:33.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.728+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94144011863424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c628e50 con 0x7f6948074060 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c629810 con 0x559f9c61a820 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94144011855344] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94144011863424] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94144011866976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c628e50 con 0x559f9c61a820 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.732+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c629780 con 0x7f6950016440 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94144011866976] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94144011864480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c628dc0 con 0x7f6950016440 2024-09-13T19:08:33.743 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62a580 con 0x7f6950016440 2024-09-13T19:08:33.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94144011864480] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94144011869184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62a580 con 0x7f6950016440 2024-09-13T19:08:33.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.736+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62af80 con 0x7f6950016440 2024-09-13T19:08:33.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94144011872912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62b3a0 con 0x7f6950016440 2024-09-13T19:08:33.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=0 2024-09-13T19:08:33.746 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=1 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=2 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=3 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=4 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=5 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94144011869184] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=6 2024-09-13T19:08:33.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94144011872912] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 20 add_watcher() i=7 2024-09-13T19:08:33.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:33.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62a020 con 0x559f9c61a820 2024-09-13T19:08:33.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.740+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94144011870240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c62b8e0 con 0x559f9c61a820 2024-09-13T19:08:33.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94144011870240] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f680e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f695a822980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:33.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f695a822980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:33.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c636d70 con 0x559f9c61a820 2024-09-13T19:08:33.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.744+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c637440 con 0x7f6950016440 2024-09-13T19:08:33.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.748+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.748+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c637860 con 0x559f9c61f210 2024-09-13T19:08:33.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.748+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.748+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6377a0 con 0x559f9c61a820 2024-09-13T19:08:33.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'253 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c637d90 con 0x7f6948074060 2024-09-13T19:08:33.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c638300 con 0x559f9c61f210 2024-09-13T19:08:33.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.752+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6386e0 con 0x559f9c61a820 2024-09-13T19:08:33.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.756+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.756+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6386e0 con 0x7f6950016440 2024-09-13T19:08:33.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.756+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.756+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6386e0 con 0x7f6948074060 2024-09-13T19:08:33.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c638b90 con 0x559f9c61f210 2024-09-13T19:08:33.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c638b90 con 0x7f6948074060 2024-09-13T19:08:33.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.760+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c639100 con 0x7f6950016440 2024-09-13T19:08:33.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.764+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.764+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c639100 con 0x7f6948074060 2024-09-13T19:08:33.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.764+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.764+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634bf0 con 0x7f6950016440 2024-09-13T19:08:33.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.768+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'61 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.768+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634bf0 con 0x559f9c61a820 2024-09-13T19:08:33.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.768+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.768+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634dc0 con 0x559f9c61f210 2024-09-13T19:08:33.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634dc0 con 0x7f6948074060 2024-09-13T19:08:33.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634dc0 con 0x559f9c61f210 2024-09-13T19:08:33.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.772+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634dc0 con 0x559f9c61a820 2024-09-13T19:08:33.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.776+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.776+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c634dc0 con 0x559f9c61a820 2024-09-13T19:08:33.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.776+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.776+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.780+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.780+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x7f6948074060 2024-09-13T19:08:33.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.780+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.780+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.784+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x7f6950016440 2024-09-13T19:08:33.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.788+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.788+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.788+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.788+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x7f6950016440 2024-09-13T19:08:33.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.792+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.792+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x559f9c61f210 2024-09-13T19:08:33.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.796+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.796+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x7f6950016440 2024-09-13T19:08:33.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.796+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'62 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.804 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.796+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c6396f0 con 0x7f6948074060 2024-09-13T19:08:33.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f680d7e2640 20 reqs_thread_entry: start 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 20 Filter name: none 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f677effd640 20 reqs_thread_entry: start 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c654720 con 0x559f9c61f210 2024-09-13T19:08:33.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 20 rados_obj.operate() r=0 bl.length=363 2024-09-13T19:08:33.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656bf0 con 0x559f9c61f210 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6948083040 con 0x559f9c61f210 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 10 removing key index: true_admin_akey 2024-09-13T19:08:33.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.800+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c654bd0 con 0x559f9c61f210 2024-09-13T19:08:33.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(96 true_admin_akey [delete] v34'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-13T19:08:33.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94144012044064 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656460 con 0x7f6950016440 2024-09-13T19:08:33.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== watch-notify(notify (1) cookie 94144011864480 notify 146028888111 ret 0) ==== 207+0+0 (crc 0 0 0) 0x559f9c635200 con 0x7f6950016440 2024-09-13T19:08:33.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f68377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94144011864480 notifier 4862 bl.length()=165 2024-09-13T19:08:33.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(97 notify.5 [notify cookie 94144012044064 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f68377fe640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f681c003d70 con 0x7f6950016440 2024-09-13T19:08:33.811 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== watch-notify(notify_complete (2) cookie 94144012044064 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559f9c5fc820 con 0x7f6950016440 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 10 removing email index: 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 10 removing user buckets index 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c654720 con 0x559f9c61f210 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.812 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 10 removing user index: a_user 2024-09-13T19:08:33.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.804+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c655d30 con 0x559f9c61f210 2024-09-13T19:08:33.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(100 a_user [call,call,delete] v34'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f695a822980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-13T19:08:33.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f695a822980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-13T19:08:33.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94144012051088 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== watch-notify(notify (1) cookie 94144011855344 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x559f9c6366d0 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f68377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94144011855344 notifier 4862 bl.length()=155 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f68377fe640 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f681c003d70 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(101 notify.2 [notify cookie 94144012051088 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== watch-notify(notify_complete (2) cookie 94144012051088 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6948037070 con 0x559f9c61f210 2024-09-13T19:08:33.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f680e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:33.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.808+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94144011870240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x559f9c61a820 2024-09-13T19:08:33.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94144011870240] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.817 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94144011848576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x7f6948074060 2024-09-13T19:08:33.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94144011848576] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 20 remove_watcher() i=0 2024-09-13T19:08:33.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 2 removed watcher, disabling cache 2024-09-13T19:08:33.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94144011854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x559f9c61a820 2024-09-13T19:08:33.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94144011854288] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 20 remove_watcher() i=1 2024-09-13T19:08:33.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.812+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94144011855344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x559f9c61f210 2024-09-13T19:08:33.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f6958332640 1 -- 172.21.15.151:0/1180592522 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94144011855344] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6948098040 con 0x559f9c61f210 2024-09-13T19:08:33.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f695a822980 20 remove_watcher() i=2 2024-09-13T19:08:33.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94144011863424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x7f6948074060 2024-09-13T19:08:33.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f6957b31640 1 -- 172.21.15.151:0/1180592522 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94144011863424] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c0e7040 con 0x7f6948074060 2024-09-13T19:08:33.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f695a822980 20 remove_watcher() i=3 2024-09-13T19:08:33.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.816+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94144011866976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x559f9c61a820 2024-09-13T19:08:33.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.820+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94144011866976] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x559f9c61a820 2024-09-13T19:08:33.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.820+0000 7f695a822980 20 remove_watcher() i=4 2024-09-13T19:08:33.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.820+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94144011864480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x7f6950016440 2024-09-13T19:08:33.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94144011864480] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.830 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f695a822980 20 remove_watcher() i=5 2024-09-13T19:08:33.831 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94144011869184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x7f6950016440 2024-09-13T19:08:33.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94144011869184] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f695a822980 20 remove_watcher() i=6 2024-09-13T19:08:33.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.824+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94144011872912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f9c656850 con 0x7f6950016440 2024-09-13T19:08:33.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94144011872912] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695000a4d0 con 0x7f6950016440 2024-09-13T19:08:33.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 20 remove_watcher() i=7 2024-09-13T19:08:33.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6950016440 msgr2=0x7f69500168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6950016440 0x7f69500168c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c61a820 msgr2=0x559f9c61cce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c61a820 0x559f9c61cce0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6948074060 msgr2=0x7f694805a820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f6948074060 0x7f694805a820 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c61f210 msgr2=0x559f9c621600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c61f210 0x559f9c621600 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68280346a0 msgr2=0x7f6828036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68280346a0 0x7f6828036b60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f694c0aafd0 tx=0x7f694c0c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f6958b33640 1 -- 172.21.15.151:0/1180592522 reap_dead start 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 msgr2=0x559f9c60f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f694803d580 tx=0x7f6948007ea0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 shutdown_connections 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/1180592522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c6085b0 0x559f9c60f6f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 >> 172.21.15.151:0/1180592522 conn(0x559f9c604990 msgr2=0x559f9c602a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 shutdown_connections 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/1180592522 wait complete. 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 msgr2=0x7f6830036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 0x7f6830036b10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x559f9c45f730 tx=0x7f694c005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 msgr2=0x559f9c5fc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f694801dfd0 tx=0x7f694801a850 comp rx=0 tx=0).stop 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 shutdown_connections 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034650 0x7f6830036b10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/323237839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c5fbec0 0x559f9c5fc2e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 >> 172.21.15.151:0/323237839 conn(0x559f9c5f1010 msgr2=0x559f9c5f3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 shutdown_connections 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/323237839 wait complete. 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c4eda10 msgr2=0x559f9c5e5210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x559f9c4eda10 0x559f9c5e5210 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559f9c5eb8c0 msgr2=0x559f9c5edcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x559f9c5eb8c0 0x559f9c5edcb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c5e7980 msgr2=0x559f9c5e9d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x559f9c5e7980 0x559f9c5e9d70 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 msgr2=0x7f6840036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f694c0ae000 tx=0x7f694c0a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 msgr2=0x559f9c460510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 --2- 172.21.15.151:0/3848662585 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x559f9c4e9690 0x559f9c460510 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6948001fd0 tx=0x7f6948000bd0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f6958b33640 1 -- 172.21.15.151:0/3848662585 reap_dead start 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 shutdown_connections 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 >> 172.21.15.151:0/3848662585 conn(0x559f9c4e51b0 msgr2=0x559f9c5cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 shutdown_connections 2024-09-13T19:08:33.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.828+0000 7f695a822980 1 -- 172.21.15.151:0/3848662585 wait complete. 2024-09-13T19:08:33.848 ERROR:root:None 2024-09-13T19:08:33.848 ERROR:root:0 2024-09-13T19:08:33.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:08:33.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-13T19:08:33.848 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-13T19:08:33.925 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:33.926 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:33.926 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb044532980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55d19f1107d0 0x55d19f10f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb044532980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d19f021ae0 con 0x55d19f1103c0 2024-09-13T19:08:33.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb044532980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55d19f045e30 con 0x55d19f1107d0 2024-09-13T19:08:33.927 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb041841640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55d19f1107d0 0x55d19f10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb041841640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55d19f1107d0 0x55d19f10f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59006/0 (socket says 172.21.15.151:59006) 2024-09-13T19:08:33.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb041841640 1 -- 172.21.15.151:0/2663799487 learned_addr learned my addr 172.21.15.151:0/2663799487 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb041841640 1 -- 172.21.15.151:0/2663799487 >> v1:172.21.15.12:6789/0 conn(0x55d19f1103c0 legacy=0x55d19f10eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.928 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.920+0000 7fb041841640 1 -- 172.21.15.151:0/2663799487 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f10f8f0 con 0x55d19f1107d0 2024-09-13T19:08:33.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb041841640 1 --2- 172.21.15.151:0/2663799487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1107d0 0x55d19f10f290 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb03800a5c0 tx=0x7fb03801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bbd16b7074f1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.930 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb041040640 1 -- 172.21.15.151:0/2663799487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0380a6070 con 0x55d19f1107d0 2024-09-13T19:08:33.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb041040640 1 -- 172.21.15.151:0/2663799487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0380af070 con 0x55d19f1107d0 2024-09-13T19:08:33.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb041040640 1 -- 172.21.15.151:0/2663799487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0380aa5c0 con 0x55d19f1107d0 2024-09-13T19:08:33.931 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 -- 172.21.15.151:0/2663799487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1107d0 msgr2=0x55d19f10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 --2- 172.21.15.151:0/2663799487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1107d0 0x55d19f10f290 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb03800a5c0 tx=0x7fb03801b340 comp rx=0 tx=0).stop 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 -- 172.21.15.151:0/2663799487 shutdown_connections 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 --2- 172.21.15.151:0/2663799487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1107d0 0x55d19f10f290 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 -- 172.21.15.151:0/2663799487 >> 172.21.15.151:0/2663799487 conn(0x55d19f1951c0 msgr2=0x55d19f1975e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 -- 172.21.15.151:0/2663799487 shutdown_connections 2024-09-13T19:08:33.932 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.924+0000 7fb044532980 1 -- 172.21.15.151:0/2663799487 wait complete. 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb044532980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb044532980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d19f047200 con 0x55d19f1103c0 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59018/0 (socket says 172.21.15.151:59018) 2024-09-13T19:08:33.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb042042640 1 -- 172.21.15.151:0/2799286591 learned_addr learned my addr 172.21.15.151:0/2799286591 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.940+0000 7fb042042640 1 -- 172.21.15.151:0/2799286591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f2871e0 con 0x55d19f1103c0 2024-09-13T19:08:33.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 --2- 172.21.15.151:0/2799286591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb0340016c0 tx=0x7fb034001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee1b4f8ecddb37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf30608640 1 -- 172.21.15.151:0/2799286591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034016070 con 0x55d19f1103c0 2024-09-13T19:08:33.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf30608640 1 -- 172.21.15.151:0/2799286591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03400f640 con 0x55d19f1103c0 2024-09-13T19:08:33.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf30608640 1 -- 172.21.15.151:0/2799286591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03400f9a0 con 0x55d19f1103c0 2024-09-13T19:08:33.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/2799286591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 msgr2=0x55d19f286c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 --2- 172.21.15.151:0/2799286591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fb0340016c0 tx=0x7fb034001b80 comp rx=0 tx=0).stop 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/2799286591 shutdown_connections 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 --2- 172.21.15.151:0/2799286591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f286c10 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/2799286591 >> 172.21.15.151:0/2799286591 conn(0x55d19f1951c0 msgr2=0x55d19f282840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/2799286591 shutdown_connections 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/2799286591 wait complete. 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f28dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d19f1a5210 con 0x55d19f1103c0 2024-09-13T19:08:33.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f28dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f28dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59024/0 (socket says 172.21.15.151:59024) 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 -- 172.21.15.151:0/1997839879 learned_addr learned my addr 172.21.15.151:0/1997839879 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f28e4e0 con 0x55d19f1103c0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb042042640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f28dfa0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb03400f610 tx=0x7fb034001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf2ee05640 1 -- 172.21.15.151:0/1997839879 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034021020 con 0x55d19f1103c0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d19f28e770 con 0x55d19f1103c0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf2ee05640 1 -- 172.21.15.151:0/1997839879 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034011770 con 0x55d19f1103c0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7faf2ee05640 1 -- 172.21.15.151:0/1997839879 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034016040 con 0x55d19f1103c0 2024-09-13T19:08:33.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.944+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19f291450 con 0x55d19f1103c0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7faf2ee05640 1 -- 172.21.15.151:0/1997839879 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb034024020 con 0x55d19f1103c0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7faf2ee05640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf28034650 0x7faf28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7faf2ee05640 1 -- 172.21.15.151:0/1997839879 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb034049840 con 0x55d19f1103c0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb041841640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf28034650 0x7faf28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f1107d0 0x55d19f294f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f295580 con 0x55d19f1107d0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042843640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f1107d0 0x55d19f294f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb041841640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf28034650 0x7faf28036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0380ae000 tx=0x7fb0380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.955 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042843640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f1107d0 0x55d19f294f30 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042843640 1 -- 172.21.15.151:0/1997839879 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f1107d0 2024-09-13T19:08:33.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f292670 con 0x55d19f1107d0 2024-09-13T19:08:33.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042843640 1 -- 172.21.15.151:0/1997839879 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f1107d0 2024-09-13T19:08:33.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2978d0 0x55d19f299cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f29a3b0 con 0x55d19f2978d0 2024-09-13T19:08:33.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042042640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2978d0 0x55d19f299cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.957 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042042640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2978d0 0x55d19f299cc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042042640 1 -- 172.21.15.151:0/1997839879 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2978d0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f296770 con 0x55d19f1107d0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb042843640 1 -- 172.21.15.151:0/1997839879 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f1107d0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55d19f29b810 0x55d19f29dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f29e340 con 0x55d19f29b810 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.948+0000 7fb041841640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55d19f29b810 0x55d19f29dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb041841640 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55d19f29b810 0x55d19f29dc00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.958 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb041841640 1 -- 172.21.15.151:0/1997839879 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0380aab30 con 0x55d19f29b810 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d19f0a0800 con 0x55d19f2abe10 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59028/0 (socket says 172.21.15.151:59028) 2024-09-13T19:08:33.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb042042640 1 -- 172.21.15.151:0/2629414527 learned_addr learned my addr 172.21.15.151:0/2629414527 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb042042640 1 -- 172.21.15.151:0/2629414527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f2ac770 con 0x55d19f2abe10 2024-09-13T19:08:33.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb042042640 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb034047b00 tx=0x7fb03401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7faf27fff640 1 -- 172.21.15.151:0/2629414527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034010be0 con 0x55d19f2abe10 2024-09-13T19:08:33.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d19f2aca00 con 0x55d19f2abe10 2024-09-13T19:08:33.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7faf27fff640 1 -- 172.21.15.151:0/2629414527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034010d80 con 0x55d19f2abe10 2024-09-13T19:08:33.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7faf27fff640 1 -- 172.21.15.151:0/2629414527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034049c90 con 0x55d19f2abe10 2024-09-13T19:08:33.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.952+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19f2af680 con 0x55d19f2abe10 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf27fff640 1 -- 172.21.15.151:0/2629414527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb03402d300 con 0x55d19f2abe10 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf27fff640 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 0x7faf1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf27fff640 1 -- 172.21.15.151:0/2629414527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb034037070 con 0x55d19f2abe10 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb041841640 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 0x7faf1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb041841640 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 0x7faf1c036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55d19f295a50 tx=0x7fb038005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d19f287560 con 0x55d19f2b86c0 2024-09-13T19:08:33.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59044/0 (socket says 172.21.15.151:59044) 2024-09-13T19:08:33.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb042042640 1 -- 172.21.15.151:0/2844350601 learned_addr learned my addr 172.21.15.151:0/2844350601 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb042042640 1 -- 172.21.15.151:0/2844350601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f2b9090 con 0x55d19f2b86c0 2024-09-13T19:08:33.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb042042640 1 --2- 172.21.15.151:0/2844350601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb034045fd0 tx=0x7fb03403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1be75e4578ab91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf25ffb640 1 -- 172.21.15.151:0/2844350601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0340418c0 con 0x55d19f2b86c0 2024-09-13T19:08:33.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf25ffb640 1 -- 172.21.15.151:0/2844350601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034059030 con 0x55d19f2b86c0 2024-09-13T19:08:33.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7faf25ffb640 1 -- 172.21.15.151:0/2844350601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb034041a80 con 0x55d19f2b86c0 2024-09-13T19:08:33.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- 172.21.15.151:0/2844350601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 msgr2=0x55d19f2b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:33.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 --2- 172.21.15.151:0/2844350601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fb034045fd0 tx=0x7fb03403b460 comp rx=0 tx=0).stop 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- 172.21.15.151:0/2844350601 shutdown_connections 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 --2- 172.21.15.151:0/2844350601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2b8ac0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- 172.21.15.151:0/2844350601 >> 172.21.15.151:0/2844350601 conn(0x55d19f2b4b30 msgr2=0x55d19f2b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- 172.21.15.151:0/2844350601 shutdown_connections 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- 172.21.15.151:0/2844350601 wait complete. 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 Processor -- start 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.956+0000 7fb044532980 1 -- start start 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55d19f2b95a0 con 0x55d19f2b86c0 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042042640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59046/0 (socket says 172.21.15.151:59046) 2024-09-13T19:08:33.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 learned_addr learned my addr 172.21.15.151:0/80370513 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19f2bfeb0 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042042640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2bf970 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb034010fd0 tx=0x7fb034030180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 -- 172.21.15.151:0/80370513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03406d070 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d19f2bfeb0 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 -- 172.21.15.151:0/80370513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb034049e30 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 -- 172.21.15.151:0/80370513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb03402d5f0 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19f2bfeb0 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 -- 172.21.15.151:0/80370513 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb03402d980 con 0x55d19f2b86c0 2024-09-13T19:08:33.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf0c034600 0x7faf0c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7faf13fff640 1 -- 172.21.15.151:0/80370513 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb034065070 con 0x55d19f2b86c0 2024-09-13T19:08:33.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb041841640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf0c034600 0x7faf0c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f2caa10 0x55d19f2cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.969 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2cd620 con 0x55d19f2caa10 2024-09-13T19:08:33.972 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042843640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f2caa10 0x55d19f2cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb041841640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf0c034600 0x7faf0c036ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb03801b380 tx=0x7fb0380c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.960+0000 7fb042843640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f2caa10 0x55d19f2cced0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 realm 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2cda30 con 0x55d19f2caa10 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:33.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce300 con 0x55d19f2caa10 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2cf400 0x55d19f2d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d1dc0 con 0x55d19f2cf400 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2cf400 0x55d19f2d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2cf400 0x55d19f2d17f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 20 searching for the correct realm 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3690 con 0x55d19f2cf400 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb034026020 0x7fb034030550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3690 con 0x7fb034026020 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb034026020 0x7fb034030550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb034026020 0x7fb034030550 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0380aab30 con 0x7fb034026020 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3690 con 0x7fb034026020 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0380aab30 con 0x7fb034026020 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3690 con 0x55d19f2caa10 2024-09-13T19:08:33.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb03c018410 0x7fb03c018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:33.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.964+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb03c018410 0x7fb03c018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb03c018410 0x7fb03c018890 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x7fb03c018410 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x7fb03c018410 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb034026020 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0380aab30 con 0x7fb034026020 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x7fb03c018410 2024-09-13T19:08:33.979 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.968+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb034026020 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0380aab30 con 0x7fb034026020 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x7fb03c018410 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x7fb03c018410 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb034026020 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0380aab30 con 0x7fb034026020 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.972+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c0083f0 con 0x55d19f2caa10 2024-09-13T19:08:33.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:33.984 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb034026020 2024-09-13T19:08:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2cf400 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x7fb03c018410 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ce6a0 con 0x55d19f2caa10 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fb03c03b040 con 0x7fb034026020 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:33.988 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.976+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d2680 con 0x55d19f2caa10 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d2a70 con 0x55d19f2caa10 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d2a70 con 0x7fb034026020 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:33.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 zone default found 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 4 Realm: () 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 zonegroup default 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3340 con 0x7fb03c018410 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d3340 con 0x55d19f2cf400 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.990 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d54f0 con 0x55d19f2cf400 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 started sync module instance, tier type = 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:33.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d4940 con 0x7fb034026020 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94358807072048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d5e00 con 0x7fb034026020 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.980+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d6650 con 0x55d19f2caa10 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.984+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94358807072048] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.984+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.984+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94358807075152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d6650 con 0x55d19f2caa10 2024-09-13T19:08:33.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.984+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d7130 con 0x55d19f2cf400 2024-09-13T19:08:33.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94358807075152] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94358807077280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d65c0 con 0x55d19f2cf400 2024-09-13T19:08:33.994 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d7ff0 con 0x7fb034026020 2024-09-13T19:08:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94358807085968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d8c60 con 0x7fb034026020 2024-09-13T19:08:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d9620 con 0x55d19f2caa10 2024-09-13T19:08:33.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94358807077280] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:33.996 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.988+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94358807085968] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94358807087024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d8bd0 con 0x55d19f2caa10 2024-09-13T19:08:33.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d9ad0 con 0x7fb03c018410 2024-09-13T19:08:33.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94358807087024] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:33.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:33.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94358807089520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d9a40 con 0x7fb03c018410 2024-09-13T19:08:33.999 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.992+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2da2d0 con 0x7fb03c018410 2024-09-13T19:08:34.001 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94358807089520] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94358807090576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2da4b0 con 0x7fb03c018410 2024-09-13T19:08:34.002 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2dad00 con 0x7fb03c018410 2024-09-13T19:08:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94358807094928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2db0a0 con 0x7fb03c018410 2024-09-13T19:08:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=0 2024-09-13T19:08:34.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=1 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=2 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=3 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=4 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=5 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94358807090576] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:33.996+0000 7fb044532980 20 add_watcher() i=6 2024-09-13T19:08:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94358807094928] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 20 add_watcher() i=7 2024-09-13T19:08:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:34.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d9a30 con 0x55d19f2caa10 2024-09-13T19:08:34.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:34.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94358807091696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2db5f0 con 0x55d19f2caa10 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94358807091696] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb03c036040 con 0x55d19f2caa10 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7faef8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 5 note: GC not initialized 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fae737fe640 20 reqs_thread_entry: start 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:34.009 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.000+0000 7fb044532980 20 Filter name: none 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fae717fa640 20 reqs_thread_entry: start 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f301760 con 0x7fb03c018410 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fb03c036040 con 0x7fb03c018410 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:34.010 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:34.011 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.004+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f307d70 con 0x7fb03c018410 2024-09-13T19:08:34.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x7fb03c018410 2024-09-13T19:08:34.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.013 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94358807279584 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d19f303480 con 0x55d19f2caa10 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94358807087024 notify 146028888100 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fb03c010040 con 0x55d19f2caa10 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7faf25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94358807087024 notifier 4869 bl.length()=666 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94358807279584 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb03c03f040 con 0x55d19f2caa10 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7faf25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7faf25ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.014 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7faf25ffb640 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7faf08003eb0 con 0x55d19f2caa10 2024-09-13T19:08:34.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x55d19f2caa10 2024-09-13T19:08:34.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94358807279584 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb03c007750 con 0x55d19f2caa10 2024-09-13T19:08:34.015 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:34.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7faef8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.015 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94358807091696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ff560 con 0x55d19f2caa10 2024-09-13T19:08:34.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94358807091696] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x55d19f2caa10 2024-09-13T19:08:34.016 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.008+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94358807072048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ff560 con 0x7fb034026020 2024-09-13T19:08:34.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94358807072048] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:34.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb044532980 20 remove_watcher() i=0 2024-09-13T19:08:34.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb044532980 2 removed watcher, disabling cache 2024-09-13T19:08:34.018 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94358807075152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d4d30 con 0x55d19f2caa10 2024-09-13T19:08:34.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94358807075152] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x55d19f2caa10 2024-09-13T19:08:34.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb044532980 20 remove_watcher() i=1 2024-09-13T19:08:34.020 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.012+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94358807077280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ff560 con 0x55d19f2cf400 2024-09-13T19:08:34.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb042042640 1 -- 172.21.15.151:0/80370513 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94358807077280] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03400f070 con 0x55d19f2cf400 2024-09-13T19:08:34.023 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb044532980 20 remove_watcher() i=2 2024-09-13T19:08:34.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94358807085968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d5950 con 0x7fb034026020 2024-09-13T19:08:34.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb041841640 1 -- 172.21.15.151:0/80370513 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94358807085968] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0380e7040 con 0x7fb034026020 2024-09-13T19:08:34.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb044532980 20 remove_watcher() i=3 2024-09-13T19:08:34.024 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.016+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94358807087024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d4d30 con 0x55d19f2caa10 2024-09-13T19:08:34.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94358807087024] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x55d19f2caa10 2024-09-13T19:08:34.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb044532980 20 remove_watcher() i=4 2024-09-13T19:08:34.025 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94358807089520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d61a0 con 0x7fb03c018410 2024-09-13T19:08:34.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94358807089520] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x7fb03c018410 2024-09-13T19:08:34.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb044532980 20 remove_watcher() i=5 2024-09-13T19:08:34.028 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.020+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94358807090576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2ff560 con 0x7fb03c018410 2024-09-13T19:08:34.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94358807090576] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x7fb03c018410 2024-09-13T19:08:34.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 20 remove_watcher() i=6 2024-09-13T19:08:34.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94358807094928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d19f2d5950 con 0x7fb03c018410 2024-09-13T19:08:34.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94358807094928] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb03c03f040 con 0x7fb03c018410 2024-09-13T19:08:34.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 20 remove_watcher() i=7 2024-09-13T19:08:34.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb03c018410 msgr2=0x7fb03c018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fb03c018410 0x7fb03c018890 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f2caa10 msgr2=0x55d19f2cced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f2caa10 0x55d19f2cced0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb034026020 msgr2=0x7fb034030550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fb034026020 0x7fb034030550 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2cf400 msgr2=0x55d19f2d17f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2cf400 0x55d19f2d17f0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf0c034600 msgr2=0x7faf0c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf0c034600 0x7faf0c036ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb03801b380 tx=0x7fb0380c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 msgr2=0x55d19f2bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 --2- 172.21.15.151:0/80370513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2b86c0 0x55d19f2bf970 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fb034010fd0 tx=0x7fb034030180 comp rx=0 tx=0).stop 2024-09-13T19:08:34.034 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 reap_dead start 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb042843640 1 -- 172.21.15.151:0/80370513 reap_dead start 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 shutdown_connections 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.024+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 >> 172.21.15.151:0/80370513 conn(0x55d19f2b4b30 msgr2=0x55d19f2b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 shutdown_connections 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/80370513 wait complete. 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 msgr2=0x7faf1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 0x7faf1c036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55d19f295a50 tx=0x7fb038005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 msgr2=0x55d19f2ac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb034047b00 tx=0x7fb03401ccc0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 shutdown_connections 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf1c034650 0x7faf1c036b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/2629414527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f2abe10 0x55d19f2ac230 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 >> 172.21.15.151:0/2629414527 conn(0x55d19f2a0f60 msgr2=0x55d19f2a39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 shutdown_connections 2024-09-13T19:08:34.036 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/2629414527 wait complete. 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f1107d0 msgr2=0x55d19f294f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55d19f1107d0 0x55d19f294f30 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55d19f29b810 msgr2=0x55d19f29dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55d19f29b810 0x55d19f29dc00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2978d0 msgr2=0x55d19f299cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55d19f2978d0 0x55d19f299cc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf28034650 msgr2=0x7faf28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7faf28034650 0x7faf28036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0380ae000 tx=0x7fb0380a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 msgr2=0x55d19f28dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 --2- 172.21.15.151:0/1997839879 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d19f1103c0 0x55d19f28dfa0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb03400f610 tx=0x7fb034001260 comp rx=0 tx=0).stop 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb042843640 1 -- 172.21.15.151:0/1997839879 reap_dead start 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 shutdown_connections 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 >> 172.21.15.151:0/1997839879 conn(0x55d19f1951c0 msgr2=0x55d19f2813c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 shutdown_connections 2024-09-13T19:08:34.038 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.028+0000 7fb044532980 1 -- 172.21.15.151:0/1997839879 wait complete. 2024-09-13T19:08:34.045 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.046 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.046 ERROR:root:0 2024-09-13T19:08:34.046 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:34.059 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:34.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:08:34.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-13T19:08:34.059 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-13T19:08:34.121 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:34.122 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b073c8980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56311e7ef060 0x56311e7f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b073c8980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56311e674ae0 con 0x56311e7eac90 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b073c8980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x56311e698e30 con 0x56311e7ef060 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b046d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56311e7ef060 0x56311e7f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b046d7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x56311e7ef060 0x56311e7f1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59058/0 (socket says 172.21.15.151:59058) 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b04ed8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x56311e7eac90 0x56311e7eb070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39838/0 (socket says 172.21.15.151:39838) 2024-09-13T19:08:34.124 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b046d7640 1 -- 172.21.15.151:0/4290866684 learned_addr learned my addr 172.21.15.151:0/4290866684 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b046d7640 1 -- 172.21.15.151:0/4290866684 >> v1:172.21.15.12:6789/0 conn(0x56311e7eac90 legacy=0x56311e7eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.125 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.116+0000 7f8b046d7640 1 -- 172.21.15.151:0/4290866684 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e7f29a0 con 0x56311e7ef060 2024-09-13T19:08:34.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b046d7640 1 --2- 172.21.15.151:0/4290866684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7ef060 0x56311e7f1450 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009650 tx=0x7f8af801c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d93931730ef024a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.126 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b03ed6640 1 -- 172.21.15.151:0/4290866684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80b0070 con 0x56311e7ef060 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b03ed6640 1 -- 172.21.15.151:0/4290866684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af8009200 con 0x56311e7ef060 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b03ed6640 1 -- 172.21.15.151:0/4290866684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af80075f0 con 0x56311e7ef060 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 -- 172.21.15.151:0/4290866684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7ef060 msgr2=0x56311e7f1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 --2- 172.21.15.151:0/4290866684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7ef060 0x56311e7f1450 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009650 tx=0x7f8af801c100 comp rx=0 tx=0).stop 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 -- 172.21.15.151:0/4290866684 shutdown_connections 2024-09-13T19:08:34.127 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 --2- 172.21.15.151:0/4290866684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7ef060 0x56311e7f1450 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 -- 172.21.15.151:0/4290866684 >> 172.21.15.151:0/4290866684 conn(0x56311e7e67b0 msgr2=0x56311e7e8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 -- 172.21.15.151:0/4290866684 shutdown_connections 2024-09-13T19:08:34.128 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.120+0000 7f8b073c8980 1 -- 172.21.15.151:0/4290866684 wait complete. 2024-09-13T19:08:34.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56311e69a200 con 0x56311e7eac90 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59074/0 (socket says 172.21.15.151:59074) 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b04ed8640 1 -- 172.21.15.151:0/745363069 learned_addr learned my addr 172.21.15.151:0/745363069 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b04ed8640 1 -- 172.21.15.151:0/745363069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e8d8960 con 0x56311e7eac90 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/745363069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8af400b240 tx=0x7f8af400b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3937cc5417b0ca45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f89f2e0d640 1 -- 172.21.15.151:0/745363069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af400e700 con 0x56311e7eac90 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f89f2e0d640 1 -- 172.21.15.151:0/745363069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af400e8a0 con 0x56311e7eac90 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f89f2e0d640 1 -- 172.21.15.151:0/745363069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af400eb80 con 0x56311e7eac90 2024-09-13T19:08:34.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- 172.21.15.151:0/745363069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 msgr2=0x56311e8d8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 --2- 172.21.15.151:0/745363069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8af400b240 tx=0x7f8af400b700 comp rx=0 tx=0).stop 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- 172.21.15.151:0/745363069 shutdown_connections 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 --2- 172.21.15.151:0/745363069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8d8390 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- 172.21.15.151:0/745363069 >> 172.21.15.151:0/745363069 conn(0x56311e7e67b0 msgr2=0x56311e8d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- 172.21.15.151:0/745363069 shutdown_connections 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.136+0000 7f8b073c8980 1 -- 172.21.15.151:0/745363069 wait complete. 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8df730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56311e7f24a0 con 0x56311e7eac90 2024-09-13T19:08:34.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8df730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8df730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59080/0 (socket says 172.21.15.151:59080) 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b04ed8640 1 -- 172.21.15.151:0/795410453 learned_addr learned my addr 172.21.15.151:0/795410453 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b04ed8640 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e8dfc70 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8df730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8af4000c10 tx=0x7f8af4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 -- 172.21.15.151:0/795410453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af400fa90 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 -- 172.21.15.151:0/795410453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af400fc50 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311e8dff00 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 -- 172.21.15.151:0/795410453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af401a480 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311e8e2be0 con 0x56311e7eac90 2024-09-13T19:08:34.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 -- 172.21.15.151:0/795410453 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af4017070 con 0x56311e7eac90 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89ec034650 0x7f89ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f89f160a640 1 -- 172.21.15.151:0/795410453 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8af4015020 con 0x56311e7eac90 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b046d7640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89ec034650 0x7f89ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.140+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e7ef060 0x56311e8e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e8e6d10 con 0x56311e7ef060 2024-09-13T19:08:34.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b056d9640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e7ef060 0x56311e8e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b046d7640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89ec034650 0x7f89ec036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8af80ad000 tx=0x7f8af80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b056d9640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e7ef060 0x56311e8e66c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b056d9640 1 -- 172.21.15.151:0/795410453 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e7ef060 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e8e3e00 con 0x56311e7ef060 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b056d9640 1 -- 172.21.15.151:0/795410453 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e7ef060 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e8e90b0 0x56311e8eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e8ebb90 con 0x56311e8e90b0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e8e90b0 0x56311e8eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e8e90b0 0x56311e8eb4a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b04ed8640 1 -- 172.21.15.151:0/795410453 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8af402e070 con 0x56311e8e90b0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e8e7f50 con 0x56311e7ef060 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b056d9640 1 -- 172.21.15.151:0/795410453 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e7ef060 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56311e8ecff0 0x56311e8ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e8efb20 con 0x56311e8ecff0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b046d7640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56311e8ecff0 0x56311e8ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b046d7640 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56311e8ecff0 0x56311e8ef3e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b046d7640 1 -- 172.21.15.151:0/795410453 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8af80a9070 con 0x56311e8ecff0 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.144+0000 7f8b073c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56311e6f3800 con 0x56311e8fd5b0 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59086/0 (socket says 172.21.15.151:59086) 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b04ed8640 1 -- 172.21.15.151:0/3851497208 learned_addr learned my addr 172.21.15.151:0/3851497208 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b04ed8640 1 -- 172.21.15.151:0/3851497208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e8fdf10 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8af4019790 tx=0x7f8af4019e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 -- 172.21.15.151:0/3851497208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af4042640 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311e8fe1a0 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 -- 172.21.15.151:0/3851497208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af4042800 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 -- 172.21.15.151:0/3851497208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af40429b0 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311e8fe1a0 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 -- 172.21.15.151:0/3851497208 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af404ad10 con 0x56311e8fd5b0 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 0x7f89dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f89ea7fc640 1 -- 172.21.15.151:0/3851497208 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8af403dd30 con 0x56311e8fd5b0 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b046d7640 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 0x7f89dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b046d7640 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 0x7f89dc036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x56311e8e7230 tx=0x7f8af8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.148+0000 7f8b073c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56311e8d8ce0 con 0x56311e909d20 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59092/0 (socket says 172.21.15.151:59092) 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 -- 172.21.15.151:0/3735050307 learned_addr learned my addr 172.21.15.151:0/3735050307 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 -- 172.21.15.151:0/3735050307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e90a6d0 con 0x56311e909d20 2024-09-13T19:08:34.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/3735050307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8af4036fd0 tx=0x7f8af40314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bfdf97d6e2cb92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f89dbfff640 1 -- 172.21.15.151:0/3735050307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af40275f0 con 0x56311e909d20 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f89dbfff640 1 -- 172.21.15.151:0/3735050307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af404a680 con 0x56311e909d20 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f89dbfff640 1 -- 172.21.15.151:0/3735050307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af40278b0 con 0x56311e909d20 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- 172.21.15.151:0/3735050307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 msgr2=0x56311e90a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3735050307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f8af4036fd0 tx=0x7f8af40314b0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- 172.21.15.151:0/3735050307 shutdown_connections 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3735050307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e90a100 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- 172.21.15.151:0/3735050307 >> 172.21.15.151:0/3735050307 conn(0x56311e906100 msgr2=0x56311e904200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- 172.21.15.151:0/3735050307 shutdown_connections 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- 172.21.15.151:0/3735050307 wait complete. 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 Processor -- start 2024-09-13T19:08:34.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- start start 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e910e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b073c8980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56311e90ab70 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e910e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e910e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59102/0 (socket says 172.21.15.151:59102) 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 learned_addr learned my addr 172.21.15.151:0/2570802531 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311e9113b0 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.152+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e910e70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8af40314f0 tx=0x7f8af4017f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 -- 172.21.15.151:0/2570802531 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af4069070 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 -- 172.21.15.151:0/2570802531 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af401d9d0 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 -- 172.21.15.151:0/2570802531 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8af401dd10 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56311e9113b0 con 0x56311e909d20 2024-09-13T19:08:34.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311e9113b0 con 0x56311e909d20 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 -- 172.21.15.151:0/2570802531 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8af406c070 con 0x56311e909d20 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89d00346a0 0x7f89d0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f89da7fc640 1 -- 172.21.15.151:0/2570802531 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8af406fd70 con 0x56311e909d20 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b046d7640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89d00346a0 0x7f89d0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e91bfc0 0x56311e91e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e91ebb0 con 0x56311e91bfc0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e91bfc0 0x56311e91e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b046d7640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89d00346a0 0x7f89d0036b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8af80ae040 tx=0x7f8af80a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e91bfc0 0x56311e91e460 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 realm 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e91efc0 con 0x56311e91bfc0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e91f860 con 0x56311e91bfc0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e920960 0x56311e922d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e9233f0 con 0x56311e920960 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.156+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e920960 0x56311e922d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e920960 0x56311e922d50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b073c8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b073c8980 20 searching for the correct realm 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e924c50 con 0x56311e920960 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b04ed8640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8af406e070 0x7f8af4056410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e924c50 con 0x7f8af406e070 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8af406e070 0x7f8af4056410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8af406e070 0x7f8af4056410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af80a9070 con 0x7f8af406e070 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e924c50 con 0x7f8af406e070 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af80a9070 con 0x7f8af406e070 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e924c50 con 0x56311e91bfc0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8afc016440 0x7f8afc0168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8afc016440 0x7f8afc0168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.186 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.160+0000 7f8b056d9640 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8afc016440 0x7f8afc0168c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8af406e070 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8af80a9070 con 0x7f8af406e070 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8af406e070 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8af80a9070 con 0x7f8af406e070 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.164+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.188 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.189 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8af406e070 2024-09-13T19:08:34.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af80a9070 con 0x7f8af406e070 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.168+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8af406e070 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e920960 2024-09-13T19:08:34.197 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8afc016440 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x56311e91bfc0 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56311e91fc00 con 0x7f8af406e070 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:34.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e923d40 con 0x56311e91bfc0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e9238f0 con 0x56311e91bfc0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e924590 con 0x7f8af406e070 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.199 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.172+0000 7f8b073c8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 zone default found 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 4 Realm: () 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 zonegroup default 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e9250b0 con 0x7f8afc016440 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e926a90 con 0x56311e920960 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e926e60 con 0x56311e920960 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.201 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 started sync module instance, tier type = 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e925f30 con 0x7f8af406e070 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94768966296352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e925b90 con 0x7f8af406e070 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e927d70 con 0x56311e91bfc0 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.176+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94768966296352] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94768966301888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e927ce0 con 0x56311e91bfc0 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e928b40 con 0x56311e920960 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94768966301888] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94768966304096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e928f30 con 0x56311e920960 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.180+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9298f0 con 0x7f8af406e070 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94768966311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92a560 con 0x7f8af406e070 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92af20 con 0x56311e91bfc0 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94768966304096] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94768966311056] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94768966305152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92a1c0 con 0x56311e91bfc0 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.184+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92af20 con 0x7f8afc016440 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.188+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94768966305152] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.188+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.188+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94768966317360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92af20 con 0x7f8afc016440 2024-09-13T19:08:34.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.188+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92c0d0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.188+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94768966317360] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94768966314880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92c0d0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92ca90 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94768966321632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92ceb0 con 0x7f8afc016440 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=0 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=1 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=2 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=3 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=4 2024-09-13T19:08:34.209 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=5 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94768966314880] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.192+0000 7f8b073c8980 20 add_watcher() i=6 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94768966321632] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 add_watcher() i=7 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e92bc50 con 0x56311e91bfc0 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94768966319136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e92d310 con 0x56311e91bfc0 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94768966319136] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:34.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 5 note: GC not initialized 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f89b9fe3640 20 reqs_thread_entry: start 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 Filter name: none 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f892b7fe640 20 reqs_thread_entry: start 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.196+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e9534b0 con 0x7f8afc016440 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e959e20 con 0x7f8afc016440 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94768966506640 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56311e9554f0 con 0x56311e91bfc0 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94768966305152 notify 146028888101 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f8afc030040 con 0x56311e91bfc0 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f89dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94768966305152 notifier 4876 bl.length()=666 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f89dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f89dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94768966506640 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f89dbfff640 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f89c8003eb0 con 0x56311e91bfc0 2024-09-13T19:08:34.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.200+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94768966506640 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8afc02a910 con 0x56311e91bfc0 2024-09-13T19:08:34.213 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94768966319136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9512b0 con 0x56311e91bfc0 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94768966319136] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94768966296352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9512b0 con 0x7f8af406e070 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94768966296352] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b073c8980 20 remove_watcher() i=0 2024-09-13T19:08:34.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b073c8980 2 removed watcher, disabling cache 2024-09-13T19:08:34.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.204+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94768966301888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e926320 con 0x56311e91bfc0 2024-09-13T19:08:34.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94768966301888] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b073c8980 20 remove_watcher() i=1 2024-09-13T19:08:34.216 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94768966304096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9512b0 con 0x56311e920960 2024-09-13T19:08:34.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b04ed8640 1 -- 172.21.15.151:0/2570802531 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94768966304096] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af406b030 con 0x56311e920960 2024-09-13T19:08:34.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b073c8980 20 remove_watcher() i=2 2024-09-13T19:08:34.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94768966311056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9278c0 con 0x7f8af406e070 2024-09-13T19:08:34.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.208+0000 7f8b046d7640 1 -- 172.21.15.151:0/2570802531 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94768966311056] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8af80e3040 con 0x7f8af406e070 2024-09-13T19:08:34.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.212+0000 7f8b073c8980 20 remove_watcher() i=3 2024-09-13T19:08:34.218 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.212+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94768966305152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e926320 con 0x56311e91bfc0 2024-09-13T19:08:34.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.212+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94768966305152] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x56311e91bfc0 2024-09-13T19:08:34.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.212+0000 7f8b073c8980 20 remove_watcher() i=4 2024-09-13T19:08:34.219 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.212+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94768966317360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9512b0 con 0x7f8afc016440 2024-09-13T19:08:34.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94768966317360] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b073c8980 20 remove_watcher() i=5 2024-09-13T19:08:34.221 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94768966314880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e929c90 con 0x7f8afc016440 2024-09-13T19:08:34.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94768966314880] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b073c8980 20 remove_watcher() i=6 2024-09-13T19:08:34.224 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.216+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94768966321632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56311e9278c0 con 0x7f8afc016440 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94768966321632] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8afc00a4d0 con 0x7f8afc016440 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 20 remove_watcher() i=7 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8afc016440 msgr2=0x7f8afc0168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f8afc016440 0x7f8afc0168c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e91bfc0 msgr2=0x56311e91e460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e91bfc0 0x56311e91e460 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8af406e070 msgr2=0x7f8af4056410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f8af406e070 0x7f8af4056410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e920960 msgr2=0x56311e922d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.228 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e920960 0x56311e922d50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89d00346a0 msgr2=0x7f89d0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89d00346a0 0x7f89d0036b60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8af80ae040 tx=0x7f8af80a8000 comp rx=0 tx=0).stop 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 msgr2=0x56311e910e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/2570802531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e909d20 0x56311e910e70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8af40314f0 tx=0x7f8af4017f90 comp rx=0 tx=0).stop 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 reap_dead start 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b056d9640 1 -- 172.21.15.151:0/2570802531 reap_dead start 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 shutdown_connections 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 >> 172.21.15.151:0/2570802531 conn(0x56311e906100 msgr2=0x56311e9041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 shutdown_connections 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/2570802531 wait complete. 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 msgr2=0x7f89dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 0x7f89dc036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x56311e8e7230 tx=0x7f8af8005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.229 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 msgr2=0x56311e8fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f8af4019790 tx=0x7f8af4019e70 comp rx=0 tx=0).stop 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 shutdown_connections 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89dc034650 0x7f89dc036b10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/3851497208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e8fd5b0 0x56311e8fd9d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 >> 172.21.15.151:0/3851497208 conn(0x56311e8f2700 msgr2=0x56311e8f5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 shutdown_connections 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/3851497208 wait complete. 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e7ef060 msgr2=0x56311e8e66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x56311e7ef060 0x56311e8e66c0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56311e8ecff0 msgr2=0x56311e8ef3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x56311e8ecff0 0x56311e8ef3e0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e8e90b0 msgr2=0x56311e8eb4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.230 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x56311e8e90b0 0x56311e8eb4a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89ec034650 msgr2=0x7f89ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f89ec034650 0x7f89ec036b10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8af80ad000 tx=0x7f8af80a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 msgr2=0x56311e8df730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 --2- 172.21.15.151:0/795410453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56311e7eac90 0x56311e8df730 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f8af4000c10 tx=0x7f8af4000ee0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b056d9640 1 -- 172.21.15.151:0/795410453 reap_dead start 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 shutdown_connections 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 >> 172.21.15.151:0/795410453 conn(0x56311e7e67b0 msgr2=0x56311e8d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 shutdown_connections 2024-09-13T19:08:34.231 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.220+0000 7f8b073c8980 1 -- 172.21.15.151:0/795410453 wait complete. 2024-09-13T19:08:34.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.237 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.237 ERROR:root:0 2024-09-13T19:08:34.237 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:34.249 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:34.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:34.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:34.251 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:08:34.316 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:34.317 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:34.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4fb785980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558af737f7d0 0x558af737e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.318 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4fb785980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558af7290ae0 con 0x558af737f3c0 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4fb785980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x558af72b4e30 con 0x558af737f7d0 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558af737f7d0 0x558af737e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x558af737f7d0 0x558af737e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59104/0 (socket says 172.21.15.151:59104) 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 -- 172.21.15.151:0/890856156 learned_addr learned my addr 172.21.15.151:0/890856156 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 -- 172.21.15.151:0/890856156 >> v1:172.21.15.12:6789/0 conn(0x558af737f3c0 legacy=0x558af737db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.319 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 -- 172.21.15.151:0/890856156 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af737e8f0 con 0x558af737f7d0 2024-09-13T19:08:34.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.312+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/890856156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f7d0 0x558af737e290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000a5c0 tx=0x7fd4f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739b4715e0448d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4ebfff640 1 -- 172.21.15.151:0/890856156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00a6070 con 0x558af737f7d0 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4ebfff640 1 -- 172.21.15.151:0/890856156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4f00af070 con 0x558af737f7d0 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4ebfff640 1 -- 172.21.15.151:0/890856156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4f00aa5c0 con 0x558af737f7d0 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 -- 172.21.15.151:0/890856156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f7d0 msgr2=0x558af737e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 --2- 172.21.15.151:0/890856156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f7d0 0x558af737e290 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd4f000a5c0 tx=0x7fd4f001b340 comp rx=0 tx=0).stop 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 -- 172.21.15.151:0/890856156 shutdown_connections 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 --2- 172.21.15.151:0/890856156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f7d0 0x558af737e290 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 -- 172.21.15.151:0/890856156 >> 172.21.15.151:0/890856156 conn(0x558af74041c0 msgr2=0x558af74065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 -- 172.21.15.151:0/890856156 shutdown_connections 2024-09-13T19:08:34.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.316+0000 7fd4fb785980 1 -- 172.21.15.151:0/890856156 wait complete. 2024-09-13T19:08:34.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4fb785980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.335 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4fb785980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558af72b6200 con 0x558af737f3c0 2024-09-13T19:08:34.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59114/0 (socket says 172.21.15.151:59114) 2024-09-13T19:08:34.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4f9295640 1 -- 172.21.15.151:0/2732883694 learned_addr learned my addr 172.21.15.151:0/2732883694 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.336 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4f9295640 1 -- 172.21.15.151:0/2732883694 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af74f61e0 con 0x558af737f3c0 2024-09-13T19:08:34.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd4f9295640 1 --2- 172.21.15.151:0/2732883694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec001ea0 tx=0x7fd4ec00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3bcc4dacd56899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd3e7606640 1 -- 172.21.15.151:0/2732883694 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec00a040 con 0x558af737f3c0 2024-09-13T19:08:34.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd3e7606640 1 -- 172.21.15.151:0/2732883694 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec00f620 con 0x558af737f3c0 2024-09-13T19:08:34.337 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.328+0000 7fd3e7606640 1 -- 172.21.15.151:0/2732883694 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec00f890 con 0x558af737f3c0 2024-09-13T19:08:34.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/2732883694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 msgr2=0x558af74f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 --2- 172.21.15.151:0/2732883694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec001ea0 tx=0x7fd4ec00b680 comp rx=0 tx=0).stop 2024-09-13T19:08:34.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/2732883694 shutdown_connections 2024-09-13T19:08:34.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 --2- 172.21.15.151:0/2732883694 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74f5c10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.338 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/2732883694 >> 172.21.15.151:0/2732883694 conn(0x558af74041c0 msgr2=0x558af74f1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/2732883694 shutdown_connections 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/2732883694 wait complete. 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558af7414210 con 0x558af737f3c0 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74fcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59124/0 (socket says 172.21.15.151:59124) 2024-09-13T19:08:34.339 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4f9295640 1 -- 172.21.15.151:0/3468641264 learned_addr learned my addr 172.21.15.151:0/3468641264 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4f9295640 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af74fd4e0 con 0x558af737f3c0 2024-09-13T19:08:34.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74fcfa0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec001fd0 tx=0x7fd4ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 -- 172.21.15.151:0/3468641264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec001520 con 0x558af737f3c0 2024-09-13T19:08:34.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558af74fd770 con 0x558af737f3c0 2024-09-13T19:08:34.340 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 -- 172.21.15.151:0/3468641264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec01ca10 con 0x558af737f3c0 2024-09-13T19:08:34.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 -- 172.21.15.151:0/3468641264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec01cd50 con 0x558af737f3c0 2024-09-13T19:08:34.341 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af7500450 con 0x558af737f3c0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 -- 172.21.15.151:0/3468641264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4ec017050 con 0x558af737f3c0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3e0034650 0x7fd3e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.332+0000 7fd3e5e03640 1 -- 172.21.15.151:0/3468641264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd4ec015020 con 0x558af737f3c0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3e0034650 0x7fd3e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af737f7d0 0x558af75040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7504620 con 0x558af737f7d0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af737f7d0 0x558af75040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3e0034650 0x7fd3e0036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ae000 tx=0x7fd4f00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af737f7d0 0x558af75040a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3468641264 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af737f7d0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7501670 con 0x558af737f7d0 2024-09-13T19:08:34.343 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3468641264 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af737f7d0 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af7506930 0x558af7508d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7509410 con 0x558af7506930 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af7506930 0x558af7508d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af7506930 0x558af7508d20 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9295640 1 -- 172.21.15.151:0/3468641264 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd4ec02e070 con 0x558af7506930 2024-09-13T19:08:34.344 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af75057d0 con 0x558af737f7d0 2024-09-13T19:08:34.345 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3468641264 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af737f7d0 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558af750a870 0x558af750cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af750d3a0 con 0x558af750a870 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558af750a870 0x558af750cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558af750a870 0x558af750cc60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3468641264 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd4f00aab40 con 0x558af750a870 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4fb785980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558af730f800 con 0x558af751ae70 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.336+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59126/0 (socket says 172.21.15.151:59126) 2024-09-13T19:08:34.346 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f9295640 1 -- 172.21.15.151:0/3284849992 learned_addr learned my addr 172.21.15.151:0/3284849992 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f9295640 1 -- 172.21.15.151:0/3284849992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af751b7d0 con 0x558af751ae70 2024-09-13T19:08:34.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec048860 tx=0x7fd4ec018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 -- 172.21.15.151:0/3284849992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec02f800 con 0x558af751ae70 2024-09-13T19:08:34.347 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 -- 172.21.15.151:0/3284849992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec048950 con 0x558af751ae70 2024-09-13T19:08:34.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 -- 172.21.15.151:0/3284849992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec048c70 con 0x558af751ae70 2024-09-13T19:08:34.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558af751ba60 con 0x558af751ae70 2024-09-13T19:08:34.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af751e6e0 con 0x558af751ae70 2024-09-13T19:08:34.348 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 -- 172.21.15.151:0/3284849992 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4ec013340 con 0x558af751ae70 2024-09-13T19:08:34.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 0x7fd3d0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd3deffd640 1 -- 172.21.15.151:0/3284849992 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd4ec04c5e0 con 0x558af751ae70 2024-09-13T19:08:34.349 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 0x7fd3d0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 0x7fd3d0036b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x558af7504ab0 tx=0x7fd4f0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.340+0000 7fd4fb785980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558af74f6560 con 0x558af7527700 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59134/0 (socket says 172.21.15.151:59134) 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 -- 172.21.15.151:0/3318057732 learned_addr learned my addr 172.21.15.151:0/3318057732 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.350 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 -- 172.21.15.151:0/3318057732 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af75280d0 con 0x558af7527700 2024-09-13T19:08:34.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3318057732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00ffd0 tx=0x7fd4ec042230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433fdb559db372cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3dcff9640 1 -- 172.21.15.151:0/3318057732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec02ce30 con 0x558af7527700 2024-09-13T19:08:34.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3dcff9640 1 -- 172.21.15.151:0/3318057732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec04c000 con 0x558af7527700 2024-09-13T19:08:34.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3dcff9640 1 -- 172.21.15.151:0/3318057732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec041d00 con 0x558af7527700 2024-09-13T19:08:34.352 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3318057732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 msgr2=0x558af7527b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3318057732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00ffd0 tx=0x7fd4ec042230 comp rx=0 tx=0).stop 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3318057732 shutdown_connections 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3318057732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af7527b00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3318057732 >> 172.21.15.151:0/3318057732 conn(0x558af7523b30 msgr2=0x558af7521c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3318057732 shutdown_connections 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3318057732 wait complete. 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 Processor -- start 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- start start 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af752e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x558af75280d0 con 0x558af7527700 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af752e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af752e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59146/0 (socket says 172.21.15.151:59146) 2024-09-13T19:08:34.353 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 learned_addr learned my addr 172.21.15.151:0/3398000626 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af752ecd0 con 0x558af7527700 2024-09-13T19:08:34.354 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af752e790 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec01c680 tx=0x7fd4ec04c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3ceffd640 1 -- 172.21.15.151:0/3398000626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec06c070 con 0x558af7527700 2024-09-13T19:08:34.357 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3ceffd640 1 -- 172.21.15.151:0/3398000626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4ec02ce30 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558af752ecd0 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd3ceffd640 1 -- 172.21.15.151:0/3398000626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec060040 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.344+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af752ecd0 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd3ceffd640 1 -- 172.21.15.151:0/3398000626 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd4ec04a3d0 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd3ceffd640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3c4034600 0x7fd3c4036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd3ceffd640 1 -- 172.21.15.151:0/3398000626 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd4ec056070 con 0x558af7527700 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3c4034600 0x7fd3c4036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af7539690 0x558af753bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af753c2a0 con 0x558af7539690 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af7539690 0x558af753bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3c4034600 0x7fd3c4036ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0017f50 tx=0x7fd4f00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.358 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af7539690 0x558af753bb50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 realm 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af753c6b0 con 0x558af7539690 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af753cf50 con 0x558af7539690 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.359 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af753e050 0x558af7540440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7540ae0 con 0x558af753e050 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af753e050 0x558af7540440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af753e050 0x558af7540440 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 20 searching for the correct realm 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.348+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af7542340 con 0x558af753e050 2024-09-13T19:08:34.360 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9295640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd4ec04b470 0x7fd4ec03a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af7542340 con 0x7fd4ec04b470 2024-09-13T19:08:34.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd4ec04b470 0x7fd4ec03a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.361 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd4ec04b470 0x7fd4ec03a9e0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f00aab40 con 0x7fd4ec04b470 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af7542340 con 0x7fd4ec04b470 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f00aab40 con 0x7fd4ec04b470 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af7542340 con 0x558af7539690 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.364 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd4f4016440 0x7fd4f40168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd4f4016440 0x7fd4f40168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd4f4016440 0x7fd4f40168c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.352+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd4f00aab40 con 0x7fd4ec04b470 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.365 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd4f00aab40 con 0x7fd4ec04b470 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.366 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.369 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.356+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f00aab40 con 0x7fd4ec04b470 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.370 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.360+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af753e050 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.371 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4f4016440 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x558af7539690 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558af753d2f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:34.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7541430 con 0x558af7539690 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7541040 con 0x558af7539690 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7541080 con 0x7fd4ec04b470 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:34.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 zone default found 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 4 Realm: () 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 zonegroup default 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7542770 con 0x7fd4f4016440 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7544150 con 0x558af753e050 2024-09-13T19:08:34.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af75445b0 con 0x558af753e050 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 started sync module instance, tier type = 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.364+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af75435f0 con 0x7fd4ec04b470 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94055343340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7543250 con 0x7fd4ec04b470 2024-09-13T19:08:34.378 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af75454e0 con 0x558af7539690 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94055343340048] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94055343345712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7545450 con 0x558af7539690 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.368+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7546230 con 0x558af753e050 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94055343345712] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94055343347920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af75461a0 con 0x558af753e050 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7546c40 con 0x7fd4ec04b470 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.380 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94055343351696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af75474e0 con 0x7fd4ec04b470 2024-09-13T19:08:34.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7547f60 con 0x558af7539690 2024-09-13T19:08:34.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.372+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94055343347920] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.381 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94055343351696] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94055343353904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7545cf0 con 0x558af7539690 2024-09-13T19:08:34.382 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7548800 con 0x7fd4f4016440 2024-09-13T19:08:34.383 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94055343353904] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94055343356496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7548800 con 0x7fd4f4016440 2024-09-13T19:08:34.384 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.376+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7549090 con 0x7fd4f4016440 2024-09-13T19:08:34.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.380+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.380+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94055343360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7549720 con 0x7fd4f4016440 2024-09-13T19:08:34.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.380+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7549fd0 con 0x7fd4f4016440 2024-09-13T19:08:34.386 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.380+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94055343356496] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.388 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.380+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94055343360000] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94055343358800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7549720 con 0x7fd4f4016440 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=0 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=1 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=2 2024-09-13T19:08:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=3 2024-09-13T19:08:34.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=4 2024-09-13T19:08:34.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=5 2024-09-13T19:08:34.390 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=6 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94055343358800] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 20 add_watcher() i=7 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af754d0d0 con 0x558af7539690 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.384+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94055343362672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af754a550 con 0x558af7539690 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94055343362672] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd3af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 5 note: GC not initialized 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd3ae7e4640 20 reqs_thread_entry: start 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 Filter name: none 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd31ffff640 20 reqs_thread_entry: start 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7570580 con 0x7fd4f4016440 2024-09-13T19:08:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:08:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.388+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7576ee0 con 0x7fd4f4016440 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94055343548752 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558af7572590 con 0x558af7539690 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94055343353904 notify 146028888102 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7fd4f4030040 con 0x558af7539690 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd3dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94055343353904 notifier 4883 bl.length()=679 2024-09-13T19:08:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd3dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd3dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94055343548752 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd3dcff9640 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd3bc003eb0 con 0x558af7539690 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94055343548752 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd4f402a5e0 con 0x558af7539690 2024-09-13T19:08:34.399 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:34.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd3af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94055343362672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af756e380 con 0x558af7539690 2024-09-13T19:08:34.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94055343362672] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.400 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.392+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94055343340048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af756e380 con 0x7fd4ec04b470 2024-09-13T19:08:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94055343340048] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4fb785980 20 remove_watcher() i=0 2024-09-13T19:08:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4fb785980 2 removed watcher, disabling cache 2024-09-13T19:08:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94055343345712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7543a10 con 0x558af7539690 2024-09-13T19:08:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94055343345712] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4fb785980 20 remove_watcher() i=1 2024-09-13T19:08:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.396+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94055343347920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af756e380 con 0x558af753e050 2024-09-13T19:08:34.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4f9295640 1 -- 172.21.15.151:0/3398000626 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94055343347920] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4ec079040 con 0x558af753e050 2024-09-13T19:08:34.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 20 remove_watcher() i=2 2024-09-13T19:08:34.405 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94055343351696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7545030 con 0x7fd4ec04b470 2024-09-13T19:08:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4f8a94640 1 -- 172.21.15.151:0/3398000626 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94055343351696] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f00e7040 con 0x7fd4ec04b470 2024-09-13T19:08:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 20 remove_watcher() i=3 2024-09-13T19:08:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94055343353904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7543a10 con 0x558af7539690 2024-09-13T19:08:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94055343353904] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x558af7539690 2024-09-13T19:08:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 20 remove_watcher() i=4 2024-09-13T19:08:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.400+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94055343356496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af75458d0 con 0x7fd4f4016440 2024-09-13T19:08:34.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94055343356496] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4fb785980 20 remove_watcher() i=5 2024-09-13T19:08:34.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94055343360000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af756e380 con 0x7fd4f4016440 2024-09-13T19:08:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94055343360000] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4fb785980 20 remove_watcher() i=6 2024-09-13T19:08:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.404+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94055343358800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558af7545030 con 0x7fd4f4016440 2024-09-13T19:08:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94055343358800] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4f400a4d0 con 0x7fd4f4016440 2024-09-13T19:08:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 20 remove_watcher() i=7 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd4f4016440 msgr2=0x7fd4f40168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fd4f4016440 0x7fd4f40168c0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af7539690 msgr2=0x558af753bb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af7539690 0x558af753bb50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd4ec04b470 msgr2=0x7fd4ec03a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd4ec04b470 0x7fd4ec03a9e0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af753e050 msgr2=0x558af7540440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af753e050 0x558af7540440 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3c4034600 msgr2=0x7fd3c4036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3c4034600 0x7fd3c4036ac0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0017f50 tx=0x7fd4f00c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 msgr2=0x558af752e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3398000626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af7527700 0x558af752e790 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec01c680 tx=0x7fd4ec04c2b0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 reap_dead start 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3398000626 reap_dead start 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 shutdown_connections 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 >> 172.21.15.151:0/3398000626 conn(0x558af7523b30 msgr2=0x558af7521c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 shutdown_connections 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3398000626 wait complete. 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 msgr2=0x7fd3d0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 0x7fd3d0036b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x558af7504ab0 tx=0x7fd4f0005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 msgr2=0x558af751b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec048860 tx=0x7fd4ec018d50 comp rx=0 tx=0).stop 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 shutdown_connections 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3d00346a0 0x7fd3d0036b60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3284849992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af751ae70 0x558af751b290 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 >> 172.21.15.151:0/3284849992 conn(0x558af750ffc0 msgr2=0x558af7512a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 shutdown_connections 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3284849992 wait complete. 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af737f7d0 msgr2=0x558af75040a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x558af737f7d0 0x558af75040a0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558af750a870 msgr2=0x558af750cc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x558af750a870 0x558af750cc60 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af7506930 msgr2=0x558af7508d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x558af7506930 0x558af7508d20 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3e0034650 msgr2=0x7fd3e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd3e0034650 0x7fd3e0036b10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd4f00ae000 tx=0x7fd4f00a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 msgr2=0x558af74fcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 --2- 172.21.15.151:0/3468641264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558af737f3c0 0x558af74fcfa0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec001fd0 tx=0x7fd4ec000bd0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4f9a96640 1 -- 172.21.15.151:0/3468641264 reap_dead start 2024-09-13T19:08:34.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 shutdown_connections 2024-09-13T19:08:34.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 >> 172.21.15.151:0/3468641264 conn(0x558af74041c0 msgr2=0x558af74f03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 shutdown_connections 2024-09-13T19:08:34.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.408+0000 7fd4fb785980 1 -- 172.21.15.151:0/3468641264 wait complete. 2024-09-13T19:08:34.426 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.427 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.427 ERROR:root:0 2024-09-13T19:08:34.427 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:34.441 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:34.441 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:08:34.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-13T19:08:34.442 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-13T19:08:34.504 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:34.504 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:34.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f695bc37980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649f75adc70 0x5649f75b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f695bc37980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5649f742fae0 con 0x5649f75a98f0 2024-09-13T19:08:34.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f695bc37980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x5649f7453e30 con 0x5649f75adc70 2024-09-13T19:08:34.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6958f46640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649f75adc70 0x5649f75b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.506 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6958f46640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x5649f75adc70 0x5649f75b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59148/0 (socket says 172.21.15.151:59148) 2024-09-13T19:08:34.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6959747640 1 --1- 172.21.15.151:0/1782119110 >> v1:172.21.15.12:6789/0 conn(0x5649f75a98f0 0x5649f75a9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39858/0 (socket says 172.21.15.151:39858) 2024-09-13T19:08:34.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6958f46640 1 -- 172.21.15.151:0/1782119110 learned_addr learned my addr 172.21.15.151:0/1782119110 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6958f46640 1 -- 172.21.15.151:0/1782119110 >> v1:172.21.15.12:6789/0 conn(0x5649f75a98f0 legacy=0x5649f75a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.500+0000 7f6958f46640 1 -- 172.21.15.151:0/1782119110 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f75b15b0 con 0x5649f75adc70 2024-09-13T19:08:34.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f6958f46640 1 --2- 172.21.15.151:0/1782119110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75adc70 0x5649f75b0060 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f695000a5c0 tx=0x7f695001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fa48f8c3b3fe57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f694bfff640 1 -- 172.21.15.151:0/1782119110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69500a6070 con 0x5649f75adc70 2024-09-13T19:08:34.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f694bfff640 1 -- 172.21.15.151:0/1782119110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69500af070 con 0x5649f75adc70 2024-09-13T19:08:34.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f694bfff640 1 -- 172.21.15.151:0/1782119110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69500aa5c0 con 0x5649f75adc70 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 -- 172.21.15.151:0/1782119110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75adc70 msgr2=0x5649f75b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 --2- 172.21.15.151:0/1782119110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75adc70 0x5649f75b0060 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f695000a5c0 tx=0x7f695001b340 comp rx=0 tx=0).stop 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 -- 172.21.15.151:0/1782119110 shutdown_connections 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 --2- 172.21.15.151:0/1782119110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75adc70 0x5649f75b0060 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 -- 172.21.15.151:0/1782119110 >> 172.21.15.151:0/1782119110 conn(0x5649f751d240 msgr2=0x5649f751d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 -- 172.21.15.151:0/1782119110 shutdown_connections 2024-09-13T19:08:34.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.504+0000 7f695bc37980 1 -- 172.21.15.151:0/1782119110 wait complete. 2024-09-13T19:08:34.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f695bc37980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f695bc37980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649f7455200 con 0x5649f75a98f0 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59162/0 (socket says 172.21.15.151:59162) 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f6959747640 1 -- 172.21.15.151:0/3175283657 learned_addr learned my addr 172.21.15.151:0/3175283657 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.516+0000 7f6959747640 1 -- 172.21.15.151:0/3175283657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f76953e0 con 0x5649f75a98f0 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 --2- 172.21.15.151:0/3175283657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f694c00b240 tx=0x7f694c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=368ad5474f45f86a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6847606640 1 -- 172.21.15.151:0/3175283657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c00e700 con 0x5649f75a98f0 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6847606640 1 -- 172.21.15.151:0/3175283657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00e8a0 con 0x5649f75a98f0 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6847606640 1 -- 172.21.15.151:0/3175283657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c00eb80 con 0x5649f75a98f0 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/3175283657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 msgr2=0x5649f7694e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 --2- 172.21.15.151:0/3175283657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f694c00b240 tx=0x7f694c00b700 comp rx=0 tx=0).stop 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/3175283657 shutdown_connections 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 --2- 172.21.15.151:0/3175283657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f75a98f0 0x5649f7694e10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/3175283657 >> 172.21.15.151:0/3175283657 conn(0x5649f751d240 msgr2=0x5649f76909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/3175283657 shutdown_connections 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/3175283657 wait complete. 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 0x5649f769c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649f75b10b0 con 0x5649f769c3a0 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 0x5649f769c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 0x5649f769c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59170/0 (socket says 172.21.15.151:59170) 2024-09-13T19:08:34.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 -- 172.21.15.151:0/899518884 learned_addr learned my addr 172.21.15.151:0/899518884 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f769cd00 con 0x5649f769c3a0 2024-09-13T19:08:34.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6959747640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 0x5649f769c7c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f694c000c10 tx=0x7f694c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6845e03640 1 -- 172.21.15.151:0/899518884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c001530 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6845e03640 1 -- 172.21.15.151:0/899518884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00f9f0 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f769cf90 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f6845e03640 1 -- 172.21.15.151:0/899518884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c00fcf0 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.520+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f769fa70 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6845e03640 1 -- 172.21.15.151:0/899518884 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f694c017070 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6845e03640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6845e03640 1 -- 172.21.15.151:0/899518884 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f694c015020 con 0x5649f769c3a0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6958f46640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76a1760 0x5649f76a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.531 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76a41b0 con 0x5649f76a1760 2024-09-13T19:08:34.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959f48640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76a1760 0x5649f76a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6958f46640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69500ae000 tx=0x7f69500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959f48640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76a1760 0x5649f76a3b70 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.535 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959f48640 1 -- 172.21.15.151:0/899518884 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76a1760 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76a0d40 con 0x5649f76a1760 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959f48640 1 -- 172.21.15.151:0/899518884 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76a1760 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76a6530 0x5649f76a8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76a9010 con 0x5649f76a6530 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959747640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76a6530 0x5649f76a8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959747640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76a6530 0x5649f76a8920 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959747640 1 -- 172.21.15.151:0/899518884 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f694c02e070 con 0x5649f76a6530 2024-09-13T19:08:34.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76a53d0 con 0x5649f76a1760 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6959f48640 1 -- 172.21.15.151:0/899518884 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76a1760 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649f76aa470 0x5649f76ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76acfa0 con 0x5649f76aa470 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6958f46640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649f76aa470 0x5649f76ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.524+0000 7f6958f46640 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649f76aa470 0x5649f76ac860 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6958f46640 1 -- 172.21.15.151:0/899518884 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69500aaa00 con 0x5649f76aa470 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649f74ae800 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59178/0 (socket says 172.21.15.151:59178) 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6959747640 1 -- 172.21.15.151:0/2931076427 learned_addr learned my addr 172.21.15.151:0/2931076427 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6959747640 1 -- 172.21.15.151:0/2931076427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f76bb370 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6959747640 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f694c048d00 tx=0x7f694c043e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 -- 172.21.15.151:0/2931076427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c041070 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 -- 172.21.15.151:0/2931076427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c01a5b0 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f76bb600 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 -- 172.21.15.151:0/2931076427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c01a8d0 con 0x5649f76baa10 2024-09-13T19:08:34.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f76bb600 con 0x5649f76baa10 2024-09-13T19:08:34.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 -- 172.21.15.151:0/2931076427 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f694c042330 con 0x5649f76baa10 2024-09-13T19:08:34.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 0x7f6830036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f683effd640 1 -- 172.21.15.151:0/2931076427 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f694c032860 con 0x5649f76baa10 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f6958f46640 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 0x7f6830036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.528+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6958f46640 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 0x7f6830036ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5649f76a46b0 tx=0x7f6950005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649f7695760 con 0x5649f76c7120 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59188/0 (socket says 172.21.15.151:59188) 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 -- 172.21.15.151:0/4202108422 learned_addr learned my addr 172.21.15.151:0/4202108422 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 -- 172.21.15.151:0/4202108422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f76c7ad0 con 0x5649f76c7120 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- 172.21.15.151:0/4202108422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f694c0422c0 tx=0x7f694c032420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288553b7f086723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.547 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f683cff9640 1 -- 172.21.15.151:0/4202108422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c03c410 con 0x5649f76c7120 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f683cff9640 1 -- 172.21.15.151:0/4202108422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c025340 con 0x5649f76c7120 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f683cff9640 1 -- 172.21.15.151:0/4202108422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c019d60 con 0x5649f76c7120 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/4202108422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 msgr2=0x5649f76c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 --2- 172.21.15.151:0/4202108422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f694c0422c0 tx=0x7f694c032420 comp rx=0 tx=0).stop 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/4202108422 shutdown_connections 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 --2- 172.21.15.151:0/4202108422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76c7500 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/4202108422 >> 172.21.15.151:0/4202108422 conn(0x5649f76c3500 msgr2=0x5649f76c1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/4202108422 shutdown_connections 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/4202108422 wait complete. 2024-09-13T19:08:34.548 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 Processor -- start 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- start start 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5649f76c7f70 con 0x5649f76c7120 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59200/0 (socket says 172.21.15.151:59200) 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 learned_addr learned my addr 172.21.15.151:0/642056102 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649f76ce7d0 con 0x5649f76c7120 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f6959747640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f694c0422c0 tx=0x7f694c0324d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f682effd640 1 -- 172.21.15.151:0/642056102 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c070070 con 0x5649f76c7120 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5649f76ce7d0 con 0x5649f76c7120 2024-09-13T19:08:34.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f682effd640 1 -- 172.21.15.151:0/642056102 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c01de20 con 0x5649f76c7120 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f682effd640 1 -- 172.21.15.151:0/642056102 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f694c042800 con 0x5649f76c7120 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.532+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649f76ceca0 con 0x5649f76c7120 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f682effd640 1 -- 172.21.15.151:0/642056102 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f694c073070 con 0x5649f76c7120 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f682effd640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68240345b0 0x7f6824036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f682effd640 1 -- 172.21.15.151:0/642056102 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f694c05b070 con 0x5649f76c7120 2024-09-13T19:08:34.550 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6958f46640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68240345b0 0x7f6824036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76d9480 0x5649f76db940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dc090 con 0x5649f76d9480 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76d9480 0x5649f76db940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6958f46640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68240345b0 0x7f6824036a70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f695001b380 tx=0x7f69500c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76d9480 0x5649f76db940 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 realm 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dc4a0 con 0x5649f76d9480 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dcd40 con 0x5649f76d9480 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76dde40 0x5649f76e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e08d0 con 0x5649f76dde40 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959747640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76dde40 0x5649f76e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959747640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76dde40 0x5649f76e0230 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 20 searching for the correct realm 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.536+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e2130 con 0x5649f76dde40 2024-09-13T19:08:34.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959747640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f694c075060 0x7f694c0502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e2130 con 0x7f694c075060 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f694c075060 0x7f694c0502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f694c075060 0x7f694c0502b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69500aaa00 con 0x7f694c075060 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e2130 con 0x7f694c075060 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69500aaa00 con 0x7f694c075060 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e2130 con 0x5649f76d9480 2024-09-13T19:08:34.555 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6954016440 0x7f69540168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.556 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6954016440 0x7f69540168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6954016440 0x7f69540168c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f694c075060 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f69500aaa00 con 0x7f694c075060 2024-09-13T19:08:34.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.540+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f694c075060 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f69500aaa00 con 0x7f694c075060 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.544+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f694c075060 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69500aaa00 con 0x7f694c075060 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f694c075060 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76dde40 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.548+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f6954016440 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x5649f76d9480 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5649f76dd0e0 con 0x7f694c075060 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:34.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e1220 con 0x5649f76d9480 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e0e00 con 0x5649f76d9480 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e1a70 con 0x7f694c075060 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 zone default found 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 4 Realm: () 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 zonegroup default 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e2590 con 0x7f6954016440 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e3f70 con 0x5649f76dde40 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e4360 con 0x5649f76dde40 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 started sync module instance, tier type = 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e3410 con 0x7f694c075060 2024-09-13T19:08:34.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94875683796992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e3070 con 0x7f694c075060 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.552+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e5290 con 0x5649f76d9480 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.556+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94875683796992] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.556+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.556+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94875683802592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e56b0 con 0x5649f76d9480 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.556+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e6070 con 0x5649f76dde40 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94875683802592] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94875683803648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e5620 con 0x5649f76dde40 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e6d70 con 0x7f694c075060 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94875683811680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e7a30 con 0x7f694c075060 2024-09-13T19:08:34.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e83f0 con 0x5649f76d9480 2024-09-13T19:08:34.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94875683803648] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94875683811680] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94875683815232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e7a30 con 0x5649f76d9480 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.560+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e8360 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.564+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94875683815232] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.564+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.564+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94875683812736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e79a0 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.564+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e92b0 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94875683819008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e96d0 con 0x7f6954016440 2024-09-13T19:08:34.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76ea130 con 0x7f6954016440 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94875683812736] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94875683819008] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94875683817440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76e9220 con 0x7f6954016440 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=0 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=1 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=2 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=3 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=4 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=5 2024-09-13T19:08:34.579 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.568+0000 7f695bc37980 20 add_watcher() i=6 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94875683817440] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 add_watcher() i=7 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f76ed230 con 0x5649f76d9480 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94875683822608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f76ea6b0 con 0x5649f76d9480 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94875683822608] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f680f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 5 note: GC not initialized 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f680e7e4640 20 reqs_thread_entry: start 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 Filter name: none 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f677ffff640 20 reqs_thread_entry: start 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.572+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f77106a0 con 0x7f6954016440 2024-09-13T19:08:34.583 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 20 rados_obj.operate() r=0 bl.length=503 2024-09-13T19:08:34.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:34.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:34.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f7717070 con 0x7f6954016440 2024-09-13T19:08:34.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94875684006624 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5649f7712780 con 0x5649f76d9480 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94875683815232 notify 146028888103 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f6954030040 con 0x5649f76d9480 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f683cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94875683815232 notifier 4890 bl.length()=636 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f683cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f683cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94875684006624 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.576+0000 7f683cff9640 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f681c003eb0 con 0x5649f76d9480 2024-09-13T19:08:34.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify_complete (2) cookie 94875684006624 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f695402a8f0 con 0x5649f76d9480 2024-09-13T19:08:34.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.587 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:34.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f680f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94875683822608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x5649f76d9480 2024-09-13T19:08:34.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94875683822608] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94875683796992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x7f694c075060 2024-09-13T19:08:34.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94875683796992] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f695bc37980 20 remove_watcher() i=0 2024-09-13T19:08:34.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f695bc37980 2 removed watcher, disabling cache 2024-09-13T19:08:34.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.580+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94875683802592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x5649f76d9480 2024-09-13T19:08:34.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94875683802592] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f695bc37980 20 remove_watcher() i=1 2024-09-13T19:08:34.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94875683803648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x5649f76dde40 2024-09-13T19:08:34.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f6959747640 1 -- 172.21.15.151:0/642056102 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94875683803648] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f694c072030 con 0x5649f76dde40 2024-09-13T19:08:34.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f695bc37980 20 remove_watcher() i=2 2024-09-13T19:08:34.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.584+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94875683811680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x7f694c075060 2024-09-13T19:08:34.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f6958f46640 1 -- 172.21.15.151:0/642056102 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94875683811680] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69500e7040 con 0x7f694c075060 2024-09-13T19:08:34.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f695bc37980 20 remove_watcher() i=3 2024-09-13T19:08:34.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94875683815232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x5649f76d9480 2024-09-13T19:08:34.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94875683815232] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x5649f76d9480 2024-09-13T19:08:34.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f695bc37980 20 remove_watcher() i=4 2024-09-13T19:08:34.595 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.588+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94875683812736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x7f6954016440 2024-09-13T19:08:34.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94875683812736] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f695bc37980 20 remove_watcher() i=5 2024-09-13T19:08:34.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94875683819008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x7f6954016440 2024-09-13T19:08:34.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94875683819008] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f695bc37980 20 remove_watcher() i=6 2024-09-13T19:08:34.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.592+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94875683817440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5649f770e4c0 con 0x7f6954016440 2024-09-13T19:08:34.604 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94875683817440] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f695400a4d0 con 0x7f6954016440 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 20 remove_watcher() i=7 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6954016440 msgr2=0x7f69540168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f6954016440 0x7f69540168c0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76d9480 msgr2=0x5649f76db940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76d9480 0x5649f76db940 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f694c075060 msgr2=0x7f694c0502b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f694c075060 0x7f694c0502b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76dde40 msgr2=0x5649f76e0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76dde40 0x5649f76e0230 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68240345b0 msgr2=0x7f6824036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68240345b0 0x7f6824036a70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f695001b380 tx=0x7f69500c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:34.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 msgr2=0x5649f76ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f6959f48640 1 -- 172.21.15.151:0/642056102 reap_dead start 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f694c0422c0 tx=0x7f694c0324d0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 shutdown_connections 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/642056102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76c7120 0x5649f76ce290 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 >> 172.21.15.151:0/642056102 conn(0x5649f76c3500 msgr2=0x5649f76c15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 shutdown_connections 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/642056102 wait complete. 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 msgr2=0x7f6830036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 0x7f6830036ac0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x5649f76a46b0 tx=0x7f6950005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 msgr2=0x5649f76bae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f694c048d00 tx=0x7f694c043e70 comp rx=0 tx=0).stop 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 shutdown_connections 2024-09-13T19:08:34.606 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f6830034600 0x7f6830036ac0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/2931076427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f76baa10 0x5649f76bae30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 >> 172.21.15.151:0/2931076427 conn(0x5649f76afb60 msgr2=0x5649f76b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 shutdown_connections 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/2931076427 wait complete. 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76a1760 msgr2=0x5649f76a3b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x5649f76a1760 0x5649f76a3b70 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649f76aa470 msgr2=0x5649f76ac860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x5649f76aa470 0x5649f76ac860 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76a6530 msgr2=0x5649f76a8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x5649f76a6530 0x5649f76a8920 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 msgr2=0x7f6840036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f68400346a0 0x7f6840036b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f69500ae000 tx=0x7f69500a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:34.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 msgr2=0x5649f769c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 --2- 172.21.15.151:0/899518884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5649f769c3a0 0x5649f769c7c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f694c000c10 tx=0x7f694c000ee0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f6959f48640 1 -- 172.21.15.151:0/899518884 reap_dead start 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 shutdown_connections 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 >> 172.21.15.151:0/899518884 conn(0x5649f751d240 msgr2=0x5649f768f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 shutdown_connections 2024-09-13T19:08:34.608 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.596+0000 7f695bc37980 1 -- 172.21.15.151:0/899518884 wait complete. 2024-09-13T19:08:34.613 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.613 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.613 ERROR:root:0 2024-09-13T19:08:34.613 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:08:34.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:08:34.613 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-13T19:08:34.686 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:34.686 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:34.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b256eb980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561b1f2ff900 0x561b1f301cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b256eb980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561b1f184ae0 con 0x561b1f2fb580 2024-09-13T19:08:34.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b256eb980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x561b1f1a8e30 con 0x561b1f2ff900 2024-09-13T19:08:34.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b229fa640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x561b1f2ff900 0x561b1f301cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b231fb640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x561b1f2fb580 0x561b1f2fb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39870/0 (socket says 172.21.15.151:39870) 2024-09-13T19:08:34.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b231fb640 1 -- 172.21.15.151:0/2113681680 learned_addr learned my addr 172.21.15.151:0/2113681680 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:34.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b229fa640 1 -- 172.21.15.151:0/2113681680 >> v1:172.21.15.12:6789/0 conn(0x561b1f2fb580 legacy=0x561b1f2fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.680+0000 7f3b229fa640 1 -- 172.21.15.151:0/2113681680 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f303240 con 0x561b1f2ff900 2024-09-13T19:08:34.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b229fa640 1 --2- 172.21.15.151:0/2113681680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2ff900 0x561b1f301cf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00a480 tx=0x7f3b0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0da65b7a131b443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b221f9640 1 -- 172.21.15.151:0/2113681680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0c0b0070 con 0x561b1f2ff900 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b221f9640 1 -- 172.21.15.151:0/2113681680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0ab540 con 0x561b1f2ff900 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b221f9640 1 -- 172.21.15.151:0/2113681680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0c0ab840 con 0x561b1f2ff900 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 -- 172.21.15.151:0/2113681680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2ff900 msgr2=0x561b1f301cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2113681680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2ff900 0x561b1f301cf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00a480 tx=0x7f3b0c01b280 comp rx=0 tx=0).stop 2024-09-13T19:08:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 -- 172.21.15.151:0/2113681680 shutdown_connections 2024-09-13T19:08:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2113681680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2ff900 0x561b1f301cf0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 -- 172.21.15.151:0/2113681680 >> 172.21.15.151:0/2113681680 conn(0x561b1f2f70a0 msgr2=0x561b1f2f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 -- 172.21.15.151:0/2113681680 shutdown_connections 2024-09-13T19:08:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.684+0000 7f3b256eb980 1 -- 172.21.15.151:0/2113681680 wait complete. 2024-09-13T19:08:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b256eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b256eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b1f1aa200 con 0x561b1f2fb580 2024-09-13T19:08:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59210/0 (socket says 172.21.15.151:59210) 2024-09-13T19:08:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b231fb640 1 -- 172.21.15.151:0/2792817930 learned_addr learned my addr 172.21.15.151:0/2792817930 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.696+0000 7f3b231fb640 1 -- 172.21.15.151:0/2792817930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f3e5e90 con 0x561b1f2fb580 2024-09-13T19:08:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 --2- 172.21.15.151:0/2792817930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3b140017b0 tx=0x7f3b14001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba92b5ff01b048d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a1160a640 1 -- 172.21.15.151:0/2792817930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14016070 con 0x561b1f2fb580 2024-09-13T19:08:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a1160a640 1 -- 172.21.15.151:0/2792817930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14004530 con 0x561b1f2fb580 2024-09-13T19:08:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a1160a640 1 -- 172.21.15.151:0/2792817930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14004870 con 0x561b1f2fb580 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/2792817930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 msgr2=0x561b1f3e58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2792817930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3b140017b0 tx=0x7f3b14001c70 comp rx=0 tx=0).stop 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/2792817930 shutdown_connections 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2792817930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3e58c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/2792817930 >> 172.21.15.151:0/2792817930 conn(0x561b1f2f70a0 msgr2=0x561b1f3e14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/2792817930 shutdown_connections 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/2792817930 wait complete. 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b1f302d40 con 0x561b1f2fb580 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59216/0 (socket says 172.21.15.151:59216) 2024-09-13T19:08:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 -- 172.21.15.151:0/1064370044 learned_addr learned my addr 172.21.15.151:0/1064370044 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f3ed150 con 0x561b1f2fb580 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b231fb640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3ecc10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000f90 tx=0x7f3b14001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a0fe07640 1 -- 172.21.15.151:0/1064370044 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14020070 con 0x561b1f2fb580 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b1f3ed3e0 con 0x561b1f2fb580 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a0fe07640 1 -- 172.21.15.151:0/1064370044 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14011400 con 0x561b1f2fb580 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3a0fe07640 1 -- 172.21.15.151:0/1064370044 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14016040 con 0x561b1f2fb580 2024-09-13T19:08:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.700+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1f3f00c0 con 0x561b1f2fb580 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3a0fe07640 1 -- 172.21.15.151:0/1064370044 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b14023070 con 0x561b1f2fb580 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3a0fe07640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3a08034650 0x7f3a08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3a0fe07640 1 -- 172.21.15.151:0/1064370044 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3b14049260 con 0x561b1f2fb580 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b229fa640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3a08034650 0x7f3a08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f2ff900 0x561b1f3f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f3f4250 con 0x561b1f2ff900 2024-09-13T19:08:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b239fc640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f2ff900 0x561b1f3f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b229fa640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3a08034650 0x7f3a08036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0ad000 tx=0x7f3b0c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b239fc640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f2ff900 0x561b1f3f3d10 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b239fc640 1 -- 172.21.15.151:0/1064370044 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f2ff900 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f3f12c0 con 0x561b1f2ff900 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b239fc640 1 -- 172.21.15.151:0/1064370044 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f2ff900 2024-09-13T19:08:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f3f6520 0x561b1f3f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f3f9000 con 0x561b1f3f6520 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b231fb640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f3f6520 0x561b1f3f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b231fb640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f3f6520 0x561b1f3f8910 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b231fb640 1 -- 172.21.15.151:0/1064370044 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b1402c070 con 0x561b1f3f6520 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f3f5390 con 0x561b1f2ff900 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b239fc640 1 -- 172.21.15.151:0/1064370044 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f2ff900 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561b1f3fa460 0x561b1f3fc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f3fcf50 con 0x561b1f3fa460 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b229fa640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561b1f3fa460 0x561b1f3fc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b229fa640 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561b1f3fa460 0x561b1f3fc850 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.704+0000 7f3b229fa640 1 -- 172.21.15.151:0/1064370044 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b0c0b3040 con 0x561b1f3fa460 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b1f203800 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59228/0 (socket says 172.21.15.151:59228) 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b231fb640 1 -- 172.21.15.151:0/2643367248 learned_addr learned my addr 172.21.15.151:0/2643367248 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b231fb640 1 -- 172.21.15.151:0/2643367248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f40b380 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b231fb640 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3b14047590 tx=0x7f3b1401b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 -- 172.21.15.151:0/2643367248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1402a040 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b1f40b610 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 -- 172.21.15.151:0/2643367248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1402da10 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 -- 172.21.15.151:0/2643367248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1402a420 con 0x561b1f40aa20 2024-09-13T19:08:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1f40e290 con 0x561b1f40aa20 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 -- 172.21.15.151:0/2643367248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b1402dcf0 con 0x561b1f40aa20 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 0x7f39fc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3a0d602640 1 -- 172.21.15.151:0/2643367248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3b14035070 con 0x561b1f40aa20 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b229fa640 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 0x7f39fc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.708+0000 7f3b229fa640 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 0x7f39fc036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561b1f3f46c0 tx=0x7f3b0c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.718 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b1f3e6210 con 0x561b1f41b7c0 2024-09-13T19:08:34.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59234/0 (socket says 172.21.15.151:59234) 2024-09-13T19:08:34.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 -- 172.21.15.151:0/3898973571 learned_addr learned my addr 172.21.15.151:0/3898973571 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 -- 172.21.15.151:0/3898973571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f41c190 con 0x561b1f41b7c0 2024-09-13T19:08:34.719 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- 172.21.15.151:0/3898973571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403a040 tx=0x7f3b14049ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9138219fb39b48c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3a06ffd640 1 -- 172.21.15.151:0/3898973571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14026640 con 0x561b1f41b7c0 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3a06ffd640 1 -- 172.21.15.151:0/3898973571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14026cb0 con 0x561b1f41b7c0 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3a06ffd640 1 -- 172.21.15.151:0/3898973571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14012030 con 0x561b1f41b7c0 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- 172.21.15.151:0/3898973571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 msgr2=0x561b1f41bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 --2- 172.21.15.151:0/3898973571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403a040 tx=0x7f3b14049ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- 172.21.15.151:0/3898973571 shutdown_connections 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 --2- 172.21.15.151:0/3898973571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f41bbc0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- 172.21.15.151:0/3898973571 >> 172.21.15.151:0/3898973571 conn(0x561b1f413740 msgr2=0x561b1f411840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- 172.21.15.151:0/3898973571 shutdown_connections 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- 172.21.15.151:0/3898973571 wait complete. 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 Processor -- start 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- start start 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b256eb980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x561b1f41c6e0 con 0x561b1f41b7c0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59246/0 (socket says 172.21.15.151:59246) 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 learned_addr learned my addr 172.21.15.151:0/549088174 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b1f422e40 con 0x561b1f41b7c0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.712+0000 7f3b231fb640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3b14046360 tx=0x7f3b140123c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 -- 172.21.15.151:0/549088174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1406e070 con 0x561b1f41b7c0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561b1f422e40 con 0x561b1f41b7c0 2024-09-13T19:08:34.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 -- 172.21.15.151:0/549088174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1400cb90 con 0x561b1f41b7c0 2024-09-13T19:08:34.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 -- 172.21.15.151:0/549088174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1400ce70 con 0x561b1f41b7c0 2024-09-13T19:08:34.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b1f4232b0 con 0x561b1f41b7c0 2024-09-13T19:08:34.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 -- 172.21.15.151:0/549088174 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3b14071070 con 0x561b1f41b7c0 2024-09-13T19:08:34.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39ec0347a0 0x7f39ec036c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3a057fa640 1 -- 172.21.15.151:0/549088174 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3b14074d60 con 0x561b1f41b7c0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b229fa640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39ec0347a0 0x7f39ec036c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f42da70 0x561b1f42ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f430660 con 0x561b1f42da70 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f42da70 0x561b1f42ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b229fa640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39ec0347a0 0x7f39ec036c60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c10 tx=0x7f3b0c0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f42da70 0x561b1f42ff10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 realm 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f430a70 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f431310 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f432410 0x561b1f434800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f434e50 con 0x561b1f432410 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b231fb640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f432410 0x561b1f434800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b231fb640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f432410 0x561b1f434800 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 20 searching for the correct realm 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.716+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4366b0 con 0x561b1f432410 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b231fb640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f3b14073060 0x7f3b14023840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4366b0 con 0x7f3b14073060 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f3b14073060 0x7f3b14023840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f3b14073060 0x7f3b14023840 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c0c9030 con 0x7f3b14073060 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4366b0 con 0x7f3b14073060 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c0c9030 con 0x7f3b14073060 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4366b0 con 0x561b1f42da70 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f3b1c018410 0x7f3b1c018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f3b1c018410 0x7f3b1c018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f3b1c018410 0x7f3b1c018890 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x7f3b1c018410 2024-09-13T19:08:34.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x7f3b1c018410 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.720+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b14073060 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b0c0c9030 con 0x7f3b14073060 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x7f3b1c018410 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b14073060 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b0c0c9030 con 0x7f3b14073060 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x7f3b1c018410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.724+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x7f3b1c018410 2024-09-13T19:08:34.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b14073060 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c0c9030 con 0x7f3b14073060 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c0083f0 con 0x561b1f42da70 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b14073060 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f432410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.728+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x7f3b1c018410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4316b0 con 0x561b1f42da70 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3b1c03b040 con 0x7f3b14073060 2024-09-13T19:08:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4356a0 con 0x561b1f42da70 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f435a40 con 0x561b1f42da70 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f435a40 con 0x7f3b14073060 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 zone default found 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 4 Realm: () 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 zonegroup default 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.753 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f436310 con 0x7f3b1c018410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f436310 con 0x561b1f432410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f438540 con 0x561b1f432410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 started sync module instance, tier type = 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f437990 con 0x7f3b14073060 2024-09-13T19:08:34.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94674488622464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4375f0 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.732+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f439470 con 0x561b1f42da70 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.736+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94674488622464] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.736+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.736+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94674488627136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f439890 con 0x561b1f42da70 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.736+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43a160 con 0x561b1f432410 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.736+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94674488627136] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94674488628464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43a550 con 0x561b1f432410 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43af10 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94674488636080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43bb80 con 0x7f3b14073060 2024-09-13T19:08:34.755 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43c540 con 0x561b1f42da70 2024-09-13T19:08:34.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94674488628464] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94674488636080] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94674488639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43bb80 con 0x561b1f42da70 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.740+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43c4b0 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.744+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94674488639632] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.744+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.744+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94674488637136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43baf0 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.744+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43d290 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94674488637136] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94674488641840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43d200 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43dc40 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94674488641840] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94674488645392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43de20 con 0x7f3b1c018410 2024-09-13T19:08:34.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=0 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=1 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=2 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=3 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=4 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=5 2024-09-13T19:08:34.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.748+0000 7f3b256eb980 20 add_watcher() i=6 2024-09-13T19:08:34.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94674488645392] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 add_watcher() i=7 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f4411f0 con 0x561b1f42da70 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94674488646928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f43e5e0 con 0x561b1f42da70 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94674488646928] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b1c036040 con 0x561b1f42da70 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f39d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 5 note: GC not initialized 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f39d8fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:34.761 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 Filter name: none 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f39527fc640 20 reqs_thread_entry: start 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 20 rados->read ofs=0 len=0 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.752+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f464700 con 0x7f3b1c018410 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f3b1c036040 con 0x7f3b1c018410 2024-09-13T19:08:34.762 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:08:34.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:34.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:34.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f46ad30 con 0x7f3b1c018410 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x7f3b1c018410 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94674488829856 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561b1f466420 con 0x561b1f42da70 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94674488639632 notify 146028888104 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f3b1c010040 con 0x561b1f42da70 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94674488829856 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3b1c03f040 con 0x561b1f42da70 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3a06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94674488639632 notifier 4897 bl.length()=666 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3a06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:34.765 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3a06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:34.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3a06ffd640 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f39e8003eb0 con 0x561b1f42da70 2024-09-13T19:08:34.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify_complete (2) cookie 94674488829856 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3b1c007750 con 0x561b1f42da70 2024-09-13T19:08:34.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.756+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x561b1f42da70 2024-09-13T19:08:34.766 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:34.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f39d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:34.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94674488646928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f462500 con 0x561b1f42da70 2024-09-13T19:08:34.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94674488646928] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x561b1f42da70 2024-09-13T19:08:34.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94674488622464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f462500 con 0x7f3b14073060 2024-09-13T19:08:34.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94674488622464] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b256eb980 20 remove_watcher() i=0 2024-09-13T19:08:34.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b256eb980 2 removed watcher, disabling cache 2024-09-13T19:08:34.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.760+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94674488627136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f463ae0 con 0x561b1f42da70 2024-09-13T19:08:34.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94674488627136] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x561b1f42da70 2024-09-13T19:08:34.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b256eb980 20 remove_watcher() i=1 2024-09-13T19:08:34.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94674488628464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f463ae0 con 0x561b1f432410 2024-09-13T19:08:34.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b231fb640 1 -- 172.21.15.151:0/549088174 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94674488628464] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14070030 con 0x561b1f432410 2024-09-13T19:08:34.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b256eb980 20 remove_watcher() i=2 2024-09-13T19:08:34.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.764+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94674488636080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f463ae0 con 0x7f3b14073060 2024-09-13T19:08:34.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b229fa640 1 -- 172.21.15.151:0/549088174 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94674488636080] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c0e5040 con 0x7f3b14073060 2024-09-13T19:08:34.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b256eb980 20 remove_watcher() i=3 2024-09-13T19:08:34.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94674488639632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f463ae0 con 0x561b1f42da70 2024-09-13T19:08:34.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94674488639632] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x561b1f42da70 2024-09-13T19:08:34.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b256eb980 20 remove_watcher() i=4 2024-09-13T19:08:34.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.768+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94674488637136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f463ae0 con 0x7f3b1c018410 2024-09-13T19:08:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94674488637136] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x7f3b1c018410 2024-09-13T19:08:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b256eb980 20 remove_watcher() i=5 2024-09-13T19:08:34.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94674488641840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f437d80 con 0x7f3b1c018410 2024-09-13T19:08:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94674488641840] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x7f3b1c018410 2024-09-13T19:08:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b256eb980 20 remove_watcher() i=6 2024-09-13T19:08:34.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.772+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94674488645392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561b1f462500 con 0x7f3b1c018410 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94674488645392] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c03f040 con 0x7f3b1c018410 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 20 remove_watcher() i=7 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f3b1c018410 msgr2=0x7f3b1c018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f3b1c018410 0x7f3b1c018890 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f42da70 msgr2=0x561b1f42ff10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f42da70 0x561b1f42ff10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f3b14073060 msgr2=0x7f3b14023840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f3b14073060 0x7f3b14023840 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f432410 msgr2=0x561b1f434800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f432410 0x561b1f434800 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39ec0347a0 msgr2=0x7f39ec036c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39ec0347a0 0x7f39ec036c60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c000c10 tx=0x7f3b0c0b9040 comp rx=0 tx=0).stop 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 msgr2=0x561b1f422900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b239fc640 1 -- 172.21.15.151:0/549088174 reap_dead start 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f3b14046360 tx=0x7f3b140123c0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 shutdown_connections 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/549088174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f41b7c0 0x561b1f422900 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 >> 172.21.15.151:0/549088174 conn(0x561b1f413740 msgr2=0x561b1f411810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 shutdown_connections 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/549088174 wait complete. 2024-09-13T19:08:34.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 msgr2=0x7f39fc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 0x7f39fc036b10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x561b1f3f46c0 tx=0x7f3b0c005a10 comp rx=0 tx=0).stop 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 msgr2=0x561b1f40ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3b14047590 tx=0x7f3b1401b640 comp rx=0 tx=0).stop 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 shutdown_connections 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f39fc034650 0x7f39fc036b10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/2643367248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f40aa20 0x561b1f40ae40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 >> 172.21.15.151:0/2643367248 conn(0x561b1f3ffb70 msgr2=0x561b1f4025f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 shutdown_connections 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/2643367248 wait complete. 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f2ff900 msgr2=0x561b1f3f3d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x561b1f2ff900 0x561b1f3f3d10 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561b1f3fa460 msgr2=0x561b1f3fc850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x561b1f3fa460 0x561b1f3fc850 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f3f6520 msgr2=0x561b1f3f8910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x561b1f3f6520 0x561b1f3f8910 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3a08034650 msgr2=0x7f3a08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f3a08034650 0x7f3a08036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0ad000 tx=0x7f3b0c0a5040 comp rx=0 tx=0).stop 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 msgr2=0x561b1f3ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 --2- 172.21.15.151:0/1064370044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x561b1f2fb580 0x561b1f3ecc10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000f90 tx=0x7f3b14001260 comp rx=0 tx=0).stop 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b239fc640 1 -- 172.21.15.151:0/1064370044 reap_dead start 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 shutdown_connections 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 >> 172.21.15.151:0/1064370044 conn(0x561b1f2f70a0 msgr2=0x561b1f3e0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 shutdown_connections 2024-09-13T19:08:34.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.776+0000 7f3b256eb980 1 -- 172.21.15.151:0/1064370044 wait complete. 2024-09-13T19:08:34.793 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.793 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:34.793 ERROR:root:0 2024-09-13T19:08:34.793 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:34.805 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000051f16884b845a018-0066e48db2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:08:34.806 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:08:34.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-13T19:08:34.806 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-13T19:08:34.873 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:35.741 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1fb1d7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a680571a20 0x55a680573e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1fb1d7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a6803f5ae0 con 0x55a68056d6a0 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1fb1d7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55a680419e30 con 0x55a680571a20 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f84e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a680571a20 0x55a680573e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f8ce7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55a68056d6a0 0x55a68056da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39874/0 (socket says 172.21.15.151:39874) 2024-09-13T19:08:35.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f84e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55a680571a20 0x55a680573e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59248/0 (socket says 172.21.15.151:59248) 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/606325234 learned_addr learned my addr 172.21.15.151:0/606325234 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f84e6640 1 -- 172.21.15.151:0/606325234 >> v1:172.21.15.12:6789/0 conn(0x55a68056d6a0 legacy=0x55a68056da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.868+0000 7fe1f84e6640 1 -- 172.21.15.151:0/606325234 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a680575360 con 0x55a680571a20 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/606325234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680573e10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800a480 tx=0x7fe1e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269cedbdf7059dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1f7ce5640 1 -- 172.21.15.151:0/606325234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80b0070 con 0x55a680571a20 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1f7ce5640 1 -- 172.21.15.151:0/606325234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e80ab540 con 0x55a680571a20 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1f7ce5640 1 -- 172.21.15.151:0/606325234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1e80ab840 con 0x55a680571a20 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/606325234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 msgr2=0x55a680573e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/606325234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680573e10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800a480 tx=0x7fe1e801b280 comp rx=0 tx=0).stop 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/606325234 shutdown_connections 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/606325234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680573e10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/606325234 >> 172.21.15.151:0/606325234 conn(0x55a6805691c0 msgr2=0x55a68056b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.773 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/606325234 shutdown_connections 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.872+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/606325234 wait complete. 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1fb1d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1fb1d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a68041b200 con 0x55a68056d6a0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59252/0 (socket says 172.21.15.151:59252) 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/77188279 learned_addr learned my addr 172.21.15.151:0/77188279 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.884+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/77188279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a680659060 con 0x55a68056d6a0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/77188279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec001d90 tx=0x7fe1ec001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca2f1b148cbb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e6e0d640 1 -- 172.21.15.151:0/77188279 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec013030 con 0x55a68056d6a0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e6e0d640 1 -- 172.21.15.151:0/77188279 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00e690 con 0x55a68056d6a0 2024-09-13T19:08:35.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e6e0d640 1 -- 172.21.15.151:0/77188279 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec00ea10 con 0x55a68056d6a0 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/77188279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 msgr2=0x55a680658a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/77188279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec001d90 tx=0x7fe1ec001e80 comp rx=0 tx=0).stop 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/77188279 shutdown_connections 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/77188279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68056d6a0 0x55a680658a90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/77188279 >> 172.21.15.151:0/77188279 conn(0x55a6805691c0 msgr2=0x55a6806546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/77188279 shutdown_connections 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/77188279 wait complete. 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680660050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a680574e60 con 0x55a680571a20 2024-09-13T19:08:35.775 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680660050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680660050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59264/0 (socket says 172.21.15.151:59264) 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/1434239473 learned_addr learned my addr 172.21.15.151:0/1434239473 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a680660590 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680660050 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004000 tx=0x7fe1ec000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e560a640 1 -- 172.21.15.151:0/1434239473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec027070 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a680660820 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e560a640 1 -- 172.21.15.151:0/1434239473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0198b0 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe0e560a640 1 -- 172.21.15.151:0/1434239473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec019b90 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.888+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a680663500 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe0e560a640 1 -- 172.21.15.151:0/1434239473 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1ec02a070 con 0x55a680571a20 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe0e560a640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0e0034650 0x7fe0e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe0e560a640 1 -- 172.21.15.151:0/1434239473 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe1ec01f070 con 0x55a680571a20 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0e0034650 0x7fe0e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a680664fd0 0x55a6806673c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a680667990 con 0x55a680664fd0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a680664fd0 0x55a6806673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0e0034650 0x7fe0e0036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80ad000 tx=0x7fe1e80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a680664fd0 0x55a6806673c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f94e8640 1 -- 172.21.15.151:0/1434239473 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a680664fd0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a680664720 con 0x55a680664fd0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f94e8640 1 -- 172.21.15.151:0/1434239473 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a680664fd0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a680669ce0 0x55a68066c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a68066c7c0 con 0x55a680669ce0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a680669ce0 0x55a68066c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a680669ce0 0x55a68066c0d0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/1434239473 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1ec029030 con 0x55a680669ce0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a680668b80 con 0x55a680664fd0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f94e8640 1 -- 172.21.15.151:0/1434239473 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a680664fd0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a68066dc20 0x55a680670010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a680670750 con 0x55a68066dc20 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a68066dc20 0x55a680670010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a68066dc20 0x55a680670010 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.892+0000 7fe1f84e6640 1 -- 172.21.15.151:0/1434239473 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1e80b3040 con 0x55a68066dc20 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a680474800 con 0x55a68067e240 2024-09-13T19:08:35.778 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59268/0 (socket says 172.21.15.151:59268) 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3199800232 learned_addr learned my addr 172.21.15.151:0/3199800232 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3199800232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68067eba0 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec048380 tx=0x7fe1ec016ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 -- 172.21.15.151:0/3199800232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec040070 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 -- 172.21.15.151:0/3199800232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec016360 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a68067ee30 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 -- 172.21.15.151:0/3199800232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec02ac60 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a680681ab0 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 -- 172.21.15.151:0/3199800232 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1ec03a070 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 0x7fe0d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe0de7fc640 1 -- 172.21.15.151:0/3199800232 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe1ec037030 con 0x55a68067e240 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 0x7fe0d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.896+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 0x7fe0d0036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a680667e60 tx=0x7fe1e8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6806593e0 con 0x55a68068aae0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59276/0 (socket says 172.21.15.151:59276) 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/2084916319 learned_addr learned my addr 172.21.15.151:0/2084916319 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/2084916319 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a68068b4b0 con 0x55a68068aae0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/2084916319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00dc10 tx=0x7fe1ec022ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac39b5a350d567d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe0cffff640 1 -- 172.21.15.151:0/2084916319 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec02ae20 con 0x55a68068aae0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe0cffff640 1 -- 172.21.15.151:0/2084916319 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec061070 con 0x55a68068aae0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe0cffff640 1 -- 172.21.15.151:0/2084916319 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec02ccc0 con 0x55a68068aae0 2024-09-13T19:08:35.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/2084916319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 msgr2=0x55a68068aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/2084916319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00dc10 tx=0x7fe1ec022ca0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/2084916319 shutdown_connections 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/2084916319 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a68068aee0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/2084916319 >> 172.21.15.151:0/2084916319 conn(0x55a680686f50 msgr2=0x55a680685050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/2084916319 shutdown_connections 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/2084916319 wait complete. 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 Processor -- start 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- start start 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1fb1d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a68068b9c0 con 0x55a68068aae0 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59284/0 (socket says 172.21.15.151:59284) 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 learned_addr learned my addr 172.21.15.151:0/3604423367 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.900+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a680692280 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00dc10 tx=0x7fe1ec037ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 -- 172.21.15.151:0/3604423367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec02a490 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a680692280 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 -- 172.21.15.151:0/3604423367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1ec022410 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 -- 172.21.15.151:0/3604423367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1ec02c440 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a680692280 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 -- 172.21.15.151:0/3604423367 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe1ec016070 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0c4034650 0x7fe0c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe0ce7fc640 1 -- 172.21.15.151:0/3604423367 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe1ec014070 con 0x55a68068aae0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0c4034650 0x7fe0c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a68069cdd0 0x55a68069f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a68069f9e0 con 0x55a68069cdd0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a68069cdd0 0x55a68069f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0c4034650 0x7fe0c4036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8018eb0 tx=0x7fe1e80b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a68069cdd0 0x55a68069f290 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 realm 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a68069fdf0 con 0x55a68069cdd0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a06c0 con 0x55a68069cdd0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6806a17c0 0x55a6806a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a41c0 con 0x55a6806a17c0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.904+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6806a17c0 0x55a6806a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6806a17c0 0x55a6806a3bb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.784 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1fb1d7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1fb1d7980 20 searching for the correct realm 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a5a90 con 0x55a6806a17c0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f8ce7640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe1ec019010 0x7fe1ec0668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a5a90 con 0x7fe1ec019010 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe1ec019010 0x7fe1ec0668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe1ec019010 0x7fe1ec0668b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80c9030 con 0x7fe1ec019010 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a5a90 con 0x7fe1ec019010 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80c9030 con 0x7fe1ec019010 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a5a90 con 0x55a68069cdd0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe1f0016440 0x7fe1f00168c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe1f0016440 0x7fe1f00168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe1f0016440 0x7fe1f00168c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.908+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1ec019010 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe1e80c9030 con 0x7fe1ec019010 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1ec019010 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe1e80c9030 con 0x7fe1ec019010 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.787 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.912+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.788 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1ec019010 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80c9030 con 0x7fe1ec019010 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1ec019010 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.789 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a6806a17c0 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.916+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1f0016440 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x55a68069cdd0 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a0a60 con 0x7fe1ec019010 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:35.790 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a4b80 con 0x55a68069cdd0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a4fd0 con 0x55a68069cdd0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a53f0 con 0x7fe1ec019010 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 zone default found 2024-09-13T19:08:35.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 4 Realm: () 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 zonegroup default 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a5ec0 con 0x7fe1f0016440 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a78a0 con 0x55a6806a17c0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a7c40 con 0x55a6806a17c0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 started sync module instance, tier type = 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.920+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a6d40 con 0x7fe1ec019010 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173607391584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a69a0 con 0x7fe1ec019010 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a8b40 con 0x55a68069cdd0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173607391584] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173607397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a8f60 con 0x55a68069cdd0 2024-09-13T19:08:35.793 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.924+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a9920 con 0x55a6806a17c0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173607400560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806aa170 con 0x55a6806a17c0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806aab70 con 0x7fe1ec019010 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173607397008] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173607398064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806aaf60 con 0x7fe1ec019010 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806ab920 con 0x55a68069cdd0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173607400560] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173607398064] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.928+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173607405184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806ab470 con 0x55a68069cdd0 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.932+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806abd00 con 0x7fe1f0016440 2024-09-13T19:08:35.794 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.932+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.932+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173607408752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806ab890 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.932+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806acbc0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.932+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173607405184] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173607408752] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173607411952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806ac710 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806acfc0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173607411952] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173607413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806acb30 con 0x7fe1f0016440 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=0 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=1 2024-09-13T19:08:35.795 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=2 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=3 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=4 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=5 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.936+0000 7fe1fb1d7980 20 add_watcher() i=6 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173607413520] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 add_watcher() i=7 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806b0460 con 0x55a68069cdd0 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173607415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806ad920 con 0x55a68069cdd0 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173607415680] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.796 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe0af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 5 note: GC not initialized 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe0ae7e4640 20 reqs_thread_entry: start 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 Filter name: none 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe0a77fe640 20 reqs_thread_entry: start 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.940+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d3b20 con 0x7fe1f0016440 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 20 rados_obj.operate() r=0 bl.length=490 2024-09-13T19:08:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806da490 con 0x7fe1f0016440 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94173607599872 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d5b60 con 0x55a68069cdd0 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94173607405184 notify 146028888105 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fe1f0030040 con 0x55a68069cdd0 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe0cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94173607405184 notifier 4904 bl.length()=636 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe0cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:35.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe0cffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe0cffff640 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe0bc003eb0 con 0x55a68069cdd0 2024-09-13T19:08:35.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.944+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94173607599872 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94173607599872 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe1f002a8f0 con 0x55a68069cdd0 2024-09-13T19:08:35.799 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe0af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173607415680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d1920 con 0x55a68069cdd0 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94173607415680] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173607391584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d1920 con 0x7fe1ec019010 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94173607391584] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1fb1d7980 20 remove_watcher() i=0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1fb1d7980 2 removed watcher, disabling cache 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.948+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173607397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a7160 con 0x55a68069cdd0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94173607397008] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1fb1d7980 20 remove_watcher() i=1 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173607400560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d1920 con 0x55a6806a17c0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1f8ce7640 1 -- 172.21.15.151:0/3604423367 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94173607400560] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1ec083040 con 0x55a6806a17c0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1fb1d7980 20 remove_watcher() i=2 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.952+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173607398064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a8690 con 0x7fe1ec019010 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1f84e6640 1 -- 172.21.15.151:0/3604423367 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94173607398064] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1e80e5040 con 0x7fe1ec019010 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1fb1d7980 20 remove_watcher() i=3 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173607405184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a7160 con 0x55a68069cdd0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94173607405184] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x55a68069cdd0 2024-09-13T19:08:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1fb1d7980 20 remove_watcher() i=4 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.956+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173607408752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806a9470 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94173607408752] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1fb1d7980 20 remove_watcher() i=5 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173607411952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806d1920 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94173607411952] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1fb1d7980 20 remove_watcher() i=6 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.960+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173607413520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a6806aa680 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94173607413520] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe1f000a4d0 con 0x7fe1f0016440 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 20 remove_watcher() i=7 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe1f0016440 msgr2=0x7fe1f00168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe1f0016440 0x7fe1f00168c0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a68069cdd0 msgr2=0x55a68069f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a68069cdd0 0x55a68069f290 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe1ec019010 msgr2=0x7fe1ec0668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fe1ec019010 0x7fe1ec0668b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6806a17c0 msgr2=0x55a6806a3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a6806a17c0 0x55a6806a3bb0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0c4034650 msgr2=0x7fe0c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0c4034650 0x7fe0c4036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8018eb0 tx=0x7fe1e80b9040 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1f94e8640 1 -- 172.21.15.151:0/3604423367 reap_dead start 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 msgr2=0x55a680691d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00dc10 tx=0x7fe1ec037ed0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 shutdown_connections 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3604423367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68068aae0 0x55a680691d40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 >> 172.21.15.151:0/3604423367 conn(0x55a680686f50 msgr2=0x55a680685020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 shutdown_connections 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3604423367 wait complete. 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 msgr2=0x7fe0d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 0x7fe0d0036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55a680667e60 tx=0x7fe1e8005a10 comp rx=0 tx=0).stop 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 msgr2=0x55a68067e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec048380 tx=0x7fe1ec016ab0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 shutdown_connections 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0d0034650 0x7fe0d0036b10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/3199800232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a68067e240 0x55a68067e660 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 >> 172.21.15.151:0/3199800232 conn(0x55a680673390 msgr2=0x55a680675e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 shutdown_connections 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/3199800232 wait complete. 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a680664fd0 msgr2=0x55a6806673c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55a680664fd0 0x55a6806673c0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a68066dc20 msgr2=0x55a680670010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55a68066dc20 0x55a680670010 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a680669ce0 msgr2=0x55a68066c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55a680669ce0 0x55a68066c0d0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0e0034650 msgr2=0x7fe0e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe0e0034650 0x7fe0e0036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80ad000 tx=0x7fe1e80a5040 comp rx=0 tx=0).stop 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 msgr2=0x55a680660050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 --2- 172.21.15.151:0/1434239473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a680571a20 0x55a680660050 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004000 tx=0x7fe1ec000bd0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1f94e8640 1 -- 172.21.15.151:0/1434239473 reap_dead start 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 shutdown_connections 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 >> 172.21.15.151:0/1434239473 conn(0x55a6805691c0 msgr2=0x55a680653240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 shutdown_connections 2024-09-13T19:08:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:34.964+0000 7fe1fb1d7980 1 -- 172.21.15.151:0/1434239473 wait complete. 2024-09-13T19:08:35.811 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:35.811 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:35.811 ERROR:root:0 2024-09-13T19:08:35.811 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:35.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:35.811 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:08:35.891 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:35.891 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:35.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f9812294980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f4f2ab4c70 0x55f4f2ab7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f9812294980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4f2936ae0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f9812294980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55f4f295ae30 con 0x55f4f2ab4c70 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f980f5a3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55f4f2ab4c70 0x55f4f2ab7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.893 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f980fda4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x55f4f2ab08f0 0x55f4f2ab0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39886/0 (socket says 172.21.15.151:39886) 2024-09-13T19:08:35.894 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.884+0000 7f980fda4640 1 -- 172.21.15.151:0/2363209023 learned_addr learned my addr 172.21.15.151:0/2363209023 (peer_addr_for_me v1:172.21.15.151:0/0) 2024-09-13T19:08:35.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980eda2640 1 -- 172.21.15.151:0/2363209023 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181735499 0 0) 0x55f4f2936ae0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980eda2640 1 -- 172.21.15.151:0/2363209023 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97fc001e20 con 0x55f4f2ab08f0 2024-09-13T19:08:35.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980f5a3640 1 -- 172.21.15.151:0/2363209023 >> v1:172.21.15.12:6789/0 conn(0x55f4f2ab08f0 legacy=0x55f4f2ab0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980f5a3640 1 -- 172.21.15.151:0/2363209023 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2ab85b0 con 0x55f4f2ab4c70 2024-09-13T19:08:35.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980f5a3640 1 --2- 172.21.15.151:0/2363209023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab4c70 0x55f4f2ab7060 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97f800a480 tx=0x7f97f801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4581c9eb01d8ecd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980eda2640 1 -- 172.21.15.151:0/2363209023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f80b0070 con 0x55f4f2ab4c70 2024-09-13T19:08:35.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980eda2640 1 -- 172.21.15.151:0/2363209023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97f80ab540 con 0x55f4f2ab4c70 2024-09-13T19:08:35.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f980eda2640 1 -- 172.21.15.151:0/2363209023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f80ab820 con 0x55f4f2ab4c70 2024-09-13T19:08:35.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 -- 172.21.15.151:0/2363209023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab4c70 msgr2=0x55f4f2ab7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 --2- 172.21.15.151:0/2363209023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab4c70 0x55f4f2ab7060 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f97f800a480 tx=0x7f97f801b280 comp rx=0 tx=0).stop 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 -- 172.21.15.151:0/2363209023 shutdown_connections 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 --2- 172.21.15.151:0/2363209023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab4c70 0x55f4f2ab7060 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 -- 172.21.15.151:0/2363209023 >> 172.21.15.151:0/2363209023 conn(0x55f4f2a24240 msgr2=0x55f4f2a24650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 -- 172.21.15.151:0/2363209023 shutdown_connections 2024-09-13T19:08:35.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.888+0000 7f9812294980 1 -- 172.21.15.151:0/2363209023 wait complete. 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.904+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.904+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.904+0000 7f9812294980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4f295c200 con 0x55f4f2ab08f0 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59298/0 (socket says 172.21.15.151:59298) 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 -- 172.21.15.151:0/3708519676 learned_addr learned my addr 172.21.15.151:0/3708519676 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 -- 172.21.15.151:0/3708519676 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2b9c060 con 0x55f4f2ab08f0 2024-09-13T19:08:35.916 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 --2- 172.21.15.151:0/3708519676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9800001dc0 tx=0x7f980000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e47c78b1bdc81f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f96fde0b640 1 -- 172.21.15.151:0/3708519676 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800012020 con 0x55f4f2ab08f0 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f96fde0b640 1 -- 172.21.15.151:0/3708519676 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980000e7c0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f96fde0b640 1 -- 172.21.15.151:0/3708519676 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980000eb40 con 0x55f4f2ab08f0 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- 172.21.15.151:0/3708519676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 msgr2=0x55f4f2b9ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 --2- 172.21.15.151:0/3708519676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9800001dc0 tx=0x7f980000b6d0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- 172.21.15.151:0/3708519676 shutdown_connections 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 --2- 172.21.15.151:0/3708519676 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2b9ba90 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- 172.21.15.151:0/3708519676 >> 172.21.15.151:0/3708519676 conn(0x55f4f2a24240 msgr2=0x55f4f2b976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- 172.21.15.151:0/3708519676 shutdown_connections 2024-09-13T19:08:35.917 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- 172.21.15.151:0/3708519676 wait complete. 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2ba2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f9812294980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4f2ab80b0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2ba2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2ba2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59310/0 (socket says 172.21.15.151:59310) 2024-09-13T19:08:35.918 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.908+0000 7f980fda4640 1 -- 172.21.15.151:0/776021094 learned_addr learned my addr 172.21.15.151:0/776021094 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f980fda4640 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2ba3380 con 0x55f4f2ab08f0 2024-09-13T19:08:35.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f980fda4640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2ba2e40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55f4f2b9cc70 tx=0x7f9800000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.921 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 -- 172.21.15.151:0/776021094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800012030 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 -- 172.21.15.151:0/776021094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800001440 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f2ba3610 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 -- 172.21.15.151:0/776021094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980001aaf0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f2ba62f0 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 -- 172.21.15.151:0/776021094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9800015020 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96f8034650 0x7f96f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f96f7fff640 1 -- 172.21.15.151:0/776021094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9800020030 con 0x55f4f2ab08f0 2024-09-13T19:08:35.922 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f980f5a3640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96f8034650 0x7f96f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2ab4c70 0x55f4f2ba9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2baa470 con 0x55f4f2ab4c70 2024-09-13T19:08:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f98105a5640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2ab4c70 0x55f4f2ba9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.923 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f980f5a3640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96f8034650 0x7f96f8036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f97f80ad000 tx=0x7f97f80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f98105a5640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2ab4c70 0x55f4f2ba9e30 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f98105a5640 1 -- 172.21.15.151:0/776021094 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2ab4c70 2024-09-13T19:08:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2ba7510 con 0x55f4f2ab4c70 2024-09-13T19:08:35.924 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f98105a5640 1 -- 172.21.15.151:0/776021094 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2ab4c70 2024-09-13T19:08:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2bac7a0 0x55f4f2baeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2baf260 con 0x55f4f2bac7a0 2024-09-13T19:08:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.912+0000 7f980fda4640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2bac7a0 0x55f4f2baeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.925 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2bac7a0 0x55f4f2baeb90 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 -- 172.21.15.151:0/776021094 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9800008030 con 0x55f4f2bac7a0 2024-09-13T19:08:35.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bab640 con 0x55f4f2ab4c70 2024-09-13T19:08:35.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f98105a5640 1 -- 172.21.15.151:0/776021094 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2ab4c70 2024-09-13T19:08:35.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f4f2bb06a0 0x55f4f2bb2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.934 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bb3220 con 0x55f4f2bb06a0 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980f5a3640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f4f2bb06a0 0x55f4f2bb2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980f5a3640 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f4f2bb06a0 0x55f4f2bb2a90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980f5a3640 1 -- 172.21.15.151:0/776021094 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f97f80b3040 con 0x55f4f2bb06a0 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f9812294980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4f29b5800 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.935 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59326/0 (socket says 172.21.15.151:59326) 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 -- 172.21.15.151:0/2354236758 learned_addr learned my addr 172.21.15.151:0/2354236758 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 -- 172.21.15.151:0/2354236758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2bc1650 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f980fda4640 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9800048590 tx=0x7f98000300c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.916+0000 7f96f57fa640 1 -- 172.21.15.151:0/2354236758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800016570 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96f57fa640 1 -- 172.21.15.151:0/2354236758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800016710 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f2bc1880 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96f57fa640 1 -- 172.21.15.151:0/2354236758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800018430 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f2bc4500 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96f57fa640 1 -- 172.21.15.151:0/2354236758 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9800009070 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96f57fa640 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 0x7f96e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.936 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96f57fa640 1 -- 172.21.15.151:0/2354236758 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9800037070 con 0x55f4f2bc0cf0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980f5a3640 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 0x7f96e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980f5a3640 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 0x7f96e8036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55f4f2baa970 tx=0x7f97f8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4f2b9c3e0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59340/0 (socket says 172.21.15.151:59340) 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980fda4640 1 -- 172.21.15.151:0/1016846310 learned_addr learned my addr 172.21.15.151:0/1016846310 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980fda4640 1 -- 172.21.15.151:0/1016846310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2bcdfa0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f980fda4640 1 --2- 172.21.15.151:0/1016846310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9800016a90 tx=0x7f9800009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8873ffb5cd642279 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.937 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96eeffd640 1 -- 172.21.15.151:0/1016846310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f980005a070 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96eeffd640 1 -- 172.21.15.151:0/1016846310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800030710 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f96eeffd640 1 -- 172.21.15.151:0/1016846310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98000417e0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.920+0000 7f9812294980 1 -- 172.21.15.151:0/1016846310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 msgr2=0x55f4f2bcd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 --2- 172.21.15.151:0/1016846310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9800016a90 tx=0x7f9800009d40 comp rx=0 tx=0).stop 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1016846310 shutdown_connections 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 --2- 172.21.15.151:0/1016846310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bcd9d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1016846310 >> 172.21.15.151:0/1016846310 conn(0x55f4f2bc99d0 msgr2=0x55f4f2bc7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1016846310 shutdown_connections 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1016846310 wait complete. 2024-09-13T19:08:35.938 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 Processor -- start 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- start start 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f4f2bce440 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980fda4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59348/0 (socket says 172.21.15.151:59348) 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 learned_addr learned my addr 172.21.15.151:0/1409937014 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f2bd4db0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980fda4640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9800026040 tx=0x7f9800008e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 -- 172.21.15.151:0/1409937014 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9800030500 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4f2bd4db0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 -- 172.21.15.151:0/1409937014 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9800024420 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 -- 172.21.15.151:0/1409937014 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98000417e0 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.939 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f2bd5220 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 -- 172.21.15.151:0/1409937014 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9800071060 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96d8034600 0x7f96d8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f96ed7fa640 1 -- 172.21.15.151:0/1409937014 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f980002de00 con 0x55f4f2bcd5f0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.924+0000 7f980f5a3640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96d8034600 0x7f96d8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2bdf940 0x55f4f2be1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be2550 con 0x55f4f2bdf940 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980f5a3640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96d8034600 0x7f96d8036ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97f80acfd0 tx=0x7f97f80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2bdf940 0x55f4f2be1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.940 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2bdf940 0x55f4f2be1e00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.946 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 realm 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be2960 con 0x55f4f2bdf940 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be3230 con 0x55f4f2bdf940 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.947 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2be4330 0x55f4f2be6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be6cf0 con 0x55f4f2be4330 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2be4330 0x55f4f2be6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2be4330 0x55f4f2be6720 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 20 searching for the correct realm 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be85c0 con 0x55f4f2be4330 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f980005f070 0x7f9800055960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be85c0 con 0x7f980005f070 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980f5a3640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f980005f070 0x7f9800055960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980f5a3640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f980005f070 0x7f9800055960 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80ca030 con 0x7f980005f070 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.928+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be85c0 con 0x7f980005f070 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80ca030 con 0x7f980005f070 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be85c0 con 0x55f4f2bdf940 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9808016440 0x7f98080168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.949 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9808016440 0x7f98080168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:35.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9808016440 0x7f98080168a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:35.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.950 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f980005f070 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f97f80ca030 con 0x7f980005f070 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.932+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.951 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f980005f070 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f97f80ca030 con 0x7f980005f070 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.952 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.936+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f980005f070 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80ca030 con 0x7f980005f070 2024-09-13T19:08:35.953 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.954 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f980005f070 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.940+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2be4330 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f9808016440 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be35d0 con 0x7f980005f070 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.961 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be76b0 con 0x55f4f2bdf940 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be7b00 con 0x55f4f2bdf940 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be7f20 con 0x7f980005f070 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 zone default found 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 4 Realm: () 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:35.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 zonegroup default 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be89f0 con 0x7f9808016440 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bea3d0 con 0x55f4f2be4330 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bea7a0 con 0x55f4f2be4330 2024-09-13T19:08:35.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 started sync module instance, tier type = 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.944+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be9870 con 0x7f980005f070 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510532959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be94d0 con 0x7f980005f070 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2beb6d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510532959328] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510532964896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bebaf0 con 0x55f4f2bdf940 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.948+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bec3c0 con 0x55f4f2be4330 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510532964896] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510532966224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bec7b0 con 0x55f4f2be4330 2024-09-13T19:08:35.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bed170 con 0x7f980005f070 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510532971712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2beda10 con 0x7f980005f070 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.952+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bee410 con 0x55f4f2bdf940 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510532966224] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510532971712] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510532967408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bed560 con 0x55f4f2bdf940 2024-09-13T19:08:35.966 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2beece0 con 0x7f9808016440 2024-09-13T19:08:35.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.956+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510532967408] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510532976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bed560 con 0x7f9808016440 2024-09-13T19:08:35.967 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bef1f0 con 0x7f9808016440 2024-09-13T19:08:35.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510532979936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bef660 con 0x7f9808016440 2024-09-13T19:08:35.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bf0120 con 0x7f9808016440 2024-09-13T19:08:35.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.960+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510532976416] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510532979936] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510532983792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bef1b0 con 0x7f9808016440 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=0 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=1 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=2 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=3 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=4 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=5 2024-09-13T19:08:35.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.964+0000 7f9812294980 20 add_watcher() i=6 2024-09-13T19:08:35.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510532983792] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 add_watcher() i=7 2024-09-13T19:08:35.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:35.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bf3220 con 0x55f4f2bdf940 2024-09-13T19:08:35.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510532978736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bf06a0 con 0x55f4f2bdf940 2024-09-13T19:08:35.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510532978736] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f980800a4d0 con 0x55f4f2bdf940 2024-09-13T19:08:35.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f96c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:35.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:35.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 5 note: GC not initialized 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f96c4fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 Filter name: none 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f963e7fc640 20 reqs_thread_entry: start 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 20 rados->read ofs=0 len=0 2024-09-13T19:08:35.977 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.968+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c16670 con 0x7f9808016440 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f980800a4d0 con 0x7f9808016440 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 20 rados_obj.operate() r=0 bl.length=460 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c1cc70 con 0x7f9808016440 2024-09-13T19:08:35.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f980804b040 con 0x7f9808016440 2024-09-13T19:08:35.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:35.980 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94510533166816 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18360 con 0x55f4f2bdf940 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94510532967408 notify 146028888106 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f9808030040 con 0x55f4f2bdf940 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f96eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94510532967408 notifier 4911 bl.length()=649 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f96eeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f96eeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94510533166816 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f980804b040 con 0x55f4f2bdf940 2024-09-13T19:08:35.981 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f96eeffd640 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f96d4003eb0 con 0x55f4f2bdf940 2024-09-13T19:08:35.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== watch-notify(notify_complete (2) cookie 94510533166816 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f980802a900 con 0x55f4f2bdf940 2024-09-13T19:08:35.982 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.972+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x55f4f2bdf940 2024-09-13T19:08:35.982 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:35.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f96c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:35.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510532978736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18b20 con 0x55f4f2bdf940 2024-09-13T19:08:35.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94510532978736] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f980804b040 con 0x55f4f2bdf940 2024-09-13T19:08:35.983 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510532959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18b20 con 0x7f980005f070 2024-09-13T19:08:35.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94510532959328] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f9812294980 20 remove_watcher() i=0 2024-09-13T19:08:35.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f9812294980 2 removed watcher, disabling cache 2024-09-13T19:08:35.985 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.976+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510532964896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18b20 con 0x55f4f2bdf940 2024-09-13T19:08:35.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.980+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94510532964896] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x55f4f2bdf940 2024-09-13T19:08:35.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.980+0000 7f9812294980 20 remove_watcher() i=1 2024-09-13T19:08:35.987 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.980+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510532966224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18b20 con 0x55f4f2be4330 2024-09-13T19:08:35.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f980fda4640 1 -- 172.21.15.151:0/1409937014 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94510532966224] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980005c030 con 0x55f4f2be4330 2024-09-13T19:08:35.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 20 remove_watcher() i=2 2024-09-13T19:08:35.989 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510532971712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2c18b20 con 0x7f980005f070 2024-09-13T19:08:35.991 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f980f5a3640 1 -- 172.21.15.151:0/1409937014 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94510532971712] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97f80e6040 con 0x7f980005f070 2024-09-13T19:08:35.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 20 remove_watcher() i=3 2024-09-13T19:08:35.992 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510532967408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2bee830 con 0x55f4f2bdf940 2024-09-13T19:08:35.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94510532967408] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x55f4f2bdf940 2024-09-13T19:08:35.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 20 remove_watcher() i=4 2024-09-13T19:08:35.993 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.984+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510532976416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2be9c60 con 0x7f9808016440 2024-09-13T19:08:35.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94510532976416] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x7f9808016440 2024-09-13T19:08:35.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f9812294980 20 remove_watcher() i=5 2024-09-13T19:08:35.995 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510532979936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2beb220 con 0x7f9808016440 2024-09-13T19:08:35.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94510532979936] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x7f9808016440 2024-09-13T19:08:35.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f9812294980 20 remove_watcher() i=6 2024-09-13T19:08:35.997 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.988+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510532983792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f4f2beccc0 con 0x7f9808016440 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94510532983792] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f980804b040 con 0x7f9808016440 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 20 remove_watcher() i=7 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9808016440 msgr2=0x7f98080168a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7f9808016440 0x7f98080168a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2bdf940 msgr2=0x55f4f2be1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.003 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2bdf940 0x55f4f2be1e00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f980005f070 msgr2=0x7f9800055960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7f980005f070 0x7f9800055960 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2be4330 msgr2=0x55f4f2be6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2be4330 0x55f4f2be6720 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.004 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96d8034600 msgr2=0x7f96d8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96d8034600 0x7f96d8036ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f97f80acfd0 tx=0x7f97f80a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f98105a5640 1 -- 172.21.15.151:0/1409937014 reap_dead start 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 msgr2=0x55f4f2bd4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9800026040 tx=0x7f9800008e80 comp rx=0 tx=0).stop 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 shutdown_connections 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/1409937014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bcd5f0 0x55f4f2bd4870 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.005 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 >> 172.21.15.151:0/1409937014 conn(0x55f4f2bc99d0 msgr2=0x55f4f2bc7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 shutdown_connections 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/1409937014 wait complete. 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 msgr2=0x7f96e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 0x7f96e8036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55f4f2baa970 tx=0x7f97f8005a10 comp rx=0 tx=0).stop 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 msgr2=0x55f4f2bc1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9800048590 tx=0x7f98000300c0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 shutdown_connections 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96e8034650 0x7f96e8036b10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.006 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/2354236758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2bc0cf0 0x55f4f2bc1110 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 >> 172.21.15.151:0/2354236758 conn(0x55f4f2bb5e40 msgr2=0x55f4f2bb88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 shutdown_connections 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/2354236758 wait complete. 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2ab4c70 msgr2=0x55f4f2ba9e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55f4f2ab4c70 0x55f4f2ba9e30 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f4f2bb06a0 msgr2=0x55f4f2bb2a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55f4f2bb06a0 0x55f4f2bb2a90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2bac7a0 msgr2=0x55f4f2baeb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55f4f2bac7a0 0x55f4f2baeb90 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96f8034650 msgr2=0x7f96f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f96f8034650 0x7f96f8036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f97f80ad000 tx=0x7f97f80a5040 comp rx=0 tx=0).stop 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 msgr2=0x55f4f2ba2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.007 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f9812294980 1 --2- 172.21.15.151:0/776021094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f4f2ab08f0 0x55f4f2ba2e40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x55f4f2b9cc70 tx=0x7f9800000bd0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.992+0000 7f98105a5640 1 -- 172.21.15.151:0/776021094 reap_dead start 2024-09-13T19:08:36.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.996+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 shutdown_connections 2024-09-13T19:08:36.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.996+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 >> 172.21.15.151:0/776021094 conn(0x55f4f2a24240 msgr2=0x55f4f2b96240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.996+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 shutdown_connections 2024-09-13T19:08:36.008 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:35.996+0000 7f9812294980 1 -- 172.21.15.151:0/776021094 wait complete. 2024-09-13T19:08:36.013 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:36.013 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:36.013 ERROR:root:0 2024-09-13T19:08:36.013 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:36.013 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-13T19:08:36.013 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-13T19:08:36.093 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:08:36.093 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:08:36.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e57d7980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55eb08a8ec70 0x55eb08a91060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e57d7980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eb08910ae0 con 0x55eb08a8a8f0 2024-09-13T19:08:36.094 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e57d7980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x55eb08934e30 con 0x55eb08a8ec70 2024-09-13T19:08:36.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e2ae6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55eb08a8ec70 0x55eb08a91060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e2ae6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x55eb08a8ec70 0x55eb08a91060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59350/0 (socket says 172.21.15.151:59350) 2024-09-13T19:08:36.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/421781720 learned_addr learned my addr 172.21.15.151:0/421781720 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e32e7640 1 --1- 172.21.15.151:0/421781720 >> v1:172.21.15.12:6789/0 conn(0x55eb08a8a8f0 0x55eb08a8acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:39898/0 (socket says 172.21.15.151:39898) 2024-09-13T19:08:36.095 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/421781720 >> v1:172.21.15.12:6789/0 conn(0x55eb08a8a8f0 legacy=0x55eb08a8acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.096 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.088+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/421781720 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08a925b0 con 0x55eb08a8ec70 2024-09-13T19:08:36.097 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/421781720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8ec70 0x55eb08a91060 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00a5c0 tx=0x7ff2cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d817a0e20e2b9579 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e22e5640 1 -- 172.21.15.151:0/421781720 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc0a6070 con 0x55eb08a8ec70 2024-09-13T19:08:36.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e22e5640 1 -- 172.21.15.151:0/421781720 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc0af070 con 0x55eb08a8ec70 2024-09-13T19:08:36.098 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e22e5640 1 -- 172.21.15.151:0/421781720 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2cc0aa5c0 con 0x55eb08a8ec70 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 -- 172.21.15.151:0/421781720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8ec70 msgr2=0x55eb08a91060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/421781720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8ec70 0x55eb08a91060 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00a5c0 tx=0x7ff2cc01b340 comp rx=0 tx=0).stop 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 -- 172.21.15.151:0/421781720 shutdown_connections 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/421781720 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8ec70 0x55eb08a91060 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 -- 172.21.15.151:0/421781720 >> 172.21.15.151:0/421781720 conn(0x55eb089fe240 msgr2=0x55eb089fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 -- 172.21.15.151:0/421781720 shutdown_connections 2024-09-13T19:08:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.096+0000 7ff2e57d7980 1 -- 172.21.15.151:0/421781720 wait complete. 2024-09-13T19:08:36.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.114 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb08936200 con 0x55eb08a8a8f0 2024-09-13T19:08:36.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59356/0 (socket says 172.21.15.151:59356) 2024-09-13T19:08:36.115 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3513556823 learned_addr learned my addr 172.21.15.151:0/3513556823 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.119 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3513556823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08b76270 con 0x55eb08a8a8f0 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/3513556823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001690 tx=0x7ff2d4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec12fc87f4e3a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff1d160a640 1 -- 172.21.15.151:0/3513556823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4003460 con 0x55eb08a8a8f0 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff1d160a640 1 -- 172.21.15.151:0/3513556823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4003600 con 0x55eb08a8a8f0 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff1d160a640 1 -- 172.21.15.151:0/3513556823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4003920 con 0x55eb08a8a8f0 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3513556823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 msgr2=0x55eb08b75ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3513556823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001690 tx=0x7ff2d4001b50 comp rx=0 tx=0).stop 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3513556823 shutdown_connections 2024-09-13T19:08:36.120 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3513556823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b75ca0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3513556823 >> 172.21.15.151:0/3513556823 conn(0x55eb089fe240 msgr2=0x55eb08b718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3513556823 shutdown_connections 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3513556823 wait complete. 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.108+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b7cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb08a920b0 con 0x55eb08a8a8f0 2024-09-13T19:08:36.121 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b7cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b7cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59370/0 (socket says 172.21.15.151:59370) 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e32e7640 1 -- 172.21.15.151:0/2681411993 learned_addr learned my addr 172.21.15.151:0/2681411993 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e32e7640 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08b7d4f0 con 0x55eb08a8a8f0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b7cfb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001360 tx=0x7ff2d4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 -- 172.21.15.151:0/2681411993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4022020 con 0x55eb08a8a8f0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 -- 172.21.15.151:0/2681411993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4006840 con 0x55eb08a8a8f0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb08b7d780 con 0x55eb08a8a8f0 2024-09-13T19:08:36.122 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 -- 172.21.15.151:0/2681411993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d401e800 con 0x55eb08a8a8f0 2024-09-13T19:08:36.123 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb08b80460 con 0x55eb08a8a8f0 2024-09-13T19:08:36.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 -- 172.21.15.151:0/2681411993 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d4025020 con 0x55eb08a8a8f0 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1c8034650 0x7ff1c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff1cfe07640 1 -- 172.21.15.151:0/2681411993 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff2d4049bb0 con 0x55eb08a8a8f0 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1c8034650 0x7ff1c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08a8ec70 0x55eb08b840b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08b845f0 con 0x55eb08a8ec70 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.112+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08a8ec70 0x55eb08b840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1c8034650 0x7ff1c8036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0ae000 tx=0x7ff2cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08a8ec70 0x55eb08b840b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/2681411993 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08a8ec70 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08b81680 con 0x55eb08a8ec70 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/2681411993 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08a8ec70 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08b86940 0x55eb08b88d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08b89400 con 0x55eb08b86940 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08b86940 0x55eb08b88d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08b86940 0x55eb08b88d30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e32e7640 1 -- 172.21.15.151:0/2681411993 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff2d401b040 con 0x55eb08b86940 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08b857b0 con 0x55eb08a8ec70 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/2681411993 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08a8ec70 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55eb08b8a860 0x55eb08b8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08b8d340 con 0x55eb08b8a860 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55eb08b8a860 0x55eb08b8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55eb08b8a860 0x55eb08b8cc50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/2681411993 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff2cc0aab50 con 0x55eb08b8a860 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.116+0000 7ff2e57d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb0898f800 con 0x55eb08b9adf0 2024-09-13T19:08:36.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59386/0 (socket says 172.21.15.151:59386) 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 -- 172.21.15.151:0/2855974303 learned_addr learned my addr 172.21.15.151:0/2855974303 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 -- 172.21.15.151:0/2855974303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08b9b750 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4047f30 tx=0x7ff2d4010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 -- 172.21.15.151:0/2855974303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4026860 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 -- 172.21.15.151:0/2855974303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4026a00 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb08b9b980 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 -- 172.21.15.151:0/2855974303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d401d530 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb08b9e600 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 -- 172.21.15.151:0/2855974303 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d4028900 con 0x55eb08b9adf0 2024-09-13T19:08:36.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 0x7ff1bc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff1cd602640 1 -- 172.21.15.151:0/2855974303 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff2d4037070 con 0x55eb08b9adf0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 0x7ff1bc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 0x7ff1bc036b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55eb08b84ef0 tx=0x7ff2cc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e57d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb08b76590 con 0x55eb08ba76d0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.120+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59392/0 (socket says 172.21.15.151:59392) 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 -- 172.21.15.151:0/1999637571 learned_addr learned my addr 172.21.15.151:0/1999637571 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 -- 172.21.15.151:0/1999637571 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08ba8080 con 0x55eb08ba76d0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/1999637571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4026bd0 tx=0x7ff2d40465b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207b8e9b1db12e6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c6ffd640 1 -- 172.21.15.151:0/1999637571 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4059070 con 0x55eb08ba76d0 2024-09-13T19:08:36.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c6ffd640 1 -- 172.21.15.151:0/1999637571 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d4030de0 con 0x55eb08ba76d0 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c6ffd640 1 -- 172.21.15.151:0/1999637571 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d401d6d0 con 0x55eb08ba76d0 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/1999637571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 msgr2=0x55eb08ba7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/1999637571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4026bd0 tx=0x7ff2d40465b0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/1999637571 shutdown_connections 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/1999637571 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08ba7ab0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/1999637571 >> 172.21.15.151:0/1999637571 conn(0x55eb08ba3ab0 msgr2=0x55eb08ba1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/1999637571 shutdown_connections 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/1999637571 wait complete. 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 Processor -- start 2024-09-13T19:08:36.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- start start 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eb08ba8520 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:59406/0 (socket says 172.21.15.151:59406) 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 learned_addr learned my addr 172.21.15.151:0/3334388006 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb08baede0 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4003e30 tx=0x7ff2d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c57fa640 1 -- 172.21.15.151:0/3334388006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d40103a0 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c57fa640 1 -- 172.21.15.151:0/3334388006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d401d6d0 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eb08baede0 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff1c57fa640 1 -- 172.21.15.151:0/3334388006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2d4049510 con 0x55eb08ba76d0 2024-09-13T19:08:36.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.124+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb08baede0 con 0x55eb08ba76d0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff1c57fa640 1 -- 172.21.15.151:0/3334388006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff2d40307e0 con 0x55eb08ba76d0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff1c57fa640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1ac034650 0x7ff1ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff1c57fa640 1 -- 172.21.15.151:0/3334388006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff2d4063030 con 0x55eb08ba76d0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1ac034650 0x7ff1ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08bb9900 0x55eb08bbbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbc510 con 0x55eb08bb9900 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08bb9900 0x55eb08bbbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1ac034650 0x7ff1ac036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc01b380 tx=0x7ff2cc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08bb9900 0x55eb08bbbdc0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.149 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 realm 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbc920 con 0x55eb08bb9900 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd1f0 con 0x55eb08bb9900 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.150 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08bbe2f0 0x55eb08bc06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc0d30 con 0x55eb08bbe2f0 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08bbe2f0 0x55eb08bc06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.128+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08bbe2f0 0x55eb08bc06e0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e57d7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e57d7980 20 searching for the correct realm 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc2590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e32e7640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff2d403a020 0x7ff2d4055450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc2590 con 0x7ff2d403a020 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff2d403a020 0x7ff2d4055450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff2d403a020 0x7ff2d4055450 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc0aab50 con 0x7ff2d403a020 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc2590 con 0x7ff2d403a020 2024-09-13T19:08:36.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc0aab50 con 0x7ff2d403a020 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc2590 con 0x55eb08bb9900 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff2dc018410 0x7ff2dc018890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff2dc018410 0x7ff2dc018890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff2dc018410 0x7ff2dc018890 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x7ff2dc018410 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.132+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x7ff2dc018410 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2d403a020 2024-09-13T19:08:36.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff2cc0aab50 con 0x7ff2d403a020 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x7ff2dc018410 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2d403a020 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff2cc0aab50 con 0x7ff2d403a020 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.136+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x7ff2dc018410 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x7ff2dc018410 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2d403a020 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc0aab50 con 0x7ff2d403a020 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc0083f0 con 0x55eb08bb9900 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.156 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.140+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2d403a020 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bbe2f0 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x7ff2dc018410 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bbd590 con 0x55eb08bb9900 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff2dc03b040 con 0x7ff2d403a020 2024-09-13T19:08:36.162 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc1580 con 0x55eb08bb9900 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc1920 con 0x55eb08bb9900 2024-09-13T19:08:36.163 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc1920 con 0x7ff2d403a020 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 zone default found 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 4 Realm: () 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 zonegroup default 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.164 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.144+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc21f0 con 0x7ff2dc018410 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc21f0 con 0x55eb08bbe2f0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc4490 con 0x55eb08bbe2f0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 started sync module instance, tier type = 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:08:36.165 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc3840 con 0x7ff2d403a020 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94467952229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc34a0 con 0x7ff2d403a020 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc52b0 con 0x55eb08bb9900 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.148+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94467952229424] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94467952232688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc56a0 con 0x55eb08bb9900 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc6060 con 0x55eb08bbe2f0 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94467952232688] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94467952237488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc6450 con 0x55eb08bbe2f0 2024-09-13T19:08:36.166 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.152+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc6e10 con 0x7ff2d403a020 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94467952243120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc7a80 con 0x7ff2d403a020 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc8440 con 0x55eb08bb9900 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94467952237488] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94467952243120] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94467952246672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc7a80 con 0x55eb08bb9900 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.156+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc83b0 con 0x7ff2dc018410 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.160+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94467952246672] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.160+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.168 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.160+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94467952244176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc79f0 con 0x7ff2dc018410 2024-09-13T19:08:36.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.160+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc9300 con 0x7ff2dc018410 2024-09-13T19:08:36.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.160+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94467952244176] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.169 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94467952248880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc9300 con 0x7ff2dc018410 2024-09-13T19:08:36.170 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc9cc0 con 0x7ff2dc018410 2024-09-13T19:08:36.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94467952248880] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94467952250928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc9cc0 con 0x7ff2dc018410 2024-09-13T19:08:36.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=0 2024-09-13T19:08:36.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=1 2024-09-13T19:08:36.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=2 2024-09-13T19:08:36.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=3 2024-09-13T19:08:36.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=4 2024-09-13T19:08:36.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=5 2024-09-13T19:08:36.173 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.164+0000 7ff2e57d7980 20 add_watcher() i=6 2024-09-13T19:08:36.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94467952250928] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 add_watcher() i=7 2024-09-13T19:08:36.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 2 all 8 watchers are set, enabling cache 2024-09-13T19:08:36.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bccff0 con 0x55eb08bb9900 2024-09-13T19:08:36.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94467952265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc9e30 con 0x55eb08bb9900 2024-09-13T19:08:36.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94467952265760] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x55eb08bb9900 2024-09-13T19:08:36.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:36.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:08:36.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:08:36.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 5 note: GC not initialized 2024-09-13T19:08:36.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff198fe1640 20 reqs_thread_entry: start 2024-09-13T19:08:36.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 init_complete bucket index max shards: 11 2024-09-13T19:08:36.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 Filter name: none 2024-09-13T19:08:36.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff1127fc640 20 reqs_thread_entry: start 2024-09-13T19:08:36.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-13T19:08:36.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 20 rados->read ofs=0 len=0 2024-09-13T19:08:36.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.168+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf0790 con 0x7ff2dc018410 2024-09-13T19:08:36.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 20 rados_obj.operate() r=0 bl.length=473 2024-09-13T19:08:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-13T19:08:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-13T19:08:36.179 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf7020 con 0x7ff2dc018410 2024-09-13T19:08:36.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff2dc036040 con 0x7ff2dc018410 2024-09-13T19:08:36.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:36.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-13T19:08:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94467952437904 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf2750 con 0x55eb08bb9900 2024-09-13T19:08:36.181 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== watch-notify(notify (1) cookie 94467952246672 notify 146028888107 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7ff2dc010040 con 0x55eb08bb9900 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(64 notify.4 [notify cookie 94467952437904 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff2dc03e020 con 0x55eb08bb9900 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff1c6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94467952246672 notifier 4918 bl.length()=649 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff1c6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff1c6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.172+0000 7ff1c6ffd640 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff1a8003eb0 con 0x55eb08bb9900 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x55eb08bb9900 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== watch-notify(notify_complete (2) cookie 94467952437904 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff2dc007700 con 0x55eb08bb9900 2024-09-13T19:08:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-13T19:08:32.560021Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-13T19:08:32.559998Z","tags":[],"group_ids":[]} 2024-09-13T19:08:36.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff199fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:08:36.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94467952265760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf6330 con 0x55eb08bb9900 2024-09-13T19:08:36.183 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94467952265760] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x55eb08bb9900 2024-09-13T19:08:36.184 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94467952229424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf6330 con 0x7ff2d403a020 2024-09-13T19:08:36.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94467952229424] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e57d7980 20 remove_watcher() i=0 2024-09-13T19:08:36.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e57d7980 2 removed watcher, disabling cache 2024-09-13T19:08:36.185 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.176+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94467952232688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf6330 con 0x55eb08bb9900 2024-09-13T19:08:36.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.180+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94467952232688] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x55eb08bb9900 2024-09-13T19:08:36.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.180+0000 7ff2e57d7980 20 remove_watcher() i=1 2024-09-13T19:08:36.187 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.180+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94467952237488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf6330 con 0x55eb08bbe2f0 2024-09-13T19:08:36.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e32e7640 1 -- 172.21.15.151:0/3334388006 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94467952237488] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2d4066070 con 0x55eb08bbe2f0 2024-09-13T19:08:36.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e57d7980 20 remove_watcher() i=2 2024-09-13T19:08:36.190 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94467952243120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bf6330 con 0x7ff2d403a020 2024-09-13T19:08:36.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e2ae6640 1 -- 172.21.15.151:0/3334388006 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94467952243120] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2cc0e7040 con 0x7ff2d403a020 2024-09-13T19:08:36.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e57d7980 20 remove_watcher() i=3 2024-09-13T19:08:36.191 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.184+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94467952246672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc3c30 con 0x55eb08bb9900 2024-09-13T19:08:36.193 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94467952246672] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x55eb08bb9900 2024-09-13T19:08:36.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e57d7980 20 remove_watcher() i=4 2024-09-13T19:08:36.194 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94467952244176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc48f0 con 0x7ff2dc018410 2024-09-13T19:08:36.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94467952244176] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x7ff2dc018410 2024-09-13T19:08:36.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e57d7980 20 remove_watcher() i=5 2024-09-13T19:08:36.196 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.188+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94467952248880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc7f90 con 0x7ff2dc018410 2024-09-13T19:08:36.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94467952248880] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x7ff2dc018410 2024-09-13T19:08:36.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 20 remove_watcher() i=6 2024-09-13T19:08:36.198 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94467952250928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55eb08bc3c30 con 0x7ff2dc018410 2024-09-13T19:08:36.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94467952250928] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff2dc03e020 con 0x7ff2dc018410 2024-09-13T19:08:36.200 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 20 remove_watcher() i=7 2024-09-13T19:08:36.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff2dc018410 msgr2=0x7ff2dc018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7ff2dc018410 0x7ff2dc018890 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.202 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08bb9900 msgr2=0x55eb08bbbdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08bb9900 0x55eb08bbbdc0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff2d403a020 msgr2=0x7ff2d4055450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7ff2d403a020 0x7ff2d4055450 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08bbe2f0 msgr2=0x55eb08bc06e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08bbe2f0 0x55eb08bc06e0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1ac034650 msgr2=0x7ff1ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1ac034650 0x7ff1ac036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc01b380 tx=0x7ff2cc0c1040 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 msgr2=0x55eb08bae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/3334388006 reap_dead start 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4003e30 tx=0x7ff2d4009f90 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 shutdown_connections 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/3334388006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08ba76d0 0x55eb08bae8a0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.203 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 >> 172.21.15.151:0/3334388006 conn(0x55eb08ba3ab0 msgr2=0x55eb08ba1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 shutdown_connections 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.192+0000 7ff2e57d7980 1 -- 172.21.15.151:0/3334388006 wait complete. 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 msgr2=0x7ff1bc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 0x7ff1bc036b60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55eb08b84ef0 tx=0x7ff2cc005ad0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 msgr2=0x55eb08b9b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4047f30 tx=0x7ff2d4010f90 comp rx=0 tx=0).stop 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 shutdown_connections 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1bc0346a0 0x7ff1bc036b60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2855974303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08b9adf0 0x55eb08b9b210 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 >> 172.21.15.151:0/2855974303 conn(0x55eb08b8ff40 msgr2=0x55eb08b929c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 shutdown_connections 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2855974303 wait complete. 2024-09-13T19:08:36.204 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08a8ec70 msgr2=0x55eb08b840b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x55eb08a8ec70 0x55eb08b840b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55eb08b8a860 msgr2=0x55eb08b8cc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x55eb08b8a860 0x55eb08b8cc50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08b86940 msgr2=0x55eb08b88d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x55eb08b86940 0x55eb08b88d30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1c8034650 msgr2=0x7ff1c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7ff1c8034650 0x7ff1c8036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc0ae000 tx=0x7ff2cc0a6000 comp rx=0 tx=0).stop 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 msgr2=0x55eb08b7cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 --2- 172.21.15.151:0/2681411993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eb08a8a8f0 0x55eb08b7cfb0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4001360 tx=0x7ff2d4001260 comp rx=0 tx=0).stop 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e3ae8640 1 -- 172.21.15.151:0/2681411993 reap_dead start 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 shutdown_connections 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 >> 172.21.15.151:0/2681411993 conn(0x55eb089fe240 msgr2=0x55eb08b70450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 shutdown_connections 2024-09-13T19:08:36.205 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:08:36.196+0000 7ff2e57d7980 1 -- 172.21.15.151:0/2681411993 wait complete. 2024-09-13T19:08:36.213 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:36.213 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-13T19:08:32.560021Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-13T19:08:32.559998Z', 'tags': [], 'group_ids': []} 2024-09-13T19:08:36.213 ERROR:root:0 2024-09-13T19:08:36.214 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:08:36.232 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.232 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.245 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.245 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:08:36.262 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.263 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.278 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.278 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-13T19:08:36.303 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-13T19:08:36.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.317 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-13T19:08:36.341 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.342 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.355 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-13T19:08:36.378 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-13T19:08:36.378 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.391 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.392 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-13T19:08:36.417 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-13T19:08:36.417 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.430 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-13T19:08:36.455 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.455 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.469 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-13T19:08:36.488 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.488 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.502 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-13T19:08:36.525 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.539 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.554 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:08:36.555 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:08:36.570 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:08:36.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-13T19:08:36.622 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-13T19:08:36.622 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:08:36.638 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:08:36.593866Z', 'creation_time': '2024-09-13T19:08:36.586464Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:08:36.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-13T19:08:36.655 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:08:36.593866Z', 'creation_time': '2024-09-13T19:08:36.586464Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-13T19:08:36.666 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:08:36.682 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:08:36.593866Z', 'creation_time': '2024-09-13T19:08:36.586464Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:08:36.683 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-13T19:08:36.699 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000e67a39d92af28245-0066e48db4-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:08:36.710 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-13T19:08:36.734 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.735 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-13T19:08:36.765 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:08:36.787 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11'} 2024-09-13T19:08:36.818 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.866 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11'} 2024-09-13T19:08:36.897 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-13T19:08:36.929 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.957 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-13T19:08:36.986 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:08:36.986 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-13T19:08:37.007 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': 'ef9ca8b0-9ae4-481e-ba9d-bc0942310d85', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'marker': '56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-13T19:08:36.882841Z', 'creation_time': '2024-09-13T19:08:36.586464Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-13T19:09:37.132 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-13T19:09:37.187 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-13T19:09:37.188 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-13T19:09:37.224 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-13T19:09:37.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:09:37.238 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-13T19:09:37.239 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-13T19:09:37.252 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-13T19:09:37.252 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-13T19:09:37.266 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-13T19:09:37.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-13T19:09:37.281 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-13T19:09:37.281 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-13T19:09:37.294 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-13T19:00:00.000000Z', 'epoch': 1726254000, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-13T19:09:37.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-13T19:09:37.313 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:37.313 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-13T19:09:37.327 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-13T19:09:37.327 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-13T19:09:37.351 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:09:37.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-13T19:09:37.387 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:09:37.799 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:09:37.814 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000065cd7706114e2a66-0066e48df1-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:37.992 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:09:38.007 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:09:38.018 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-13T19:09:38.032 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-13T19:09:38.181 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-13T19:09:38.285 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:38.285 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:09:38.302 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-13T19:09:38.303 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-13T19:09:38.322 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-13T19:09:38.349 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-13T19:09:38.364 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000001df6099290055de0-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.415 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-13T19:09:38.502 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:38.502 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-13T19:09:38.516 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ca2b510b9b01afaf-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.517 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-13T19:09:38.529 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '0ec6a80a-19c9-443d-b0bf-f69600ef4862'}]}} 2024-09-13T19:09:38.529 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-13T19:09:38.562 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-13T19:09:38.562 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:09:38.574 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:09:38.575 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-13T19:09:38.589 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000003f3f13168f010dd2-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.589 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-13T19:09:38.602 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000eaa48c0d873f2738-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.628 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:09:38.642 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:09:38.643 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-13T19:09:38.656 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e0841e4701b2cdf4-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.656 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-13T19:09:38.669 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003e0aae1c662facac-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-13T19:09:38.682 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-13T19:09:38.683 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-13T19:09:38.695 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000185502b988f810ba-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-13T19:09:38.708 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000594e5c1be9ca564b-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-13T19:09:38.721 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000d73d9520bb206bcf-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-13T19:09:38.735 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000cc564c7fba1abd70-0066e48df2-4225-default', 'HostId': '4225-default-default'} 2024-09-13T19:09:38.735 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-13T19:09:38.765 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:38.766 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-13T19:09:38.779 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-13T19:09:38.779 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-13T19:09:38.798 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:38.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-13T19:09:38.811 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-13T19:09:38.812 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-13T19:09:38.830 INFO:tasks.radosgw_admin_rest: empty result 2024-09-13T19:09:38.835 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-13T19:09:38.845 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-13T19:09:38.846 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:09:38.847 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-13T19:09:38.843+0000 7f2a58b57640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29504) UID: 0 2024-09-13T19:09:38.847 INFO:tasks.rgw.client.0.smithi151.stdout:2024-09-13T19:09:38.843+0000 7f2a5c39fa40 -1 shutting down 2024-09-13T19:10:03.252 INFO:tasks.rgw.client.0:Stopped 2024-09-13T19:10:03.253 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-13T19:10:03.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/vault-root-token 2024-09-13T19:10:03.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-13T19:10:03.378 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-13T19:10:03.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-13T19:10:03.379 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-13T19:10:03.457 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setuser ceph since I am not root 2024-09-13T19:10:03.457 INFO:teuthology.orchestra.run.smithi151.stderr:ignoring --setgroup ceph since I am not root 2024-09-13T19:10:03.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba5a65980 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564cf8e998e0 0x564cf8e99cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.458 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba5a65980 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564cf8d1fae0 con 0x564cf8e9a230 2024-09-13T19:10:03.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba5a65980 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x564cf8d43e30 con 0x564cf8e998e0 2024-09-13T19:10:03.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564cf8e998e0 0x564cf8e99cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x564cf8e998e0 0x564cf8e99cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55250/0 (socket says 172.21.15.151:55250) 2024-09-13T19:10:03.459 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba2d74640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x564cf8e9a230 0x564cf8e9ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.151:59274/0 (socket says 172.21.15.151:59274) 2024-09-13T19:10:03.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 -- 172.21.15.151:0/2043111063 learned_addr learned my addr 172.21.15.151:0/2043111063 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 -- 172.21.15.151:0/2043111063 >> v1:172.21.15.12:6789/0 conn(0x564cf8e9a230 legacy=0x564cf8e9ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.460 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 -- 172.21.15.151:0/2043111063 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8ea14b0 con 0x564cf8e998e0 2024-09-13T19:10:03.461 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.454+0000 7feba3575640 1 --2- 172.21.15.151:0/2043111063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8e99cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7feb9400a5c0 tx=0x7feb9401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c75e726ef8af53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba2573640 1 -- 172.21.15.151:0/2043111063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940a6070 con 0x564cf8e998e0 2024-09-13T19:10:03.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba2573640 1 -- 172.21.15.151:0/2043111063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940af070 con 0x564cf8e998e0 2024-09-13T19:10:03.462 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba2573640 1 -- 172.21.15.151:0/2043111063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940aa5c0 con 0x564cf8e998e0 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 -- 172.21.15.151:0/2043111063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 msgr2=0x564cf8e99cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 --2- 172.21.15.151:0/2043111063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8e99cc0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7feb9400a5c0 tx=0x7feb9401b340 comp rx=0 tx=0).stop 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 -- 172.21.15.151:0/2043111063 shutdown_connections 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 --2- 172.21.15.151:0/2043111063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8e99cc0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 -- 172.21.15.151:0/2043111063 >> 172.21.15.151:0/2043111063 conn(0x564cf8e0d230 msgr2=0x564cf8e0d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 -- 172.21.15.151:0/2043111063 shutdown_connections 2024-09-13T19:10:03.463 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.458+0000 7feba5a65980 1 -- 172.21.15.151:0/2043111063 wait complete. 2024-09-13T19:10:03.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.479 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564cf8d45200 con 0x564cf8e998e0 2024-09-13T19:10:03.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55260/0 (socket says 172.21.15.151:55260) 2024-09-13T19:10:03.480 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba3575640 1 -- 172.21.15.151:0/987579030 learned_addr learned my addr 172.21.15.151:0/987579030 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba3575640 1 -- 172.21.15.151:0/987579030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8f851a0 con 0x564cf8e998e0 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba3575640 1 --2- 172.21.15.151:0/987579030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb940199f0 tx=0x7feb94003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376f37696f81bd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7fea90618640 1 -- 172.21.15.151:0/987579030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940aaa00 con 0x564cf8e998e0 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7fea90618640 1 -- 172.21.15.151:0/987579030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940aaba0 con 0x564cf8e998e0 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7fea90618640 1 -- 172.21.15.151:0/987579030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940bd3f0 con 0x564cf8e998e0 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- 172.21.15.151:0/987579030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 msgr2=0x564cf8f84bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 --2- 172.21.15.151:0/987579030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7feb940199f0 tx=0x7feb94003030 comp rx=0 tx=0).stop 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- 172.21.15.151:0/987579030 shutdown_connections 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 --2- 172.21.15.151:0/987579030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f84bd0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.482 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- 172.21.15.151:0/987579030 >> 172.21.15.151:0/987579030 conn(0x564cf8e0d230 msgr2=0x564cf8f80800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- 172.21.15.151:0/987579030 shutdown_connections 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 -- 172.21.15.151:0/987579030 wait complete. 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.474+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f8be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.483 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564cf8ea0ef0 con 0x564cf8e998e0 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f8be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f8be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55268/0 (socket says 172.21.15.151:55268) 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3575640 1 -- 172.21.15.151:0/1861806338 learned_addr learned my addr 172.21.15.151:0/1861806338 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3575640 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8f8c360 con 0x564cf8e998e0 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3575640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f8be20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb940199f0 tx=0x7feb940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 -- 172.21.15.151:0/1861806338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940bd7c0 con 0x564cf8e998e0 2024-09-13T19:10:03.484 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 -- 172.21.15.151:0/1861806338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940bd960 con 0x564cf8e998e0 2024-09-13T19:10:03.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cf8f8c5f0 con 0x564cf8e998e0 2024-09-13T19:10:03.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 -- 172.21.15.151:0/1861806338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940bdc40 con 0x564cf8e998e0 2024-09-13T19:10:03.485 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf8f8f2d0 con 0x564cf8e998e0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 -- 172.21.15.151:0/1861806338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb940ce020 con 0x564cf8e998e0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea88034650 0x7fea88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7fea8ee15640 1 -- 172.21.15.151:0/1861806338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feb940cc020 con 0x564cf8e998e0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba2d74640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea88034650 0x7fea88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8e9a230 0x564cf8f92df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8f93460 con 0x564cf8e9a230 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.478+0000 7feba3d76640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8e9a230 0x564cf8f92df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba2d74640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea88034650 0x7fea88036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feb8c001e50 tx=0x7feb8c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.486 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3d76640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8e9a230 0x564cf8f92df0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3d76640 1 -- 172.21.15.151:0/1861806338 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8e9a230 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8f93d00 con 0x564cf8e9a230 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3d76640 1 -- 172.21.15.151:0/1861806338 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8e9a230 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8f95610 0x564cf8f97ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:3 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8f98260 con 0x564cf8f95610 2024-09-13T19:10:03.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8f95610 0x564cf8f97ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8f95610 0x564cf8f97ad0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 -- 172.21.15.151:0/1861806338 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(3 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feb94002030 con 0x564cf8f95610 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8f94550 con 0x564cf8e9a230 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3d76640 1 -- 172.21.15.151:0/1861806338 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8e9a230 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564cf8f996c0 0x564cf8f9bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:5 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8f9c1a0 con 0x564cf8f996c0 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba2d74640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564cf8f996c0 0x564cf8f9bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.489 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba2d74640 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564cf8f996c0 0x564cf8f9bab0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba2d74640 1 -- 172.21.15.151:0/1861806338 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(5 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feb8c00f700 con 0x564cf8f996c0 2024-09-13T19:10:03.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.490 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba5a65980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564cf8d9e800 con 0x564cf8fa9c70 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55276/0 (socket says 172.21.15.151:55276) 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.482+0000 7feba3575640 1 -- 172.21.15.151:0/2814858053 learned_addr learned my addr 172.21.15.151:0/2814858053 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba3575640 1 -- 172.21.15.151:0/2814858053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8faa5d0 con 0x564cf8fa9c70 2024-09-13T19:10:03.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba3575640 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7feb9401b380 tx=0x7feb940c5e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 -- 172.21.15.151:0/2814858053 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940c6480 con 0x564cf8fa9c70 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 -- 172.21.15.151:0/2814858053 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940c6620 con 0x564cf8fa9c70 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cf8faa860 con 0x564cf8fa9c70 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 -- 172.21.15.151:0/2814858053 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940c6940 con 0x564cf8fa9c70 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf8fad4e0 con 0x564cf8fa9c70 2024-09-13T19:10:03.492 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 -- 172.21.15.151:0/2814858053 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb940e3130 con 0x564cf8fa9c70 2024-09-13T19:10:03.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 0x7fea7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.493 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7fea87fff640 1 -- 172.21.15.151:0/2814858053 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feb940eed10 con 0x564cf8fa9c70 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba2d74640 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 0x7fea7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba2d74640 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 0x7fea7c036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x564cf8f90530 tx=0x7feb8c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba5a65980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564cf8f85460 con 0x564cf8fb6600 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55278/0 (socket says 172.21.15.151:55278) 2024-09-13T19:10:03.494 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.486+0000 7feba3575640 1 -- 172.21.15.151:0/12682397 learned_addr learned my addr 172.21.15.151:0/12682397 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 -- 172.21.15.151:0/12682397 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8fb6fd0 con 0x564cf8fb6600 2024-09-13T19:10:03.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 --2- 172.21.15.151:0/12682397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7feb940c5a70 tx=0x7feb940bc5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24b82c70dc35cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea85ffb640 1 -- 172.21.15.151:0/12682397 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940f2070 con 0x564cf8fb6600 2024-09-13T19:10:03.495 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea85ffb640 1 -- 172.21.15.151:0/12682397 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb940c54d0 con 0x564cf8fb6600 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea85ffb640 1 -- 172.21.15.151:0/12682397 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940e3420 con 0x564cf8fb6600 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/12682397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 msgr2=0x564cf8fb6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 --2- 172.21.15.151:0/12682397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7feb940c5a70 tx=0x7feb940bc5e0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/12682397 shutdown_connections 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 --2- 172.21.15.151:0/12682397 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fb6a00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/12682397 >> 172.21.15.151:0/12682397 conn(0x564cf8fb2990 msgr2=0x564cf8fb0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/12682397 shutdown_connections 2024-09-13T19:10:03.496 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/12682397 wait complete. 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 Processor -- start 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- start start 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fbd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564cf8fb7520 con 0x564cf8fb6600 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fbd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fbd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.151:55280/0 (socket says 172.21.15.151:55280) 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 learned_addr learned my addr 172.21.15.151:0/295833894 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cf8fbdd60 con 0x564cf8fb6600 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba3575640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fbd820 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feb940d2ff0 tx=0x7feb940aeef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea73fff640 1 -- 172.21.15.151:0/295833894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb94004d20 con 0x564cf8fb6600 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cf8fbdd60 con 0x564cf8fb6600 2024-09-13T19:10:03.498 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea73fff640 1 -- 172.21.15.151:0/295833894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb94004ec0 con 0x564cf8fb6600 2024-09-13T19:10:03.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7fea73fff640 1 -- 172.21.15.151:0/295833894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb940e59e0 con 0x564cf8fb6600 2024-09-13T19:10:03.499 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.490+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cf8fbdd60 con 0x564cf8fb6600 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7fea73fff640 1 -- 172.21.15.151:0/295833894 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb940e5ba0 con 0x564cf8fb6600 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7fea73fff640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea6c034650 0x7fea6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7fea73fff640 1 -- 172.21.15.151:0/295833894 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7feb941117b0 con 0x564cf8fb6600 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba2d74640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea6c034650 0x7fea6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8fc8640 0x564cf8fcab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcb250 con 0x564cf8fc8640 2024-09-13T19:10:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8fc8640 0x564cf8fcab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba2d74640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea6c034650 0x7fea6c036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x564cf8f9c5a0 tx=0x7feb8c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.501 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8fc8640 0x564cf8fcab00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 realm 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcb660 con 0x564cf8fc8640 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcbf30 con 0x564cf8fc8640 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8fcd030 0x564cf8fcf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:5 5.7 5:e50e4354:::zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcfa30 con 0x564cf8fcd030 2024-09-13T19:10:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.494+0000 7feba3575640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8fcd030 0x564cf8fcf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3575640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8fcd030 0x564cf8fcf420 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== osd_op_reply(5 zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba5a65980 20 rados_obj.operate() r=0 bl.length=993 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba5a65980 20 searching for the correct realm 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd1300 con 0x564cf8fcd030 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3575640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7feb94009040 0x7feb940c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd1300 con 0x7feb94009040 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7feb94009040 0x7feb940c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7feb94009040 0x7feb940c7590 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd1300 con 0x7feb94009040 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd1300 con 0x564cf8fc8640 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7feb9c016440 0x7feb9c0168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7feb9c016440 0x7feb9c0168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.498+0000 7feba3d76640 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7feb9c016440 0x7feb9c0168a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.508 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb94009040 2024-09-13T19:10:03.509 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 3 ==== osd_op_reply(13 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 3 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 3 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb94009040 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 4 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.511 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.502+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 4 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.512 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 7 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 9 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 10 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.513 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 5 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 8 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb94009040 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 5 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 11 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.506+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 6 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.522 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 9 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 7 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb94009040 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 6 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fcd030 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 10 ==== osd_op_reply(34 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb9c016440 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 8 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x564cf8fc8640 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 12 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcc2d0 con 0x7feb94009040 2024-09-13T19:10:03.523 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 7 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba5a65980 20 RGWRados::pool_iterate: got zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba5a65980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba5a65980 20 RGWRados::pool_iterate: got default.zone. 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba5a65980 20 RGWRados::pool_iterate: got period_config.default 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.510+0000 7feba5a65980 20 RGWRados::pool_iterate: got zone_info.56657ff8-3f1d-4de3-ac6b-fca799f3ee55 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd03f0 con 0x564cf8fc8640 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.524 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fcffd0 con 0x564cf8fc8640 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=0 bl.length=46 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:40 5.1c 5:3fbd74fd:::zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd0c90 con 0x7feb94009040 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 8 ==== osd_op_reply(40 zonegroup_info.ef9ca8b0-9ae4-481e-ba9d-bc0942310d85 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=0 bl.length=436 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 zone default found 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 4 Realm: () 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 4 ZoneGroup: default (ef9ca8b0-9ae4-481e-ba9d-bc0942310d85) 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 4 Zone: default (56657ff8-3f1d-4de3-ac6b-fca799f3ee55) 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 zonegroup default 2024-09-13T19:10:03.525 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd1730 con 0x7feb9c016440 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 9 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=0 bl.length=187 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd11b0 con 0x564cf8fcd030 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados->read ofs=0 len=0 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd3700 con 0x564cf8fcd030 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 started sync module instance, tier type = 2024-09-13T19:10:03.526 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 20 started zone id=56657ff8-3f1d-4de3-ac6b-fca799f3ee55 (name=default) with tier type = 2024-09-13T19:10:03.527 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.514+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2a50 con 0x7feb94009040 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 9 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94888594845248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd4010 con 0x7feb94009040 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd4860 con 0x564cf8fc8640 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94888594845248] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 15 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94888594848608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd4860 con 0x564cf8fc8640 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.518+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd52b0 con 0x564cf8fcd030 2024-09-13T19:10:03.528 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94888594848608] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 13 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94888594853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd4860 con 0x564cf8fcd030 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd5cc0 con 0x7feb94009040 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 11 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94888594855952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd6560 con 0x7feb94009040 2024-09-13T19:10:03.529 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.522+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd6f80 con 0x564cf8fc8640 2024-09-13T19:10:03.530 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94888594853280] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 17 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94888594860656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd7370 con 0x564cf8fc8640 2024-09-13T19:10:03.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd7d30 con 0x7feb9c016440 2024-09-13T19:10:03.532 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94888594855952] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.533 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.526+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94888594860656] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 10 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94888594850736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd7880 con 0x7feb9c016440 2024-09-13T19:10:03.534 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd80d0 con 0x7feb9c016440 2024-09-13T19:10:03.536 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94888594850736] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94888594864256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd8150 con 0x7feb9c016440 2024-09-13T19:10:03.537 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.530+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd89e0 con 0x7feb9c016440 2024-09-13T19:10:03.538 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94888594864256] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 14 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94888594865312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd8bc0 con 0x7feb9c016440 2024-09-13T19:10:03.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=0 2024-09-13T19:10:03.539 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=1 2024-09-13T19:10:03.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=2 2024-09-13T19:10:03.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=3 2024-09-13T19:10:03.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=4 2024-09-13T19:10:03.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=5 2024-09-13T19:10:03.540 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=6 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94888594865312] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 20 add_watcher() i=7 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 2 all 8 watchers are set, enabling cache 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.534+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fdbf90 con 0x564cf8fc8640 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.542 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94888594868912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd9380 con 0x564cf8fc8640 2024-09-13T19:10:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94888594868912] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7fea58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:10:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba5a65980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-13T19:10:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba5a65980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-13T19:10:03.544 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.538+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe4650 con 0x564cf8fc8640 2024-09-13T19:10:03.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.542+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.546 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.542+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe4d20 con 0x7feb9c016440 2024-09-13T19:10:03.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.542+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 16 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.549 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.542+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5140 con 0x564cf8fcd030 2024-09-13T19:10:03.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5120 con 0x564cf8fc8640 2024-09-13T19:10:03.551 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'275 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.552 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe57b0 con 0x7feb94009040 2024-09-13T19:10:03.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.553 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.546+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5d20 con 0x564cf8fcd030 2024-09-13T19:10:03.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.550+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.554 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.550+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5db0 con 0x564cf8fc8640 2024-09-13T19:10:03.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.550+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.557 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.550+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5db0 con 0x7feb9c016440 2024-09-13T19:10:03.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.554+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 17 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.559 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.554+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe5db0 con 0x7feb94009040 2024-09-13T19:10:03.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.554+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.561 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.554+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6320 con 0x564cf8fcd030 2024-09-13T19:10:03.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.558+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.563 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.558+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6320 con 0x7feb94009040 2024-09-13T19:10:03.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.558+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.558+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x7feb9c016440 2024-09-13T19:10:03.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.562+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 18 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.562+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x7feb94009040 2024-09-13T19:10:03.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.562+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.562+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x7feb9c016440 2024-09-13T19:10:03.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.566+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 19 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'64 uv41 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.566+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fc8640 2024-09-13T19:10:03.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.566+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.566+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fcd030 2024-09-13T19:10:03.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x7feb94009040 2024-09-13T19:10:03.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.576 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fcd030 2024-09-13T19:10:03.577 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.578 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.570+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fc8640 2024-09-13T19:10:03.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.574+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.580 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.574+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fc8640 2024-09-13T19:10:03.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.574+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.582 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.574+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x564cf8fcd030 2024-09-13T19:10:03.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.578+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.584 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.578+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe67d0 con 0x7feb94009040 2024-09-13T19:10:03.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.578+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.578+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.582+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.582+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.582+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.589 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.582+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.586+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.591 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.586+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.586+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.593 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.586+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x7feb9c016440 2024-09-13T19:10:03.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.590+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 20 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.596 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.590+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.597 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.590+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.598 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.590+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x7feb9c016440 2024-09-13T19:10:03.600 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.594+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 21 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.601 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.594+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x564cf8fcd030 2024-09-13T19:10:03.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.598+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.603 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.598+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x7feb9c016440 2024-09-13T19:10:03.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.598+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 22 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'65 uv43 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.605 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.598+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fe6e20 con 0x7feb94009040 2024-09-13T19:10:03.607 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7fe9d37fe640 20 reqs_thread_entry: start 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7feba5a65980 20 init_complete bucket index max shards: 11 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7feba5a65980 20 Filter name: none 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7fe9d17fa640 20 reqs_thread_entry: start 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-13T19:10:03.609 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.602+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 27 ==== osd_op_reply(94 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 28 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.612 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 29 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 30 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.613 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 31 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.614 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.606+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.610+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 32 ==== osd_op_reply(99 gc.0 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.610+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-13T19:10:03.615 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.610+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.610+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 23 ==== osd_op_reply(100 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.618 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.610+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 24 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.619 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb9c016440 2024-09-13T19:10:03.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 25 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.620 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 26 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 27 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.614+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.618+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 28 ==== osd_op_reply(105 gc.1 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.618+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-13T19:10:03.625 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.618+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.618+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 27 ==== osd_op_reply(106 gc.2 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.626 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.618+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 28 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 29 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 30 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.627 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 31 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.628 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 32 ==== osd_op_reply(111 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-13T19:10:03.629 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.622+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 33 ==== osd_op_reply(112 gc.3 [call] v34'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.630 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 34 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.631 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 35 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 36 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.632 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 37 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.633 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 38 ==== osd_op_reply(117 gc.3 [call] v34'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-13T19:10:03.634 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.626+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 20 ==== osd_op_reply(118 gc.4 [call] v34'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 21 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 22 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 23 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.638 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 24 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.639 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.641 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 25 ==== osd_op_reply(123 gc.4 [call] v34'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.630+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 33 ==== osd_op_reply(124 gc.5 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 34 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 35 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 36 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.642 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 37 ==== osd_op_reply(128 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.634+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 38 ==== osd_op_reply(129 gc.5 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-13T19:10:03.643 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 39 ==== osd_op_reply(130 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 40 ==== osd_op_reply(131 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.646 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.638+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 41 ==== osd_op_reply(132 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 42 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.647 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 43 ==== osd_op_reply(134 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.648 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 44 ==== osd_op_reply(135 gc.6 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-13T19:10:03.649 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.642+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 29 ==== osd_op_reply(136 gc.7 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.652 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 30 ==== osd_op_reply(137 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb9c016440 2024-09-13T19:10:03.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 31 ==== osd_op_reply(138 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.646+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 32 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 33 ==== osd_op_reply(140 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.657 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.650+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 34 ==== osd_op_reply(141 gc.7 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-13T19:10:03.659 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.663 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 26 ==== osd_op_reply(142 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 27 ==== osd_op_reply(143 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.654+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.664 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 28 ==== osd_op_reply(144 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 29 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 30 ==== osd_op_reply(146 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.665 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.666 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 31 ==== osd_op_reply(147 gc.8 [call] v34'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-13T19:10:03.667 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.658+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 39 ==== osd_op_reply(148 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 40 ==== osd_op_reply(149 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.668 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 41 ==== osd_op_reply(150 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 42 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 43 ==== osd_op_reply(152 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.670 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.662+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 44 ==== osd_op_reply(153 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-13T19:10:03.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 32 ==== osd_op_reply(154 gc.10 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 33 ==== osd_op_reply(155 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.666+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 34 ==== osd_op_reply(156 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.674 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 35 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 36 ==== osd_op_reply(158 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.675 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:159 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 37 ==== osd_op_reply(159 gc.10 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-13T19:10:03.678 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.670+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.674+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 35 ==== osd_op_reply(160 gc.11 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.680 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.674+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.674+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 36 ==== osd_op_reply(161 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.674+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.681 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.674+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:162 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb9c016440 2024-09-13T19:10:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 37 ==== osd_op_reply(162 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.682 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:163 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 38 ==== osd_op_reply(163 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.683 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:164 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 39 ==== osd_op_reply(164 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.684 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.678+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:165 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.687 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.682+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 40 ==== osd_op_reply(165 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.682+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-13T19:10:03.688 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.682+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.682+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 38 ==== osd_op_reply(166 gc.12 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.690 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.682+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 39 ==== osd_op_reply(167 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.692 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:168 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 40 ==== osd_op_reply(168 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:169 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 41 ==== osd_op_reply(169 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.693 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:170 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 42 ==== osd_op_reply(170 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c037040 con 0x7feb94009040 2024-09-13T19:10:03.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:171 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 43 ==== osd_op_reply(171 gc.12 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-13T19:10:03.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.686+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.690+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 41 ==== osd_op_reply(172 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.690+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.690+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 42 ==== osd_op_reply(173 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.690+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.690+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:174 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb9c016440 2024-09-13T19:10:03.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 43 ==== osd_op_reply(174 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:175 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 44 ==== osd_op_reply(175 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:176 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 45 ==== osd_op_reply(176 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.694+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:177 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb9c016440 2024-09-13T19:10:03.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.698+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 46 ==== osd_op_reply(177 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.698+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-13T19:10:03.704 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.698+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.698+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 45 ==== osd_op_reply(178 gc.14 [call] v34'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.698+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.706 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 46 ==== osd_op_reply(179 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:180 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 47 ==== osd_op_reply(180 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:181 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 48 ==== osd_op_reply(181 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.708 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:182 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 49 ==== osd_op_reply(182 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.702+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:183 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.706+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 50 ==== osd_op_reply(183 gc.14 [call] v34'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.706+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-13T19:10:03.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.706+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.713 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.706+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 45 ==== osd_op_reply(184 gc.15 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.706+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 46 ==== osd_op_reply(185 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.714 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:186 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 47 ==== osd_op_reply(186 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.715 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:187 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 48 ==== osd_op_reply(187 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.716 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:188 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 49 ==== osd_op_reply(188 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.717 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.710+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:189 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.720 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.714+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 50 ==== osd_op_reply(189 gc.15 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.714+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-13T19:10:03.721 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.714+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 44 ==== osd_op_reply(190 gc.16 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 45 ==== osd_op_reply(191 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:192 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 46 ==== osd_op_reply(192 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:193 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.724 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 47 ==== osd_op_reply(193 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:194 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 48 ==== osd_op_reply(194 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.718+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:195 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.722+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 49 ==== osd_op_reply(195 gc.16 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.722+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-13T19:10:03.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.722+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.722+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 51 ==== osd_op_reply(196 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.729 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.722+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 52 ==== osd_op_reply(197 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.730 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:198 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 53 ==== osd_op_reply(198 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.731 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:199 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 54 ==== osd_op_reply(199 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.732 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:200 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 55 ==== osd_op_reply(200 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.733 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.726+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:201 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.735 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.730+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 56 ==== osd_op_reply(201 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.730+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-13T19:10:03.736 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.730+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:202 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.738 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 51 ==== osd_op_reply(202 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.739 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:203 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 52 ==== osd_op_reply(203 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:204 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 53 ==== osd_op_reply(204 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.740 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:205 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 54 ==== osd_op_reply(205 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.741 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:206 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 55 ==== osd_op_reply(206 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.734+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:207 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.738+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 56 ==== osd_op_reply(207 gc.18 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.738+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-13T19:10:03.744 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.738+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:208 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 57 ==== osd_op_reply(208 gc.19 [call] v34'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.747 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:209 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 58 ==== osd_op_reply(209 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:210 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fc8640 2024-09-13T19:10:03.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 59 ==== osd_op_reply(210 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.749 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:211 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.742+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 60 ==== osd_op_reply(211 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:212 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 61 ==== osd_op_reply(212 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:213 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fc8640 2024-09-13T19:10:03.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 62 ==== osd_op_reply(213 gc.19 [call] v34'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-13T19:10:03.754 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.746+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:214 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.750+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 57 ==== osd_op_reply(214 gc.20 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.757 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.750+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:215 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.750+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 58 ==== osd_op_reply(215 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.750+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.750+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:216 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.758 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 59 ==== osd_op_reply(216 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:217 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 60 ==== osd_op_reply(217 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.759 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:218 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 61 ==== osd_op_reply(218 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.760 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.754+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:219 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.758+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 62 ==== osd_op_reply(219 gc.20 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.758+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-13T19:10:03.764 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.758+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:220 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 50 ==== osd_op_reply(220 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.766 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:221 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 51 ==== osd_op_reply(221 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:222 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x7feb94009040 2024-09-13T19:10:03.768 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 52 ==== osd_op_reply(222 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:223 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 53 ==== osd_op_reply(223 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:224 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 54 ==== osd_op_reply(224 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.769 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.762+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:225 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x7feb94009040 2024-09-13T19:10:03.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.766+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 55 ==== osd_op_reply(225 gc.21 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.766+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-13T19:10:03.772 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.766+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 63 ==== osd_op_reply(226 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.774 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 64 ==== osd_op_reply(227 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.776 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:228 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9001e50 con 0x564cf8fcd030 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 65 ==== osd_op_reply(228 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:229 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 66 ==== osd_op_reply(229 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.777 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:230 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002e60 con 0x564cf8fcd030 2024-09-13T19:10:03.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 67 ==== osd_op_reply(230 gc.22 [call out=1715b] v0'0 uv35 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-13T19:10:03.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 20 garbage collection: RGWGC::process iterating over entry tag='56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.1276215583584313585', time=2024-09-13T19:09:52.794663+0000, chain.objs.size()=7 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_1 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:231 3.3as0 3:5ffe9ad2:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90033d0 con 0x7feb94009040 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_2 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:232 3.13s0 3:c9aefd19:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006020 con 0x564cf8fcd030 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_3 2024-09-13T19:10:03.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:233 3.24s0 3:250fc6d7:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9008ab0 con 0x7feb9c016440 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_4 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:234 3.15s0 3:a8f6f739:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf900b320 con 0x7feb94009040 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_5 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:235 3.cs0 3:30256005:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9008ab0 con 0x564cf8fcd030 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_6 2024-09-13T19:10:03.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:236 3.3cs0 3:3ca03cad:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90100c0 con 0x7feb94009040 2024-09-13T19:10:03.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_7 2024-09-13T19:10:03.783 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.770+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:237 3.21s0 3:85ff4dd4:::56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9012930 con 0x7feb9c016440 2024-09-13T19:10:03.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.778+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 47 ==== osd_op_reply(233 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.785 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.778+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 48 ==== osd_op_reply(237 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_7 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.778+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 56 ==== osd_op_reply(231 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_1 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.786 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.778+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 57 ==== osd_op_reply(234 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.782+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 58 ==== osd_op_reply(236 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.791 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.786+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 68 ==== osd_op_reply(235 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.786+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 69 ==== osd_op_reply(232 56657ff8-3f1d-4de3-ac6b-fca799f3ee55.4225.11__shadow_.8pbecub-0wVqYOesAAi73DkezqwKIy3_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.786+0000 7feba5a65980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-13T19:10:03.792 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.786+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:238 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9005990 con 0x564cf8fcd030 2024-09-13T19:10:03.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.790+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 70 ==== osd_op_reply(238 gc.22 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.798 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.790+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:239 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.800 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.794+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 71 ==== osd_op_reply(239 gc.22 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.794+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-13T19:10:03.801 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.794+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.805 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.794+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 72 ==== osd_op_reply(240 gc.23 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.794+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 73 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9002300 con 0x564cf8fcd030 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 74 ==== osd_op_reply(242 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 75 ==== osd_op_reply(243 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:244 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 76 ==== osd_op_reply(244 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.807 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.798+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:245 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.808 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 77 ==== osd_op_reply(245 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-13T19:10:03.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 78 ==== osd_op_reply(246 gc.24 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 79 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.813 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.802+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 80 ==== osd_op_reply(248 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 81 ==== osd_op_reply(249 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:250 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.814 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 82 ==== osd_op_reply(250 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.815 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.806+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:251 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 83 ==== osd_op_reply(251 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-13T19:10:03.816 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 84 ==== osd_op_reply(252 gc.25 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 85 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.818 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.810+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 86 ==== osd_op_reply(254 gc.25 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.819 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 87 ==== osd_op_reply(255 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.821 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:256 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 88 ==== osd_op_reply(256 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:257 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x564cf8fcd030 2024-09-13T19:10:03.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 89 ==== osd_op_reply(257 gc.25 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-13T19:10:03.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.814+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9006520 con 0x7feb9c016440 2024-09-13T19:10:03.824 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.818+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 49 ==== osd_op_reply(258 gc.26 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.825 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.818+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.818+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 50 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.818+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.826 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.818+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.827 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 51 ==== osd_op_reply(260 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 52 ==== osd_op_reply(261 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.828 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 53 ==== osd_op_reply(262 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.829 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.822+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.826+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 54 ==== osd_op_reply(263 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.826+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-13T19:10:03.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.826+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 90 ==== osd_op_reply(264 gc.27 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.836 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 91 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 92 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 93 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 94 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.839 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.830+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x564cf8fcd030 2024-09-13T19:10:03.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.834+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 95 ==== osd_op_reply(269 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.834+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-13T19:10:03.840 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.834+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 55 ==== osd_op_reply(270 gc.28 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.842 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 56 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.843 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf90063c0 con 0x7feb9c016440 2024-09-13T19:10:03.844 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 57 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 58 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.845 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.838+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 59 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.846 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 60 ==== osd_op_reply(275 gc.28 [call] v34'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-13T19:10:03.849 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.842+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 96 ==== osd_op_reply(276 gc.29 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 97 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.852 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 98 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.853 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 99 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.846+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.854 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 100 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.855 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x564cf8fcd030 2024-09-13T19:10:03.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 101 ==== osd_op_reply(281 gc.29 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-13T19:10:03.857 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.850+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.854+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 61 ==== osd_op_reply(282 gc.30 [call] v34'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.854+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.854+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 62 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.861 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.854+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.854+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 63 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.862 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 64 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.864 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 65 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.858+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb9c016440 2024-09-13T19:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.862+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 66 ==== osd_op_reply(287 gc.30 [call] v34'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.862+0000 7feba5a65980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-13T19:10:03.869 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.862+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 59 ==== osd_op_reply(288 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.871 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 60 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.872 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 61 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 62 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.873 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-13T19:10:03.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.866+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.870+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 63 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.870+0000 7feba5a65980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-13T19:10:03.874 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.870+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf9003890 con 0x7feb94009040 2024-09-13T19:10:03.877 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.870+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 64 ==== osd_op_reply(293 gc.31 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.874+0000 7fea58fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-13T19:10:03.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.874+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94888594868912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fde280 con 0x564cf8fc8640 2024-09-13T19:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.874+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 63 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94888594868912] v34'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.874+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94888594845248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fde280 con 0x7feb94009040 2024-09-13T19:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.878+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 65 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94888594845248] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.878+0000 7feba5a65980 20 remove_watcher() i=0 2024-09-13T19:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.878+0000 7feba5a65980 2 removed watcher, disabling cache 2024-09-13T19:10:03.884 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.878+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94888594848608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x564cf8fc8640 2024-09-13T19:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 64 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94888594848608] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba5a65980 20 remove_watcher() i=1 2024-09-13T19:10:03.887 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94888594853280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x564cf8fcd030 2024-09-13T19:10:03.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba3575640 1 -- 172.21.15.151:0/295833894 <== osd.3 v2:172.21.15.151:6800/3085220080 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94888594853280] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb940f4070 con 0x564cf8fcd030 2024-09-13T19:10:03.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba5a65980 20 remove_watcher() i=2 2024-09-13T19:10:03.889 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.882+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94888594855952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x7feb94009040 2024-09-13T19:10:03.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.886+0000 7feba2d74640 1 -- 172.21.15.151:0/295833894 <== osd.2 v2:172.21.15.151:6808/3546065622 66 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94888594855952] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb8c054040 con 0x7feb94009040 2024-09-13T19:10:03.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.886+0000 7feba5a65980 20 remove_watcher() i=3 2024-09-13T19:10:03.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.886+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94888594860656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x564cf8fc8640 2024-09-13T19:10:03.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.1 v2:172.21.15.151:6816/4016279334 65 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94888594860656] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x564cf8fc8640 2024-09-13T19:10:03.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba5a65980 20 remove_watcher() i=4 2024-09-13T19:10:03.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94888594850736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x7feb9c016440 2024-09-13T19:10:03.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94888594850736] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.897 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba5a65980 20 remove_watcher() i=5 2024-09-13T19:10:03.898 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.890+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94888594864256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd2e40 con 0x7feb9c016440 2024-09-13T19:10:03.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.894+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94888594864256] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.894+0000 7feba5a65980 20 remove_watcher() i=6 2024-09-13T19:10:03.901 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.894+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94888594865312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564cf8fd7880 con 0x7feb9c016440 2024-09-13T19:10:03.903 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 <== osd.0 v2:172.21.15.12:6800/3844244554 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94888594865312] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feb9c00a4d0 con 0x7feb9c016440 2024-09-13T19:10:03.904 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 20 remove_watcher() i=7 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7feb9c016440 msgr2=0x7feb9c0168a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7feb9c016440 0x7feb9c0168a0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8fc8640 msgr2=0x564cf8fcab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8fc8640 0x564cf8fcab00 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7feb94009040 msgr2=0x7feb940c7590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7feb94009040 0x7feb940c7590 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.905 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8fcd030 msgr2=0x564cf8fcf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8fcd030 0x564cf8fcf420 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea6c034650 msgr2=0x7fea6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea6c034650 0x7fea6c036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x564cf8f9c5a0 tx=0x7feb8c010000 comp rx=0 tx=0).stop 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 msgr2=0x564cf8fbd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/295833894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fb6600 0x564cf8fbd820 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7feb940d2ff0 tx=0x7feb940aeef0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 reap_dead start 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba3d76640 1 -- 172.21.15.151:0/295833894 reap_dead start 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 shutdown_connections 2024-09-13T19:10:03.906 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 >> 172.21.15.151:0/295833894 conn(0x564cf8fb2990 msgr2=0x564cf8fb0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 shutdown_connections 2024-09-13T19:10:03.907 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/295833894 wait complete. 2024-09-13T19:10:03.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 msgr2=0x7fea7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 0x7fea7c036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x564cf8f90530 tx=0x7feb8c00f000 comp rx=0 tx=0).stop 2024-09-13T19:10:03.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 msgr2=0x564cf8faa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.908 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7feb9401b380 tx=0x7feb940c5e00 comp rx=0 tx=0).stop 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 shutdown_connections 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea7c034650 0x7fea7c036b10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 --2- 172.21.15.151:0/2814858053 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8fa9c70 0x564cf8faa090 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 >> 172.21.15.151:0/2814858053 conn(0x564cf8f9edc0 msgr2=0x564cf8fa1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.898+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 shutdown_connections 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/2814858053 wait complete. 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8e9a230 msgr2=0x564cf8f92df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x564cf8e9a230 0x564cf8f92df0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.909 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564cf8f996c0 msgr2=0x564cf8f9bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x564cf8f996c0 0x564cf8f9bab0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8f95610 msgr2=0x564cf8f97ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x564cf8f95610 0x564cf8f97ad0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea88034650 msgr2=0x7fea88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fea88034650 0x7fea88036b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feb8c001e50 tx=0x7feb8c0013b0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 msgr2=0x564cf8f8be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 --2- 172.21.15.151:0/1861806338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564cf8e998e0 0x564cf8f8be20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7feb940199f0 tx=0x7feb940180e0 comp rx=0 tx=0).stop 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba3d76640 1 -- 172.21.15.151:0/1861806338 reap_dead start 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 shutdown_connections 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 >> 172.21.15.151:0/1861806338 conn(0x564cf8e0d230 msgr2=0x564cf8f7f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 shutdown_connections 2024-09-13T19:10:03.910 INFO:teuthology.orchestra.run.smithi151.stderr:2024-09-13T19:10:03.902+0000 7feba5a65980 1 -- 172.21.15.151:0/1861806338 wait complete. 2024-09-13T19:10:03.926 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T19:10:03.935 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T19:10:03.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:04.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f3214a22640 1 Processor -- start 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f3214a22640 1 -- start start 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f3214a22640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f321006d0e0 0x7f321006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f3214a22640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3210071c10 con 0x7f321006da00 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f3214a22640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3210072230 con 0x7f321006d0e0 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f321006d0e0 0x7f321006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320dd9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f321006da00 0x7f321012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40242/0 (socket says 172.21.15.12:40242) 2024-09-13T19:10:04.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320dd9b640 1 -- 172.21.15.12:0/2453415592 learned_addr learned my addr 172.21.15.12:0/2453415592 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:04.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320e59c640 1 -- 172.21.15.12:0/2453415592 >> v1:172.21.15.12:6789/0 conn(0x7f321006da00 legacy=0x7f321012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320e59c640 1 -- 172.21.15.12:0/2453415592 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32100709e0 con 0x7f321006d0e0 2024-09-13T19:10:04.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320e59c640 1 --2- 172.21.15.12:0/2453415592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f321006d4c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0feac88dc1d736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320d59a640 1 -- 172.21.15.12:0/2453415592 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000b0070 con 0x7f321006d0e0 2024-09-13T19:10:04.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320d59a640 1 -- 172.21.15.12:0/2453415592 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32000ab530 con 0x7f321006d0e0 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.063+0000 7f320d59a640 1 -- 172.21.15.12:0/2453415592 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000ab830 con 0x7f321006d0e0 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/2453415592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 msgr2=0x7f321006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 --2- 172.21.15.12:0/2453415592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f321006d4c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c370 comp rx=0 tx=0).stop 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/2453415592 shutdown_connections 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 --2- 172.21.15.12:0/2453415592 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f321006d4c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/2453415592 >> 172.21.15.12:0/2453415592 conn(0x7f3210099a50 msgr2=0x7f32100972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/2453415592 shutdown_connections 2024-09-13T19:10:04.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/2453415592 wait complete. 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 Processor -- start 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- start start 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3210134e80 con 0x7f321006d0e0 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f320e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f320e59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43560/0 (socket says 172.21.15.12:43560) 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f320e59c640 1 -- 172.21.15.12:0/1355523684 learned_addr learned my addr 172.21.15.12:0/1355523684 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f320e59c640 1 -- 172.21.15.12:0/1355523684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321012a3a0 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f320e59c640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae040 tx=0x7f320001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000b0050 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32000b1040 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321012b010 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32000b5780 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321012b6a0 con 0x7f321006d0e0 2024-09-13T19:10:04.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321006d4c0 con 0x7f321006d0e0 2024-09-13T19:10:04.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.067+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32000be030 con 0x7f321006d0e0 2024-09-13T19:10:04.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.071+0000 7f31feffd640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 0x7f31f0038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.071+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f32000bc070 con 0x7f321006d0e0 2024-09-13T19:10:04.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.071+0000 7f320dd9b640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 0x7f31f0038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.071+0000 7f320dd9b640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 0x7f31f0038220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3204001610 tx=0x7f3204007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.075+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f32000c5060 con 0x7f321006d0e0 2024-09-13T19:10:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.235+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3210073790 con 0x7f31f0035d60 2024-09-13T19:10:04.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.287+0000 7f31feffd640 1 -- 172.21.15.12:0/1355523684 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666053 (secure 0 0 0) 0x7f3210073790 con 0x7f31f0035d60 2024-09-13T19:10:04.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:04.307 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:04.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 msgr2=0x7f31f0038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 0x7f31f0038220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3204001610 tx=0x7f3204007ad0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 msgr2=0x7f3210128c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae040 tx=0x7f320001abb0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 shutdown_connections 2024-09-13T19:10:04.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f31f0035d60 0x7f31f0038220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 --2- 172.21.15.12:0/1355523684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f321006d0e0 0x7f3210128c50 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 >> 172.21.15.12:0/1355523684 conn(0x7f3210099a50 msgr2=0x7f32101b9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:04.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 shutdown_connections 2024-09-13T19:10:04.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.291+0000 7f3214a22640 1 -- 172.21.15.12:0/1355523684 wait complete. 2024-09-13T19:10:04.317 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-13T19:10:03.013199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4875,"num_read_kb":4452,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36214728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007162"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337381+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:06:58.337381+0000","last_peered":"2024-09-13T19:06:58.337381+0000","last_clean":"2024-09-13T19:06:58.337381+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:06:58.337381+0000","last_undegraded":"2024-09-13T19:06:58.337381+0000","last_fullsized":"2024-09-13T19:06:58.337381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.324626+0000","last_change":"2024-09-13T19:06:21.265691+0000","last_active":"2024-09-13T19:07:07.324626+0000","last_peered":"2024-09-13T19:07:07.324626+0000","last_clean":"2024-09-13T19:07:07.324626+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:07:07.324626+0000","last_undegraded":"2024-09-13T19:07:07.324626+0000","last_fullsized":"2024-09-13T19:07:07.324626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.241844+0000","last_change":"2024-09-13T19:06:19.281253+0000","last_active":"2024-09-13T19:09:38.241844+0000","last_peered":"2024-09-13T19:09:38.241844+0000","last_clean":"2024-09-13T19:09:38.241844+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:09:38.241844+0000","last_undegraded":"2024-09-13T19:09:38.241844+0000","last_fullsized":"2024-09-13T19:09:38.241844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343896+0000","last_change":"2024-09-13T19:06:21.257152+0000","last_active":"2024-09-13T19:06:58.343896+0000","last_peered":"2024-09-13T19:06:58.343896+0000","last_clean":"2024-09-13T19:06:58.343896+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:06:58.343896+0000","last_undegraded":"2024-09-13T19:06:58.343896+0000","last_fullsized":"2024-09-13T19:06:58.343896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:59.192920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.348389+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:06:58.348389+0000","last_peered":"2024-09-13T19:06:58.348389+0000","last_clean":"2024-09-13T19:06:58.348389+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:06:58.348389+0000","last_undegraded":"2024-09-13T19:06:58.348389+0000","last_fullsized":"2024-09-13T19:06:58.348389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:19.158740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040680+0000","last_change":"2024-09-13T19:06:21.257435+0000","last_active":"2024-09-13T19:09:38.040680+0000","last_peered":"2024-09-13T19:09:38.040680+0000","last_clean":"2024-09-13T19:09:38.040680+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:09:38.040680+0000","last_undegraded":"2024-09-13T19:09:38.040680+0000","last_fullsized":"2024-09-13T19:09:38.040680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:15.700530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:18.996355+0000","last_change":"2024-09-13T19:06:19.272048+0000","last_active":"2024-09-13T19:08:18.996355+0000","last_peered":"2024-09-13T19:08:18.996355+0000","last_clean":"2024-09-13T19:08:18.996355+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:08:18.996355+0000","last_undegraded":"2024-09-13T19:08:18.996355+0000","last_fullsized":"2024-09-13T19:08:18.996355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.254845+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.254845+0000","last_peered":"2024-09-13T19:09:38.254845+0000","last_clean":"2024-09-13T19:09:38.254845+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.254845+0000","last_undegraded":"2024-09-13T19:09:38.254845+0000","last_fullsized":"2024-09-13T19:09:38.254845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:26.262099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341432+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:06:58.341432+0000","last_peered":"2024-09-13T19:06:58.341432+0000","last_clean":"2024-09-13T19:06:58.341432+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:06:58.341432+0000","last_undegraded":"2024-09-13T19:06:58.341432+0000","last_fullsized":"2024-09-13T19:06:58.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:58.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455588+0000","last_change":"2024-09-13T19:06:21.261907+0000","last_active":"2024-09-13T19:09:38.455588+0000","last_peered":"2024-09-13T19:09:38.455588+0000","last_clean":"2024-09-13T19:09:38.455588+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:09:38.455588+0000","last_undegraded":"2024-09-13T19:09:38.455588+0000","last_fullsized":"2024-09-13T19:09:38.455588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.003606+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:08:49.003606+0000","last_peered":"2024-09-13T19:08:49.003606+0000","last_clean":"2024-09-13T19:08:49.003606+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:08:49.003606+0000","last_undegraded":"2024-09-13T19:08:49.003606+0000","last_fullsized":"2024-09-13T19:08:49.003606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.654845+0000","last_change":"2024-09-13T19:06:21.266198+0000","last_active":"2024-09-13T19:07:50.654845+0000","last_peered":"2024-09-13T19:07:50.654845+0000","last_clean":"2024-09-13T19:07:50.654845+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:07:50.654845+0000","last_undegraded":"2024-09-13T19:07:50.654845+0000","last_fullsized":"2024-09-13T19:07:50.654845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:26.835463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.307843+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:07:07.307843+0000","last_peered":"2024-09-13T19:07:07.307843+0000","last_clean":"2024-09-13T19:07:07.307843+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:07:07.307843+0000","last_undegraded":"2024-09-13T19:07:07.307843+0000","last_fullsized":"2024-09-13T19:07:07.307843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:38.969649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474547+0000","last_change":"2024-09-13T19:06:21.255493+0000","last_active":"2024-09-13T19:09:38.474547+0000","last_peered":"2024-09-13T19:09:38.474547+0000","last_clean":"2024-09-13T19:09:38.474547+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:09:38.474547+0000","last_undegraded":"2024-09-13T19:09:38.474547+0000","last_fullsized":"2024-09-13T19:09:38.474547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327422+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:06:58.327422+0000","last_peered":"2024-09-13T19:06:58.327422+0000","last_clean":"2024-09-13T19:06:58.327422+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:06:58.327422+0000","last_undegraded":"2024-09-13T19:06:58.327422+0000","last_fullsized":"2024-09-13T19:06:58.327422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.906061+0000","last_change":"2024-09-13T19:06:21.259423+0000","last_active":"2024-09-13T19:09:37.906061+0000","last_peered":"2024-09-13T19:09:37.906061+0000","last_clean":"2024-09-13T19:09:37.906061+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:09:37.906061+0000","last_undegraded":"2024-09-13T19:09:37.906061+0000","last_fullsized":"2024-09-13T19:09:37.906061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.971735+0000","last_change":"2024-09-13T19:06:21.257261+0000","last_active":"2024-09-13T19:07:06.971735+0000","last_peered":"2024-09-13T19:07:06.971735+0000","last_clean":"2024-09-13T19:07:06.971735+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:07:06.971735+0000","last_undegraded":"2024-09-13T19:07:06.971735+0000","last_fullsized":"2024-09-13T19:07:06.971735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:38.952619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.296557+0000","last_change":"2024-09-13T19:06:19.287823+0000","last_active":"2024-09-13T19:07:07.296557+0000","last_peered":"2024-09-13T19:07:07.296557+0000","last_clean":"2024-09-13T19:07:07.296557+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:07:07.296557+0000","last_undegraded":"2024-09-13T19:07:07.296557+0000","last_fullsized":"2024-09-13T19:07:07.296557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475773+0000","last_change":"2024-09-13T19:06:21.263484+0000","last_active":"2024-09-13T19:09:38.475773+0000","last_peered":"2024-09-13T19:09:38.475773+0000","last_clean":"2024-09-13T19:09:38.475773+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:09:38.475773+0000","last_undegraded":"2024-09-13T19:09:38.475773+0000","last_fullsized":"2024-09-13T19:09:38.475773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.370620+0000","last_change":"2024-09-13T19:06:19.276357+0000","last_active":"2024-09-13T19:07:50.370620+0000","last_peered":"2024-09-13T19:07:50.370620+0000","last_clean":"2024-09-13T19:07:50.370620+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:07:50.370620+0000","last_undegraded":"2024-09-13T19:07:50.370620+0000","last_fullsized":"2024-09-13T19:07:50.370620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.121880+0000","last_change":"2024-09-13T19:06:21.265579+0000","last_active":"2024-09-13T19:08:37.121880+0000","last_peered":"2024-09-13T19:08:37.121880+0000","last_clean":"2024-09-13T19:08:37.121880+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:08:37.121880+0000","last_undegraded":"2024-09-13T19:08:37.121880+0000","last_fullsized":"2024-09-13T19:08:37.121880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.785658+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.785658+0000","last_peered":"2024-09-13T19:09:37.785658+0000","last_clean":"2024-09-13T19:09:37.785658+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.785658+0000","last_undegraded":"2024-09-13T19:09:37.785658+0000","last_fullsized":"2024-09-13T19:09:37.785658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885359+0000","last_change":"2024-09-13T19:06:21.253936+0000","last_active":"2024-09-13T19:09:37.885359+0000","last_peered":"2024-09-13T19:09:37.885359+0000","last_clean":"2024-09-13T19:09:37.885359+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:09:37.885359+0000","last_undegraded":"2024-09-13T19:09:37.885359+0000","last_fullsized":"2024-09-13T19:09:37.885359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342316+0000","last_change":"2024-09-13T19:06:19.281986+0000","last_active":"2024-09-13T19:06:58.342316+0000","last_peered":"2024-09-13T19:06:58.342316+0000","last_clean":"2024-09-13T19:06:58.342316+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:06:58.342316+0000","last_undegraded":"2024-09-13T19:06:58.342316+0000","last_fullsized":"2024-09-13T19:06:58.342316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392252+0000","last_change":"2024-09-13T19:06:21.254760+0000","last_active":"2024-09-13T19:09:38.392252+0000","last_peered":"2024-09-13T19:09:38.392252+0000","last_clean":"2024-09-13T19:09:38.392252+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:09:38.392252+0000","last_undegraded":"2024-09-13T19:09:38.392252+0000","last_fullsized":"2024-09-13T19:09:38.392252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:14.792775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.215043+0000","last_change":"2024-09-13T19:06:19.278861+0000","last_active":"2024-09-13T19:09:38.215043+0000","last_peered":"2024-09-13T19:09:38.215043+0000","last_clean":"2024-09-13T19:09:38.215043+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:09:38.215043+0000","last_undegraded":"2024-09-13T19:09:38.215043+0000","last_fullsized":"2024-09-13T19:09:38.215043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:09.190817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.880925+0000","last_change":"2024-09-13T19:06:21.265434+0000","last_active":"2024-09-13T19:09:37.880925+0000","last_peered":"2024-09-13T19:09:37.880925+0000","last_clean":"2024-09-13T19:09:37.880925+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:09:37.880925+0000","last_undegraded":"2024-09-13T19:09:37.880925+0000","last_fullsized":"2024-09-13T19:09:37.880925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:23.561123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337225+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:06:58.337225+0000","last_peered":"2024-09-13T19:06:58.337225+0000","last_clean":"2024-09-13T19:06:58.337225+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:06:58.337225+0000","last_undegraded":"2024-09-13T19:06:58.337225+0000","last_fullsized":"2024-09-13T19:06:58.337225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:26.485200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.318135+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.318135+0000","last_peered":"2024-09-13T19:09:38.318135+0000","last_clean":"2024-09-13T19:09:38.318135+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.318135+0000","last_undegraded":"2024-09-13T19:09:38.318135+0000","last_fullsized":"2024-09-13T19:09:38.318135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:07.774766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004272+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:08:44.004272+0000","last_peered":"2024-09-13T19:08:44.004272+0000","last_clean":"2024-09-13T19:08:44.004272+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:08:44.004272+0000","last_undegraded":"2024-09-13T19:08:44.004272+0000","last_fullsized":"2024-09-13T19:08:44.004272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:52.354210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002406+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:08:39.002406+0000","last_peered":"2024-09-13T19:08:39.002406+0000","last_clean":"2024-09-13T19:08:39.002406+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:08:39.002406+0000","last_undegraded":"2024-09-13T19:08:39.002406+0000","last_fullsized":"2024-09-13T19:08:39.002406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:09.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344167+0000","last_change":"2024-09-13T19:06:23.276780+0000","last_active":"2024-09-13T19:06:58.344167+0000","last_peered":"2024-09-13T19:06:58.344167+0000","last_clean":"2024-09-13T19:06:58.344167+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:06:58.344167+0000","last_undegraded":"2024-09-13T19:06:58.344167+0000","last_fullsized":"2024-09-13T19:06:58.344167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:36.923375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.780434+0000","last_change":"2024-09-13T19:06:25.281596+0000","last_active":"2024-09-13T19:08:33.780434+0000","last_peered":"2024-09-13T19:08:33.780434+0000","last_clean":"2024-09-13T19:08:33.780434+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:08:33.780434+0000","last_undegraded":"2024-09-13T19:08:33.780434+0000","last_fullsized":"2024-09-13T19:08:33.780434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:11.221079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359118+0000","last_change":"2024-09-13T19:06:27.318504+0000","last_active":"2024-09-13T19:06:58.359118+0000","last_peered":"2024-09-13T19:06:58.359118+0000","last_clean":"2024-09-13T19:06:58.359118+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:06:58.359118+0000","last_undegraded":"2024-09-13T19:06:58.359118+0000","last_fullsized":"2024-09-13T19:06:58.359118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.391456+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:07:50.391456+0000","last_peered":"2024-09-13T19:07:50.391456+0000","last_clean":"2024-09-13T19:07:50.391456+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:07:50.391456+0000","last_undegraded":"2024-09-13T19:07:50.391456+0000","last_fullsized":"2024-09-13T19:07:50.391456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:43.269034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.454561+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.454561+0000","last_peered":"2024-09-13T19:09:38.454561+0000","last_clean":"2024-09-13T19:09:38.454561+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.454561+0000","last_undegraded":"2024-09-13T19:09:38.454561+0000","last_fullsized":"2024-09-13T19:09:38.454561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:44.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328877+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:06:58.328877+0000","last_peered":"2024-09-13T19:06:58.328877+0000","last_clean":"2024-09-13T19:06:58.328877+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:06:58.328877+0000","last_undegraded":"2024-09-13T19:06:58.328877+0000","last_fullsized":"2024-09-13T19:06:58.328877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327809+0000","last_change":"2024-09-13T19:06:23.252446+0000","last_active":"2024-09-13T19:06:58.327809+0000","last_peered":"2024-09-13T19:06:58.327809+0000","last_clean":"2024-09-13T19:06:58.327809+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:06:58.327809+0000","last_undegraded":"2024-09-13T19:06:58.327809+0000","last_fullsized":"2024-09-13T19:06:58.327809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358498+0000","last_change":"2024-09-13T19:06:25.281296+0000","last_active":"2024-09-13T19:06:58.358498+0000","last_peered":"2024-09-13T19:06:58.358498+0000","last_clean":"2024-09-13T19:06:58.358498+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:06:58.358498+0000","last_undegraded":"2024-09-13T19:06:58.358498+0000","last_fullsized":"2024-09-13T19:06:58.358498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:03.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358756+0000","last_change":"2024-09-13T19:06:27.324894+0000","last_active":"2024-09-13T19:06:58.358756+0000","last_peered":"2024-09-13T19:06:58.358756+0000","last_clean":"2024-09-13T19:06:58.358756+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:06:58.358756+0000","last_undegraded":"2024-09-13T19:06:58.358756+0000","last_fullsized":"2024-09-13T19:06:58.358756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326789+0000","last_change":"2024-09-13T19:06:29.300886+0000","last_active":"2024-09-13T19:06:58.326789+0000","last_peered":"2024-09-13T19:06:58.326789+0000","last_clean":"2024-09-13T19:06:58.326789+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:06:58.326789+0000","last_undegraded":"2024-09-13T19:06:58.326789+0000","last_fullsized":"2024-09-13T19:06:58.326789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.372361+0000","last_change":"2024-09-13T19:06:21.256421+0000","last_active":"2024-09-13T19:09:38.372361+0000","last_peered":"2024-09-13T19:09:38.372361+0000","last_clean":"2024-09-13T19:09:38.372361+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:09:38.372361+0000","last_undegraded":"2024-09-13T19:09:38.372361+0000","last_fullsized":"2024-09-13T19:09:38.372361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:08.365440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337123+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:06:58.337123+0000","last_peered":"2024-09-13T19:06:58.337123+0000","last_clean":"2024-09-13T19:06:58.337123+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:06:58.337123+0000","last_undegraded":"2024-09-13T19:06:58.337123+0000","last_fullsized":"2024-09-13T19:06:58.337123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:05.346402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336788+0000","last_change":"2024-09-13T19:06:23.258127+0000","last_active":"2024-09-13T19:06:58.336788+0000","last_peered":"2024-09-13T19:06:58.336788+0000","last_clean":"2024-09-13T19:06:58.336788+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:06:58.336788+0000","last_undegraded":"2024-09-13T19:06:58.336788+0000","last_fullsized":"2024-09-13T19:06:58.336788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331611+0000","last_change":"2024-09-13T19:06:25.297719+0000","last_active":"2024-09-13T19:06:58.331611+0000","last_peered":"2024-09-13T19:06:58.331611+0000","last_clean":"2024-09-13T19:06:58.331611+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:06:58.331611+0000","last_undegraded":"2024-09-13T19:06:58.331611+0000","last_fullsized":"2024-09-13T19:06:58.331611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.240465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518030+0000","last_change":"2024-09-13T19:06:27.301544+0000","last_active":"2024-09-13T19:09:38.518030+0000","last_peered":"2024-09-13T19:09:38.518030+0000","last_clean":"2024-09-13T19:09:38.518030+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:09:38.518030+0000","last_undegraded":"2024-09-13T19:09:38.518030+0000","last_fullsized":"2024-09-13T19:09:38.518030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:19.445306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328744+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:06:58.328744+0000","last_peered":"2024-09-13T19:06:58.328744+0000","last_clean":"2024-09-13T19:06:58.328744+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:06:58.328744+0000","last_undegraded":"2024-09-13T19:06:58.328744+0000","last_fullsized":"2024-09-13T19:06:58.328744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:06.414507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.042619+0000","last_change":"2024-09-13T19:06:21.259001+0000","last_active":"2024-09-13T19:09:38.042619+0000","last_peered":"2024-09-13T19:09:38.042619+0000","last_clean":"2024-09-13T19:09:38.042619+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:09:38.042619+0000","last_undegraded":"2024-09-13T19:09:38.042619+0000","last_fullsized":"2024-09-13T19:09:38.042619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358360+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:06:58.358360+0000","last_peered":"2024-09-13T19:06:58.358360+0000","last_clean":"2024-09-13T19:06:58.358360+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:06:58.358360+0000","last_undegraded":"2024-09-13T19:06:58.358360+0000","last_fullsized":"2024-09-13T19:06:58.358360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:48.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350380+0000","last_change":"2024-09-13T19:06:23.276603+0000","last_active":"2024-09-13T19:06:58.350380+0000","last_peered":"2024-09-13T19:06:58.350380+0000","last_clean":"2024-09-13T19:06:58.350380+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:06:58.350380+0000","last_undegraded":"2024-09-13T19:06:58.350380+0000","last_fullsized":"2024-09-13T19:06:58.350380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:06.962778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.772098+0000","last_change":"2024-09-13T19:06:25.297031+0000","last_active":"2024-09-13T19:08:33.772098+0000","last_peered":"2024-09-13T19:08:33.772098+0000","last_clean":"2024-09-13T19:08:33.772098+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:08:33.772098+0000","last_undegraded":"2024-09-13T19:08:33.772098+0000","last_fullsized":"2024-09-13T19:08:33.772098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:32.765951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":443,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518951+0000","last_change":"2024-09-13T19:06:27.283769+0000","last_active":"2024-09-13T19:09:38.518951+0000","last_peered":"2024-09-13T19:09:38.518951+0000","last_clean":"2024-09-13T19:09:38.518951+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:09:38.518951+0000","last_undegraded":"2024-09-13T19:09:38.518951+0000","last_fullsized":"2024-09-13T19:09:38.518951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:00.073225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375233+0000","last_change":"2024-09-13T19:06:21.259478+0000","last_active":"2024-09-13T19:09:38.375233+0000","last_peered":"2024-09-13T19:09:38.375233+0000","last_clean":"2024-09-13T19:09:38.375233+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:09:38.375233+0000","last_undegraded":"2024-09-13T19:09:38.375233+0000","last_fullsized":"2024-09-13T19:09:38.375233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:26.304922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.779034+0000","last_change":"2024-09-13T19:06:19.264318+0000","last_active":"2024-09-13T19:08:36.779034+0000","last_peered":"2024-09-13T19:08:36.779034+0000","last_clean":"2024-09-13T19:08:36.779034+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:08:36.779034+0000","last_undegraded":"2024-09-13T19:08:36.779034+0000","last_fullsized":"2024-09-13T19:08:36.779034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341484+0000","last_change":"2024-09-13T19:06:23.274173+0000","last_active":"2024-09-13T19:06:58.341484+0000","last_peered":"2024-09-13T19:06:58.341484+0000","last_clean":"2024-09-13T19:06:58.341484+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:06:58.341484+0000","last_undegraded":"2024-09-13T19:06:58.341484+0000","last_fullsized":"2024-09-13T19:06:58.341484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001216+0000","last_change":"2024-09-13T19:06:25.302087+0000","last_active":"2024-09-13T19:08:39.001216+0000","last_peered":"2024-09-13T19:08:39.001216+0000","last_clean":"2024-09-13T19:08:39.001216+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:08:39.001216+0000","last_undegraded":"2024-09-13T19:08:39.001216+0000","last_fullsized":"2024-09-13T19:08:39.001216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:04.630747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330037+0000","last_change":"2024-09-13T19:06:27.297316+0000","last_active":"2024-09-13T19:06:58.330037+0000","last_peered":"2024-09-13T19:06:58.330037+0000","last_clean":"2024-09-13T19:06:58.330037+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:06:58.330037+0000","last_undegraded":"2024-09-13T19:06:58.330037+0000","last_fullsized":"2024-09-13T19:06:58.330037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:15.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.394157+0000","last_change":"2024-09-13T19:06:29.313617+0000","last_active":"2024-09-13T19:07:50.394157+0000","last_peered":"2024-09-13T19:07:50.394157+0000","last_clean":"2024-09-13T19:07:50.394157+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:07:50.394157+0000","last_undegraded":"2024-09-13T19:07:50.394157+0000","last_fullsized":"2024-09-13T19:07:50.394157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:24.043207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.390167+0000","last_change":"2024-09-13T19:06:21.258654+0000","last_active":"2024-09-13T19:09:38.390167+0000","last_peered":"2024-09-13T19:09:38.390167+0000","last_clean":"2024-09-13T19:09:38.390167+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:09:38.390167+0000","last_undegraded":"2024-09-13T19:09:38.390167+0000","last_fullsized":"2024-09-13T19:09:38.390167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.205636+0000","last_change":"2024-09-13T19:06:19.273587+0000","last_active":"2024-09-13T19:09:38.205636+0000","last_peered":"2024-09-13T19:09:38.205636+0000","last_clean":"2024-09-13T19:09:38.205636+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:09:38.205636+0000","last_undegraded":"2024-09-13T19:09:38.205636+0000","last_fullsized":"2024-09-13T19:09:38.205636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.978035+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:06:58.978035+0000","last_peered":"2024-09-13T19:06:58.978035+0000","last_clean":"2024-09-13T19:06:58.978035+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:06:58.978035+0000","last_undegraded":"2024-09-13T19:06:58.978035+0000","last_fullsized":"2024-09-13T19:06:58.978035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.755116+0000","last_change":"2024-09-13T19:06:25.280611+0000","last_active":"2024-09-13T19:08:33.755116+0000","last_peered":"2024-09-13T19:08:33.755116+0000","last_clean":"2024-09-13T19:08:33.755116+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:08:33.755116+0000","last_undegraded":"2024-09-13T19:08:33.755116+0000","last_fullsized":"2024-09-13T19:08:33.755116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:29.037601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328820+0000","last_change":"2024-09-13T19:06:27.297989+0000","last_active":"2024-09-13T19:06:58.328820+0000","last_peered":"2024-09-13T19:06:58.328820+0000","last_clean":"2024-09-13T19:06:58.328820+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:06:58.328820+0000","last_undegraded":"2024-09-13T19:06:58.328820+0000","last_fullsized":"2024-09-13T19:06:58.328820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:44.711664+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:07:44.711664+0000","last_peered":"2024-09-13T19:07:44.711664+0000","last_clean":"2024-09-13T19:07:44.711664+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:07:44.711664+0000","last_undegraded":"2024-09-13T19:07:44.711664+0000","last_fullsized":"2024-09-13T19:07:44.711664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610491+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:09:38.610491+0000","last_peered":"2024-09-13T19:09:38.610491+0000","last_clean":"2024-09-13T19:09:38.610491+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:09:38.610491+0000","last_undegraded":"2024-09-13T19:09:38.610491+0000","last_fullsized":"2024-09-13T19:09:38.610491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:03.939657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.460726+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:07:06.460726+0000","last_peered":"2024-09-13T19:07:06.460726+0000","last_clean":"2024-09-13T19:07:06.460726+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:07:06.460726+0000","last_undegraded":"2024-09-13T19:07:06.460726+0000","last_fullsized":"2024-09-13T19:07:06.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:30.862085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328791+0000","last_change":"2024-09-13T19:06:23.258115+0000","last_active":"2024-09-13T19:06:58.328791+0000","last_peered":"2024-09-13T19:06:58.328791+0000","last_clean":"2024-09-13T19:06:58.328791+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:06:58.328791+0000","last_undegraded":"2024-09-13T19:06:58.328791+0000","last_fullsized":"2024-09-13T19:06:58.328791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.789775+0000","last_change":"2024-09-13T19:06:25.289758+0000","last_active":"2024-09-13T19:08:33.789775+0000","last_peered":"2024-09-13T19:08:33.789775+0000","last_clean":"2024-09-13T19:08:33.789775+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:08:33.789775+0000","last_undegraded":"2024-09-13T19:08:33.789775+0000","last_fullsized":"2024-09-13T19:08:33.789775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:14.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.829627+0000","last_change":"2024-09-13T19:06:27.298298+0000","last_active":"2024-09-13T19:09:38.829627+0000","last_peered":"2024-09-13T19:09:38.829627+0000","last_clean":"2024-09-13T19:09:38.829627+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:09:38.829627+0000","last_undegraded":"2024-09-13T19:09:38.829627+0000","last_fullsized":"2024-09-13T19:09:38.829627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.115703+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:08:37.115703+0000","last_peered":"2024-09-13T19:08:37.115703+0000","last_clean":"2024-09-13T19:08:37.115703+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:08:37.115703+0000","last_undegraded":"2024-09-13T19:08:37.115703+0000","last_fullsized":"2024-09-13T19:08:37.115703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:12.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.657938+0000","last_change":"2024-09-13T19:06:21.254633+0000","last_active":"2024-09-13T19:07:50.657938+0000","last_peered":"2024-09-13T19:07:50.657938+0000","last_clean":"2024-09-13T19:07:50.657938+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:07:50.657938+0000","last_undegraded":"2024-09-13T19:07:50.657938+0000","last_fullsized":"2024-09-13T19:07:50.657938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.476452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000975+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:08:34.000975+0000","last_peered":"2024-09-13T19:08:34.000975+0000","last_clean":"2024-09-13T19:08:34.000975+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:08:34.000975+0000","last_undegraded":"2024-09-13T19:08:34.000975+0000","last_fullsized":"2024-09-13T19:08:34.000975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:54.868067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327588+0000","last_change":"2024-09-13T19:06:23.249243+0000","last_active":"2024-09-13T19:06:58.327588+0000","last_peered":"2024-09-13T19:06:58.327588+0000","last_clean":"2024-09-13T19:06:58.327588+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:06:58.327588+0000","last_undegraded":"2024-09-13T19:06:58.327588+0000","last_fullsized":"2024-09-13T19:06:58.327588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.792229+0000","last_change":"2024-09-13T19:06:25.282586+0000","last_active":"2024-09-13T19:08:33.792229+0000","last_peered":"2024-09-13T19:08:33.792229+0000","last_clean":"2024-09-13T19:08:33.792229+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:08:33.792229+0000","last_undegraded":"2024-09-13T19:08:33.792229+0000","last_fullsized":"2024-09-13T19:08:33.792229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.800732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326947+0000","last_change":"2024-09-13T19:06:27.313481+0000","last_active":"2024-09-13T19:06:58.326947+0000","last_peered":"2024-09-13T19:06:58.326947+0000","last_clean":"2024-09-13T19:06:58.326947+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:06:58.326947+0000","last_undegraded":"2024-09-13T19:06:58.326947+0000","last_fullsized":"2024-09-13T19:06:58.326947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.751983+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:09:38.751983+0000","last_peered":"2024-09-13T19:09:38.751983+0000","last_clean":"2024-09-13T19:09:38.751983+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:09:38.751983+0000","last_undegraded":"2024-09-13T19:09:38.751983+0000","last_fullsized":"2024-09-13T19:09:38.751983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:28.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255473+0000","last_change":"2024-09-13T19:06:21.254823+0000","last_active":"2024-09-13T19:09:38.255473+0000","last_peered":"2024-09-13T19:09:38.255473+0000","last_clean":"2024-09-13T19:09:38.255473+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:09:38.255473+0000","last_undegraded":"2024-09-13T19:09:38.255473+0000","last_fullsized":"2024-09-13T19:09:38.255473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.117376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329744+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:06:58.329744+0000","last_peered":"2024-09-13T19:06:58.329744+0000","last_clean":"2024-09-13T19:06:58.329744+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:06:58.329744+0000","last_undegraded":"2024-09-13T19:06:58.329744+0000","last_fullsized":"2024-09-13T19:06:58.329744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.658155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333104+0000","last_change":"2024-09-13T19:06:23.253330+0000","last_active":"2024-09-13T19:06:58.333104+0000","last_peered":"2024-09-13T19:06:58.333104+0000","last_clean":"2024-09-13T19:06:58.333104+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:06:58.333104+0000","last_undegraded":"2024-09-13T19:06:58.333104+0000","last_fullsized":"2024-09-13T19:06:58.333104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:06.158565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.761313+0000","last_change":"2024-09-13T19:06:25.281709+0000","last_active":"2024-09-13T19:08:33.761313+0000","last_peered":"2024-09-13T19:08:33.761313+0000","last_clean":"2024-09-13T19:08:33.761313+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:08:33.761313+0000","last_undegraded":"2024-09-13T19:08:33.761313+0000","last_fullsized":"2024-09-13T19:08:33.761313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:30.269921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354536+0000","last_change":"2024-09-13T19:06:27.302986+0000","last_active":"2024-09-13T19:06:58.354536+0000","last_peered":"2024-09-13T19:06:58.354536+0000","last_clean":"2024-09-13T19:06:58.354536+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:06:58.354536+0000","last_undegraded":"2024-09-13T19:06:58.354536+0000","last_fullsized":"2024-09-13T19:06:58.354536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:39.152741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.342251+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:08:33.342251+0000","last_peered":"2024-09-13T19:08:33.342251+0000","last_clean":"2024-09-13T19:08:33.342251+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:08:33.342251+0000","last_undegraded":"2024-09-13T19:08:33.342251+0000","last_fullsized":"2024-09-13T19:08:33.342251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:56.624697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.349011+0000","last_change":"2024-09-13T19:06:21.267040+0000","last_active":"2024-09-13T19:06:58.349011+0000","last_peered":"2024-09-13T19:06:58.349011+0000","last_clean":"2024-09-13T19:06:58.349011+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:06:58.349011+0000","last_undegraded":"2024-09-13T19:06:58.349011+0000","last_fullsized":"2024-09-13T19:06:58.349011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:49.679514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.338851+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:06:58.338851+0000","last_peered":"2024-09-13T19:06:58.338851+0000","last_clean":"2024-09-13T19:06:58.338851+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:06:58.338851+0000","last_undegraded":"2024-09-13T19:06:58.338851+0000","last_fullsized":"2024-09-13T19:06:58.338851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:51.658861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328141+0000","last_change":"2024-09-13T19:06:23.258329+0000","last_active":"2024-09-13T19:06:58.328141+0000","last_peered":"2024-09-13T19:06:58.328141+0000","last_clean":"2024-09-13T19:06:58.328141+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:06:58.328141+0000","last_undegraded":"2024-09-13T19:06:58.328141+0000","last_fullsized":"2024-09-13T19:06:58.328141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:19.236853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002628+0000","last_change":"2024-09-13T19:06:25.286826+0000","last_active":"2024-09-13T19:08:44.002628+0000","last_peered":"2024-09-13T19:08:44.002628+0000","last_clean":"2024-09-13T19:08:44.002628+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:08:44.002628+0000","last_undegraded":"2024-09-13T19:08:44.002628+0000","last_fullsized":"2024-09-13T19:08:44.002628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:08.372479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.762784+0000","last_change":"2024-09-13T19:06:27.328186+0000","last_active":"2024-09-13T19:09:38.762784+0000","last_peered":"2024-09-13T19:09:38.762784+0000","last_clean":"2024-09-13T19:09:38.762784+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:09:38.762784+0000","last_undegraded":"2024-09-13T19:09:38.762784+0000","last_fullsized":"2024-09-13T19:09:38.762784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:01.872002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.922026+0000","last_change":"2024-09-13T19:06:29.297215+0000","last_active":"2024-09-13T19:08:36.922026+0000","last_peered":"2024-09-13T19:08:36.922026+0000","last_clean":"2024-09-13T19:08:36.922026+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:08:36.922026+0000","last_undegraded":"2024-09-13T19:08:36.922026+0000","last_fullsized":"2024-09-13T19:08:36.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.039686+0000","last_change":"2024-09-13T19:06:21.255658+0000","last_active":"2024-09-13T19:09:38.039686+0000","last_peered":"2024-09-13T19:09:38.039686+0000","last_clean":"2024-09-13T19:09:38.039686+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:09:38.039686+0000","last_undegraded":"2024-09-13T19:09:38.039686+0000","last_fullsized":"2024-09-13T19:09:38.039686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724793+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:07:05.724793+0000","last_peered":"2024-09-13T19:07:05.724793+0000","last_clean":"2024-09-13T19:07:05.724793+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:07:05.724793+0000","last_undegraded":"2024-09-13T19:07:05.724793+0000","last_fullsized":"2024-09-13T19:07:05.724793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.606992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.151797+0000","last_change":"2024-09-13T19:06:23.268138+0000","last_active":"2024-09-13T19:08:36.151797+0000","last_peered":"2024-09-13T19:08:36.151797+0000","last_clean":"2024-09-13T19:08:36.151797+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:08:36.151797+0000","last_undegraded":"2024-09-13T19:08:36.151797+0000","last_fullsized":"2024-09-13T19:08:36.151797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.704741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004313+0000","last_change":"2024-09-13T19:06:25.281762+0000","last_active":"2024-09-13T19:08:44.004313+0000","last_peered":"2024-09-13T19:08:44.004313+0000","last_clean":"2024-09-13T19:08:44.004313+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:08:44.004313+0000","last_undegraded":"2024-09-13T19:08:44.004313+0000","last_fullsized":"2024-09-13T19:08:44.004313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:51.768718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":470,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.622710+0000","last_change":"2024-09-13T19:06:27.321351+0000","last_active":"2024-09-13T19:09:38.622710+0000","last_peered":"2024-09-13T19:09:38.622710+0000","last_clean":"2024-09-13T19:09:38.622710+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:09:38.622710+0000","last_undegraded":"2024-09-13T19:09:38.622710+0000","last_fullsized":"2024-09-13T19:09:38.622710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.413797+0000","last_change":"2024-09-13T19:06:29.303776+0000","last_active":"2024-09-13T19:08:36.413797+0000","last_peered":"2024-09-13T19:08:36.413797+0000","last_clean":"2024-09-13T19:08:36.413797+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:08:36.413797+0000","last_undegraded":"2024-09-13T19:08:36.413797+0000","last_fullsized":"2024-09-13T19:08:36.413797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:42.497813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455777+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.455777+0000","last_peered":"2024-09-13T19:09:38.455777+0000","last_clean":"2024-09-13T19:09:38.455777+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.455777+0000","last_undegraded":"2024-09-13T19:09:38.455777+0000","last_fullsized":"2024-09-13T19:09:38.455777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:54.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336035+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:06:58.336035+0000","last_peered":"2024-09-13T19:06:58.336035+0000","last_clean":"2024-09-13T19:06:58.336035+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:06:58.336035+0000","last_undegraded":"2024-09-13T19:06:58.336035+0000","last_fullsized":"2024-09-13T19:06:58.336035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:35.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354619+0000","last_change":"2024-09-13T19:06:23.278499+0000","last_active":"2024-09-13T19:06:58.354619+0000","last_peered":"2024-09-13T19:06:58.354619+0000","last_clean":"2024-09-13T19:06:58.354619+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:06:58.354619+0000","last_undegraded":"2024-09-13T19:06:58.354619+0000","last_fullsized":"2024-09-13T19:06:58.354619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:05.943867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.782491+0000","last_change":"2024-09-13T19:06:25.280810+0000","last_active":"2024-09-13T19:08:33.782491+0000","last_peered":"2024-09-13T19:08:33.782491+0000","last_clean":"2024-09-13T19:08:33.782491+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:08:33.782491+0000","last_undegraded":"2024-09-13T19:08:33.782491+0000","last_fullsized":"2024-09-13T19:08:33.782491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.687336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330438+0000","last_change":"2024-09-13T19:06:27.327479+0000","last_active":"2024-09-13T19:06:58.330438+0000","last_peered":"2024-09-13T19:06:58.330438+0000","last_clean":"2024-09-13T19:06:58.330438+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:06:58.330438+0000","last_undegraded":"2024-09-13T19:06:58.330438+0000","last_fullsized":"2024-09-13T19:06:58.330438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:32.856579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.552955+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:09:38.552955+0000","last_peered":"2024-09-13T19:09:38.552955+0000","last_clean":"2024-09-13T19:09:38.552955+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:09:38.552955+0000","last_undegraded":"2024-09-13T19:09:38.552955+0000","last_fullsized":"2024-09-13T19:09:38.552955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:43.406563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.038245+0000","last_change":"2024-09-13T19:06:21.266428+0000","last_active":"2024-09-13T19:07:08.038245+0000","last_peered":"2024-09-13T19:07:08.038245+0000","last_clean":"2024-09-13T19:07:08.038245+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:07:08.038245+0000","last_undegraded":"2024-09-13T19:07:08.038245+0000","last_fullsized":"2024-09-13T19:07:08.038245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:15.353078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353237+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:58.353237+0000","last_peered":"2024-09-13T19:06:58.353237+0000","last_clean":"2024-09-13T19:06:58.353237+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:58.353237+0000","last_undegraded":"2024-09-13T19:06:58.353237+0000","last_fullsized":"2024-09-13T19:06:58.353237+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341613+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:58.341613+0000","last_peered":"2024-09-13T19:06:58.341613+0000","last_clean":"2024-09-13T19:06:58.341613+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:58.341613+0000","last_undegraded":"2024-09-13T19:06:58.341613+0000","last_fullsized":"2024-09-13T19:06:58.341613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.642212+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:07:50.642212+0000","last_peered":"2024-09-13T19:07:50.642212+0000","last_clean":"2024-09-13T19:07:50.642212+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:07:50.642212+0000","last_undegraded":"2024-09-13T19:07:50.642212+0000","last_fullsized":"2024-09-13T19:07:50.642212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:05.311607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343001+0000","last_change":"2024-09-13T19:06:23.274175+0000","last_active":"2024-09-13T19:06:58.343001+0000","last_peered":"2024-09-13T19:06:58.343001+0000","last_clean":"2024-09-13T19:06:58.343001+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:06:58.343001+0000","last_undegraded":"2024-09-13T19:06:58.343001+0000","last_fullsized":"2024-09-13T19:06:58.343001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:15.978917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.801042+0000","last_change":"2024-09-13T19:06:25.277544+0000","last_active":"2024-09-13T19:08:33.801042+0000","last_peered":"2024-09-13T19:08:33.801042+0000","last_clean":"2024-09-13T19:08:33.801042+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:08:33.801042+0000","last_undegraded":"2024-09-13T19:08:33.801042+0000","last_fullsized":"2024-09-13T19:08:33.801042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:24.442610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333055+0000","last_change":"2024-09-13T19:06:27.299350+0000","last_active":"2024-09-13T19:06:58.333055+0000","last_peered":"2024-09-13T19:06:58.333055+0000","last_clean":"2024-09-13T19:06:58.333055+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:06:58.333055+0000","last_undegraded":"2024-09-13T19:06:58.333055+0000","last_fullsized":"2024-09-13T19:06:58.333055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:10.979684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.482335+0000","last_change":"2024-09-13T19:06:29.300679+0000","last_active":"2024-09-13T19:09:38.482335+0000","last_peered":"2024-09-13T19:09:38.482335+0000","last_clean":"2024-09-13T19:09:38.482335+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:09:38.482335+0000","last_undegraded":"2024-09-13T19:09:38.482335+0000","last_fullsized":"2024-09-13T19:09:38.482335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:18.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.325242+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:07:07.325242+0000","last_peered":"2024-09-13T19:07:07.325242+0000","last_clean":"2024-09-13T19:07:07.325242+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:07:07.325242+0000","last_undegraded":"2024-09-13T19:07:07.325242+0000","last_fullsized":"2024-09-13T19:07:07.325242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:10.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335353+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:58.335353+0000","last_peered":"2024-09-13T19:06:58.335353+0000","last_clean":"2024-09-13T19:06:58.335353+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:58.335353+0000","last_undegraded":"2024-09-13T19:06:58.335353+0000","last_fullsized":"2024-09-13T19:06:58.335353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327250+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:06:58.327250+0000","last_peered":"2024-09-13T19:06:58.327250+0000","last_clean":"2024-09-13T19:06:58.327250+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:06:58.327250+0000","last_undegraded":"2024-09-13T19:06:58.327250+0000","last_fullsized":"2024-09-13T19:06:58.327250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.122617+0000","last_change":"2024-09-13T19:06:23.276941+0000","last_active":"2024-09-13T19:08:36.122617+0000","last_peered":"2024-09-13T19:08:36.122617+0000","last_clean":"2024-09-13T19:08:36.122617+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:08:36.122617+0000","last_undegraded":"2024-09-13T19:08:36.122617+0000","last_fullsized":"2024-09-13T19:08:36.122617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:43.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517889+0000","last_change":"2024-09-13T19:06:25.284975+0000","last_active":"2024-09-13T19:09:38.517889+0000","last_peered":"2024-09-13T19:09:38.517889+0000","last_clean":"2024-09-13T19:09:38.517889+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:09:38.517889+0000","last_undegraded":"2024-09-13T19:09:38.517889+0000","last_fullsized":"2024-09-13T19:09:38.517889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:14.778552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342538+0000","last_change":"2024-09-13T19:06:27.305676+0000","last_active":"2024-09-13T19:06:58.342538+0000","last_peered":"2024-09-13T19:06:58.342538+0000","last_clean":"2024-09-13T19:06:58.342538+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:06:58.342538+0000","last_undegraded":"2024-09-13T19:06:58.342538+0000","last_fullsized":"2024-09-13T19:06:58.342538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:49.829980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.388695+0000","last_change":"2024-09-13T19:06:29.319214+0000","last_active":"2024-09-13T19:07:50.388695+0000","last_peered":"2024-09-13T19:07:50.388695+0000","last_clean":"2024-09-13T19:07:50.388695+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:07:50.388695+0000","last_undegraded":"2024-09-13T19:07:50.388695+0000","last_fullsized":"2024-09-13T19:07:50.388695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:33.276278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.256520+0000","last_change":"2024-09-13T19:06:21.260320+0000","last_active":"2024-09-13T19:09:38.256520+0000","last_peered":"2024-09-13T19:09:38.256520+0000","last_clean":"2024-09-13T19:09:38.256520+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:09:38.256520+0000","last_undegraded":"2024-09-13T19:09:38.256520+0000","last_fullsized":"2024-09-13T19:09:38.256520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329531+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:58.329531+0000","last_peered":"2024-09-13T19:06:58.329531+0000","last_clean":"2024-09-13T19:06:58.329531+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:58.329531+0000","last_undegraded":"2024-09-13T19:06:58.329531+0000","last_fullsized":"2024-09-13T19:06:58.329531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326113+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:06:58.326113+0000","last_peered":"2024-09-13T19:06:58.326113+0000","last_clean":"2024-09-13T19:06:58.326113+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:06:58.326113+0000","last_undegraded":"2024-09-13T19:06:58.326113+0000","last_fullsized":"2024-09-13T19:06:58.326113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.371226+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:06:58.371226+0000","last_peered":"2024-09-13T19:06:58.371226+0000","last_clean":"2024-09-13T19:06:58.371226+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:06:58.371226+0000","last_undegraded":"2024-09-13T19:06:58.371226+0000","last_fullsized":"2024-09-13T19:06:58.371226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:30.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518498+0000","last_change":"2024-09-13T19:06:25.297340+0000","last_active":"2024-09-13T19:09:38.518498+0000","last_peered":"2024-09-13T19:09:38.518498+0000","last_clean":"2024-09-13T19:09:38.518498+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:09:38.518498+0000","last_undegraded":"2024-09-13T19:09:38.518498+0000","last_fullsized":"2024-09-13T19:09:38.518498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:59.204433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329583+0000","last_change":"2024-09-13T19:06:27.303087+0000","last_active":"2024-09-13T19:06:58.329583+0000","last_peered":"2024-09-13T19:06:58.329583+0000","last_clean":"2024-09-13T19:06:58.329583+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:06:58.329583+0000","last_undegraded":"2024-09-13T19:06:58.329583+0000","last_fullsized":"2024-09-13T19:06:58.329583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:15.260803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335697+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:06:58.335697+0000","last_peered":"2024-09-13T19:06:58.335697+0000","last_clean":"2024-09-13T19:06:58.335697+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:06:58.335697+0000","last_undegraded":"2024-09-13T19:06:58.335697+0000","last_fullsized":"2024-09-13T19:06:58.335697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:02.339869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.032925+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:07:08.032925+0000","last_peered":"2024-09-13T19:07:08.032925+0000","last_clean":"2024-09-13T19:07:08.032925+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:07:08.032925+0000","last_undegraded":"2024-09-13T19:07:08.032925+0000","last_fullsized":"2024-09-13T19:07:08.032925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336137+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:58.336137+0000","last_peered":"2024-09-13T19:06:58.336137+0000","last_clean":"2024-09-13T19:06:58.336137+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:58.336137+0000","last_undegraded":"2024-09-13T19:06:58.336137+0000","last_fullsized":"2024-09-13T19:06:58.336137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330472+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:06:58.330472+0000","last_peered":"2024-09-13T19:06:58.330472+0000","last_clean":"2024-09-13T19:06:58.330472+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:06:58.330472+0000","last_undegraded":"2024-09-13T19:06:58.330472+0000","last_fullsized":"2024-09-13T19:06:58.330472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330688+0000","last_change":"2024-09-13T19:06:23.247010+0000","last_active":"2024-09-13T19:06:58.330688+0000","last_peered":"2024-09-13T19:06:58.330688+0000","last_clean":"2024-09-13T19:06:58.330688+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:06:58.330688+0000","last_undegraded":"2024-09-13T19:06:58.330688+0000","last_fullsized":"2024-09-13T19:06:58.330688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:39.504976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.165710+0000","last_change":"2024-09-13T19:06:25.277155+0000","last_active":"2024-09-13T19:09:37.165710+0000","last_peered":"2024-09-13T19:09:37.165710+0000","last_clean":"2024-09-13T19:09:37.165710+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:09:37.165710+0000","last_undegraded":"2024-09-13T19:09:37.165710+0000","last_fullsized":"2024-09-13T19:09:37.165710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:35.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353918+0000","last_change":"2024-09-13T19:06:27.303059+0000","last_active":"2024-09-13T19:06:58.353918+0000","last_peered":"2024-09-13T19:06:58.353918+0000","last_clean":"2024-09-13T19:06:58.353918+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:06:58.353918+0000","last_undegraded":"2024-09-13T19:06:58.353918+0000","last_fullsized":"2024-09-13T19:06:58.353918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:37.515962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.452185+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:08:36.452185+0000","last_peered":"2024-09-13T19:08:36.452185+0000","last_clean":"2024-09-13T19:08:36.452185+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:08:36.452185+0000","last_undegraded":"2024-09-13T19:08:36.452185+0000","last_fullsized":"2024-09-13T19:08:36.452185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.652660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.037885+0000","last_change":"2024-09-13T19:06:21.264605+0000","last_active":"2024-09-13T19:07:08.037885+0000","last_peered":"2024-09-13T19:07:08.037885+0000","last_clean":"2024-09-13T19:07:08.037885+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:07:08.037885+0000","last_undegraded":"2024-09-13T19:07:08.037885+0000","last_fullsized":"2024-09-13T19:07:08.037885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331265+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:06:58.331265+0000","last_peered":"2024-09-13T19:06:58.331265+0000","last_clean":"2024-09-13T19:06:58.331265+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:06:58.331265+0000","last_undegraded":"2024-09-13T19:06:58.331265+0000","last_fullsized":"2024-09-13T19:06:58.331265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328957+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:58.328957+0000","last_peered":"2024-09-13T19:06:58.328957+0000","last_clean":"2024-09-13T19:06:58.328957+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:58.328957+0000","last_undegraded":"2024-09-13T19:06:58.328957+0000","last_fullsized":"2024-09-13T19:06:58.328957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.989981+0000","last_change":"2024-09-13T19:06:23.246897+0000","last_active":"2024-09-13T19:08:28.989981+0000","last_peered":"2024-09-13T19:08:28.989981+0000","last_clean":"2024-09-13T19:08:28.989981+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:08:28.989981+0000","last_undegraded":"2024-09-13T19:08:28.989981+0000","last_fullsized":"2024-09-13T19:08:28.989981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:02.627136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'63","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.803978+0000","last_change":"2024-09-13T19:06:25.271746+0000","last_active":"2024-09-13T19:08:33.803978+0000","last_peered":"2024-09-13T19:08:33.803978+0000","last_clean":"2024-09-13T19:08:33.803978+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:08:33.803978+0000","last_undegraded":"2024-09-13T19:08:33.803978+0000","last_fullsized":"2024-09-13T19:08:33.803978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:48.903655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328017+0000","last_change":"2024-09-13T19:06:27.327868+0000","last_active":"2024-09-13T19:06:58.328017+0000","last_peered":"2024-09-13T19:06:58.328017+0000","last_clean":"2024-09-13T19:06:58.328017+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:06:58.328017+0000","last_undegraded":"2024-09-13T19:06:58.328017+0000","last_fullsized":"2024-09-13T19:06:58.328017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:58.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.927178+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:36.927178+0000","last_peered":"2024-09-13T19:08:36.927178+0000","last_clean":"2024-09-13T19:08:36.927178+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:36.927178+0000","last_undegraded":"2024-09-13T19:08:36.927178+0000","last_fullsized":"2024-09-13T19:08:36.927178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:18.960181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474863+0000","last_change":"2024-09-13T19:06:21.256957+0000","last_active":"2024-09-13T19:09:38.474863+0000","last_peered":"2024-09-13T19:09:38.474863+0000","last_clean":"2024-09-13T19:09:38.474863+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:09:38.474863+0000","last_undegraded":"2024-09-13T19:09:38.474863+0000","last_fullsized":"2024-09-13T19:09:38.474863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.052247+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:08:37.052247+0000","last_peered":"2024-09-13T19:08:37.052247+0000","last_clean":"2024-09-13T19:08:37.052247+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:08:37.052247+0000","last_undegraded":"2024-09-13T19:08:37.052247+0000","last_fullsized":"2024-09-13T19:08:37.052247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344720+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:58.344720+0000","last_peered":"2024-09-13T19:06:58.344720+0000","last_clean":"2024-09-13T19:06:58.344720+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:58.344720+0000","last_undegraded":"2024-09-13T19:06:58.344720+0000","last_fullsized":"2024-09-13T19:06:58.344720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.357946+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:06:58.357946+0000","last_peered":"2024-09-13T19:06:58.357946+0000","last_clean":"2024-09-13T19:06:58.357946+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:06:58.357946+0000","last_undegraded":"2024-09-13T19:06:58.357946+0000","last_fullsized":"2024-09-13T19:06:58.357946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:53.053072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.352663+0000","last_change":"2024-09-13T19:06:25.289221+0000","last_active":"2024-09-13T19:06:58.352663+0000","last_peered":"2024-09-13T19:06:58.352663+0000","last_clean":"2024-09-13T19:06:58.352663+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:06:58.352663+0000","last_undegraded":"2024-09-13T19:06:58.352663+0000","last_fullsized":"2024-09-13T19:06:58.352663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:24.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517756+0000","last_change":"2024-09-13T19:06:27.322042+0000","last_active":"2024-09-13T19:09:38.517756+0000","last_peered":"2024-09-13T19:09:38.517756+0000","last_clean":"2024-09-13T19:09:38.517756+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:09:38.517756+0000","last_undegraded":"2024-09-13T19:09:38.517756+0000","last_fullsized":"2024-09-13T19:09:38.517756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350581+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:06:58.350581+0000","last_peered":"2024-09-13T19:06:58.350581+0000","last_clean":"2024-09-13T19:06:58.350581+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:06:58.350581+0000","last_undegraded":"2024-09-13T19:06:58.350581+0000","last_fullsized":"2024-09-13T19:06:58.350581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:14.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336082+0000","last_change":"2024-09-13T19:06:21.259985+0000","last_active":"2024-09-13T19:06:58.336082+0000","last_peered":"2024-09-13T19:06:58.336082+0000","last_clean":"2024-09-13T19:06:58.336082+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:06:58.336082+0000","last_undegraded":"2024-09-13T19:06:58.336082+0000","last_fullsized":"2024-09-13T19:06:58.336082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.974707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.356451+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:06:58.356451+0000","last_peered":"2024-09-13T19:06:58.356451+0000","last_clean":"2024-09-13T19:06:58.356451+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:06:58.356451+0000","last_undegraded":"2024-09-13T19:06:58.356451+0000","last_fullsized":"2024-09-13T19:06:58.356451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:21.325723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333377+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:58.333377+0000","last_peered":"2024-09-13T19:06:58.333377+0000","last_clean":"2024-09-13T19:06:58.333377+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:58.333377+0000","last_undegraded":"2024-09-13T19:06:58.333377+0000","last_fullsized":"2024-09-13T19:06:58.333377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336839+0000","last_change":"2024-09-13T19:06:23.278519+0000","last_active":"2024-09-13T19:06:58.336839+0000","last_peered":"2024-09-13T19:06:58.336839+0000","last_clean":"2024-09-13T19:06:58.336839+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:06:58.336839+0000","last_undegraded":"2024-09-13T19:06:58.336839+0000","last_fullsized":"2024-09-13T19:06:58.336839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:56.056319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337965+0000","last_change":"2024-09-13T19:06:25.303816+0000","last_active":"2024-09-13T19:06:58.337965+0000","last_peered":"2024-09-13T19:06:58.337965+0000","last_clean":"2024-09-13T19:06:58.337965+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:06:58.337965+0000","last_undegraded":"2024-09-13T19:06:58.337965+0000","last_fullsized":"2024-09-13T19:06:58.337965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:40.157012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.797372+0000","last_change":"2024-09-13T19:06:27.282458+0000","last_active":"2024-09-13T19:09:38.797372+0000","last_peered":"2024-09-13T19:09:38.797372+0000","last_clean":"2024-09-13T19:09:38.797372+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:09:38.797372+0000","last_undegraded":"2024-09-13T19:09:38.797372+0000","last_fullsized":"2024-09-13T19:09:38.797372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341741+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:06:58.341741+0000","last_peered":"2024-09-13T19:06:58.341741+0000","last_clean":"2024-09-13T19:06:58.341741+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:06:58.341741+0000","last_undegraded":"2024-09-13T19:06:58.341741+0000","last_fullsized":"2024-09-13T19:06:58.341741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:28.410267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474093+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:09:38.474093+0000","last_peered":"2024-09-13T19:09:38.474093+0000","last_clean":"2024-09-13T19:09:38.474093+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:09:38.474093+0000","last_undegraded":"2024-09-13T19:09:38.474093+0000","last_fullsized":"2024-09-13T19:09:38.474093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:40.974350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359033+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:06:58.359033+0000","last_peered":"2024-09-13T19:06:58.359033+0000","last_clean":"2024-09-13T19:06:58.359033+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:06:58.359033+0000","last_undegraded":"2024-09-13T19:06:58.359033+0000","last_fullsized":"2024-09-13T19:06:58.359033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355963+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:58.355963+0000","last_peered":"2024-09-13T19:06:58.355963+0000","last_clean":"2024-09-13T19:06:58.355963+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:58.355963+0000","last_undegraded":"2024-09-13T19:06:58.355963+0000","last_fullsized":"2024-09-13T19:06:58.355963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335083+0000","last_change":"2024-09-13T19:06:23.258816+0000","last_active":"2024-09-13T19:06:58.335083+0000","last_peered":"2024-09-13T19:06:58.335083+0000","last_clean":"2024-09-13T19:06:58.335083+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:06:58.335083+0000","last_undegraded":"2024-09-13T19:06:58.335083+0000","last_fullsized":"2024-09-13T19:06:58.335083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.779140+0000","last_change":"2024-09-13T19:06:25.297079+0000","last_active":"2024-09-13T19:08:33.779140+0000","last_peered":"2024-09-13T19:08:33.779140+0000","last_clean":"2024-09-13T19:08:33.779140+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:08:33.779140+0000","last_undegraded":"2024-09-13T19:08:33.779140+0000","last_fullsized":"2024-09-13T19:08:33.779140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:41.508588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326963+0000","last_change":"2024-09-13T19:06:27.313781+0000","last_active":"2024-09-13T19:06:58.326963+0000","last_peered":"2024-09-13T19:06:58.326963+0000","last_clean":"2024-09-13T19:06:58.326963+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:06:58.326963+0000","last_undegraded":"2024-09-13T19:06:58.326963+0000","last_fullsized":"2024-09-13T19:06:58.326963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:40.346062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342617+0000","last_change":"2024-09-13T19:06:29.312253+0000","last_active":"2024-09-13T19:06:58.342617+0000","last_peered":"2024-09-13T19:06:58.342617+0000","last_clean":"2024-09-13T19:06:58.342617+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:06:58.342617+0000","last_undegraded":"2024-09-13T19:06:58.342617+0000","last_fullsized":"2024-09-13T19:06:58.342617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:42.361204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.616193+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:09:38.616193+0000","last_peered":"2024-09-13T19:09:38.616193+0000","last_clean":"2024-09-13T19:09:38.616193+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:09:38.616193+0000","last_undegraded":"2024-09-13T19:09:38.616193+0000","last_fullsized":"2024-09-13T19:09:38.616193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:59.779490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.391281+0000","last_change":"2024-09-13T19:06:21.254116+0000","last_active":"2024-09-13T19:09:38.391281+0000","last_peered":"2024-09-13T19:09:38.391281+0000","last_clean":"2024-09-13T19:09:38.391281+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:09:38.391281+0000","last_undegraded":"2024-09-13T19:09:38.391281+0000","last_fullsized":"2024-09-13T19:09:38.391281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344342+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:06:58.344342+0000","last_peered":"2024-09-13T19:06:58.344342+0000","last_clean":"2024-09-13T19:06:58.344342+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:06:58.344342+0000","last_undegraded":"2024-09-13T19:06:58.344342+0000","last_fullsized":"2024-09-13T19:06:58.344342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:27.824459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340835+0000","last_change":"2024-09-13T19:06:23.271978+0000","last_active":"2024-09-13T19:06:58.340835+0000","last_peered":"2024-09-13T19:06:58.340835+0000","last_clean":"2024-09-13T19:06:58.340835+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:06:58.340835+0000","last_undegraded":"2024-09-13T19:06:58.340835+0000","last_fullsized":"2024-09-13T19:06:58.340835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:00.312157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'33","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005883+0000","last_change":"2024-09-13T19:06:25.283177+0000","last_active":"2024-09-13T19:08:49.005883+0000","last_peered":"2024-09-13T19:08:49.005883+0000","last_clean":"2024-09-13T19:08:49.005883+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:08:49.005883+0000","last_undegraded":"2024-09-13T19:08:49.005883+0000","last_fullsized":"2024-09-13T19:08:49.005883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:04.407822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336859+0000","last_change":"2024-09-13T19:06:27.325440+0000","last_active":"2024-09-13T19:06:58.336859+0000","last_peered":"2024-09-13T19:06:58.336859+0000","last_clean":"2024-09-13T19:06:58.336859+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:06:58.336859+0000","last_undegraded":"2024-09-13T19:06:58.336859+0000","last_fullsized":"2024-09-13T19:06:58.336859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:33.587433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.338476+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:09:38.338476+0000","last_peered":"2024-09-13T19:09:38.338476+0000","last_clean":"2024-09-13T19:09:38.338476+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:09:38.338476+0000","last_undegraded":"2024-09-13T19:09:38.338476+0000","last_fullsized":"2024-09-13T19:09:38.338476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:15.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.333822+0000","last_change":"2024-09-13T19:06:21.258397+0000","last_active":"2024-09-13T19:08:31.333822+0000","last_peered":"2024-09-13T19:08:31.333822+0000","last_clean":"2024-09-13T19:08:31.333822+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:08:31.333822+0000","last_undegraded":"2024-09-13T19:08:31.333822+0000","last_fullsized":"2024-09-13T19:08:31.333822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002481+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:08:44.002481+0000","last_peered":"2024-09-13T19:08:44.002481+0000","last_clean":"2024-09-13T19:08:44.002481+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:08:44.002481+0000","last_undegraded":"2024-09-13T19:08:44.002481+0000","last_fullsized":"2024-09-13T19:08:44.002481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337678+0000","last_change":"2024-09-13T19:06:23.263752+0000","last_active":"2024-09-13T19:06:58.337678+0000","last_peered":"2024-09-13T19:06:58.337678+0000","last_clean":"2024-09-13T19:06:58.337678+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:06:58.337678+0000","last_undegraded":"2024-09-13T19:06:58.337678+0000","last_fullsized":"2024-09-13T19:06:58.337678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:11.243897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.175973+0000","last_change":"2024-09-13T19:06:25.282738+0000","last_active":"2024-09-13T19:09:37.175973+0000","last_peered":"2024-09-13T19:09:37.175973+0000","last_clean":"2024-09-13T19:09:37.175973+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:09:37.175973+0000","last_undegraded":"2024-09-13T19:09:37.175973+0000","last_fullsized":"2024-09-13T19:09:37.175973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:30.312744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329003+0000","last_change":"2024-09-13T19:06:27.319132+0000","last_active":"2024-09-13T19:06:58.329003+0000","last_peered":"2024-09-13T19:06:58.329003+0000","last_clean":"2024-09-13T19:06:58.329003+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:06:58.329003+0000","last_undegraded":"2024-09-13T19:06:58.329003+0000","last_fullsized":"2024-09-13T19:06:58.329003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:50.916949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329771+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:06:58.329771+0000","last_peered":"2024-09-13T19:06:58.329771+0000","last_clean":"2024-09-13T19:06:58.329771+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:06:58.329771+0000","last_undegraded":"2024-09-13T19:06:58.329771+0000","last_fullsized":"2024-09-13T19:06:58.329771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:34.489280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328516+0000","last_change":"2024-09-13T19:06:21.244155+0000","last_active":"2024-09-13T19:06:58.328516+0000","last_peered":"2024-09-13T19:06:58.328516+0000","last_clean":"2024-09-13T19:06:58.328516+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:06:58.328516+0000","last_undegraded":"2024-09-13T19:06:58.328516+0000","last_fullsized":"2024-09-13T19:06:58.328516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345339+0000","last_change":"2024-09-13T19:06:19.272180+0000","last_active":"2024-09-13T19:06:58.345339+0000","last_peered":"2024-09-13T19:06:58.345339+0000","last_clean":"2024-09-13T19:06:58.345339+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:06:58.345339+0000","last_undegraded":"2024-09-13T19:06:58.345339+0000","last_fullsized":"2024-09-13T19:06:58.345339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329720+0000","last_change":"2024-09-13T19:06:23.263616+0000","last_active":"2024-09-13T19:06:58.329720+0000","last_peered":"2024-09-13T19:06:58.329720+0000","last_clean":"2024-09-13T19:06:58.329720+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:06:58.329720+0000","last_undegraded":"2024-09-13T19:06:58.329720+0000","last_fullsized":"2024-09-13T19:06:58.329720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:38.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.326409+0000","last_change":"2024-09-13T19:06:25.270269+0000","last_active":"2024-09-13T19:09:37.326409+0000","last_peered":"2024-09-13T19:09:37.326409+0000","last_clean":"2024-09-13T19:09:37.326409+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:09:37.326409+0000","last_undegraded":"2024-09-13T19:09:37.326409+0000","last_fullsized":"2024-09-13T19:09:37.326409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:42.960440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.339704+0000","last_change":"2024-09-13T19:06:27.320991+0000","last_active":"2024-09-13T19:06:58.339704+0000","last_peered":"2024-09-13T19:06:58.339704+0000","last_clean":"2024-09-13T19:06:58.339704+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:06:58.339704+0000","last_undegraded":"2024-09-13T19:06:58.339704+0000","last_fullsized":"2024-09-13T19:06:58.339704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.378906+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.378906+0000","last_peered":"2024-09-13T19:09:37.378906+0000","last_clean":"2024-09-13T19:09:37.378906+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.378906+0000","last_undegraded":"2024-09-13T19:09:37.378906+0000","last_fullsized":"2024-09-13T19:09:37.378906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:43.618866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.383880+0000","last_change":"2024-09-13T19:06:21.259679+0000","last_active":"2024-09-13T19:07:50.383880+0000","last_peered":"2024-09-13T19:07:50.383880+0000","last_clean":"2024-09-13T19:07:50.383880+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:07:50.383880+0000","last_undegraded":"2024-09-13T19:07:50.383880+0000","last_fullsized":"2024-09-13T19:07:50.383880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:13.988925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.722225+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:07:05.722225+0000","last_peered":"2024-09-13T19:07:05.722225+0000","last_clean":"2024-09-13T19:07:05.722225+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:07:05.722225+0000","last_undegraded":"2024-09-13T19:07:05.722225+0000","last_fullsized":"2024-09-13T19:07:05.722225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336516+0000","last_change":"2024-09-13T19:06:23.274472+0000","last_active":"2024-09-13T19:06:58.336516+0000","last_peered":"2024-09-13T19:06:58.336516+0000","last_clean":"2024-09-13T19:06:58.336516+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:06:58.336516+0000","last_undegraded":"2024-09-13T19:06:58.336516+0000","last_fullsized":"2024-09-13T19:06:58.336516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:17.488278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.126723+0000","last_change":"2024-09-13T19:06:25.301056+0000","last_active":"2024-09-13T19:08:37.126723+0000","last_peered":"2024-09-13T19:08:37.126723+0000","last_clean":"2024-09-13T19:08:37.126723+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:08:37.126723+0000","last_undegraded":"2024-09-13T19:08:37.126723+0000","last_fullsized":"2024-09-13T19:08:37.126723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:47.795992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329265+0000","last_change":"2024-09-13T19:06:27.294666+0000","last_active":"2024-09-13T19:06:58.329265+0000","last_peered":"2024-09-13T19:06:58.329265+0000","last_clean":"2024-09-13T19:06:58.329265+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:06:58.329265+0000","last_undegraded":"2024-09-13T19:06:58.329265+0000","last_fullsized":"2024-09-13T19:06:58.329265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.973735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000048+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:08:29.000048+0000","last_peered":"2024-09-13T19:08:29.000048+0000","last_clean":"2024-09-13T19:08:29.000048+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:08:29.000048+0000","last_undegraded":"2024-09-13T19:08:29.000048+0000","last_fullsized":"2024-09-13T19:08:29.000048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:37.935118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335394+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:06:58.335394+0000","last_peered":"2024-09-13T19:06:58.335394+0000","last_clean":"2024-09-13T19:06:58.335394+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:06:58.335394+0000","last_undegraded":"2024-09-13T19:06:58.335394+0000","last_fullsized":"2024-09-13T19:06:58.335394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.587940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333770+0000","last_change":"2024-09-13T19:06:23.248415+0000","last_active":"2024-09-13T19:06:58.333770+0000","last_peered":"2024-09-13T19:06:58.333770+0000","last_clean":"2024-09-13T19:06:58.333770+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:06:58.333770+0000","last_undegraded":"2024-09-13T19:06:58.333770+0000","last_fullsized":"2024-09-13T19:06:58.333770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.792380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.799086+0000","last_change":"2024-09-13T19:06:25.283923+0000","last_active":"2024-09-13T19:08:33.799086+0000","last_peered":"2024-09-13T19:08:33.799086+0000","last_clean":"2024-09-13T19:08:33.799086+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:08:33.799086+0000","last_undegraded":"2024-09-13T19:08:33.799086+0000","last_fullsized":"2024-09-13T19:08:33.799086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:12.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330187+0000","last_change":"2024-09-13T19:06:27.303955+0000","last_active":"2024-09-13T19:06:58.330187+0000","last_peered":"2024-09-13T19:06:58.330187+0000","last_clean":"2024-09-13T19:06:58.330187+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:06:58.330187+0000","last_undegraded":"2024-09-13T19:06:58.330187+0000","last_fullsized":"2024-09-13T19:06:58.330187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:14.386556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.917251+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:36.917251+0000","last_peered":"2024-09-13T19:08:36.917251+0000","last_clean":"2024-09-13T19:08:36.917251+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:36.917251+0000","last_undegraded":"2024-09-13T19:08:36.917251+0000","last_fullsized":"2024-09-13T19:08:36.917251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:57.870673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.318999+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:08:31.318999+0000","last_peered":"2024-09-13T19:08:31.318999+0000","last_clean":"2024-09-13T19:08:31.318999+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:08:31.318999+0000","last_undegraded":"2024-09-13T19:08:31.318999+0000","last_fullsized":"2024-09-13T19:08:31.318999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724569+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:07:05.724569+0000","last_peered":"2024-09-13T19:07:05.724569+0000","last_clean":"2024-09-13T19:07:05.724569+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:07:05.724569+0000","last_undegraded":"2024-09-13T19:07:05.724569+0000","last_fullsized":"2024-09-13T19:07:05.724569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337604+0000","last_change":"2024-09-13T19:06:23.257527+0000","last_active":"2024-09-13T19:06:58.337604+0000","last_peered":"2024-09-13T19:06:58.337604+0000","last_clean":"2024-09-13T19:06:58.337604+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:06:58.337604+0000","last_undegraded":"2024-09-13T19:06:58.337604+0000","last_fullsized":"2024-09-13T19:06:58.337604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:25.565333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.767219+0000","last_change":"2024-09-13T19:06:25.294450+0000","last_active":"2024-09-13T19:08:33.767219+0000","last_peered":"2024-09-13T19:08:33.767219+0000","last_clean":"2024-09-13T19:08:33.767219+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:08:33.767219+0000","last_undegraded":"2024-09-13T19:08:33.767219+0000","last_fullsized":"2024-09-13T19:08:33.767219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:37.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359493+0000","last_change":"2024-09-13T19:06:27.318412+0000","last_active":"2024-09-13T19:06:58.359493+0000","last_peered":"2024-09-13T19:06:58.359493+0000","last_clean":"2024-09-13T19:06:58.359493+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:06:58.359493+0000","last_undegraded":"2024-09-13T19:06:58.359493+0000","last_fullsized":"2024-09-13T19:06:58.359493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335274+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:06:58.335274+0000","last_peered":"2024-09-13T19:06:58.335274+0000","last_clean":"2024-09-13T19:06:58.335274+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:06:58.335274+0000","last_undegraded":"2024-09-13T19:06:58.335274+0000","last_fullsized":"2024-09-13T19:06:58.335274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:55.890196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.122252+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:08:37.122252+0000","last_peered":"2024-09-13T19:08:37.122252+0000","last_clean":"2024-09-13T19:08:37.122252+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:08:37.122252+0000","last_undegraded":"2024-09-13T19:08:37.122252+0000","last_fullsized":"2024-09-13T19:08:37.122252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.738508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724550+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:07:05.724550+0000","last_peered":"2024-09-13T19:07:05.724550+0000","last_clean":"2024-09-13T19:07:05.724550+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:07:05.724550+0000","last_undegraded":"2024-09-13T19:07:05.724550+0000","last_fullsized":"2024-09-13T19:07:05.724550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.152165+0000","last_change":"2024-09-13T19:06:23.260000+0000","last_active":"2024-09-13T19:08:36.152165+0000","last_peered":"2024-09-13T19:08:36.152165+0000","last_clean":"2024-09-13T19:08:36.152165+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:08:36.152165+0000","last_undegraded":"2024-09-13T19:08:36.152165+0000","last_fullsized":"2024-09-13T19:08:36.152165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.210958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.795083+0000","last_change":"2024-09-13T19:06:25.266493+0000","last_active":"2024-09-13T19:08:33.795083+0000","last_peered":"2024-09-13T19:08:33.795083+0000","last_clean":"2024-09-13T19:08:33.795083+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:08:33.795083+0000","last_undegraded":"2024-09-13T19:08:33.795083+0000","last_fullsized":"2024-09-13T19:08:33.795083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:30.843285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331097+0000","last_change":"2024-09-13T19:06:27.282770+0000","last_active":"2024-09-13T19:06:58.331097+0000","last_peered":"2024-09-13T19:06:58.331097+0000","last_clean":"2024-09-13T19:06:58.331097+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:06:58.331097+0000","last_undegraded":"2024-09-13T19:06:58.331097+0000","last_fullsized":"2024-09-13T19:06:58.331097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:40.940281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.927729+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:37.927729+0000","last_peered":"2024-09-13T19:09:37.927729+0000","last_clean":"2024-09-13T19:09:37.927729+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:37.927729+0000","last_undegraded":"2024-09-13T19:09:37.927729+0000","last_fullsized":"2024-09-13T19:09:37.927729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:02.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040188+0000","last_change":"2024-09-13T19:06:21.255465+0000","last_active":"2024-09-13T19:09:38.040188+0000","last_peered":"2024-09-13T19:09:38.040188+0000","last_clean":"2024-09-13T19:09:38.040188+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:09:38.040188+0000","last_undegraded":"2024-09-13T19:09:38.040188+0000","last_fullsized":"2024-09-13T19:09:38.040188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.833948+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.833948+0000","last_peered":"2024-09-13T19:09:37.833948+0000","last_clean":"2024-09-13T19:09:37.833948+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.833948+0000","last_undegraded":"2024-09-13T19:09:37.833948+0000","last_fullsized":"2024-09-13T19:09:37.833948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.989504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359878+0000","last_change":"2024-09-13T19:06:23.268155+0000","last_active":"2024-09-13T19:06:58.359878+0000","last_peered":"2024-09-13T19:06:58.359878+0000","last_clean":"2024-09-13T19:06:58.359878+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:06:58.359878+0000","last_undegraded":"2024-09-13T19:06:58.359878+0000","last_fullsized":"2024-09-13T19:06:58.359878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:03.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351172+0000","last_change":"2024-09-13T19:06:25.299007+0000","last_active":"2024-09-13T19:06:58.351172+0000","last_peered":"2024-09-13T19:06:58.351172+0000","last_clean":"2024-09-13T19:06:58.351172+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:06:58.351172+0000","last_undegraded":"2024-09-13T19:06:58.351172+0000","last_fullsized":"2024-09-13T19:06:58.351172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:41.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517887+0000","last_change":"2024-09-13T19:06:27.327682+0000","last_active":"2024-09-13T19:09:38.517887+0000","last_peered":"2024-09-13T19:09:38.517887+0000","last_clean":"2024-09-13T19:09:38.517887+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:09:38.517887+0000","last_undegraded":"2024-09-13T19:09:38.517887+0000","last_fullsized":"2024-09-13T19:09:38.517887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:21.374194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334429+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:06:58.334429+0000","last_peered":"2024-09-13T19:06:58.334429+0000","last_clean":"2024-09-13T19:06:58.334429+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:06:58.334429+0000","last_undegraded":"2024-09-13T19:06:58.334429+0000","last_fullsized":"2024-09-13T19:06:58.334429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:51.144768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.656707+0000","last_change":"2024-09-13T19:06:21.254380+0000","last_active":"2024-09-13T19:07:50.656707+0000","last_peered":"2024-09-13T19:07:50.656707+0000","last_clean":"2024-09-13T19:07:50.656707+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:07:50.656707+0000","last_undegraded":"2024-09-13T19:07:50.656707+0000","last_fullsized":"2024-09-13T19:07:50.656707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.222552+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.222552+0000","last_peered":"2024-09-13T19:09:38.222552+0000","last_clean":"2024-09-13T19:09:38.222552+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.222552+0000","last_undegraded":"2024-09-13T19:09:38.222552+0000","last_fullsized":"2024-09-13T19:09:38.222552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340885+0000","last_change":"2024-09-13T19:06:23.273729+0000","last_active":"2024-09-13T19:06:58.340885+0000","last_peered":"2024-09-13T19:06:58.340885+0000","last_clean":"2024-09-13T19:06:58.340885+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:06:58.340885+0000","last_undegraded":"2024-09-13T19:06:58.340885+0000","last_fullsized":"2024-09-13T19:06:58.340885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.751783+0000","last_change":"2024-09-13T19:06:25.276088+0000","last_active":"2024-09-13T19:08:33.751783+0000","last_peered":"2024-09-13T19:08:33.751783+0000","last_clean":"2024-09-13T19:08:33.751783+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:08:33.751783+0000","last_undegraded":"2024-09-13T19:08:33.751783+0000","last_fullsized":"2024-09-13T19:08:33.751783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:19.360900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326495+0000","last_change":"2024-09-13T19:06:27.298155+0000","last_active":"2024-09-13T19:06:58.326495+0000","last_peered":"2024-09-13T19:06:58.326495+0000","last_clean":"2024-09-13T19:06:58.326495+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:06:58.326495+0000","last_undegraded":"2024-09-13T19:06:58.326495+0000","last_fullsized":"2024-09-13T19:06:58.326495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359715+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:06:58.359715+0000","last_peered":"2024-09-13T19:06:58.359715+0000","last_clean":"2024-09-13T19:06:58.359715+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:06:58.359715+0000","last_undegraded":"2024-09-13T19:06:58.359715+0000","last_fullsized":"2024-09-13T19:06:58.359715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040383+0000","last_change":"2024-09-13T19:06:21.253912+0000","last_active":"2024-09-13T19:09:38.040383+0000","last_peered":"2024-09-13T19:09:38.040383+0000","last_clean":"2024-09-13T19:09:38.040383+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:09:38.040383+0000","last_undegraded":"2024-09-13T19:09:38.040383+0000","last_fullsized":"2024-09-13T19:09:38.040383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.709655+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:36.709655+0000","last_peered":"2024-09-13T19:08:36.709655+0000","last_clean":"2024-09-13T19:08:36.709655+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:36.709655+0000","last_undegraded":"2024-09-13T19:08:36.709655+0000","last_fullsized":"2024-09-13T19:08:36.709655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:48.191162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331581+0000","last_change":"2024-09-13T19:06:23.249406+0000","last_active":"2024-09-13T19:06:58.331581+0000","last_peered":"2024-09-13T19:06:58.331581+0000","last_clean":"2024-09-13T19:06:58.331581+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:06:58.331581+0000","last_undegraded":"2024-09-13T19:06:58.331581+0000","last_fullsized":"2024-09-13T19:06:58.331581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:04.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.754389+0000","last_change":"2024-09-13T19:06:25.266112+0000","last_active":"2024-09-13T19:08:33.754389+0000","last_peered":"2024-09-13T19:08:33.754389+0000","last_clean":"2024-09-13T19:08:33.754389+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:08:33.754389+0000","last_undegraded":"2024-09-13T19:08:33.754389+0000","last_fullsized":"2024-09-13T19:08:33.754389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:56.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335590+0000","last_change":"2024-09-13T19:06:27.315327+0000","last_active":"2024-09-13T19:06:58.335590+0000","last_peered":"2024-09-13T19:06:58.335590+0000","last_clean":"2024-09-13T19:06:58.335590+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:06:58.335590+0000","last_undegraded":"2024-09-13T19:06:58.335590+0000","last_fullsized":"2024-09-13T19:06:58.335590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:49.675039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.040455+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:07:08.040455+0000","last_peered":"2024-09-13T19:07:08.040455+0000","last_clean":"2024-09-13T19:07:08.040455+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:07:08.040455+0000","last_undegraded":"2024-09-13T19:07:08.040455+0000","last_fullsized":"2024-09-13T19:07:08.040455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:46.491796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.331808+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:08:31.331808+0000","last_peered":"2024-09-13T19:08:31.331808+0000","last_clean":"2024-09-13T19:08:31.331808+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:08:31.331808+0000","last_undegraded":"2024-09-13T19:08:31.331808+0000","last_fullsized":"2024-09-13T19:08:31.331808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:41.004998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333723+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:06:58.333723+0000","last_peered":"2024-09-13T19:06:58.333723+0000","last_clean":"2024-09-13T19:06:58.333723+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:06:58.333723+0000","last_undegraded":"2024-09-13T19:06:58.333723+0000","last_fullsized":"2024-09-13T19:06:58.333723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342542+0000","last_change":"2024-09-13T19:06:23.259969+0000","last_active":"2024-09-13T19:06:58.342542+0000","last_peered":"2024-09-13T19:06:58.342542+0000","last_clean":"2024-09-13T19:06:58.342542+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:06:58.342542+0000","last_undegraded":"2024-09-13T19:06:58.342542+0000","last_fullsized":"2024-09-13T19:06:58.342542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.790940+0000","last_change":"2024-09-13T19:06:25.289764+0000","last_active":"2024-09-13T19:08:33.790940+0000","last_peered":"2024-09-13T19:08:33.790940+0000","last_clean":"2024-09-13T19:08:33.790940+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:08:33.790940+0000","last_undegraded":"2024-09-13T19:08:33.790940+0000","last_fullsized":"2024-09-13T19:08:33.790940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.324875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336001+0000","last_change":"2024-09-13T19:06:27.319266+0000","last_active":"2024-09-13T19:06:58.336001+0000","last_peered":"2024-09-13T19:06:58.336001+0000","last_clean":"2024-09-13T19:06:58.336001+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:06:58.336001+0000","last_undegraded":"2024-09-13T19:06:58.336001+0000","last_fullsized":"2024-09-13T19:06:58.336001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:43.390934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.046344+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.046344+0000","last_peered":"2024-09-13T19:09:38.046344+0000","last_clean":"2024-09-13T19:09:38.046344+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.046344+0000","last_undegraded":"2024-09-13T19:09:38.046344+0000","last_fullsized":"2024-09-13T19:09:38.046344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:45.313091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.272488+0000","last_change":"2024-09-13T19:06:21.251997+0000","last_active":"2024-09-13T19:09:38.272488+0000","last_peered":"2024-09-13T19:09:38.272488+0000","last_clean":"2024-09-13T19:09:38.272488+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:09:38.272488+0000","last_undegraded":"2024-09-13T19:09:38.272488+0000","last_fullsized":"2024-09-13T19:09:38.272488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:59.294405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359505+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:06:58.359505+0000","last_peered":"2024-09-13T19:06:58.359505+0000","last_clean":"2024-09-13T19:06:58.359505+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:06:58.359505+0000","last_undegraded":"2024-09-13T19:06:58.359505+0000","last_fullsized":"2024-09-13T19:06:58.359505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.875646+0000","last_change":"2024-09-13T19:06:23.274237+0000","last_active":"2024-09-13T19:08:31.875646+0000","last_peered":"2024-09-13T19:08:31.875646+0000","last_clean":"2024-09-13T19:08:31.875646+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:08:31.875646+0000","last_undegraded":"2024-09-13T19:08:31.875646+0000","last_fullsized":"2024-09-13T19:08:31.875646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.993135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.176231+0000","last_change":"2024-09-13T19:06:25.303807+0000","last_active":"2024-09-13T19:09:37.176231+0000","last_peered":"2024-09-13T19:09:37.176231+0000","last_clean":"2024-09-13T19:09:37.176231+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:09:37.176231+0000","last_undegraded":"2024-09-13T19:09:37.176231+0000","last_fullsized":"2024-09-13T19:09:37.176231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:40.599519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327617+0000","last_change":"2024-09-13T19:06:27.299682+0000","last_active":"2024-09-13T19:06:58.327617+0000","last_peered":"2024-09-13T19:06:58.327617+0000","last_clean":"2024-09-13T19:06:58.327617+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:06:58.327617+0000","last_undegraded":"2024-09-13T19:06:58.327617+0000","last_fullsized":"2024-09-13T19:06:58.327617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.813468+0000","last_change":"2024-09-13T19:06:29.310143+0000","last_active":"2024-09-13T19:08:33.813468+0000","last_peered":"2024-09-13T19:08:33.813468+0000","last_clean":"2024-09-13T19:08:33.813468+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:08:33.813468+0000","last_undegraded":"2024-09-13T19:08:33.813468+0000","last_fullsized":"2024-09-13T19:08:33.813468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:12.690041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.275471+0000","last_change":"2024-09-13T19:06:21.260509+0000","last_active":"2024-09-13T19:09:38.275471+0000","last_peered":"2024-09-13T19:09:38.275471+0000","last_clean":"2024-09-13T19:09:38.275471+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:09:38.275471+0000","last_undegraded":"2024-09-13T19:09:38.275471+0000","last_fullsized":"2024-09-13T19:09:38.275471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:30.336072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327522+0000","last_change":"2024-09-13T19:06:19.270097+0000","last_active":"2024-09-13T19:06:58.327522+0000","last_peered":"2024-09-13T19:06:58.327522+0000","last_clean":"2024-09-13T19:06:58.327522+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:06:58.327522+0000","last_undegraded":"2024-09-13T19:06:58.327522+0000","last_fullsized":"2024-09-13T19:06:58.327522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.966727+0000","last_change":"2024-09-13T19:06:21.255097+0000","last_active":"2024-09-13T19:07:06.966727+0000","last_peered":"2024-09-13T19:07:06.966727+0000","last_clean":"2024-09-13T19:07:06.966727+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:07:06.966727+0000","last_undegraded":"2024-09-13T19:07:06.966727+0000","last_fullsized":"2024-09-13T19:07:06.966727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.988700+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:08:23.988700+0000","last_peered":"2024-09-13T19:08:23.988700+0000","last_clean":"2024-09-13T19:08:23.988700+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:08:23.988700+0000","last_undegraded":"2024-09-13T19:08:23.988700+0000","last_fullsized":"2024-09-13T19:08:23.988700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.881877+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:09:37.881877+0000","last_peered":"2024-09-13T19:09:37.881877+0000","last_clean":"2024-09-13T19:09:37.881877+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:09:37.881877+0000","last_undegraded":"2024-09-13T19:09:37.881877+0000","last_fullsized":"2024-09-13T19:09:37.881877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:14.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.302528+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:07:07.302528+0000","last_peered":"2024-09-13T19:07:07.302528+0000","last_clean":"2024-09-13T19:07:07.302528+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:07:07.302528+0000","last_undegraded":"2024-09-13T19:07:07.302528+0000","last_fullsized":"2024-09-13T19:07:07.302528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:57.289705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329300+0000","last_change":"2024-09-13T19:06:21.255692+0000","last_active":"2024-09-13T19:06:58.329300+0000","last_peered":"2024-09-13T19:06:58.329300+0000","last_clean":"2024-09-13T19:06:58.329300+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:06:58.329300+0000","last_undegraded":"2024-09-13T19:06:58.329300+0000","last_fullsized":"2024-09-13T19:06:58.329300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.441511+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:09:38.441511+0000","last_peered":"2024-09-13T19:09:38.441511+0000","last_clean":"2024-09-13T19:09:38.441511+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:09:38.441511+0000","last_undegraded":"2024-09-13T19:09:38.441511+0000","last_fullsized":"2024-09-13T19:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:20.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.502701+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:07:06.502701+0000","last_peered":"2024-09-13T19:07:06.502701+0000","last_clean":"2024-09-13T19:07:06.502701+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:07:06.502701+0000","last_undegraded":"2024-09-13T19:07:06.502701+0000","last_fullsized":"2024-09-13T19:07:06.502701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:31.414170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990079+0000","last_change":"2024-09-13T19:06:19.281225+0000","last_active":"2024-09-13T19:08:28.990079+0000","last_peered":"2024-09-13T19:08:28.990079+0000","last_clean":"2024-09-13T19:08:28.990079+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:08:28.990079+0000","last_undegraded":"2024-09-13T19:08:28.990079+0000","last_fullsized":"2024-09-13T19:08:28.990079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.043438+0000","last_change":"2024-09-13T19:06:21.264248+0000","last_active":"2024-09-13T19:09:38.043438+0000","last_peered":"2024-09-13T19:09:38.043438+0000","last_clean":"2024-09-13T19:09:38.043438+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:09:38.043438+0000","last_undegraded":"2024-09-13T19:09:38.043438+0000","last_fullsized":"2024-09-13T19:09:38.043438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.360068+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:06:58.360068+0000","last_peered":"2024-09-13T19:06:58.360068+0000","last_clean":"2024-09-13T19:06:58.360068+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:06:58.360068+0000","last_undegraded":"2024-09-13T19:06:58.360068+0000","last_fullsized":"2024-09-13T19:06:58.360068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.456067+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:09:38.456067+0000","last_peered":"2024-09-13T19:09:38.456067+0000","last_clean":"2024-09-13T19:09:38.456067+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:09:38.456067+0000","last_undegraded":"2024-09-13T19:09:38.456067+0000","last_fullsized":"2024-09-13T19:09:38.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345491+0000","last_change":"2024-09-13T19:06:19.271992+0000","last_active":"2024-09-13T19:06:58.345491+0000","last_peered":"2024-09-13T19:06:58.345491+0000","last_clean":"2024-09-13T19:06:58.345491+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:06:58.345491+0000","last_undegraded":"2024-09-13T19:06:58.345491+0000","last_fullsized":"2024-09-13T19:06:58.345491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885011+0000","last_change":"2024-09-13T19:06:21.262337+0000","last_active":"2024-09-13T19:09:37.885011+0000","last_peered":"2024-09-13T19:09:37.885011+0000","last_clean":"2024-09-13T19:09:37.885011+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:09:37.885011+0000","last_undegraded":"2024-09-13T19:09:37.885011+0000","last_fullsized":"2024-09-13T19:09:37.885011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334715+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:06:58.334715+0000","last_peered":"2024-09-13T19:06:58.334715+0000","last_clean":"2024-09-13T19:06:58.334715+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:06:58.334715+0000","last_undegraded":"2024-09-13T19:06:58.334715+0000","last_fullsized":"2024-09-13T19:06:58.334715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.464999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455975+0000","last_change":"2024-09-13T19:06:21.260793+0000","last_active":"2024-09-13T19:09:38.455975+0000","last_peered":"2024-09-13T19:09:38.455975+0000","last_clean":"2024-09-13T19:09:38.455975+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:09:38.455975+0000","last_undegraded":"2024-09-13T19:09:38.455975+0000","last_fullsized":"2024-09-13T19:09:38.455975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.288268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335859+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:06:58.335859+0000","last_peered":"2024-09-13T19:06:58.335859+0000","last_clean":"2024-09-13T19:06:58.335859+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:06:58.335859+0000","last_undegraded":"2024-09-13T19:06:58.335859+0000","last_fullsized":"2024-09-13T19:06:58.335859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:41.941513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355462+0000","last_change":"2024-09-13T19:06:21.257594+0000","last_active":"2024-09-13T19:06:58.355462+0000","last_peered":"2024-09-13T19:06:58.355462+0000","last_clean":"2024-09-13T19:06:58.355462+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:06:58.355462+0000","last_undegraded":"2024-09-13T19:06:58.355462+0000","last_fullsized":"2024-09-13T19:06:58.355462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:55.850886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327779+0000","last_change":"2024-09-13T19:06:19.278186+0000","last_active":"2024-09-13T19:06:58.327779+0000","last_peered":"2024-09-13T19:06:58.327779+0000","last_clean":"2024-09-13T19:06:58.327779+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:06:58.327779+0000","last_undegraded":"2024-09-13T19:06:58.327779+0000","last_fullsized":"2024-09-13T19:06:58.327779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992857+0000","last_change":"2024-09-13T19:06:21.240787+0000","last_active":"2024-09-13T19:08:38.992857+0000","last_peered":"2024-09-13T19:08:38.992857+0000","last_clean":"2024-09-13T19:08:38.992857+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:08:38.992857+0000","last_undegraded":"2024-09-13T19:08:38.992857+0000","last_fullsized":"2024-09-13T19:08:38.992857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351873+0000","last_change":"2024-09-13T19:06:19.283567+0000","last_active":"2024-09-13T19:06:58.351873+0000","last_peered":"2024-09-13T19:06:58.351873+0000","last_clean":"2024-09-13T19:06:58.351873+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:06:58.351873+0000","last_undegraded":"2024-09-13T19:06:58.351873+0000","last_fullsized":"2024-09-13T19:06:58.351873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002423+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:08:39.002423+0000","last_peered":"2024-09-13T19:08:39.002423+0000","last_clean":"2024-09-13T19:08:39.002423+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:08:39.002423+0000","last_undegraded":"2024-09-13T19:08:39.002423+0000","last_fullsized":"2024-09-13T19:08:39.002423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:27.206747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341998+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:06:58.341998+0000","last_peered":"2024-09-13T19:06:58.341998+0000","last_clean":"2024-09-13T19:06:58.341998+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:06:58.341998+0000","last_undegraded":"2024-09-13T19:06:58.341998+0000","last_fullsized":"2024-09-13T19:06:58.341998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255695+0000","last_change":"2024-09-13T19:06:21.256504+0000","last_active":"2024-09-13T19:09:38.255695+0000","last_peered":"2024-09-13T19:09:38.255695+0000","last_clean":"2024-09-13T19:09:38.255695+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:09:38.255695+0000","last_undegraded":"2024-09-13T19:09:38.255695+0000","last_fullsized":"2024-09-13T19:09:38.255695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344894+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:06:58.344894+0000","last_peered":"2024-09-13T19:06:58.344894+0000","last_clean":"2024-09-13T19:06:58.344894+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:06:58.344894+0000","last_undegraded":"2024-09-13T19:06:58.344894+0000","last_fullsized":"2024-09-13T19:06:58.344894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:12.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375474+0000","last_change":"2024-09-13T19:06:21.264548+0000","last_active":"2024-09-13T19:09:38.375474+0000","last_peered":"2024-09-13T19:09:38.375474+0000","last_clean":"2024-09-13T19:09:38.375474+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:09:38.375474+0000","last_undegraded":"2024-09-13T19:09:38.375474+0000","last_fullsized":"2024-09-13T19:09:38.375474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345208+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:06:58.345208+0000","last_peered":"2024-09-13T19:06:58.345208+0000","last_clean":"2024-09-13T19:06:58.345208+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:06:58.345208+0000","last_undegraded":"2024-09-13T19:06:58.345208+0000","last_fullsized":"2024-09-13T19:06:58.345208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:43.433186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255037+0000","last_change":"2024-09-13T19:06:21.261602+0000","last_active":"2024-09-13T19:09:38.255037+0000","last_peered":"2024-09-13T19:09:38.255037+0000","last_clean":"2024-09-13T19:09:38.255037+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:09:38.255037+0000","last_undegraded":"2024-09-13T19:09:38.255037+0000","last_fullsized":"2024-09-13T19:09:38.255037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:01.086124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345905+0000","last_change":"2024-09-13T19:06:19.278323+0000","last_active":"2024-09-13T19:06:58.345905+0000","last_peered":"2024-09-13T19:06:58.345905+0000","last_clean":"2024-09-13T19:06:58.345905+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:06:58.345905+0000","last_undegraded":"2024-09-13T19:06:58.345905+0000","last_fullsized":"2024-09-13T19:06:58.345905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.374634+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:09:38.374634+0000","last_peered":"2024-09-13T19:09:38.374634+0000","last_clean":"2024-09-13T19:09:38.374634+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:09:38.374634+0000","last_undegraded":"2024-09-13T19:09:38.374634+0000","last_fullsized":"2024-09-13T19:09:38.374634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.231853+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.231853+0000","last_peered":"2024-09-13T19:09:38.231853+0000","last_clean":"2024-09-13T19:09:38.231853+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.231853+0000","last_undegraded":"2024-09-13T19:09:38.231853+0000","last_fullsized":"2024-09-13T19:09:38.231853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:03.445184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.725335+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:07:05.725335+0000","last_peered":"2024-09-13T19:07:05.725335+0000","last_clean":"2024-09-13T19:07:05.725335+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:07:05.725335+0000","last_undegraded":"2024-09-13T19:07:05.725335+0000","last_fullsized":"2024-09-13T19:07:05.725335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:32.143596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.655037+0000","last_change":"2024-09-13T19:06:21.261511+0000","last_active":"2024-09-13T19:07:50.655037+0000","last_peered":"2024-09-13T19:07:50.655037+0000","last_clean":"2024-09-13T19:07:50.655037+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:07:50.655037+0000","last_undegraded":"2024-09-13T19:07:50.655037+0000","last_fullsized":"2024-09-13T19:07:50.655037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327618+0000","last_change":"2024-09-13T19:06:19.278870+0000","last_active":"2024-09-13T19:06:58.327618+0000","last_peered":"2024-09-13T19:06:58.327618+0000","last_clean":"2024-09-13T19:06:58.327618+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:06:58.327618+0000","last_undegraded":"2024-09-13T19:06:58.327618+0000","last_fullsized":"2024-09-13T19:06:58.327618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'23","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.274840+0000","last_change":"2024-09-13T19:06:21.255155+0000","last_active":"2024-09-13T19:09:38.274840+0000","last_peered":"2024-09-13T19:09:38.274840+0000","last_clean":"2024-09-13T19:09:38.274840+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:09:38.274840+0000","last_undegraded":"2024-09-13T19:09:38.274840+0000","last_fullsized":"2024-09-13T19:09:38.274840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:04.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705714,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48384,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323456,"statfs":{"total":96636764160,"available":96587218944,"internally_reserved":0,"allocated":9093120,"data_stored":8760735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9346959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44764,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327076,"statfs":{"total":96636764160,"available":96590925824,"internally_reserved":0,"allocated":9646080,"data_stored":9348623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48348,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323492,"statfs":{"total":96636764160,"available":96587255808,"internally_reserved":0,"allocated":9056256,"data_stored":8758411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:04.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.483+0000 7f2609907640 1 Processor -- start 2024-09-13T19:10:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.483+0000 7f2609907640 1 -- start start 2024-09-13T19:10:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f260406dbd0 0x7f2604138440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f260406eb20 con 0x7f260406d0e0 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2604072f80 con 0x7f260406dbd0 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f26027fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f260406dbd0 0x7f2604138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2602ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f260406d0e0 0x7f260406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40252/0 (socket says 172.21.15.12:40252) 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2602ffd640 1 -- 172.21.15.12:0/2262010597 learned_addr learned my addr 172.21.15.12:0/2262010597 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f26027fc640 1 -- 172.21.15.12:0/2262010597 >> v1:172.21.15.12:6789/0 conn(0x7f260406d0e0 legacy=0x7f260406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f26027fc640 1 -- 172.21.15.12:0/2262010597 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2604098b90 con 0x7f260406dbd0 2024-09-13T19:10:04.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f26027fc640 1 --2- 172.21.15.12:0/2262010597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406dbd0 0x7f2604138440 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009740 tx=0x7f25ec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a591c169f21dddaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2601ffb640 1 -- 172.21.15.12:0/2262010597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25ec0b0070 con 0x7f260406dbd0 2024-09-13T19:10:04.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2601ffb640 1 -- 172.21.15.12:0/2262010597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ec0ab530 con 0x7f260406dbd0 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2601ffb640 1 -- 172.21.15.12:0/2262010597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25ec0ab830 con 0x7f260406dbd0 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 -- 172.21.15.12:0/2262010597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406dbd0 msgr2=0x7f2604138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 --2- 172.21.15.12:0/2262010597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406dbd0 0x7f2604138440 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009740 tx=0x7f25ec01c370 comp rx=0 tx=0).stop 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 -- 172.21.15.12:0/2262010597 shutdown_connections 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 --2- 172.21.15.12:0/2262010597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406dbd0 0x7f2604138440 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.487+0000 7f2609907640 1 -- 172.21.15.12:0/2262010597 >> 172.21.15.12:0/2262010597 conn(0x7f2604099a50 msgr2=0x7f26040972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:04.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- 172.21.15.12:0/2262010597 shutdown_connections 2024-09-13T19:10:04.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- 172.21.15.12:0/2262010597 wait complete. 2024-09-13T19:10:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 Processor -- start 2024-09-13T19:10:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- start start 2024-09-13T19:10:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f260413b3b0 con 0x7f260406d0e0 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2602ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2602ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43586/0 (socket says 172.21.15.12:43586) 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2602ffd640 1 -- 172.21.15.12:0/1429208793 learned_addr learned my addr 172.21.15.12:0/1429208793 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2602ffd640 1 -- 172.21.15.12:0/1429208793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2604094650 con 0x7f260406d0e0 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2602ffd640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c480 tx=0x7f25f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4017070 con 0x7f260406d0e0 2024-09-13T19:10:04.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4005c20 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26040939b0 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f4007070 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2604094290 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f25f401a070 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2604095570 con 0x7f260406d0e0 2024-09-13T19:10:04.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 0x7f25e4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.491+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f25f4048450 con 0x7f260406d0e0 2024-09-13T19:10:04.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.495+0000 7f26027fc640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 0x7f25e4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.495+0000 7f26027fc640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 0x7f25e4038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ad000 tx=0x7f25ec0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.499+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f25f4007210 con 0x7f260406d0e0 2024-09-13T19:10:04.664 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.659+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2604073790 con 0x7f25e4035db0 2024-09-13T19:10:04.794 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.703+0000 7f25fbfff640 1 -- 172.21.15.12:0/1429208793 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666053 (secure 0 0 0) 0x7f2604073790 con 0x7f25e4035db0 2024-09-13T19:10:04.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:04.804 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 msgr2=0x7f25e4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 0x7f25e4038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0ad000 tx=0x7f25ec0a6000 comp rx=0 tx=0).stop 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 msgr2=0x7f2604136490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c480 tx=0x7f25f400c940 comp rx=0 tx=0).stop 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 shutdown_connections 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f25e4035db0 0x7f25e4038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 --2- 172.21.15.12:0/1429208793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f260406d0e0 0x7f2604136490 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.711+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 >> 172.21.15.12:0/1429208793 conn(0x7f2604099a50 msgr2=0x7f26040708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.715+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 shutdown_connections 2024-09-13T19:10:04.806 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.715+0000 7f2609907640 1 -- 172.21.15.12:0/1429208793 wait complete. 2024-09-13T19:10:04.807 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-13T19:10:03.013199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416904,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4875,"num_read_kb":4452,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":186232,"kb_used_data":36536,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377301128,"statfs":{"total":386547056640,"available":386356355072,"internally_reserved":0,"allocated":37412864,"data_stored":36214728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007162"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337381+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:06:58.337381+0000","last_peered":"2024-09-13T19:06:58.337381+0000","last_clean":"2024-09-13T19:06:58.337381+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:06:58.337381+0000","last_undegraded":"2024-09-13T19:06:58.337381+0000","last_fullsized":"2024-09-13T19:06:58.337381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.324626+0000","last_change":"2024-09-13T19:06:21.265691+0000","last_active":"2024-09-13T19:07:07.324626+0000","last_peered":"2024-09-13T19:07:07.324626+0000","last_clean":"2024-09-13T19:07:07.324626+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:07:07.324626+0000","last_undegraded":"2024-09-13T19:07:07.324626+0000","last_fullsized":"2024-09-13T19:07:07.324626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.241844+0000","last_change":"2024-09-13T19:06:19.281253+0000","last_active":"2024-09-13T19:09:38.241844+0000","last_peered":"2024-09-13T19:09:38.241844+0000","last_clean":"2024-09-13T19:09:38.241844+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:09:38.241844+0000","last_undegraded":"2024-09-13T19:09:38.241844+0000","last_fullsized":"2024-09-13T19:09:38.241844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343896+0000","last_change":"2024-09-13T19:06:21.257152+0000","last_active":"2024-09-13T19:06:58.343896+0000","last_peered":"2024-09-13T19:06:58.343896+0000","last_clean":"2024-09-13T19:06:58.343896+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:06:58.343896+0000","last_undegraded":"2024-09-13T19:06:58.343896+0000","last_fullsized":"2024-09-13T19:06:58.343896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:59.192920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.348389+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:06:58.348389+0000","last_peered":"2024-09-13T19:06:58.348389+0000","last_clean":"2024-09-13T19:06:58.348389+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:06:58.348389+0000","last_undegraded":"2024-09-13T19:06:58.348389+0000","last_fullsized":"2024-09-13T19:06:58.348389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:19.158740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040680+0000","last_change":"2024-09-13T19:06:21.257435+0000","last_active":"2024-09-13T19:09:38.040680+0000","last_peered":"2024-09-13T19:09:38.040680+0000","last_clean":"2024-09-13T19:09:38.040680+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:09:38.040680+0000","last_undegraded":"2024-09-13T19:09:38.040680+0000","last_fullsized":"2024-09-13T19:09:38.040680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:15.700530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:18.996355+0000","last_change":"2024-09-13T19:06:19.272048+0000","last_active":"2024-09-13T19:08:18.996355+0000","last_peered":"2024-09-13T19:08:18.996355+0000","last_clean":"2024-09-13T19:08:18.996355+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:08:18.996355+0000","last_undegraded":"2024-09-13T19:08:18.996355+0000","last_fullsized":"2024-09-13T19:08:18.996355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.254845+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.254845+0000","last_peered":"2024-09-13T19:09:38.254845+0000","last_clean":"2024-09-13T19:09:38.254845+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.254845+0000","last_undegraded":"2024-09-13T19:09:38.254845+0000","last_fullsized":"2024-09-13T19:09:38.254845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:26.262099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341432+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:06:58.341432+0000","last_peered":"2024-09-13T19:06:58.341432+0000","last_clean":"2024-09-13T19:06:58.341432+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:06:58.341432+0000","last_undegraded":"2024-09-13T19:06:58.341432+0000","last_fullsized":"2024-09-13T19:06:58.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:58.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455588+0000","last_change":"2024-09-13T19:06:21.261907+0000","last_active":"2024-09-13T19:09:38.455588+0000","last_peered":"2024-09-13T19:09:38.455588+0000","last_clean":"2024-09-13T19:09:38.455588+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:09:38.455588+0000","last_undegraded":"2024-09-13T19:09:38.455588+0000","last_fullsized":"2024-09-13T19:09:38.455588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.003606+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:08:49.003606+0000","last_peered":"2024-09-13T19:08:49.003606+0000","last_clean":"2024-09-13T19:08:49.003606+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:08:49.003606+0000","last_undegraded":"2024-09-13T19:08:49.003606+0000","last_fullsized":"2024-09-13T19:08:49.003606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.654845+0000","last_change":"2024-09-13T19:06:21.266198+0000","last_active":"2024-09-13T19:07:50.654845+0000","last_peered":"2024-09-13T19:07:50.654845+0000","last_clean":"2024-09-13T19:07:50.654845+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:07:50.654845+0000","last_undegraded":"2024-09-13T19:07:50.654845+0000","last_fullsized":"2024-09-13T19:07:50.654845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:26.835463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.307843+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:07:07.307843+0000","last_peered":"2024-09-13T19:07:07.307843+0000","last_clean":"2024-09-13T19:07:07.307843+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:07:07.307843+0000","last_undegraded":"2024-09-13T19:07:07.307843+0000","last_fullsized":"2024-09-13T19:07:07.307843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:38.969649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474547+0000","last_change":"2024-09-13T19:06:21.255493+0000","last_active":"2024-09-13T19:09:38.474547+0000","last_peered":"2024-09-13T19:09:38.474547+0000","last_clean":"2024-09-13T19:09:38.474547+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:09:38.474547+0000","last_undegraded":"2024-09-13T19:09:38.474547+0000","last_fullsized":"2024-09-13T19:09:38.474547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327422+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:06:58.327422+0000","last_peered":"2024-09-13T19:06:58.327422+0000","last_clean":"2024-09-13T19:06:58.327422+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:06:58.327422+0000","last_undegraded":"2024-09-13T19:06:58.327422+0000","last_fullsized":"2024-09-13T19:06:58.327422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.906061+0000","last_change":"2024-09-13T19:06:21.259423+0000","last_active":"2024-09-13T19:09:37.906061+0000","last_peered":"2024-09-13T19:09:37.906061+0000","last_clean":"2024-09-13T19:09:37.906061+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:09:37.906061+0000","last_undegraded":"2024-09-13T19:09:37.906061+0000","last_fullsized":"2024-09-13T19:09:37.906061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.971735+0000","last_change":"2024-09-13T19:06:21.257261+0000","last_active":"2024-09-13T19:07:06.971735+0000","last_peered":"2024-09-13T19:07:06.971735+0000","last_clean":"2024-09-13T19:07:06.971735+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:07:06.971735+0000","last_undegraded":"2024-09-13T19:07:06.971735+0000","last_fullsized":"2024-09-13T19:07:06.971735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:38.952619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.296557+0000","last_change":"2024-09-13T19:06:19.287823+0000","last_active":"2024-09-13T19:07:07.296557+0000","last_peered":"2024-09-13T19:07:07.296557+0000","last_clean":"2024-09-13T19:07:07.296557+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:07:07.296557+0000","last_undegraded":"2024-09-13T19:07:07.296557+0000","last_fullsized":"2024-09-13T19:07:07.296557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475773+0000","last_change":"2024-09-13T19:06:21.263484+0000","last_active":"2024-09-13T19:09:38.475773+0000","last_peered":"2024-09-13T19:09:38.475773+0000","last_clean":"2024-09-13T19:09:38.475773+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:09:38.475773+0000","last_undegraded":"2024-09-13T19:09:38.475773+0000","last_fullsized":"2024-09-13T19:09:38.475773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.370620+0000","last_change":"2024-09-13T19:06:19.276357+0000","last_active":"2024-09-13T19:07:50.370620+0000","last_peered":"2024-09-13T19:07:50.370620+0000","last_clean":"2024-09-13T19:07:50.370620+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:07:50.370620+0000","last_undegraded":"2024-09-13T19:07:50.370620+0000","last_fullsized":"2024-09-13T19:07:50.370620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.121880+0000","last_change":"2024-09-13T19:06:21.265579+0000","last_active":"2024-09-13T19:08:37.121880+0000","last_peered":"2024-09-13T19:08:37.121880+0000","last_clean":"2024-09-13T19:08:37.121880+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:08:37.121880+0000","last_undegraded":"2024-09-13T19:08:37.121880+0000","last_fullsized":"2024-09-13T19:08:37.121880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.785658+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.785658+0000","last_peered":"2024-09-13T19:09:37.785658+0000","last_clean":"2024-09-13T19:09:37.785658+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.785658+0000","last_undegraded":"2024-09-13T19:09:37.785658+0000","last_fullsized":"2024-09-13T19:09:37.785658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885359+0000","last_change":"2024-09-13T19:06:21.253936+0000","last_active":"2024-09-13T19:09:37.885359+0000","last_peered":"2024-09-13T19:09:37.885359+0000","last_clean":"2024-09-13T19:09:37.885359+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:09:37.885359+0000","last_undegraded":"2024-09-13T19:09:37.885359+0000","last_fullsized":"2024-09-13T19:09:37.885359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342316+0000","last_change":"2024-09-13T19:06:19.281986+0000","last_active":"2024-09-13T19:06:58.342316+0000","last_peered":"2024-09-13T19:06:58.342316+0000","last_clean":"2024-09-13T19:06:58.342316+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:06:58.342316+0000","last_undegraded":"2024-09-13T19:06:58.342316+0000","last_fullsized":"2024-09-13T19:06:58.342316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392252+0000","last_change":"2024-09-13T19:06:21.254760+0000","last_active":"2024-09-13T19:09:38.392252+0000","last_peered":"2024-09-13T19:09:38.392252+0000","last_clean":"2024-09-13T19:09:38.392252+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:09:38.392252+0000","last_undegraded":"2024-09-13T19:09:38.392252+0000","last_fullsized":"2024-09-13T19:09:38.392252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:14.792775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.215043+0000","last_change":"2024-09-13T19:06:19.278861+0000","last_active":"2024-09-13T19:09:38.215043+0000","last_peered":"2024-09-13T19:09:38.215043+0000","last_clean":"2024-09-13T19:09:38.215043+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:09:38.215043+0000","last_undegraded":"2024-09-13T19:09:38.215043+0000","last_fullsized":"2024-09-13T19:09:38.215043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:09.190817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.880925+0000","last_change":"2024-09-13T19:06:21.265434+0000","last_active":"2024-09-13T19:09:37.880925+0000","last_peered":"2024-09-13T19:09:37.880925+0000","last_clean":"2024-09-13T19:09:37.880925+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:09:37.880925+0000","last_undegraded":"2024-09-13T19:09:37.880925+0000","last_fullsized":"2024-09-13T19:09:37.880925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:23.561123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337225+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:06:58.337225+0000","last_peered":"2024-09-13T19:06:58.337225+0000","last_clean":"2024-09-13T19:06:58.337225+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:06:58.337225+0000","last_undegraded":"2024-09-13T19:06:58.337225+0000","last_fullsized":"2024-09-13T19:06:58.337225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:26.485200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.318135+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.318135+0000","last_peered":"2024-09-13T19:09:38.318135+0000","last_clean":"2024-09-13T19:09:38.318135+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.318135+0000","last_undegraded":"2024-09-13T19:09:38.318135+0000","last_fullsized":"2024-09-13T19:09:38.318135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:07.774766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004272+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:08:44.004272+0000","last_peered":"2024-09-13T19:08:44.004272+0000","last_clean":"2024-09-13T19:08:44.004272+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:08:44.004272+0000","last_undegraded":"2024-09-13T19:08:44.004272+0000","last_fullsized":"2024-09-13T19:08:44.004272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:52.354210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002406+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:08:39.002406+0000","last_peered":"2024-09-13T19:08:39.002406+0000","last_clean":"2024-09-13T19:08:39.002406+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:08:39.002406+0000","last_undegraded":"2024-09-13T19:08:39.002406+0000","last_fullsized":"2024-09-13T19:08:39.002406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:09.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344167+0000","last_change":"2024-09-13T19:06:23.276780+0000","last_active":"2024-09-13T19:06:58.344167+0000","last_peered":"2024-09-13T19:06:58.344167+0000","last_clean":"2024-09-13T19:06:58.344167+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:06:58.344167+0000","last_undegraded":"2024-09-13T19:06:58.344167+0000","last_fullsized":"2024-09-13T19:06:58.344167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:36.923375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.780434+0000","last_change":"2024-09-13T19:06:25.281596+0000","last_active":"2024-09-13T19:08:33.780434+0000","last_peered":"2024-09-13T19:08:33.780434+0000","last_clean":"2024-09-13T19:08:33.780434+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:08:33.780434+0000","last_undegraded":"2024-09-13T19:08:33.780434+0000","last_fullsized":"2024-09-13T19:08:33.780434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:11.221079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359118+0000","last_change":"2024-09-13T19:06:27.318504+0000","last_active":"2024-09-13T19:06:58.359118+0000","last_peered":"2024-09-13T19:06:58.359118+0000","last_clean":"2024-09-13T19:06:58.359118+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:06:58.359118+0000","last_undegraded":"2024-09-13T19:06:58.359118+0000","last_fullsized":"2024-09-13T19:06:58.359118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.391456+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:07:50.391456+0000","last_peered":"2024-09-13T19:07:50.391456+0000","last_clean":"2024-09-13T19:07:50.391456+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:07:50.391456+0000","last_undegraded":"2024-09-13T19:07:50.391456+0000","last_fullsized":"2024-09-13T19:07:50.391456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:43.269034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.454561+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.454561+0000","last_peered":"2024-09-13T19:09:38.454561+0000","last_clean":"2024-09-13T19:09:38.454561+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.454561+0000","last_undegraded":"2024-09-13T19:09:38.454561+0000","last_fullsized":"2024-09-13T19:09:38.454561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:44.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328877+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:06:58.328877+0000","last_peered":"2024-09-13T19:06:58.328877+0000","last_clean":"2024-09-13T19:06:58.328877+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:06:58.328877+0000","last_undegraded":"2024-09-13T19:06:58.328877+0000","last_fullsized":"2024-09-13T19:06:58.328877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327809+0000","last_change":"2024-09-13T19:06:23.252446+0000","last_active":"2024-09-13T19:06:58.327809+0000","last_peered":"2024-09-13T19:06:58.327809+0000","last_clean":"2024-09-13T19:06:58.327809+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:06:58.327809+0000","last_undegraded":"2024-09-13T19:06:58.327809+0000","last_fullsized":"2024-09-13T19:06:58.327809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358498+0000","last_change":"2024-09-13T19:06:25.281296+0000","last_active":"2024-09-13T19:06:58.358498+0000","last_peered":"2024-09-13T19:06:58.358498+0000","last_clean":"2024-09-13T19:06:58.358498+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:06:58.358498+0000","last_undegraded":"2024-09-13T19:06:58.358498+0000","last_fullsized":"2024-09-13T19:06:58.358498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:03.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358756+0000","last_change":"2024-09-13T19:06:27.324894+0000","last_active":"2024-09-13T19:06:58.358756+0000","last_peered":"2024-09-13T19:06:58.358756+0000","last_clean":"2024-09-13T19:06:58.358756+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:06:58.358756+0000","last_undegraded":"2024-09-13T19:06:58.358756+0000","last_fullsized":"2024-09-13T19:06:58.358756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326789+0000","last_change":"2024-09-13T19:06:29.300886+0000","last_active":"2024-09-13T19:06:58.326789+0000","last_peered":"2024-09-13T19:06:58.326789+0000","last_clean":"2024-09-13T19:06:58.326789+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:06:58.326789+0000","last_undegraded":"2024-09-13T19:06:58.326789+0000","last_fullsized":"2024-09-13T19:06:58.326789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.372361+0000","last_change":"2024-09-13T19:06:21.256421+0000","last_active":"2024-09-13T19:09:38.372361+0000","last_peered":"2024-09-13T19:09:38.372361+0000","last_clean":"2024-09-13T19:09:38.372361+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:09:38.372361+0000","last_undegraded":"2024-09-13T19:09:38.372361+0000","last_fullsized":"2024-09-13T19:09:38.372361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:08.365440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337123+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:06:58.337123+0000","last_peered":"2024-09-13T19:06:58.337123+0000","last_clean":"2024-09-13T19:06:58.337123+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:06:58.337123+0000","last_undegraded":"2024-09-13T19:06:58.337123+0000","last_fullsized":"2024-09-13T19:06:58.337123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:05.346402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336788+0000","last_change":"2024-09-13T19:06:23.258127+0000","last_active":"2024-09-13T19:06:58.336788+0000","last_peered":"2024-09-13T19:06:58.336788+0000","last_clean":"2024-09-13T19:06:58.336788+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:06:58.336788+0000","last_undegraded":"2024-09-13T19:06:58.336788+0000","last_fullsized":"2024-09-13T19:06:58.336788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331611+0000","last_change":"2024-09-13T19:06:25.297719+0000","last_active":"2024-09-13T19:06:58.331611+0000","last_peered":"2024-09-13T19:06:58.331611+0000","last_clean":"2024-09-13T19:06:58.331611+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:06:58.331611+0000","last_undegraded":"2024-09-13T19:06:58.331611+0000","last_fullsized":"2024-09-13T19:06:58.331611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.240465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518030+0000","last_change":"2024-09-13T19:06:27.301544+0000","last_active":"2024-09-13T19:09:38.518030+0000","last_peered":"2024-09-13T19:09:38.518030+0000","last_clean":"2024-09-13T19:09:38.518030+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:09:38.518030+0000","last_undegraded":"2024-09-13T19:09:38.518030+0000","last_fullsized":"2024-09-13T19:09:38.518030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:19.445306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328744+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:06:58.328744+0000","last_peered":"2024-09-13T19:06:58.328744+0000","last_clean":"2024-09-13T19:06:58.328744+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:06:58.328744+0000","last_undegraded":"2024-09-13T19:06:58.328744+0000","last_fullsized":"2024-09-13T19:06:58.328744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:06.414507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.042619+0000","last_change":"2024-09-13T19:06:21.259001+0000","last_active":"2024-09-13T19:09:38.042619+0000","last_peered":"2024-09-13T19:09:38.042619+0000","last_clean":"2024-09-13T19:09:38.042619+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:09:38.042619+0000","last_undegraded":"2024-09-13T19:09:38.042619+0000","last_fullsized":"2024-09-13T19:09:38.042619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358360+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:06:58.358360+0000","last_peered":"2024-09-13T19:06:58.358360+0000","last_clean":"2024-09-13T19:06:58.358360+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:06:58.358360+0000","last_undegraded":"2024-09-13T19:06:58.358360+0000","last_fullsized":"2024-09-13T19:06:58.358360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:48.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350380+0000","last_change":"2024-09-13T19:06:23.276603+0000","last_active":"2024-09-13T19:06:58.350380+0000","last_peered":"2024-09-13T19:06:58.350380+0000","last_clean":"2024-09-13T19:06:58.350380+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:06:58.350380+0000","last_undegraded":"2024-09-13T19:06:58.350380+0000","last_fullsized":"2024-09-13T19:06:58.350380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:06.962778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.772098+0000","last_change":"2024-09-13T19:06:25.297031+0000","last_active":"2024-09-13T19:08:33.772098+0000","last_peered":"2024-09-13T19:08:33.772098+0000","last_clean":"2024-09-13T19:08:33.772098+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:08:33.772098+0000","last_undegraded":"2024-09-13T19:08:33.772098+0000","last_fullsized":"2024-09-13T19:08:33.772098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:32.765951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":443,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518951+0000","last_change":"2024-09-13T19:06:27.283769+0000","last_active":"2024-09-13T19:09:38.518951+0000","last_peered":"2024-09-13T19:09:38.518951+0000","last_clean":"2024-09-13T19:09:38.518951+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:09:38.518951+0000","last_undegraded":"2024-09-13T19:09:38.518951+0000","last_fullsized":"2024-09-13T19:09:38.518951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:00.073225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375233+0000","last_change":"2024-09-13T19:06:21.259478+0000","last_active":"2024-09-13T19:09:38.375233+0000","last_peered":"2024-09-13T19:09:38.375233+0000","last_clean":"2024-09-13T19:09:38.375233+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:09:38.375233+0000","last_undegraded":"2024-09-13T19:09:38.375233+0000","last_fullsized":"2024-09-13T19:09:38.375233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:26.304922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.779034+0000","last_change":"2024-09-13T19:06:19.264318+0000","last_active":"2024-09-13T19:08:36.779034+0000","last_peered":"2024-09-13T19:08:36.779034+0000","last_clean":"2024-09-13T19:08:36.779034+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:08:36.779034+0000","last_undegraded":"2024-09-13T19:08:36.779034+0000","last_fullsized":"2024-09-13T19:08:36.779034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341484+0000","last_change":"2024-09-13T19:06:23.274173+0000","last_active":"2024-09-13T19:06:58.341484+0000","last_peered":"2024-09-13T19:06:58.341484+0000","last_clean":"2024-09-13T19:06:58.341484+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:06:58.341484+0000","last_undegraded":"2024-09-13T19:06:58.341484+0000","last_fullsized":"2024-09-13T19:06:58.341484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001216+0000","last_change":"2024-09-13T19:06:25.302087+0000","last_active":"2024-09-13T19:08:39.001216+0000","last_peered":"2024-09-13T19:08:39.001216+0000","last_clean":"2024-09-13T19:08:39.001216+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:08:39.001216+0000","last_undegraded":"2024-09-13T19:08:39.001216+0000","last_fullsized":"2024-09-13T19:08:39.001216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:04.630747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330037+0000","last_change":"2024-09-13T19:06:27.297316+0000","last_active":"2024-09-13T19:06:58.330037+0000","last_peered":"2024-09-13T19:06:58.330037+0000","last_clean":"2024-09-13T19:06:58.330037+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:06:58.330037+0000","last_undegraded":"2024-09-13T19:06:58.330037+0000","last_fullsized":"2024-09-13T19:06:58.330037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:15.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.394157+0000","last_change":"2024-09-13T19:06:29.313617+0000","last_active":"2024-09-13T19:07:50.394157+0000","last_peered":"2024-09-13T19:07:50.394157+0000","last_clean":"2024-09-13T19:07:50.394157+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:07:50.394157+0000","last_undegraded":"2024-09-13T19:07:50.394157+0000","last_fullsized":"2024-09-13T19:07:50.394157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:24.043207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.390167+0000","last_change":"2024-09-13T19:06:21.258654+0000","last_active":"2024-09-13T19:09:38.390167+0000","last_peered":"2024-09-13T19:09:38.390167+0000","last_clean":"2024-09-13T19:09:38.390167+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:09:38.390167+0000","last_undegraded":"2024-09-13T19:09:38.390167+0000","last_fullsized":"2024-09-13T19:09:38.390167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.205636+0000","last_change":"2024-09-13T19:06:19.273587+0000","last_active":"2024-09-13T19:09:38.205636+0000","last_peered":"2024-09-13T19:09:38.205636+0000","last_clean":"2024-09-13T19:09:38.205636+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:09:38.205636+0000","last_undegraded":"2024-09-13T19:09:38.205636+0000","last_fullsized":"2024-09-13T19:09:38.205636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.978035+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:06:58.978035+0000","last_peered":"2024-09-13T19:06:58.978035+0000","last_clean":"2024-09-13T19:06:58.978035+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:06:58.978035+0000","last_undegraded":"2024-09-13T19:06:58.978035+0000","last_fullsized":"2024-09-13T19:06:58.978035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.755116+0000","last_change":"2024-09-13T19:06:25.280611+0000","last_active":"2024-09-13T19:08:33.755116+0000","last_peered":"2024-09-13T19:08:33.755116+0000","last_clean":"2024-09-13T19:08:33.755116+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:08:33.755116+0000","last_undegraded":"2024-09-13T19:08:33.755116+0000","last_fullsized":"2024-09-13T19:08:33.755116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:29.037601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328820+0000","last_change":"2024-09-13T19:06:27.297989+0000","last_active":"2024-09-13T19:06:58.328820+0000","last_peered":"2024-09-13T19:06:58.328820+0000","last_clean":"2024-09-13T19:06:58.328820+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:06:58.328820+0000","last_undegraded":"2024-09-13T19:06:58.328820+0000","last_fullsized":"2024-09-13T19:06:58.328820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:44.711664+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:07:44.711664+0000","last_peered":"2024-09-13T19:07:44.711664+0000","last_clean":"2024-09-13T19:07:44.711664+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:07:44.711664+0000","last_undegraded":"2024-09-13T19:07:44.711664+0000","last_fullsized":"2024-09-13T19:07:44.711664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610491+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:09:38.610491+0000","last_peered":"2024-09-13T19:09:38.610491+0000","last_clean":"2024-09-13T19:09:38.610491+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:09:38.610491+0000","last_undegraded":"2024-09-13T19:09:38.610491+0000","last_fullsized":"2024-09-13T19:09:38.610491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:03.939657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.460726+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:07:06.460726+0000","last_peered":"2024-09-13T19:07:06.460726+0000","last_clean":"2024-09-13T19:07:06.460726+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:07:06.460726+0000","last_undegraded":"2024-09-13T19:07:06.460726+0000","last_fullsized":"2024-09-13T19:07:06.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:30.862085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328791+0000","last_change":"2024-09-13T19:06:23.258115+0000","last_active":"2024-09-13T19:06:58.328791+0000","last_peered":"2024-09-13T19:06:58.328791+0000","last_clean":"2024-09-13T19:06:58.328791+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:06:58.328791+0000","last_undegraded":"2024-09-13T19:06:58.328791+0000","last_fullsized":"2024-09-13T19:06:58.328791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.789775+0000","last_change":"2024-09-13T19:06:25.289758+0000","last_active":"2024-09-13T19:08:33.789775+0000","last_peered":"2024-09-13T19:08:33.789775+0000","last_clean":"2024-09-13T19:08:33.789775+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:08:33.789775+0000","last_undegraded":"2024-09-13T19:08:33.789775+0000","last_fullsized":"2024-09-13T19:08:33.789775+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:14.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.829627+0000","last_change":"2024-09-13T19:06:27.298298+0000","last_active":"2024-09-13T19:09:38.829627+0000","last_peered":"2024-09-13T19:09:38.829627+0000","last_clean":"2024-09-13T19:09:38.829627+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:09:38.829627+0000","last_undegraded":"2024-09-13T19:09:38.829627+0000","last_fullsized":"2024-09-13T19:09:38.829627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.115703+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:08:37.115703+0000","last_peered":"2024-09-13T19:08:37.115703+0000","last_clean":"2024-09-13T19:08:37.115703+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:08:37.115703+0000","last_undegraded":"2024-09-13T19:08:37.115703+0000","last_fullsized":"2024-09-13T19:08:37.115703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:12.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.657938+0000","last_change":"2024-09-13T19:06:21.254633+0000","last_active":"2024-09-13T19:07:50.657938+0000","last_peered":"2024-09-13T19:07:50.657938+0000","last_clean":"2024-09-13T19:07:50.657938+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:07:50.657938+0000","last_undegraded":"2024-09-13T19:07:50.657938+0000","last_fullsized":"2024-09-13T19:07:50.657938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.476452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000975+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:08:34.000975+0000","last_peered":"2024-09-13T19:08:34.000975+0000","last_clean":"2024-09-13T19:08:34.000975+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:08:34.000975+0000","last_undegraded":"2024-09-13T19:08:34.000975+0000","last_fullsized":"2024-09-13T19:08:34.000975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:54.868067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327588+0000","last_change":"2024-09-13T19:06:23.249243+0000","last_active":"2024-09-13T19:06:58.327588+0000","last_peered":"2024-09-13T19:06:58.327588+0000","last_clean":"2024-09-13T19:06:58.327588+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:06:58.327588+0000","last_undegraded":"2024-09-13T19:06:58.327588+0000","last_fullsized":"2024-09-13T19:06:58.327588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.792229+0000","last_change":"2024-09-13T19:06:25.282586+0000","last_active":"2024-09-13T19:08:33.792229+0000","last_peered":"2024-09-13T19:08:33.792229+0000","last_clean":"2024-09-13T19:08:33.792229+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:08:33.792229+0000","last_undegraded":"2024-09-13T19:08:33.792229+0000","last_fullsized":"2024-09-13T19:08:33.792229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.800732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326947+0000","last_change":"2024-09-13T19:06:27.313481+0000","last_active":"2024-09-13T19:06:58.326947+0000","last_peered":"2024-09-13T19:06:58.326947+0000","last_clean":"2024-09-13T19:06:58.326947+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:06:58.326947+0000","last_undegraded":"2024-09-13T19:06:58.326947+0000","last_fullsized":"2024-09-13T19:06:58.326947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.751983+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:09:38.751983+0000","last_peered":"2024-09-13T19:09:38.751983+0000","last_clean":"2024-09-13T19:09:38.751983+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:09:38.751983+0000","last_undegraded":"2024-09-13T19:09:38.751983+0000","last_fullsized":"2024-09-13T19:09:38.751983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:28.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255473+0000","last_change":"2024-09-13T19:06:21.254823+0000","last_active":"2024-09-13T19:09:38.255473+0000","last_peered":"2024-09-13T19:09:38.255473+0000","last_clean":"2024-09-13T19:09:38.255473+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:09:38.255473+0000","last_undegraded":"2024-09-13T19:09:38.255473+0000","last_fullsized":"2024-09-13T19:09:38.255473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.117376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329744+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:06:58.329744+0000","last_peered":"2024-09-13T19:06:58.329744+0000","last_clean":"2024-09-13T19:06:58.329744+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:06:58.329744+0000","last_undegraded":"2024-09-13T19:06:58.329744+0000","last_fullsized":"2024-09-13T19:06:58.329744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.658155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333104+0000","last_change":"2024-09-13T19:06:23.253330+0000","last_active":"2024-09-13T19:06:58.333104+0000","last_peered":"2024-09-13T19:06:58.333104+0000","last_clean":"2024-09-13T19:06:58.333104+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:06:58.333104+0000","last_undegraded":"2024-09-13T19:06:58.333104+0000","last_fullsized":"2024-09-13T19:06:58.333104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:06.158565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.761313+0000","last_change":"2024-09-13T19:06:25.281709+0000","last_active":"2024-09-13T19:08:33.761313+0000","last_peered":"2024-09-13T19:08:33.761313+0000","last_clean":"2024-09-13T19:08:33.761313+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:08:33.761313+0000","last_undegraded":"2024-09-13T19:08:33.761313+0000","last_fullsized":"2024-09-13T19:08:33.761313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:30.269921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354536+0000","last_change":"2024-09-13T19:06:27.302986+0000","last_active":"2024-09-13T19:06:58.354536+0000","last_peered":"2024-09-13T19:06:58.354536+0000","last_clean":"2024-09-13T19:06:58.354536+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:06:58.354536+0000","last_undegraded":"2024-09-13T19:06:58.354536+0000","last_fullsized":"2024-09-13T19:06:58.354536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:39.152741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.342251+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:08:33.342251+0000","last_peered":"2024-09-13T19:08:33.342251+0000","last_clean":"2024-09-13T19:08:33.342251+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:08:33.342251+0000","last_undegraded":"2024-09-13T19:08:33.342251+0000","last_fullsized":"2024-09-13T19:08:33.342251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:56.624697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.349011+0000","last_change":"2024-09-13T19:06:21.267040+0000","last_active":"2024-09-13T19:06:58.349011+0000","last_peered":"2024-09-13T19:06:58.349011+0000","last_clean":"2024-09-13T19:06:58.349011+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:06:58.349011+0000","last_undegraded":"2024-09-13T19:06:58.349011+0000","last_fullsized":"2024-09-13T19:06:58.349011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:49.679514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.338851+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:06:58.338851+0000","last_peered":"2024-09-13T19:06:58.338851+0000","last_clean":"2024-09-13T19:06:58.338851+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:06:58.338851+0000","last_undegraded":"2024-09-13T19:06:58.338851+0000","last_fullsized":"2024-09-13T19:06:58.338851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:51.658861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328141+0000","last_change":"2024-09-13T19:06:23.258329+0000","last_active":"2024-09-13T19:06:58.328141+0000","last_peered":"2024-09-13T19:06:58.328141+0000","last_clean":"2024-09-13T19:06:58.328141+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:06:58.328141+0000","last_undegraded":"2024-09-13T19:06:58.328141+0000","last_fullsized":"2024-09-13T19:06:58.328141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:19.236853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002628+0000","last_change":"2024-09-13T19:06:25.286826+0000","last_active":"2024-09-13T19:08:44.002628+0000","last_peered":"2024-09-13T19:08:44.002628+0000","last_clean":"2024-09-13T19:08:44.002628+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:08:44.002628+0000","last_undegraded":"2024-09-13T19:08:44.002628+0000","last_fullsized":"2024-09-13T19:08:44.002628+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:08.372479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.762784+0000","last_change":"2024-09-13T19:06:27.328186+0000","last_active":"2024-09-13T19:09:38.762784+0000","last_peered":"2024-09-13T19:09:38.762784+0000","last_clean":"2024-09-13T19:09:38.762784+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:09:38.762784+0000","last_undegraded":"2024-09-13T19:09:38.762784+0000","last_fullsized":"2024-09-13T19:09:38.762784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:01.872002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.922026+0000","last_change":"2024-09-13T19:06:29.297215+0000","last_active":"2024-09-13T19:08:36.922026+0000","last_peered":"2024-09-13T19:08:36.922026+0000","last_clean":"2024-09-13T19:08:36.922026+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:08:36.922026+0000","last_undegraded":"2024-09-13T19:08:36.922026+0000","last_fullsized":"2024-09-13T19:08:36.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.039686+0000","last_change":"2024-09-13T19:06:21.255658+0000","last_active":"2024-09-13T19:09:38.039686+0000","last_peered":"2024-09-13T19:09:38.039686+0000","last_clean":"2024-09-13T19:09:38.039686+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:09:38.039686+0000","last_undegraded":"2024-09-13T19:09:38.039686+0000","last_fullsized":"2024-09-13T19:09:38.039686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724793+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:07:05.724793+0000","last_peered":"2024-09-13T19:07:05.724793+0000","last_clean":"2024-09-13T19:07:05.724793+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:07:05.724793+0000","last_undegraded":"2024-09-13T19:07:05.724793+0000","last_fullsized":"2024-09-13T19:07:05.724793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.606992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.151797+0000","last_change":"2024-09-13T19:06:23.268138+0000","last_active":"2024-09-13T19:08:36.151797+0000","last_peered":"2024-09-13T19:08:36.151797+0000","last_clean":"2024-09-13T19:08:36.151797+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:08:36.151797+0000","last_undegraded":"2024-09-13T19:08:36.151797+0000","last_fullsized":"2024-09-13T19:08:36.151797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.704741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004313+0000","last_change":"2024-09-13T19:06:25.281762+0000","last_active":"2024-09-13T19:08:44.004313+0000","last_peered":"2024-09-13T19:08:44.004313+0000","last_clean":"2024-09-13T19:08:44.004313+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:08:44.004313+0000","last_undegraded":"2024-09-13T19:08:44.004313+0000","last_fullsized":"2024-09-13T19:08:44.004313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:51.768718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":470,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.622710+0000","last_change":"2024-09-13T19:06:27.321351+0000","last_active":"2024-09-13T19:09:38.622710+0000","last_peered":"2024-09-13T19:09:38.622710+0000","last_clean":"2024-09-13T19:09:38.622710+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:09:38.622710+0000","last_undegraded":"2024-09-13T19:09:38.622710+0000","last_fullsized":"2024-09-13T19:09:38.622710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.413797+0000","last_change":"2024-09-13T19:06:29.303776+0000","last_active":"2024-09-13T19:08:36.413797+0000","last_peered":"2024-09-13T19:08:36.413797+0000","last_clean":"2024-09-13T19:08:36.413797+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:08:36.413797+0000","last_undegraded":"2024-09-13T19:08:36.413797+0000","last_fullsized":"2024-09-13T19:08:36.413797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:42.497813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455777+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.455777+0000","last_peered":"2024-09-13T19:09:38.455777+0000","last_clean":"2024-09-13T19:09:38.455777+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.455777+0000","last_undegraded":"2024-09-13T19:09:38.455777+0000","last_fullsized":"2024-09-13T19:09:38.455777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:54.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336035+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:06:58.336035+0000","last_peered":"2024-09-13T19:06:58.336035+0000","last_clean":"2024-09-13T19:06:58.336035+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:06:58.336035+0000","last_undegraded":"2024-09-13T19:06:58.336035+0000","last_fullsized":"2024-09-13T19:06:58.336035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:35.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354619+0000","last_change":"2024-09-13T19:06:23.278499+0000","last_active":"2024-09-13T19:06:58.354619+0000","last_peered":"2024-09-13T19:06:58.354619+0000","last_clean":"2024-09-13T19:06:58.354619+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:06:58.354619+0000","last_undegraded":"2024-09-13T19:06:58.354619+0000","last_fullsized":"2024-09-13T19:06:58.354619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:05.943867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.782491+0000","last_change":"2024-09-13T19:06:25.280810+0000","last_active":"2024-09-13T19:08:33.782491+0000","last_peered":"2024-09-13T19:08:33.782491+0000","last_clean":"2024-09-13T19:08:33.782491+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:08:33.782491+0000","last_undegraded":"2024-09-13T19:08:33.782491+0000","last_fullsized":"2024-09-13T19:08:33.782491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.687336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330438+0000","last_change":"2024-09-13T19:06:27.327479+0000","last_active":"2024-09-13T19:06:58.330438+0000","last_peered":"2024-09-13T19:06:58.330438+0000","last_clean":"2024-09-13T19:06:58.330438+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:06:58.330438+0000","last_undegraded":"2024-09-13T19:06:58.330438+0000","last_fullsized":"2024-09-13T19:06:58.330438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:32.856579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.552955+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:09:38.552955+0000","last_peered":"2024-09-13T19:09:38.552955+0000","last_clean":"2024-09-13T19:09:38.552955+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:09:38.552955+0000","last_undegraded":"2024-09-13T19:09:38.552955+0000","last_fullsized":"2024-09-13T19:09:38.552955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:43.406563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.038245+0000","last_change":"2024-09-13T19:06:21.266428+0000","last_active":"2024-09-13T19:07:08.038245+0000","last_peered":"2024-09-13T19:07:08.038245+0000","last_clean":"2024-09-13T19:07:08.038245+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:07:08.038245+0000","last_undegraded":"2024-09-13T19:07:08.038245+0000","last_fullsized":"2024-09-13T19:07:08.038245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:15.353078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353237+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:58.353237+0000","last_peered":"2024-09-13T19:06:58.353237+0000","last_clean":"2024-09-13T19:06:58.353237+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:58.353237+0000","last_undegraded":"2024-09-13T19:06:58.353237+0000","last_fullsized":"2024-09-13T19:06:58.353237+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341613+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:58.341613+0000","last_peered":"2024-09-13T19:06:58.341613+0000","last_clean":"2024-09-13T19:06:58.341613+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:58.341613+0000","last_undegraded":"2024-09-13T19:06:58.341613+0000","last_fullsized":"2024-09-13T19:06:58.341613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.642212+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:07:50.642212+0000","last_peered":"2024-09-13T19:07:50.642212+0000","last_clean":"2024-09-13T19:07:50.642212+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:07:50.642212+0000","last_undegraded":"2024-09-13T19:07:50.642212+0000","last_fullsized":"2024-09-13T19:07:50.642212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:05.311607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343001+0000","last_change":"2024-09-13T19:06:23.274175+0000","last_active":"2024-09-13T19:06:58.343001+0000","last_peered":"2024-09-13T19:06:58.343001+0000","last_clean":"2024-09-13T19:06:58.343001+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:06:58.343001+0000","last_undegraded":"2024-09-13T19:06:58.343001+0000","last_fullsized":"2024-09-13T19:06:58.343001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:15.978917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.801042+0000","last_change":"2024-09-13T19:06:25.277544+0000","last_active":"2024-09-13T19:08:33.801042+0000","last_peered":"2024-09-13T19:08:33.801042+0000","last_clean":"2024-09-13T19:08:33.801042+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:08:33.801042+0000","last_undegraded":"2024-09-13T19:08:33.801042+0000","last_fullsized":"2024-09-13T19:08:33.801042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:24.442610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333055+0000","last_change":"2024-09-13T19:06:27.299350+0000","last_active":"2024-09-13T19:06:58.333055+0000","last_peered":"2024-09-13T19:06:58.333055+0000","last_clean":"2024-09-13T19:06:58.333055+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:06:58.333055+0000","last_undegraded":"2024-09-13T19:06:58.333055+0000","last_fullsized":"2024-09-13T19:06:58.333055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:10.979684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.482335+0000","last_change":"2024-09-13T19:06:29.300679+0000","last_active":"2024-09-13T19:09:38.482335+0000","last_peered":"2024-09-13T19:09:38.482335+0000","last_clean":"2024-09-13T19:09:38.482335+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:09:38.482335+0000","last_undegraded":"2024-09-13T19:09:38.482335+0000","last_fullsized":"2024-09-13T19:09:38.482335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:18.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.325242+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:07:07.325242+0000","last_peered":"2024-09-13T19:07:07.325242+0000","last_clean":"2024-09-13T19:07:07.325242+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:07:07.325242+0000","last_undegraded":"2024-09-13T19:07:07.325242+0000","last_fullsized":"2024-09-13T19:07:07.325242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:10.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335353+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:58.335353+0000","last_peered":"2024-09-13T19:06:58.335353+0000","last_clean":"2024-09-13T19:06:58.335353+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:58.335353+0000","last_undegraded":"2024-09-13T19:06:58.335353+0000","last_fullsized":"2024-09-13T19:06:58.335353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327250+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:06:58.327250+0000","last_peered":"2024-09-13T19:06:58.327250+0000","last_clean":"2024-09-13T19:06:58.327250+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:06:58.327250+0000","last_undegraded":"2024-09-13T19:06:58.327250+0000","last_fullsized":"2024-09-13T19:06:58.327250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.122617+0000","last_change":"2024-09-13T19:06:23.276941+0000","last_active":"2024-09-13T19:08:36.122617+0000","last_peered":"2024-09-13T19:08:36.122617+0000","last_clean":"2024-09-13T19:08:36.122617+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:08:36.122617+0000","last_undegraded":"2024-09-13T19:08:36.122617+0000","last_fullsized":"2024-09-13T19:08:36.122617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:43.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'273","reported_seq":478,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517889+0000","last_change":"2024-09-13T19:06:25.284975+0000","last_active":"2024-09-13T19:09:38.517889+0000","last_peered":"2024-09-13T19:09:38.517889+0000","last_clean":"2024-09-13T19:09:38.517889+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:09:38.517889+0000","last_undegraded":"2024-09-13T19:09:38.517889+0000","last_fullsized":"2024-09-13T19:09:38.517889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:14.778552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342538+0000","last_change":"2024-09-13T19:06:27.305676+0000","last_active":"2024-09-13T19:06:58.342538+0000","last_peered":"2024-09-13T19:06:58.342538+0000","last_clean":"2024-09-13T19:06:58.342538+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:06:58.342538+0000","last_undegraded":"2024-09-13T19:06:58.342538+0000","last_fullsized":"2024-09-13T19:06:58.342538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:49.829980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.388695+0000","last_change":"2024-09-13T19:06:29.319214+0000","last_active":"2024-09-13T19:07:50.388695+0000","last_peered":"2024-09-13T19:07:50.388695+0000","last_clean":"2024-09-13T19:07:50.388695+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:07:50.388695+0000","last_undegraded":"2024-09-13T19:07:50.388695+0000","last_fullsized":"2024-09-13T19:07:50.388695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:33.276278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.256520+0000","last_change":"2024-09-13T19:06:21.260320+0000","last_active":"2024-09-13T19:09:38.256520+0000","last_peered":"2024-09-13T19:09:38.256520+0000","last_clean":"2024-09-13T19:09:38.256520+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:09:38.256520+0000","last_undegraded":"2024-09-13T19:09:38.256520+0000","last_fullsized":"2024-09-13T19:09:38.256520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329531+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:58.329531+0000","last_peered":"2024-09-13T19:06:58.329531+0000","last_clean":"2024-09-13T19:06:58.329531+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:58.329531+0000","last_undegraded":"2024-09-13T19:06:58.329531+0000","last_fullsized":"2024-09-13T19:06:58.329531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326113+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:06:58.326113+0000","last_peered":"2024-09-13T19:06:58.326113+0000","last_clean":"2024-09-13T19:06:58.326113+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:06:58.326113+0000","last_undegraded":"2024-09-13T19:06:58.326113+0000","last_fullsized":"2024-09-13T19:06:58.326113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.371226+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:06:58.371226+0000","last_peered":"2024-09-13T19:06:58.371226+0000","last_clean":"2024-09-13T19:06:58.371226+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:06:58.371226+0000","last_undegraded":"2024-09-13T19:06:58.371226+0000","last_fullsized":"2024-09-13T19:06:58.371226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:30.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518498+0000","last_change":"2024-09-13T19:06:25.297340+0000","last_active":"2024-09-13T19:09:38.518498+0000","last_peered":"2024-09-13T19:09:38.518498+0000","last_clean":"2024-09-13T19:09:38.518498+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:09:38.518498+0000","last_undegraded":"2024-09-13T19:09:38.518498+0000","last_fullsized":"2024-09-13T19:09:38.518498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:59.204433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329583+0000","last_change":"2024-09-13T19:06:27.303087+0000","last_active":"2024-09-13T19:06:58.329583+0000","last_peered":"2024-09-13T19:06:58.329583+0000","last_clean":"2024-09-13T19:06:58.329583+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:06:58.329583+0000","last_undegraded":"2024-09-13T19:06:58.329583+0000","last_fullsized":"2024-09-13T19:06:58.329583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:15.260803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335697+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:06:58.335697+0000","last_peered":"2024-09-13T19:06:58.335697+0000","last_clean":"2024-09-13T19:06:58.335697+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:06:58.335697+0000","last_undegraded":"2024-09-13T19:06:58.335697+0000","last_fullsized":"2024-09-13T19:06:58.335697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:02.339869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.032925+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:07:08.032925+0000","last_peered":"2024-09-13T19:07:08.032925+0000","last_clean":"2024-09-13T19:07:08.032925+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:07:08.032925+0000","last_undegraded":"2024-09-13T19:07:08.032925+0000","last_fullsized":"2024-09-13T19:07:08.032925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336137+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:58.336137+0000","last_peered":"2024-09-13T19:06:58.336137+0000","last_clean":"2024-09-13T19:06:58.336137+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:58.336137+0000","last_undegraded":"2024-09-13T19:06:58.336137+0000","last_fullsized":"2024-09-13T19:06:58.336137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330472+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:06:58.330472+0000","last_peered":"2024-09-13T19:06:58.330472+0000","last_clean":"2024-09-13T19:06:58.330472+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:06:58.330472+0000","last_undegraded":"2024-09-13T19:06:58.330472+0000","last_fullsized":"2024-09-13T19:06:58.330472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330688+0000","last_change":"2024-09-13T19:06:23.247010+0000","last_active":"2024-09-13T19:06:58.330688+0000","last_peered":"2024-09-13T19:06:58.330688+0000","last_clean":"2024-09-13T19:06:58.330688+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:06:58.330688+0000","last_undegraded":"2024-09-13T19:06:58.330688+0000","last_fullsized":"2024-09-13T19:06:58.330688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:39.504976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.165710+0000","last_change":"2024-09-13T19:06:25.277155+0000","last_active":"2024-09-13T19:09:37.165710+0000","last_peered":"2024-09-13T19:09:37.165710+0000","last_clean":"2024-09-13T19:09:37.165710+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:09:37.165710+0000","last_undegraded":"2024-09-13T19:09:37.165710+0000","last_fullsized":"2024-09-13T19:09:37.165710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:35.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353918+0000","last_change":"2024-09-13T19:06:27.303059+0000","last_active":"2024-09-13T19:06:58.353918+0000","last_peered":"2024-09-13T19:06:58.353918+0000","last_clean":"2024-09-13T19:06:58.353918+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:06:58.353918+0000","last_undegraded":"2024-09-13T19:06:58.353918+0000","last_fullsized":"2024-09-13T19:06:58.353918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:37.515962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.452185+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:08:36.452185+0000","last_peered":"2024-09-13T19:08:36.452185+0000","last_clean":"2024-09-13T19:08:36.452185+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:08:36.452185+0000","last_undegraded":"2024-09-13T19:08:36.452185+0000","last_fullsized":"2024-09-13T19:08:36.452185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.652660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.037885+0000","last_change":"2024-09-13T19:06:21.264605+0000","last_active":"2024-09-13T19:07:08.037885+0000","last_peered":"2024-09-13T19:07:08.037885+0000","last_clean":"2024-09-13T19:07:08.037885+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:07:08.037885+0000","last_undegraded":"2024-09-13T19:07:08.037885+0000","last_fullsized":"2024-09-13T19:07:08.037885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331265+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:06:58.331265+0000","last_peered":"2024-09-13T19:06:58.331265+0000","last_clean":"2024-09-13T19:06:58.331265+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:06:58.331265+0000","last_undegraded":"2024-09-13T19:06:58.331265+0000","last_fullsized":"2024-09-13T19:06:58.331265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328957+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:58.328957+0000","last_peered":"2024-09-13T19:06:58.328957+0000","last_clean":"2024-09-13T19:06:58.328957+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:58.328957+0000","last_undegraded":"2024-09-13T19:06:58.328957+0000","last_fullsized":"2024-09-13T19:06:58.328957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.989981+0000","last_change":"2024-09-13T19:06:23.246897+0000","last_active":"2024-09-13T19:08:28.989981+0000","last_peered":"2024-09-13T19:08:28.989981+0000","last_clean":"2024-09-13T19:08:28.989981+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:08:28.989981+0000","last_undegraded":"2024-09-13T19:08:28.989981+0000","last_fullsized":"2024-09-13T19:08:28.989981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:02.627136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'63","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.803978+0000","last_change":"2024-09-13T19:06:25.271746+0000","last_active":"2024-09-13T19:08:33.803978+0000","last_peered":"2024-09-13T19:08:33.803978+0000","last_clean":"2024-09-13T19:08:33.803978+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:08:33.803978+0000","last_undegraded":"2024-09-13T19:08:33.803978+0000","last_fullsized":"2024-09-13T19:08:33.803978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:48.903655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328017+0000","last_change":"2024-09-13T19:06:27.327868+0000","last_active":"2024-09-13T19:06:58.328017+0000","last_peered":"2024-09-13T19:06:58.328017+0000","last_clean":"2024-09-13T19:06:58.328017+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:06:58.328017+0000","last_undegraded":"2024-09-13T19:06:58.328017+0000","last_fullsized":"2024-09-13T19:06:58.328017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:58.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.927178+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:36.927178+0000","last_peered":"2024-09-13T19:08:36.927178+0000","last_clean":"2024-09-13T19:08:36.927178+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:36.927178+0000","last_undegraded":"2024-09-13T19:08:36.927178+0000","last_fullsized":"2024-09-13T19:08:36.927178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:18.960181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474863+0000","last_change":"2024-09-13T19:06:21.256957+0000","last_active":"2024-09-13T19:09:38.474863+0000","last_peered":"2024-09-13T19:09:38.474863+0000","last_clean":"2024-09-13T19:09:38.474863+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:09:38.474863+0000","last_undegraded":"2024-09-13T19:09:38.474863+0000","last_fullsized":"2024-09-13T19:09:38.474863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.052247+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:08:37.052247+0000","last_peered":"2024-09-13T19:08:37.052247+0000","last_clean":"2024-09-13T19:08:37.052247+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:08:37.052247+0000","last_undegraded":"2024-09-13T19:08:37.052247+0000","last_fullsized":"2024-09-13T19:08:37.052247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344720+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:58.344720+0000","last_peered":"2024-09-13T19:06:58.344720+0000","last_clean":"2024-09-13T19:06:58.344720+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:58.344720+0000","last_undegraded":"2024-09-13T19:06:58.344720+0000","last_fullsized":"2024-09-13T19:06:58.344720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.357946+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:06:58.357946+0000","last_peered":"2024-09-13T19:06:58.357946+0000","last_clean":"2024-09-13T19:06:58.357946+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:06:58.357946+0000","last_undegraded":"2024-09-13T19:06:58.357946+0000","last_fullsized":"2024-09-13T19:06:58.357946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:53.053072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.352663+0000","last_change":"2024-09-13T19:06:25.289221+0000","last_active":"2024-09-13T19:06:58.352663+0000","last_peered":"2024-09-13T19:06:58.352663+0000","last_clean":"2024-09-13T19:06:58.352663+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:06:58.352663+0000","last_undegraded":"2024-09-13T19:06:58.352663+0000","last_fullsized":"2024-09-13T19:06:58.352663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:24.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517756+0000","last_change":"2024-09-13T19:06:27.322042+0000","last_active":"2024-09-13T19:09:38.517756+0000","last_peered":"2024-09-13T19:09:38.517756+0000","last_clean":"2024-09-13T19:09:38.517756+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:09:38.517756+0000","last_undegraded":"2024-09-13T19:09:38.517756+0000","last_fullsized":"2024-09-13T19:09:38.517756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350581+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:06:58.350581+0000","last_peered":"2024-09-13T19:06:58.350581+0000","last_clean":"2024-09-13T19:06:58.350581+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:06:58.350581+0000","last_undegraded":"2024-09-13T19:06:58.350581+0000","last_fullsized":"2024-09-13T19:06:58.350581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:14.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336082+0000","last_change":"2024-09-13T19:06:21.259985+0000","last_active":"2024-09-13T19:06:58.336082+0000","last_peered":"2024-09-13T19:06:58.336082+0000","last_clean":"2024-09-13T19:06:58.336082+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:06:58.336082+0000","last_undegraded":"2024-09-13T19:06:58.336082+0000","last_fullsized":"2024-09-13T19:06:58.336082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.974707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.356451+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:06:58.356451+0000","last_peered":"2024-09-13T19:06:58.356451+0000","last_clean":"2024-09-13T19:06:58.356451+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:06:58.356451+0000","last_undegraded":"2024-09-13T19:06:58.356451+0000","last_fullsized":"2024-09-13T19:06:58.356451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:21.325723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333377+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:58.333377+0000","last_peered":"2024-09-13T19:06:58.333377+0000","last_clean":"2024-09-13T19:06:58.333377+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:58.333377+0000","last_undegraded":"2024-09-13T19:06:58.333377+0000","last_fullsized":"2024-09-13T19:06:58.333377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336839+0000","last_change":"2024-09-13T19:06:23.278519+0000","last_active":"2024-09-13T19:06:58.336839+0000","last_peered":"2024-09-13T19:06:58.336839+0000","last_clean":"2024-09-13T19:06:58.336839+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:06:58.336839+0000","last_undegraded":"2024-09-13T19:06:58.336839+0000","last_fullsized":"2024-09-13T19:06:58.336839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:56.056319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337965+0000","last_change":"2024-09-13T19:06:25.303816+0000","last_active":"2024-09-13T19:06:58.337965+0000","last_peered":"2024-09-13T19:06:58.337965+0000","last_clean":"2024-09-13T19:06:58.337965+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:06:58.337965+0000","last_undegraded":"2024-09-13T19:06:58.337965+0000","last_fullsized":"2024-09-13T19:06:58.337965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:40.157012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.797372+0000","last_change":"2024-09-13T19:06:27.282458+0000","last_active":"2024-09-13T19:09:38.797372+0000","last_peered":"2024-09-13T19:09:38.797372+0000","last_clean":"2024-09-13T19:09:38.797372+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:09:38.797372+0000","last_undegraded":"2024-09-13T19:09:38.797372+0000","last_fullsized":"2024-09-13T19:09:38.797372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341741+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:06:58.341741+0000","last_peered":"2024-09-13T19:06:58.341741+0000","last_clean":"2024-09-13T19:06:58.341741+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:06:58.341741+0000","last_undegraded":"2024-09-13T19:06:58.341741+0000","last_fullsized":"2024-09-13T19:06:58.341741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:28.410267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474093+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:09:38.474093+0000","last_peered":"2024-09-13T19:09:38.474093+0000","last_clean":"2024-09-13T19:09:38.474093+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:09:38.474093+0000","last_undegraded":"2024-09-13T19:09:38.474093+0000","last_fullsized":"2024-09-13T19:09:38.474093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:40.974350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359033+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:06:58.359033+0000","last_peered":"2024-09-13T19:06:58.359033+0000","last_clean":"2024-09-13T19:06:58.359033+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:06:58.359033+0000","last_undegraded":"2024-09-13T19:06:58.359033+0000","last_fullsized":"2024-09-13T19:06:58.359033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355963+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:58.355963+0000","last_peered":"2024-09-13T19:06:58.355963+0000","last_clean":"2024-09-13T19:06:58.355963+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:58.355963+0000","last_undegraded":"2024-09-13T19:06:58.355963+0000","last_fullsized":"2024-09-13T19:06:58.355963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335083+0000","last_change":"2024-09-13T19:06:23.258816+0000","last_active":"2024-09-13T19:06:58.335083+0000","last_peered":"2024-09-13T19:06:58.335083+0000","last_clean":"2024-09-13T19:06:58.335083+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:06:58.335083+0000","last_undegraded":"2024-09-13T19:06:58.335083+0000","last_fullsized":"2024-09-13T19:06:58.335083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'82","reported_seq":154,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.779140+0000","last_change":"2024-09-13T19:06:25.297079+0000","last_active":"2024-09-13T19:08:33.779140+0000","last_peered":"2024-09-13T19:08:33.779140+0000","last_clean":"2024-09-13T19:08:33.779140+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:08:33.779140+0000","last_undegraded":"2024-09-13T19:08:33.779140+0000","last_fullsized":"2024-09-13T19:08:33.779140+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:41.508588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326963+0000","last_change":"2024-09-13T19:06:27.313781+0000","last_active":"2024-09-13T19:06:58.326963+0000","last_peered":"2024-09-13T19:06:58.326963+0000","last_clean":"2024-09-13T19:06:58.326963+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:06:58.326963+0000","last_undegraded":"2024-09-13T19:06:58.326963+0000","last_fullsized":"2024-09-13T19:06:58.326963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:40.346062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342617+0000","last_change":"2024-09-13T19:06:29.312253+0000","last_active":"2024-09-13T19:06:58.342617+0000","last_peered":"2024-09-13T19:06:58.342617+0000","last_clean":"2024-09-13T19:06:58.342617+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:06:58.342617+0000","last_undegraded":"2024-09-13T19:06:58.342617+0000","last_fullsized":"2024-09-13T19:06:58.342617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:42.361204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.616193+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:09:38.616193+0000","last_peered":"2024-09-13T19:09:38.616193+0000","last_clean":"2024-09-13T19:09:38.616193+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:09:38.616193+0000","last_undegraded":"2024-09-13T19:09:38.616193+0000","last_fullsized":"2024-09-13T19:09:38.616193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:59.779490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.391281+0000","last_change":"2024-09-13T19:06:21.254116+0000","last_active":"2024-09-13T19:09:38.391281+0000","last_peered":"2024-09-13T19:09:38.391281+0000","last_clean":"2024-09-13T19:09:38.391281+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:09:38.391281+0000","last_undegraded":"2024-09-13T19:09:38.391281+0000","last_fullsized":"2024-09-13T19:09:38.391281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344342+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:06:58.344342+0000","last_peered":"2024-09-13T19:06:58.344342+0000","last_clean":"2024-09-13T19:06:58.344342+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:06:58.344342+0000","last_undegraded":"2024-09-13T19:06:58.344342+0000","last_fullsized":"2024-09-13T19:06:58.344342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:27.824459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340835+0000","last_change":"2024-09-13T19:06:23.271978+0000","last_active":"2024-09-13T19:06:58.340835+0000","last_peered":"2024-09-13T19:06:58.340835+0000","last_clean":"2024-09-13T19:06:58.340835+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:06:58.340835+0000","last_undegraded":"2024-09-13T19:06:58.340835+0000","last_fullsized":"2024-09-13T19:06:58.340835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:00.312157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'33","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005883+0000","last_change":"2024-09-13T19:06:25.283177+0000","last_active":"2024-09-13T19:08:49.005883+0000","last_peered":"2024-09-13T19:08:49.005883+0000","last_clean":"2024-09-13T19:08:49.005883+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:08:49.005883+0000","last_undegraded":"2024-09-13T19:08:49.005883+0000","last_fullsized":"2024-09-13T19:08:49.005883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:04.407822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336859+0000","last_change":"2024-09-13T19:06:27.325440+0000","last_active":"2024-09-13T19:06:58.336859+0000","last_peered":"2024-09-13T19:06:58.336859+0000","last_clean":"2024-09-13T19:06:58.336859+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:06:58.336859+0000","last_undegraded":"2024-09-13T19:06:58.336859+0000","last_fullsized":"2024-09-13T19:06:58.336859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:33.587433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.338476+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:09:38.338476+0000","last_peered":"2024-09-13T19:09:38.338476+0000","last_clean":"2024-09-13T19:09:38.338476+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:09:38.338476+0000","last_undegraded":"2024-09-13T19:09:38.338476+0000","last_fullsized":"2024-09-13T19:09:38.338476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:15.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.333822+0000","last_change":"2024-09-13T19:06:21.258397+0000","last_active":"2024-09-13T19:08:31.333822+0000","last_peered":"2024-09-13T19:08:31.333822+0000","last_clean":"2024-09-13T19:08:31.333822+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:08:31.333822+0000","last_undegraded":"2024-09-13T19:08:31.333822+0000","last_fullsized":"2024-09-13T19:08:31.333822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002481+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:08:44.002481+0000","last_peered":"2024-09-13T19:08:44.002481+0000","last_clean":"2024-09-13T19:08:44.002481+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:08:44.002481+0000","last_undegraded":"2024-09-13T19:08:44.002481+0000","last_fullsized":"2024-09-13T19:08:44.002481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337678+0000","last_change":"2024-09-13T19:06:23.263752+0000","last_active":"2024-09-13T19:06:58.337678+0000","last_peered":"2024-09-13T19:06:58.337678+0000","last_clean":"2024-09-13T19:06:58.337678+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:06:58.337678+0000","last_undegraded":"2024-09-13T19:06:58.337678+0000","last_fullsized":"2024-09-13T19:06:58.337678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:11.243897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.175973+0000","last_change":"2024-09-13T19:06:25.282738+0000","last_active":"2024-09-13T19:09:37.175973+0000","last_peered":"2024-09-13T19:09:37.175973+0000","last_clean":"2024-09-13T19:09:37.175973+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:09:37.175973+0000","last_undegraded":"2024-09-13T19:09:37.175973+0000","last_fullsized":"2024-09-13T19:09:37.175973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:30.312744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329003+0000","last_change":"2024-09-13T19:06:27.319132+0000","last_active":"2024-09-13T19:06:58.329003+0000","last_peered":"2024-09-13T19:06:58.329003+0000","last_clean":"2024-09-13T19:06:58.329003+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:06:58.329003+0000","last_undegraded":"2024-09-13T19:06:58.329003+0000","last_fullsized":"2024-09-13T19:06:58.329003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:50.916949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329771+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:06:58.329771+0000","last_peered":"2024-09-13T19:06:58.329771+0000","last_clean":"2024-09-13T19:06:58.329771+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:06:58.329771+0000","last_undegraded":"2024-09-13T19:06:58.329771+0000","last_fullsized":"2024-09-13T19:06:58.329771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:34.489280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328516+0000","last_change":"2024-09-13T19:06:21.244155+0000","last_active":"2024-09-13T19:06:58.328516+0000","last_peered":"2024-09-13T19:06:58.328516+0000","last_clean":"2024-09-13T19:06:58.328516+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:06:58.328516+0000","last_undegraded":"2024-09-13T19:06:58.328516+0000","last_fullsized":"2024-09-13T19:06:58.328516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345339+0000","last_change":"2024-09-13T19:06:19.272180+0000","last_active":"2024-09-13T19:06:58.345339+0000","last_peered":"2024-09-13T19:06:58.345339+0000","last_clean":"2024-09-13T19:06:58.345339+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:06:58.345339+0000","last_undegraded":"2024-09-13T19:06:58.345339+0000","last_fullsized":"2024-09-13T19:06:58.345339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329720+0000","last_change":"2024-09-13T19:06:23.263616+0000","last_active":"2024-09-13T19:06:58.329720+0000","last_peered":"2024-09-13T19:06:58.329720+0000","last_clean":"2024-09-13T19:06:58.329720+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:06:58.329720+0000","last_undegraded":"2024-09-13T19:06:58.329720+0000","last_fullsized":"2024-09-13T19:06:58.329720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:38.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.326409+0000","last_change":"2024-09-13T19:06:25.270269+0000","last_active":"2024-09-13T19:09:37.326409+0000","last_peered":"2024-09-13T19:09:37.326409+0000","last_clean":"2024-09-13T19:09:37.326409+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:09:37.326409+0000","last_undegraded":"2024-09-13T19:09:37.326409+0000","last_fullsized":"2024-09-13T19:09:37.326409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:42.960440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.339704+0000","last_change":"2024-09-13T19:06:27.320991+0000","last_active":"2024-09-13T19:06:58.339704+0000","last_peered":"2024-09-13T19:06:58.339704+0000","last_clean":"2024-09-13T19:06:58.339704+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:06:58.339704+0000","last_undegraded":"2024-09-13T19:06:58.339704+0000","last_fullsized":"2024-09-13T19:06:58.339704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.378906+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.378906+0000","last_peered":"2024-09-13T19:09:37.378906+0000","last_clean":"2024-09-13T19:09:37.378906+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.378906+0000","last_undegraded":"2024-09-13T19:09:37.378906+0000","last_fullsized":"2024-09-13T19:09:37.378906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:43.618866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.383880+0000","last_change":"2024-09-13T19:06:21.259679+0000","last_active":"2024-09-13T19:07:50.383880+0000","last_peered":"2024-09-13T19:07:50.383880+0000","last_clean":"2024-09-13T19:07:50.383880+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:07:50.383880+0000","last_undegraded":"2024-09-13T19:07:50.383880+0000","last_fullsized":"2024-09-13T19:07:50.383880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:13.988925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.722225+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:07:05.722225+0000","last_peered":"2024-09-13T19:07:05.722225+0000","last_clean":"2024-09-13T19:07:05.722225+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:07:05.722225+0000","last_undegraded":"2024-09-13T19:07:05.722225+0000","last_fullsized":"2024-09-13T19:07:05.722225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336516+0000","last_change":"2024-09-13T19:06:23.274472+0000","last_active":"2024-09-13T19:06:58.336516+0000","last_peered":"2024-09-13T19:06:58.336516+0000","last_clean":"2024-09-13T19:06:58.336516+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:06:58.336516+0000","last_undegraded":"2024-09-13T19:06:58.336516+0000","last_fullsized":"2024-09-13T19:06:58.336516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:17.488278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.126723+0000","last_change":"2024-09-13T19:06:25.301056+0000","last_active":"2024-09-13T19:08:37.126723+0000","last_peered":"2024-09-13T19:08:37.126723+0000","last_clean":"2024-09-13T19:08:37.126723+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:08:37.126723+0000","last_undegraded":"2024-09-13T19:08:37.126723+0000","last_fullsized":"2024-09-13T19:08:37.126723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:47.795992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329265+0000","last_change":"2024-09-13T19:06:27.294666+0000","last_active":"2024-09-13T19:06:58.329265+0000","last_peered":"2024-09-13T19:06:58.329265+0000","last_clean":"2024-09-13T19:06:58.329265+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:06:58.329265+0000","last_undegraded":"2024-09-13T19:06:58.329265+0000","last_fullsized":"2024-09-13T19:06:58.329265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.973735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000048+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:08:29.000048+0000","last_peered":"2024-09-13T19:08:29.000048+0000","last_clean":"2024-09-13T19:08:29.000048+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:08:29.000048+0000","last_undegraded":"2024-09-13T19:08:29.000048+0000","last_fullsized":"2024-09-13T19:08:29.000048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:37.935118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335394+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:06:58.335394+0000","last_peered":"2024-09-13T19:06:58.335394+0000","last_clean":"2024-09-13T19:06:58.335394+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:06:58.335394+0000","last_undegraded":"2024-09-13T19:06:58.335394+0000","last_fullsized":"2024-09-13T19:06:58.335394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.587940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333770+0000","last_change":"2024-09-13T19:06:23.248415+0000","last_active":"2024-09-13T19:06:58.333770+0000","last_peered":"2024-09-13T19:06:58.333770+0000","last_clean":"2024-09-13T19:06:58.333770+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:06:58.333770+0000","last_undegraded":"2024-09-13T19:06:58.333770+0000","last_fullsized":"2024-09-13T19:06:58.333770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.792380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'56","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.799086+0000","last_change":"2024-09-13T19:06:25.283923+0000","last_active":"2024-09-13T19:08:33.799086+0000","last_peered":"2024-09-13T19:08:33.799086+0000","last_clean":"2024-09-13T19:08:33.799086+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:08:33.799086+0000","last_undegraded":"2024-09-13T19:08:33.799086+0000","last_fullsized":"2024-09-13T19:08:33.799086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:12.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330187+0000","last_change":"2024-09-13T19:06:27.303955+0000","last_active":"2024-09-13T19:06:58.330187+0000","last_peered":"2024-09-13T19:06:58.330187+0000","last_clean":"2024-09-13T19:06:58.330187+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:06:58.330187+0000","last_undegraded":"2024-09-13T19:06:58.330187+0000","last_fullsized":"2024-09-13T19:06:58.330187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:14.386556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.917251+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:36.917251+0000","last_peered":"2024-09-13T19:08:36.917251+0000","last_clean":"2024-09-13T19:08:36.917251+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:36.917251+0000","last_undegraded":"2024-09-13T19:08:36.917251+0000","last_fullsized":"2024-09-13T19:08:36.917251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:57.870673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.318999+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:08:31.318999+0000","last_peered":"2024-09-13T19:08:31.318999+0000","last_clean":"2024-09-13T19:08:31.318999+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:08:31.318999+0000","last_undegraded":"2024-09-13T19:08:31.318999+0000","last_fullsized":"2024-09-13T19:08:31.318999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724569+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:07:05.724569+0000","last_peered":"2024-09-13T19:07:05.724569+0000","last_clean":"2024-09-13T19:07:05.724569+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:07:05.724569+0000","last_undegraded":"2024-09-13T19:07:05.724569+0000","last_fullsized":"2024-09-13T19:07:05.724569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337604+0000","last_change":"2024-09-13T19:06:23.257527+0000","last_active":"2024-09-13T19:06:58.337604+0000","last_peered":"2024-09-13T19:06:58.337604+0000","last_clean":"2024-09-13T19:06:58.337604+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:06:58.337604+0000","last_undegraded":"2024-09-13T19:06:58.337604+0000","last_fullsized":"2024-09-13T19:06:58.337604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:25.565333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.767219+0000","last_change":"2024-09-13T19:06:25.294450+0000","last_active":"2024-09-13T19:08:33.767219+0000","last_peered":"2024-09-13T19:08:33.767219+0000","last_clean":"2024-09-13T19:08:33.767219+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:08:33.767219+0000","last_undegraded":"2024-09-13T19:08:33.767219+0000","last_fullsized":"2024-09-13T19:08:33.767219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:37.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359493+0000","last_change":"2024-09-13T19:06:27.318412+0000","last_active":"2024-09-13T19:06:58.359493+0000","last_peered":"2024-09-13T19:06:58.359493+0000","last_clean":"2024-09-13T19:06:58.359493+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:06:58.359493+0000","last_undegraded":"2024-09-13T19:06:58.359493+0000","last_fullsized":"2024-09-13T19:06:58.359493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335274+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:06:58.335274+0000","last_peered":"2024-09-13T19:06:58.335274+0000","last_clean":"2024-09-13T19:06:58.335274+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:06:58.335274+0000","last_undegraded":"2024-09-13T19:06:58.335274+0000","last_fullsized":"2024-09-13T19:06:58.335274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:55.890196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.122252+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:08:37.122252+0000","last_peered":"2024-09-13T19:08:37.122252+0000","last_clean":"2024-09-13T19:08:37.122252+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:08:37.122252+0000","last_undegraded":"2024-09-13T19:08:37.122252+0000","last_fullsized":"2024-09-13T19:08:37.122252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.738508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724550+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:07:05.724550+0000","last_peered":"2024-09-13T19:07:05.724550+0000","last_clean":"2024-09-13T19:07:05.724550+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:07:05.724550+0000","last_undegraded":"2024-09-13T19:07:05.724550+0000","last_fullsized":"2024-09-13T19:07:05.724550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"25'1","reported_seq":218,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.152165+0000","last_change":"2024-09-13T19:06:23.260000+0000","last_active":"2024-09-13T19:08:36.152165+0000","last_peered":"2024-09-13T19:08:36.152165+0000","last_clean":"2024-09-13T19:08:36.152165+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:08:36.152165+0000","last_undegraded":"2024-09-13T19:08:36.152165+0000","last_fullsized":"2024-09-13T19:08:36.152165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.210958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.795083+0000","last_change":"2024-09-13T19:06:25.266493+0000","last_active":"2024-09-13T19:08:33.795083+0000","last_peered":"2024-09-13T19:08:33.795083+0000","last_clean":"2024-09-13T19:08:33.795083+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:08:33.795083+0000","last_undegraded":"2024-09-13T19:08:33.795083+0000","last_fullsized":"2024-09-13T19:08:33.795083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:30.843285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331097+0000","last_change":"2024-09-13T19:06:27.282770+0000","last_active":"2024-09-13T19:06:58.331097+0000","last_peered":"2024-09-13T19:06:58.331097+0000","last_clean":"2024-09-13T19:06:58.331097+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:06:58.331097+0000","last_undegraded":"2024-09-13T19:06:58.331097+0000","last_fullsized":"2024-09-13T19:06:58.331097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:40.940281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.927729+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:37.927729+0000","last_peered":"2024-09-13T19:09:37.927729+0000","last_clean":"2024-09-13T19:09:37.927729+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:37.927729+0000","last_undegraded":"2024-09-13T19:09:37.927729+0000","last_fullsized":"2024-09-13T19:09:37.927729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:02.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040188+0000","last_change":"2024-09-13T19:06:21.255465+0000","last_active":"2024-09-13T19:09:38.040188+0000","last_peered":"2024-09-13T19:09:38.040188+0000","last_clean":"2024-09-13T19:09:38.040188+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:09:38.040188+0000","last_undegraded":"2024-09-13T19:09:38.040188+0000","last_fullsized":"2024-09-13T19:09:38.040188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.833948+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.833948+0000","last_peered":"2024-09-13T19:09:37.833948+0000","last_clean":"2024-09-13T19:09:37.833948+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.833948+0000","last_undegraded":"2024-09-13T19:09:37.833948+0000","last_fullsized":"2024-09-13T19:09:37.833948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.989504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359878+0000","last_change":"2024-09-13T19:06:23.268155+0000","last_active":"2024-09-13T19:06:58.359878+0000","last_peered":"2024-09-13T19:06:58.359878+0000","last_clean":"2024-09-13T19:06:58.359878+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:06:58.359878+0000","last_undegraded":"2024-09-13T19:06:58.359878+0000","last_fullsized":"2024-09-13T19:06:58.359878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:03.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351172+0000","last_change":"2024-09-13T19:06:25.299007+0000","last_active":"2024-09-13T19:06:58.351172+0000","last_peered":"2024-09-13T19:06:58.351172+0000","last_clean":"2024-09-13T19:06:58.351172+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:06:58.351172+0000","last_undegraded":"2024-09-13T19:06:58.351172+0000","last_fullsized":"2024-09-13T19:06:58.351172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:41.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.517887+0000","last_change":"2024-09-13T19:06:27.327682+0000","last_active":"2024-09-13T19:09:38.517887+0000","last_peered":"2024-09-13T19:09:38.517887+0000","last_clean":"2024-09-13T19:09:38.517887+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:09:38.517887+0000","last_undegraded":"2024-09-13T19:09:38.517887+0000","last_fullsized":"2024-09-13T19:09:38.517887+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:21.374194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334429+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:06:58.334429+0000","last_peered":"2024-09-13T19:06:58.334429+0000","last_clean":"2024-09-13T19:06:58.334429+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:06:58.334429+0000","last_undegraded":"2024-09-13T19:06:58.334429+0000","last_fullsized":"2024-09-13T19:06:58.334429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:51.144768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.656707+0000","last_change":"2024-09-13T19:06:21.254380+0000","last_active":"2024-09-13T19:07:50.656707+0000","last_peered":"2024-09-13T19:07:50.656707+0000","last_clean":"2024-09-13T19:07:50.656707+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:07:50.656707+0000","last_undegraded":"2024-09-13T19:07:50.656707+0000","last_fullsized":"2024-09-13T19:07:50.656707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.222552+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.222552+0000","last_peered":"2024-09-13T19:09:38.222552+0000","last_clean":"2024-09-13T19:09:38.222552+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.222552+0000","last_undegraded":"2024-09-13T19:09:38.222552+0000","last_fullsized":"2024-09-13T19:09:38.222552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340885+0000","last_change":"2024-09-13T19:06:23.273729+0000","last_active":"2024-09-13T19:06:58.340885+0000","last_peered":"2024-09-13T19:06:58.340885+0000","last_clean":"2024-09-13T19:06:58.340885+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:06:58.340885+0000","last_undegraded":"2024-09-13T19:06:58.340885+0000","last_fullsized":"2024-09-13T19:06:58.340885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'37","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.751783+0000","last_change":"2024-09-13T19:06:25.276088+0000","last_active":"2024-09-13T19:08:33.751783+0000","last_peered":"2024-09-13T19:08:33.751783+0000","last_clean":"2024-09-13T19:08:33.751783+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:08:33.751783+0000","last_undegraded":"2024-09-13T19:08:33.751783+0000","last_fullsized":"2024-09-13T19:08:33.751783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:19.360900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326495+0000","last_change":"2024-09-13T19:06:27.298155+0000","last_active":"2024-09-13T19:06:58.326495+0000","last_peered":"2024-09-13T19:06:58.326495+0000","last_clean":"2024-09-13T19:06:58.326495+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:06:58.326495+0000","last_undegraded":"2024-09-13T19:06:58.326495+0000","last_fullsized":"2024-09-13T19:06:58.326495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359715+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:06:58.359715+0000","last_peered":"2024-09-13T19:06:58.359715+0000","last_clean":"2024-09-13T19:06:58.359715+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:06:58.359715+0000","last_undegraded":"2024-09-13T19:06:58.359715+0000","last_fullsized":"2024-09-13T19:06:58.359715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040383+0000","last_change":"2024-09-13T19:06:21.253912+0000","last_active":"2024-09-13T19:09:38.040383+0000","last_peered":"2024-09-13T19:09:38.040383+0000","last_clean":"2024-09-13T19:09:38.040383+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:09:38.040383+0000","last_undegraded":"2024-09-13T19:09:38.040383+0000","last_fullsized":"2024-09-13T19:09:38.040383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.709655+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:36.709655+0000","last_peered":"2024-09-13T19:08:36.709655+0000","last_clean":"2024-09-13T19:08:36.709655+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:36.709655+0000","last_undegraded":"2024-09-13T19:08:36.709655+0000","last_fullsized":"2024-09-13T19:08:36.709655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:48.191162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331581+0000","last_change":"2024-09-13T19:06:23.249406+0000","last_active":"2024-09-13T19:06:58.331581+0000","last_peered":"2024-09-13T19:06:58.331581+0000","last_clean":"2024-09-13T19:06:58.331581+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:06:58.331581+0000","last_undegraded":"2024-09-13T19:06:58.331581+0000","last_fullsized":"2024-09-13T19:06:58.331581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:04.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'31","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.754389+0000","last_change":"2024-09-13T19:06:25.266112+0000","last_active":"2024-09-13T19:08:33.754389+0000","last_peered":"2024-09-13T19:08:33.754389+0000","last_clean":"2024-09-13T19:08:33.754389+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:08:33.754389+0000","last_undegraded":"2024-09-13T19:08:33.754389+0000","last_fullsized":"2024-09-13T19:08:33.754389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:56.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335590+0000","last_change":"2024-09-13T19:06:27.315327+0000","last_active":"2024-09-13T19:06:58.335590+0000","last_peered":"2024-09-13T19:06:58.335590+0000","last_clean":"2024-09-13T19:06:58.335590+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:06:58.335590+0000","last_undegraded":"2024-09-13T19:06:58.335590+0000","last_fullsized":"2024-09-13T19:06:58.335590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:49.675039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.040455+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:07:08.040455+0000","last_peered":"2024-09-13T19:07:08.040455+0000","last_clean":"2024-09-13T19:07:08.040455+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:07:08.040455+0000","last_undegraded":"2024-09-13T19:07:08.040455+0000","last_fullsized":"2024-09-13T19:07:08.040455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:46.491796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.331808+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:08:31.331808+0000","last_peered":"2024-09-13T19:08:31.331808+0000","last_clean":"2024-09-13T19:08:31.331808+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:08:31.331808+0000","last_undegraded":"2024-09-13T19:08:31.331808+0000","last_fullsized":"2024-09-13T19:08:31.331808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:41.004998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333723+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:06:58.333723+0000","last_peered":"2024-09-13T19:06:58.333723+0000","last_clean":"2024-09-13T19:06:58.333723+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:06:58.333723+0000","last_undegraded":"2024-09-13T19:06:58.333723+0000","last_fullsized":"2024-09-13T19:06:58.333723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342542+0000","last_change":"2024-09-13T19:06:23.259969+0000","last_active":"2024-09-13T19:06:58.342542+0000","last_peered":"2024-09-13T19:06:58.342542+0000","last_clean":"2024-09-13T19:06:58.342542+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:06:58.342542+0000","last_undegraded":"2024-09-13T19:06:58.342542+0000","last_fullsized":"2024-09-13T19:06:58.342542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.790940+0000","last_change":"2024-09-13T19:06:25.289764+0000","last_active":"2024-09-13T19:08:33.790940+0000","last_peered":"2024-09-13T19:08:33.790940+0000","last_clean":"2024-09-13T19:08:33.790940+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:08:33.790940+0000","last_undegraded":"2024-09-13T19:08:33.790940+0000","last_fullsized":"2024-09-13T19:08:33.790940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.324875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336001+0000","last_change":"2024-09-13T19:06:27.319266+0000","last_active":"2024-09-13T19:06:58.336001+0000","last_peered":"2024-09-13T19:06:58.336001+0000","last_clean":"2024-09-13T19:06:58.336001+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:06:58.336001+0000","last_undegraded":"2024-09-13T19:06:58.336001+0000","last_fullsized":"2024-09-13T19:06:58.336001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:43.390934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.046344+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.046344+0000","last_peered":"2024-09-13T19:09:38.046344+0000","last_clean":"2024-09-13T19:09:38.046344+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.046344+0000","last_undegraded":"2024-09-13T19:09:38.046344+0000","last_fullsized":"2024-09-13T19:09:38.046344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:45.313091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.272488+0000","last_change":"2024-09-13T19:06:21.251997+0000","last_active":"2024-09-13T19:09:38.272488+0000","last_peered":"2024-09-13T19:09:38.272488+0000","last_clean":"2024-09-13T19:09:38.272488+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:09:38.272488+0000","last_undegraded":"2024-09-13T19:09:38.272488+0000","last_fullsized":"2024-09-13T19:09:38.272488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:59.294405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359505+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:06:58.359505+0000","last_peered":"2024-09-13T19:06:58.359505+0000","last_clean":"2024-09-13T19:06:58.359505+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:06:58.359505+0000","last_undegraded":"2024-09-13T19:06:58.359505+0000","last_fullsized":"2024-09-13T19:06:58.359505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.875646+0000","last_change":"2024-09-13T19:06:23.274237+0000","last_active":"2024-09-13T19:08:31.875646+0000","last_peered":"2024-09-13T19:08:31.875646+0000","last_clean":"2024-09-13T19:08:31.875646+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:08:31.875646+0000","last_undegraded":"2024-09-13T19:08:31.875646+0000","last_fullsized":"2024-09-13T19:08:31.875646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.993135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.176231+0000","last_change":"2024-09-13T19:06:25.303807+0000","last_active":"2024-09-13T19:09:37.176231+0000","last_peered":"2024-09-13T19:09:37.176231+0000","last_clean":"2024-09-13T19:09:37.176231+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:09:37.176231+0000","last_undegraded":"2024-09-13T19:09:37.176231+0000","last_fullsized":"2024-09-13T19:09:37.176231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:40.599519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327617+0000","last_change":"2024-09-13T19:06:27.299682+0000","last_active":"2024-09-13T19:06:58.327617+0000","last_peered":"2024-09-13T19:06:58.327617+0000","last_clean":"2024-09-13T19:06:58.327617+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:06:58.327617+0000","last_undegraded":"2024-09-13T19:06:58.327617+0000","last_fullsized":"2024-09-13T19:06:58.327617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.813468+0000","last_change":"2024-09-13T19:06:29.310143+0000","last_active":"2024-09-13T19:08:33.813468+0000","last_peered":"2024-09-13T19:08:33.813468+0000","last_clean":"2024-09-13T19:08:33.813468+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:08:33.813468+0000","last_undegraded":"2024-09-13T19:08:33.813468+0000","last_fullsized":"2024-09-13T19:08:33.813468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:12.690041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.275471+0000","last_change":"2024-09-13T19:06:21.260509+0000","last_active":"2024-09-13T19:09:38.275471+0000","last_peered":"2024-09-13T19:09:38.275471+0000","last_clean":"2024-09-13T19:09:38.275471+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:09:38.275471+0000","last_undegraded":"2024-09-13T19:09:38.275471+0000","last_fullsized":"2024-09-13T19:09:38.275471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:30.336072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327522+0000","last_change":"2024-09-13T19:06:19.270097+0000","last_active":"2024-09-13T19:06:58.327522+0000","last_peered":"2024-09-13T19:06:58.327522+0000","last_clean":"2024-09-13T19:06:58.327522+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:06:58.327522+0000","last_undegraded":"2024-09-13T19:06:58.327522+0000","last_fullsized":"2024-09-13T19:06:58.327522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.966727+0000","last_change":"2024-09-13T19:06:21.255097+0000","last_active":"2024-09-13T19:07:06.966727+0000","last_peered":"2024-09-13T19:07:06.966727+0000","last_clean":"2024-09-13T19:07:06.966727+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:07:06.966727+0000","last_undegraded":"2024-09-13T19:07:06.966727+0000","last_fullsized":"2024-09-13T19:07:06.966727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.988700+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:08:23.988700+0000","last_peered":"2024-09-13T19:08:23.988700+0000","last_clean":"2024-09-13T19:08:23.988700+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:08:23.988700+0000","last_undegraded":"2024-09-13T19:08:23.988700+0000","last_fullsized":"2024-09-13T19:08:23.988700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.881877+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:09:37.881877+0000","last_peered":"2024-09-13T19:09:37.881877+0000","last_clean":"2024-09-13T19:09:37.881877+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:09:37.881877+0000","last_undegraded":"2024-09-13T19:09:37.881877+0000","last_fullsized":"2024-09-13T19:09:37.881877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:14.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.302528+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:07:07.302528+0000","last_peered":"2024-09-13T19:07:07.302528+0000","last_clean":"2024-09-13T19:07:07.302528+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:07:07.302528+0000","last_undegraded":"2024-09-13T19:07:07.302528+0000","last_fullsized":"2024-09-13T19:07:07.302528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:57.289705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329300+0000","last_change":"2024-09-13T19:06:21.255692+0000","last_active":"2024-09-13T19:06:58.329300+0000","last_peered":"2024-09-13T19:06:58.329300+0000","last_clean":"2024-09-13T19:06:58.329300+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:06:58.329300+0000","last_undegraded":"2024-09-13T19:06:58.329300+0000","last_fullsized":"2024-09-13T19:06:58.329300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.441511+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:09:38.441511+0000","last_peered":"2024-09-13T19:09:38.441511+0000","last_clean":"2024-09-13T19:09:38.441511+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:09:38.441511+0000","last_undegraded":"2024-09-13T19:09:38.441511+0000","last_fullsized":"2024-09-13T19:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:20.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.502701+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:07:06.502701+0000","last_peered":"2024-09-13T19:07:06.502701+0000","last_clean":"2024-09-13T19:07:06.502701+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:07:06.502701+0000","last_undegraded":"2024-09-13T19:07:06.502701+0000","last_fullsized":"2024-09-13T19:07:06.502701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:31.414170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990079+0000","last_change":"2024-09-13T19:06:19.281225+0000","last_active":"2024-09-13T19:08:28.990079+0000","last_peered":"2024-09-13T19:08:28.990079+0000","last_clean":"2024-09-13T19:08:28.990079+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:08:28.990079+0000","last_undegraded":"2024-09-13T19:08:28.990079+0000","last_fullsized":"2024-09-13T19:08:28.990079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.043438+0000","last_change":"2024-09-13T19:06:21.264248+0000","last_active":"2024-09-13T19:09:38.043438+0000","last_peered":"2024-09-13T19:09:38.043438+0000","last_clean":"2024-09-13T19:09:38.043438+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:09:38.043438+0000","last_undegraded":"2024-09-13T19:09:38.043438+0000","last_fullsized":"2024-09-13T19:09:38.043438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.360068+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:06:58.360068+0000","last_peered":"2024-09-13T19:06:58.360068+0000","last_clean":"2024-09-13T19:06:58.360068+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:06:58.360068+0000","last_undegraded":"2024-09-13T19:06:58.360068+0000","last_fullsized":"2024-09-13T19:06:58.360068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.456067+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:09:38.456067+0000","last_peered":"2024-09-13T19:09:38.456067+0000","last_clean":"2024-09-13T19:09:38.456067+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:09:38.456067+0000","last_undegraded":"2024-09-13T19:09:38.456067+0000","last_fullsized":"2024-09-13T19:09:38.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345491+0000","last_change":"2024-09-13T19:06:19.271992+0000","last_active":"2024-09-13T19:06:58.345491+0000","last_peered":"2024-09-13T19:06:58.345491+0000","last_clean":"2024-09-13T19:06:58.345491+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:06:58.345491+0000","last_undegraded":"2024-09-13T19:06:58.345491+0000","last_fullsized":"2024-09-13T19:06:58.345491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885011+0000","last_change":"2024-09-13T19:06:21.262337+0000","last_active":"2024-09-13T19:09:37.885011+0000","last_peered":"2024-09-13T19:09:37.885011+0000","last_clean":"2024-09-13T19:09:37.885011+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:09:37.885011+0000","last_undegraded":"2024-09-13T19:09:37.885011+0000","last_fullsized":"2024-09-13T19:09:37.885011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334715+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:06:58.334715+0000","last_peered":"2024-09-13T19:06:58.334715+0000","last_clean":"2024-09-13T19:06:58.334715+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:06:58.334715+0000","last_undegraded":"2024-09-13T19:06:58.334715+0000","last_fullsized":"2024-09-13T19:06:58.334715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.464999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455975+0000","last_change":"2024-09-13T19:06:21.260793+0000","last_active":"2024-09-13T19:09:38.455975+0000","last_peered":"2024-09-13T19:09:38.455975+0000","last_clean":"2024-09-13T19:09:38.455975+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:09:38.455975+0000","last_undegraded":"2024-09-13T19:09:38.455975+0000","last_fullsized":"2024-09-13T19:09:38.455975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.288268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335859+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:06:58.335859+0000","last_peered":"2024-09-13T19:06:58.335859+0000","last_clean":"2024-09-13T19:06:58.335859+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:06:58.335859+0000","last_undegraded":"2024-09-13T19:06:58.335859+0000","last_fullsized":"2024-09-13T19:06:58.335859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:41.941513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355462+0000","last_change":"2024-09-13T19:06:21.257594+0000","last_active":"2024-09-13T19:06:58.355462+0000","last_peered":"2024-09-13T19:06:58.355462+0000","last_clean":"2024-09-13T19:06:58.355462+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:06:58.355462+0000","last_undegraded":"2024-09-13T19:06:58.355462+0000","last_fullsized":"2024-09-13T19:06:58.355462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:55.850886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327779+0000","last_change":"2024-09-13T19:06:19.278186+0000","last_active":"2024-09-13T19:06:58.327779+0000","last_peered":"2024-09-13T19:06:58.327779+0000","last_clean":"2024-09-13T19:06:58.327779+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:06:58.327779+0000","last_undegraded":"2024-09-13T19:06:58.327779+0000","last_fullsized":"2024-09-13T19:06:58.327779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992857+0000","last_change":"2024-09-13T19:06:21.240787+0000","last_active":"2024-09-13T19:08:38.992857+0000","last_peered":"2024-09-13T19:08:38.992857+0000","last_clean":"2024-09-13T19:08:38.992857+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:08:38.992857+0000","last_undegraded":"2024-09-13T19:08:38.992857+0000","last_fullsized":"2024-09-13T19:08:38.992857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351873+0000","last_change":"2024-09-13T19:06:19.283567+0000","last_active":"2024-09-13T19:06:58.351873+0000","last_peered":"2024-09-13T19:06:58.351873+0000","last_clean":"2024-09-13T19:06:58.351873+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:06:58.351873+0000","last_undegraded":"2024-09-13T19:06:58.351873+0000","last_fullsized":"2024-09-13T19:06:58.351873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002423+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:08:39.002423+0000","last_peered":"2024-09-13T19:08:39.002423+0000","last_clean":"2024-09-13T19:08:39.002423+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:08:39.002423+0000","last_undegraded":"2024-09-13T19:08:39.002423+0000","last_fullsized":"2024-09-13T19:08:39.002423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:27.206747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341998+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:06:58.341998+0000","last_peered":"2024-09-13T19:06:58.341998+0000","last_clean":"2024-09-13T19:06:58.341998+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:06:58.341998+0000","last_undegraded":"2024-09-13T19:06:58.341998+0000","last_fullsized":"2024-09-13T19:06:58.341998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255695+0000","last_change":"2024-09-13T19:06:21.256504+0000","last_active":"2024-09-13T19:09:38.255695+0000","last_peered":"2024-09-13T19:09:38.255695+0000","last_clean":"2024-09-13T19:09:38.255695+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:09:38.255695+0000","last_undegraded":"2024-09-13T19:09:38.255695+0000","last_fullsized":"2024-09-13T19:09:38.255695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344894+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:06:58.344894+0000","last_peered":"2024-09-13T19:06:58.344894+0000","last_clean":"2024-09-13T19:06:58.344894+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:06:58.344894+0000","last_undegraded":"2024-09-13T19:06:58.344894+0000","last_fullsized":"2024-09-13T19:06:58.344894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:12.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375474+0000","last_change":"2024-09-13T19:06:21.264548+0000","last_active":"2024-09-13T19:09:38.375474+0000","last_peered":"2024-09-13T19:09:38.375474+0000","last_clean":"2024-09-13T19:09:38.375474+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:09:38.375474+0000","last_undegraded":"2024-09-13T19:09:38.375474+0000","last_fullsized":"2024-09-13T19:09:38.375474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345208+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:06:58.345208+0000","last_peered":"2024-09-13T19:06:58.345208+0000","last_clean":"2024-09-13T19:06:58.345208+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:06:58.345208+0000","last_undegraded":"2024-09-13T19:06:58.345208+0000","last_fullsized":"2024-09-13T19:06:58.345208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:43.433186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255037+0000","last_change":"2024-09-13T19:06:21.261602+0000","last_active":"2024-09-13T19:09:38.255037+0000","last_peered":"2024-09-13T19:09:38.255037+0000","last_clean":"2024-09-13T19:09:38.255037+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:09:38.255037+0000","last_undegraded":"2024-09-13T19:09:38.255037+0000","last_fullsized":"2024-09-13T19:09:38.255037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:01.086124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345905+0000","last_change":"2024-09-13T19:06:19.278323+0000","last_active":"2024-09-13T19:06:58.345905+0000","last_peered":"2024-09-13T19:06:58.345905+0000","last_clean":"2024-09-13T19:06:58.345905+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:06:58.345905+0000","last_undegraded":"2024-09-13T19:06:58.345905+0000","last_fullsized":"2024-09-13T19:06:58.345905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.374634+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:09:38.374634+0000","last_peered":"2024-09-13T19:09:38.374634+0000","last_clean":"2024-09-13T19:09:38.374634+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:09:38.374634+0000","last_undegraded":"2024-09-13T19:09:38.374634+0000","last_fullsized":"2024-09-13T19:09:38.374634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.231853+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.231853+0000","last_peered":"2024-09-13T19:09:38.231853+0000","last_clean":"2024-09-13T19:09:38.231853+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.231853+0000","last_undegraded":"2024-09-13T19:09:38.231853+0000","last_fullsized":"2024-09-13T19:09:38.231853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:03.445184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.725335+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:07:05.725335+0000","last_peered":"2024-09-13T19:07:05.725335+0000","last_clean":"2024-09-13T19:07:05.725335+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:07:05.725335+0000","last_undegraded":"2024-09-13T19:07:05.725335+0000","last_fullsized":"2024-09-13T19:07:05.725335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:32.143596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.655037+0000","last_change":"2024-09-13T19:06:21.261511+0000","last_active":"2024-09-13T19:07:50.655037+0000","last_peered":"2024-09-13T19:07:50.655037+0000","last_clean":"2024-09-13T19:07:50.655037+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:07:50.655037+0000","last_undegraded":"2024-09-13T19:07:50.655037+0000","last_fullsized":"2024-09-13T19:07:50.655037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327618+0000","last_change":"2024-09-13T19:06:19.278870+0000","last_active":"2024-09-13T19:06:58.327618+0000","last_peered":"2024-09-13T19:06:58.327618+0000","last_clean":"2024-09-13T19:06:58.327618+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:06:58.327618+0000","last_undegraded":"2024-09-13T19:06:58.327618+0000","last_fullsized":"2024-09-13T19:06:58.327618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'23","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.274840+0000","last_change":"2024-09-13T19:06:21.255155+0000","last_active":"2024-09-13T19:09:38.274840+0000","last_peered":"2024-09-13T19:09:38.274840+0000","last_clean":"2024-09-13T19:09:38.274840+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:09:38.274840+0000","last_undegraded":"2024-09-13T19:09:38.274840+0000","last_fullsized":"2024-09-13T19:09:38.274840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:04.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705714,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48384,"kb_used_data":8880,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323456,"statfs":{"total":96636764160,"available":96587218944,"internally_reserved":0,"allocated":9093120,"data_stored":8760735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705715,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9346959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44764,"kb_used_data":9420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327076,"statfs":{"total":96636764160,"available":96590925824,"internally_reserved":0,"allocated":9646080,"data_stored":9348623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48348,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323492,"statfs":{"total":96636764160,"available":96587255808,"internally_reserved":0,"allocated":9056256,"data_stored":8758411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:04.816 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T19:10:04.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:04.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.939+0000 7f037ceca640 1 Processor -- start 2024-09-13T19:10:04.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.939+0000 7f037ceca640 1 -- start start 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037ceca640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f037812e760 0x7f037812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037ceca640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03780984f0 con 0x7f037812f1c0 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037ceca640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0378098dc0 con 0x7f037812e760 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f037812e760 0x7f037812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f0375d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f037812f1c0 0x7f037812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40268/0 (socket says 172.21.15.12:40268) 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f0375d9b640 1 -- 172.21.15.12:0/3125925524 learned_addr learned my addr 172.21.15.12:0/3125925524 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037659c640 1 -- 172.21.15.12:0/3125925524 >> v1:172.21.15.12:6789/0 conn(0x7f037812f1c0 legacy=0x7f037812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.947 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037659c640 1 -- 172.21.15.12:0/3125925524 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037812f5a0 con 0x7f037812e760 2024-09-13T19:10:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037659c640 1 --2- 172.21.15.12:0/3125925524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037812ec80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0368009740 tx=0x7f036801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e03202026947e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037559a640 1 -- 172.21.15.12:0/3125925524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03680b0070 con 0x7f037812e760 2024-09-13T19:10:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037559a640 1 -- 172.21.15.12:0/3125925524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03680ab530 con 0x7f037812e760 2024-09-13T19:10:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.943+0000 7f037559a640 1 -- 172.21.15.12:0/3125925524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03680ab830 con 0x7f037812e760 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3125925524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 msgr2=0x7f037812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 --2- 172.21.15.12:0/3125925524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037812ec80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0368009740 tx=0x7f036801c400 comp rx=0 tx=0).stop 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3125925524 shutdown_connections 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 --2- 172.21.15.12:0/3125925524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037812ec80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3125925524 >> 172.21.15.12:0/3125925524 conn(0x7f03780a10a0 msgr2=0x7f03780a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3125925524 shutdown_connections 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3125925524 wait complete. 2024-09-13T19:10:04.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 Processor -- start 2024-09-13T19:10:04.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- start start 2024-09-13T19:10:04.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0378136e30 con 0x7f037812e760 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43614/0 (socket says 172.21.15.12:43614) 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037659c640 1 -- 172.21.15.12:0/3023741868 learned_addr learned my addr 172.21.15.12:0/3023741868 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037659c640 1 -- 172.21.15.12:0/3023741868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0378130510 con 0x7f037812e760 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037659c640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f036801a030 tx=0x7f036801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03680b0050 con 0x7f037812e760 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03680b1040 con 0x7f037812e760 2024-09-13T19:10:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0378130c10 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03680b5740 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037809ce60 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037809e3a0 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.947+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f03680be030 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.951+0000 7f036effd640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 0x7f0358038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.951+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f03680bc070 con 0x7f037812e760 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.951+0000 7f0375d9b640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 0x7f0358038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.951+0000 7f0375d9b640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 0x7f0358038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0360005c10 tx=0x7f03600016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:04.955+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f03680c5020 con 0x7f037812e760 2024-09-13T19:10:05.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.111+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0378130780 con 0x7f0358035db0 2024-09-13T19:10:05.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.155+0000 7f036effd640 1 -- 172.21.15.12:0/3023741868 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665989 (secure 0 0 0) 0x7f036000cbf0 con 0x7f0358035db0 2024-09-13T19:10:05.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 msgr2=0x7f0358038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 0x7f0358038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0360005c10 tx=0x7f03600016a0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 msgr2=0x7f037809c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f036801a030 tx=0x7f036801ac40 comp rx=0 tx=0).stop 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 shutdown_connections 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f0358035db0 0x7f0358038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 --2- 172.21.15.12:0/3023741868 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f037812e760 0x7f037809c920 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 >> 172.21.15.12:0/3023741868 conn(0x7f03780a10a0 msgr2=0x7f0378095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 shutdown_connections 2024-09-13T19:10:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.163+0000 7f037ceca640 1 -- 172.21.15.12:0/3023741868 wait complete. 2024-09-13T19:10:05.184 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-13T19:10:05.013834+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4610,"ondisk_log_size":4610,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":169424,"kb_used_data":19720,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377317936,"statfs":{"total":386547056640,"available":386373566464,"internally_reserved":0,"allocated":20193280,"data_stored":18999916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25811502,"num_objects":-7,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006099"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337381+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:06:58.337381+0000","last_peered":"2024-09-13T19:06:58.337381+0000","last_clean":"2024-09-13T19:06:58.337381+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:06:58.337381+0000","last_undegraded":"2024-09-13T19:06:58.337381+0000","last_fullsized":"2024-09-13T19:06:58.337381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.324626+0000","last_change":"2024-09-13T19:06:21.265691+0000","last_active":"2024-09-13T19:07:07.324626+0000","last_peered":"2024-09-13T19:07:07.324626+0000","last_clean":"2024-09-13T19:07:07.324626+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:07:07.324626+0000","last_undegraded":"2024-09-13T19:07:07.324626+0000","last_fullsized":"2024-09-13T19:07:07.324626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.241844+0000","last_change":"2024-09-13T19:06:19.281253+0000","last_active":"2024-09-13T19:09:38.241844+0000","last_peered":"2024-09-13T19:09:38.241844+0000","last_clean":"2024-09-13T19:09:38.241844+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:09:38.241844+0000","last_undegraded":"2024-09-13T19:09:38.241844+0000","last_fullsized":"2024-09-13T19:09:38.241844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343896+0000","last_change":"2024-09-13T19:06:21.257152+0000","last_active":"2024-09-13T19:06:58.343896+0000","last_peered":"2024-09-13T19:06:58.343896+0000","last_clean":"2024-09-13T19:06:58.343896+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:06:58.343896+0000","last_undegraded":"2024-09-13T19:06:58.343896+0000","last_fullsized":"2024-09-13T19:06:58.343896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:59.192920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.348389+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:06:58.348389+0000","last_peered":"2024-09-13T19:06:58.348389+0000","last_clean":"2024-09-13T19:06:58.348389+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:06:58.348389+0000","last_undegraded":"2024-09-13T19:06:58.348389+0000","last_fullsized":"2024-09-13T19:06:58.348389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:19.158740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040680+0000","last_change":"2024-09-13T19:06:21.257435+0000","last_active":"2024-09-13T19:09:38.040680+0000","last_peered":"2024-09-13T19:09:38.040680+0000","last_clean":"2024-09-13T19:09:38.040680+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:09:38.040680+0000","last_undegraded":"2024-09-13T19:09:38.040680+0000","last_fullsized":"2024-09-13T19:09:38.040680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:15.700530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.754971+0000","last_change":"2024-09-13T19:06:19.272048+0000","last_active":"2024-09-13T19:09:37.754971+0000","last_peered":"2024-09-13T19:09:37.754971+0000","last_clean":"2024-09-13T19:09:37.754971+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:09:37.754971+0000","last_undegraded":"2024-09-13T19:09:37.754971+0000","last_fullsized":"2024-09-13T19:09:37.754971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.254845+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.254845+0000","last_peered":"2024-09-13T19:09:38.254845+0000","last_clean":"2024-09-13T19:09:38.254845+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.254845+0000","last_undegraded":"2024-09-13T19:09:38.254845+0000","last_fullsized":"2024-09-13T19:09:38.254845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:26.262099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341432+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:06:58.341432+0000","last_peered":"2024-09-13T19:06:58.341432+0000","last_clean":"2024-09-13T19:06:58.341432+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:06:58.341432+0000","last_undegraded":"2024-09-13T19:06:58.341432+0000","last_fullsized":"2024-09-13T19:06:58.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:58.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455588+0000","last_change":"2024-09-13T19:06:21.261907+0000","last_active":"2024-09-13T19:09:38.455588+0000","last_peered":"2024-09-13T19:09:38.455588+0000","last_clean":"2024-09-13T19:09:38.455588+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:09:38.455588+0000","last_undegraded":"2024-09-13T19:09:38.455588+0000","last_fullsized":"2024-09-13T19:09:38.455588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.618385+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:09:37.618385+0000","last_peered":"2024-09-13T19:09:37.618385+0000","last_clean":"2024-09-13T19:09:37.618385+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:09:37.618385+0000","last_undegraded":"2024-09-13T19:09:37.618385+0000","last_fullsized":"2024-09-13T19:09:37.618385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.654845+0000","last_change":"2024-09-13T19:06:21.266198+0000","last_active":"2024-09-13T19:07:50.654845+0000","last_peered":"2024-09-13T19:07:50.654845+0000","last_clean":"2024-09-13T19:07:50.654845+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:07:50.654845+0000","last_undegraded":"2024-09-13T19:07:50.654845+0000","last_fullsized":"2024-09-13T19:07:50.654845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:26.835463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.307843+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:07:07.307843+0000","last_peered":"2024-09-13T19:07:07.307843+0000","last_clean":"2024-09-13T19:07:07.307843+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:07:07.307843+0000","last_undegraded":"2024-09-13T19:07:07.307843+0000","last_fullsized":"2024-09-13T19:07:07.307843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:38.969649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474547+0000","last_change":"2024-09-13T19:06:21.255493+0000","last_active":"2024-09-13T19:09:38.474547+0000","last_peered":"2024-09-13T19:09:38.474547+0000","last_clean":"2024-09-13T19:09:38.474547+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:09:38.474547+0000","last_undegraded":"2024-09-13T19:09:38.474547+0000","last_fullsized":"2024-09-13T19:09:38.474547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327422+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:06:58.327422+0000","last_peered":"2024-09-13T19:06:58.327422+0000","last_clean":"2024-09-13T19:06:58.327422+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:06:58.327422+0000","last_undegraded":"2024-09-13T19:06:58.327422+0000","last_fullsized":"2024-09-13T19:06:58.327422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.906061+0000","last_change":"2024-09-13T19:06:21.259423+0000","last_active":"2024-09-13T19:09:37.906061+0000","last_peered":"2024-09-13T19:09:37.906061+0000","last_clean":"2024-09-13T19:09:37.906061+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:09:37.906061+0000","last_undegraded":"2024-09-13T19:09:37.906061+0000","last_fullsized":"2024-09-13T19:09:37.906061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.971735+0000","last_change":"2024-09-13T19:06:21.257261+0000","last_active":"2024-09-13T19:07:06.971735+0000","last_peered":"2024-09-13T19:07:06.971735+0000","last_clean":"2024-09-13T19:07:06.971735+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:07:06.971735+0000","last_undegraded":"2024-09-13T19:07:06.971735+0000","last_fullsized":"2024-09-13T19:07:06.971735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:38.952619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.296557+0000","last_change":"2024-09-13T19:06:19.287823+0000","last_active":"2024-09-13T19:07:07.296557+0000","last_peered":"2024-09-13T19:07:07.296557+0000","last_clean":"2024-09-13T19:07:07.296557+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:07:07.296557+0000","last_undegraded":"2024-09-13T19:07:07.296557+0000","last_fullsized":"2024-09-13T19:07:07.296557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475773+0000","last_change":"2024-09-13T19:06:21.263484+0000","last_active":"2024-09-13T19:09:38.475773+0000","last_peered":"2024-09-13T19:09:38.475773+0000","last_clean":"2024-09-13T19:09:38.475773+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:09:38.475773+0000","last_undegraded":"2024-09-13T19:09:38.475773+0000","last_fullsized":"2024-09-13T19:09:38.475773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.370620+0000","last_change":"2024-09-13T19:06:19.276357+0000","last_active":"2024-09-13T19:07:50.370620+0000","last_peered":"2024-09-13T19:07:50.370620+0000","last_clean":"2024-09-13T19:07:50.370620+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:07:50.370620+0000","last_undegraded":"2024-09-13T19:07:50.370620+0000","last_fullsized":"2024-09-13T19:07:50.370620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.121880+0000","last_change":"2024-09-13T19:06:21.265579+0000","last_active":"2024-09-13T19:08:37.121880+0000","last_peered":"2024-09-13T19:08:37.121880+0000","last_clean":"2024-09-13T19:08:37.121880+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:08:37.121880+0000","last_undegraded":"2024-09-13T19:08:37.121880+0000","last_fullsized":"2024-09-13T19:08:37.121880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.785658+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.785658+0000","last_peered":"2024-09-13T19:09:37.785658+0000","last_clean":"2024-09-13T19:09:37.785658+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.785658+0000","last_undegraded":"2024-09-13T19:09:37.785658+0000","last_fullsized":"2024-09-13T19:09:37.785658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885359+0000","last_change":"2024-09-13T19:06:21.253936+0000","last_active":"2024-09-13T19:09:37.885359+0000","last_peered":"2024-09-13T19:09:37.885359+0000","last_clean":"2024-09-13T19:09:37.885359+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:09:37.885359+0000","last_undegraded":"2024-09-13T19:09:37.885359+0000","last_fullsized":"2024-09-13T19:09:37.885359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342316+0000","last_change":"2024-09-13T19:06:19.281986+0000","last_active":"2024-09-13T19:06:58.342316+0000","last_peered":"2024-09-13T19:06:58.342316+0000","last_clean":"2024-09-13T19:06:58.342316+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:06:58.342316+0000","last_undegraded":"2024-09-13T19:06:58.342316+0000","last_fullsized":"2024-09-13T19:06:58.342316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392252+0000","last_change":"2024-09-13T19:06:21.254760+0000","last_active":"2024-09-13T19:09:38.392252+0000","last_peered":"2024-09-13T19:09:38.392252+0000","last_clean":"2024-09-13T19:09:38.392252+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:09:38.392252+0000","last_undegraded":"2024-09-13T19:09:38.392252+0000","last_fullsized":"2024-09-13T19:09:38.392252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:14.792775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.215043+0000","last_change":"2024-09-13T19:06:19.278861+0000","last_active":"2024-09-13T19:09:38.215043+0000","last_peered":"2024-09-13T19:09:38.215043+0000","last_clean":"2024-09-13T19:09:38.215043+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:09:38.215043+0000","last_undegraded":"2024-09-13T19:09:38.215043+0000","last_fullsized":"2024-09-13T19:09:38.215043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:09.190817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.880925+0000","last_change":"2024-09-13T19:06:21.265434+0000","last_active":"2024-09-13T19:09:37.880925+0000","last_peered":"2024-09-13T19:09:37.880925+0000","last_clean":"2024-09-13T19:09:37.880925+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:09:37.880925+0000","last_undegraded":"2024-09-13T19:09:37.880925+0000","last_fullsized":"2024-09-13T19:09:37.880925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:23.561123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337225+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:06:58.337225+0000","last_peered":"2024-09-13T19:06:58.337225+0000","last_clean":"2024-09-13T19:06:58.337225+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:06:58.337225+0000","last_undegraded":"2024-09-13T19:06:58.337225+0000","last_fullsized":"2024-09-13T19:06:58.337225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:26.485200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.318135+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.318135+0000","last_peered":"2024-09-13T19:09:38.318135+0000","last_clean":"2024-09-13T19:09:38.318135+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.318135+0000","last_undegraded":"2024-09-13T19:09:38.318135+0000","last_fullsized":"2024-09-13T19:09:38.318135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:07.774766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004272+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:08:44.004272+0000","last_peered":"2024-09-13T19:08:44.004272+0000","last_clean":"2024-09-13T19:08:44.004272+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:08:44.004272+0000","last_undegraded":"2024-09-13T19:08:44.004272+0000","last_fullsized":"2024-09-13T19:08:44.004272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:52.354210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.648816+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:09:37.648816+0000","last_peered":"2024-09-13T19:09:37.648816+0000","last_clean":"2024-09-13T19:09:37.648816+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:09:37.648816+0000","last_undegraded":"2024-09-13T19:09:37.648816+0000","last_fullsized":"2024-09-13T19:09:37.648816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:09.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344167+0000","last_change":"2024-09-13T19:06:23.276780+0000","last_active":"2024-09-13T19:06:58.344167+0000","last_peered":"2024-09-13T19:06:58.344167+0000","last_clean":"2024-09-13T19:06:58.344167+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:06:58.344167+0000","last_undegraded":"2024-09-13T19:06:58.344167+0000","last_fullsized":"2024-09-13T19:06:58.344167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:36.923375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.731353+0000","last_change":"2024-09-13T19:06:25.281596+0000","last_active":"2024-09-13T19:10:03.731353+0000","last_peered":"2024-09-13T19:10:03.731353+0000","last_clean":"2024-09-13T19:10:03.731353+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:03.731353+0000","last_undegraded":"2024-09-13T19:10:03.731353+0000","last_fullsized":"2024-09-13T19:10:03.731353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:11.221079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359118+0000","last_change":"2024-09-13T19:06:27.318504+0000","last_active":"2024-09-13T19:06:58.359118+0000","last_peered":"2024-09-13T19:06:58.359118+0000","last_clean":"2024-09-13T19:06:58.359118+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:06:58.359118+0000","last_undegraded":"2024-09-13T19:06:58.359118+0000","last_fullsized":"2024-09-13T19:06:58.359118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.391456+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:07:50.391456+0000","last_peered":"2024-09-13T19:07:50.391456+0000","last_clean":"2024-09-13T19:07:50.391456+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:07:50.391456+0000","last_undegraded":"2024-09-13T19:07:50.391456+0000","last_fullsized":"2024-09-13T19:07:50.391456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:43.269034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.454561+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.454561+0000","last_peered":"2024-09-13T19:09:38.454561+0000","last_clean":"2024-09-13T19:09:38.454561+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.454561+0000","last_undegraded":"2024-09-13T19:09:38.454561+0000","last_fullsized":"2024-09-13T19:09:38.454561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:44.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328877+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:06:58.328877+0000","last_peered":"2024-09-13T19:06:58.328877+0000","last_clean":"2024-09-13T19:06:58.328877+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:06:58.328877+0000","last_undegraded":"2024-09-13T19:06:58.328877+0000","last_fullsized":"2024-09-13T19:06:58.328877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327809+0000","last_change":"2024-09-13T19:06:23.252446+0000","last_active":"2024-09-13T19:06:58.327809+0000","last_peered":"2024-09-13T19:06:58.327809+0000","last_clean":"2024-09-13T19:06:58.327809+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:06:58.327809+0000","last_undegraded":"2024-09-13T19:06:58.327809+0000","last_fullsized":"2024-09-13T19:06:58.327809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358498+0000","last_change":"2024-09-13T19:06:25.281296+0000","last_active":"2024-09-13T19:06:58.358498+0000","last_peered":"2024-09-13T19:06:58.358498+0000","last_clean":"2024-09-13T19:06:58.358498+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:06:58.358498+0000","last_undegraded":"2024-09-13T19:06:58.358498+0000","last_fullsized":"2024-09-13T19:06:58.358498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:03.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358756+0000","last_change":"2024-09-13T19:06:27.324894+0000","last_active":"2024-09-13T19:06:58.358756+0000","last_peered":"2024-09-13T19:06:58.358756+0000","last_clean":"2024-09-13T19:06:58.358756+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:06:58.358756+0000","last_undegraded":"2024-09-13T19:06:58.358756+0000","last_fullsized":"2024-09-13T19:06:58.358756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326789+0000","last_change":"2024-09-13T19:06:29.300886+0000","last_active":"2024-09-13T19:06:58.326789+0000","last_peered":"2024-09-13T19:06:58.326789+0000","last_clean":"2024-09-13T19:06:58.326789+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:06:58.326789+0000","last_undegraded":"2024-09-13T19:06:58.326789+0000","last_fullsized":"2024-09-13T19:06:58.326789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.372361+0000","last_change":"2024-09-13T19:06:21.256421+0000","last_active":"2024-09-13T19:09:38.372361+0000","last_peered":"2024-09-13T19:09:38.372361+0000","last_clean":"2024-09-13T19:09:38.372361+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:09:38.372361+0000","last_undegraded":"2024-09-13T19:09:38.372361+0000","last_fullsized":"2024-09-13T19:09:38.372361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:08.365440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337123+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:06:58.337123+0000","last_peered":"2024-09-13T19:06:58.337123+0000","last_clean":"2024-09-13T19:06:58.337123+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:06:58.337123+0000","last_undegraded":"2024-09-13T19:06:58.337123+0000","last_fullsized":"2024-09-13T19:06:58.337123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:05.346402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336788+0000","last_change":"2024-09-13T19:06:23.258127+0000","last_active":"2024-09-13T19:06:58.336788+0000","last_peered":"2024-09-13T19:06:58.336788+0000","last_clean":"2024-09-13T19:06:58.336788+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:06:58.336788+0000","last_undegraded":"2024-09-13T19:06:58.336788+0000","last_fullsized":"2024-09-13T19:06:58.336788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331611+0000","last_change":"2024-09-13T19:06:25.297719+0000","last_active":"2024-09-13T19:06:58.331611+0000","last_peered":"2024-09-13T19:06:58.331611+0000","last_clean":"2024-09-13T19:06:58.331611+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:06:58.331611+0000","last_undegraded":"2024-09-13T19:06:58.331611+0000","last_fullsized":"2024-09-13T19:06:58.331611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.240465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.528863+0000","last_change":"2024-09-13T19:06:27.301544+0000","last_active":"2024-09-13T19:10:03.528863+0000","last_peered":"2024-09-13T19:10:03.528863+0000","last_clean":"2024-09-13T19:10:03.528863+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:03.528863+0000","last_undegraded":"2024-09-13T19:10:03.528863+0000","last_fullsized":"2024-09-13T19:10:03.528863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:19.445306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328744+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:06:58.328744+0000","last_peered":"2024-09-13T19:06:58.328744+0000","last_clean":"2024-09-13T19:06:58.328744+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:06:58.328744+0000","last_undegraded":"2024-09-13T19:06:58.328744+0000","last_fullsized":"2024-09-13T19:06:58.328744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:06.414507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.042619+0000","last_change":"2024-09-13T19:06:21.259001+0000","last_active":"2024-09-13T19:09:38.042619+0000","last_peered":"2024-09-13T19:09:38.042619+0000","last_clean":"2024-09-13T19:09:38.042619+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:09:38.042619+0000","last_undegraded":"2024-09-13T19:09:38.042619+0000","last_fullsized":"2024-09-13T19:09:38.042619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358360+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:06:58.358360+0000","last_peered":"2024-09-13T19:06:58.358360+0000","last_clean":"2024-09-13T19:06:58.358360+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:06:58.358360+0000","last_undegraded":"2024-09-13T19:06:58.358360+0000","last_fullsized":"2024-09-13T19:06:58.358360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:48.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350380+0000","last_change":"2024-09-13T19:06:23.276603+0000","last_active":"2024-09-13T19:06:58.350380+0000","last_peered":"2024-09-13T19:06:58.350380+0000","last_clean":"2024-09-13T19:06:58.350380+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:06:58.350380+0000","last_undegraded":"2024-09-13T19:06:58.350380+0000","last_fullsized":"2024-09-13T19:06:58.350380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:06.962778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.690187+0000","last_change":"2024-09-13T19:06:25.297031+0000","last_active":"2024-09-13T19:10:03.690187+0000","last_peered":"2024-09-13T19:10:03.690187+0000","last_clean":"2024-09-13T19:10:03.690187+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:03.690187+0000","last_undegraded":"2024-09-13T19:10:03.690187+0000","last_fullsized":"2024-09-13T19:10:03.690187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:32.765951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":446,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.538399+0000","last_change":"2024-09-13T19:06:27.283769+0000","last_active":"2024-09-13T19:10:03.538399+0000","last_peered":"2024-09-13T19:10:03.538399+0000","last_clean":"2024-09-13T19:10:03.538399+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:03.538399+0000","last_undegraded":"2024-09-13T19:10:03.538399+0000","last_fullsized":"2024-09-13T19:10:03.538399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:00.073225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375233+0000","last_change":"2024-09-13T19:06:21.259478+0000","last_active":"2024-09-13T19:09:38.375233+0000","last_peered":"2024-09-13T19:09:38.375233+0000","last_clean":"2024-09-13T19:09:38.375233+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:09:38.375233+0000","last_undegraded":"2024-09-13T19:09:38.375233+0000","last_fullsized":"2024-09-13T19:09:38.375233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:26.304922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.779034+0000","last_change":"2024-09-13T19:06:19.264318+0000","last_active":"2024-09-13T19:08:36.779034+0000","last_peered":"2024-09-13T19:08:36.779034+0000","last_clean":"2024-09-13T19:08:36.779034+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:08:36.779034+0000","last_undegraded":"2024-09-13T19:08:36.779034+0000","last_fullsized":"2024-09-13T19:08:36.779034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341484+0000","last_change":"2024-09-13T19:06:23.274173+0000","last_active":"2024-09-13T19:06:58.341484+0000","last_peered":"2024-09-13T19:06:58.341484+0000","last_clean":"2024-09-13T19:06:58.341484+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:06:58.341484+0000","last_undegraded":"2024-09-13T19:06:58.341484+0000","last_fullsized":"2024-09-13T19:06:58.341484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.767664+0000","last_change":"2024-09-13T19:06:25.302087+0000","last_active":"2024-09-13T19:10:03.767664+0000","last_peered":"2024-09-13T19:10:03.767664+0000","last_clean":"2024-09-13T19:10:03.767664+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:03.767664+0000","last_undegraded":"2024-09-13T19:10:03.767664+0000","last_fullsized":"2024-09-13T19:10:03.767664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:04.630747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330037+0000","last_change":"2024-09-13T19:06:27.297316+0000","last_active":"2024-09-13T19:06:58.330037+0000","last_peered":"2024-09-13T19:06:58.330037+0000","last_clean":"2024-09-13T19:06:58.330037+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:06:58.330037+0000","last_undegraded":"2024-09-13T19:06:58.330037+0000","last_fullsized":"2024-09-13T19:06:58.330037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:15.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.394157+0000","last_change":"2024-09-13T19:06:29.313617+0000","last_active":"2024-09-13T19:07:50.394157+0000","last_peered":"2024-09-13T19:07:50.394157+0000","last_clean":"2024-09-13T19:07:50.394157+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:07:50.394157+0000","last_undegraded":"2024-09-13T19:07:50.394157+0000","last_fullsized":"2024-09-13T19:07:50.394157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:24.043207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.390167+0000","last_change":"2024-09-13T19:06:21.258654+0000","last_active":"2024-09-13T19:09:38.390167+0000","last_peered":"2024-09-13T19:09:38.390167+0000","last_clean":"2024-09-13T19:09:38.390167+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:09:38.390167+0000","last_undegraded":"2024-09-13T19:09:38.390167+0000","last_fullsized":"2024-09-13T19:09:38.390167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.205636+0000","last_change":"2024-09-13T19:06:19.273587+0000","last_active":"2024-09-13T19:09:38.205636+0000","last_peered":"2024-09-13T19:09:38.205636+0000","last_clean":"2024-09-13T19:09:38.205636+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:09:38.205636+0000","last_undegraded":"2024-09-13T19:09:38.205636+0000","last_fullsized":"2024-09-13T19:09:38.205636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.978035+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:06:58.978035+0000","last_peered":"2024-09-13T19:06:58.978035+0000","last_clean":"2024-09-13T19:06:58.978035+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:06:58.978035+0000","last_undegraded":"2024-09-13T19:06:58.978035+0000","last_fullsized":"2024-09-13T19:06:58.978035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.625888+0000","last_change":"2024-09-13T19:06:25.280611+0000","last_active":"2024-09-13T19:10:03.625888+0000","last_peered":"2024-09-13T19:10:03.625888+0000","last_clean":"2024-09-13T19:10:03.625888+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:03.625888+0000","last_undegraded":"2024-09-13T19:10:03.625888+0000","last_fullsized":"2024-09-13T19:10:03.625888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:29.037601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328820+0000","last_change":"2024-09-13T19:06:27.297989+0000","last_active":"2024-09-13T19:06:58.328820+0000","last_peered":"2024-09-13T19:06:58.328820+0000","last_clean":"2024-09-13T19:06:58.328820+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:06:58.328820+0000","last_undegraded":"2024-09-13T19:06:58.328820+0000","last_fullsized":"2024-09-13T19:06:58.328820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:44.711664+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:07:44.711664+0000","last_peered":"2024-09-13T19:07:44.711664+0000","last_clean":"2024-09-13T19:07:44.711664+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:07:44.711664+0000","last_undegraded":"2024-09-13T19:07:44.711664+0000","last_fullsized":"2024-09-13T19:07:44.711664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610491+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:09:38.610491+0000","last_peered":"2024-09-13T19:09:38.610491+0000","last_clean":"2024-09-13T19:09:38.610491+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:09:38.610491+0000","last_undegraded":"2024-09-13T19:09:38.610491+0000","last_fullsized":"2024-09-13T19:09:38.610491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:03.939657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.460726+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:07:06.460726+0000","last_peered":"2024-09-13T19:07:06.460726+0000","last_clean":"2024-09-13T19:07:06.460726+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:07:06.460726+0000","last_undegraded":"2024-09-13T19:07:06.460726+0000","last_fullsized":"2024-09-13T19:07:06.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:30.862085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328791+0000","last_change":"2024-09-13T19:06:23.258115+0000","last_active":"2024-09-13T19:06:58.328791+0000","last_peered":"2024-09-13T19:06:58.328791+0000","last_clean":"2024-09-13T19:06:58.328791+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:06:58.328791+0000","last_undegraded":"2024-09-13T19:06:58.328791+0000","last_fullsized":"2024-09-13T19:06:58.328791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.802675+0000","last_change":"2024-09-13T19:06:25.289758+0000","last_active":"2024-09-13T19:10:03.802675+0000","last_peered":"2024-09-13T19:10:03.802675+0000","last_clean":"2024-09-13T19:10:03.802675+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:03.802675+0000","last_undegraded":"2024-09-13T19:10:03.802675+0000","last_fullsized":"2024-09-13T19:10:03.802675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:14.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.541481+0000","last_change":"2024-09-13T19:06:27.298298+0000","last_active":"2024-09-13T19:10:03.541481+0000","last_peered":"2024-09-13T19:10:03.541481+0000","last_clean":"2024-09-13T19:10:03.541481+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:03.541481+0000","last_undegraded":"2024-09-13T19:10:03.541481+0000","last_fullsized":"2024-09-13T19:10:03.541481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.115703+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:08:37.115703+0000","last_peered":"2024-09-13T19:08:37.115703+0000","last_clean":"2024-09-13T19:08:37.115703+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:08:37.115703+0000","last_undegraded":"2024-09-13T19:08:37.115703+0000","last_fullsized":"2024-09-13T19:08:37.115703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:12.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.657938+0000","last_change":"2024-09-13T19:06:21.254633+0000","last_active":"2024-09-13T19:07:50.657938+0000","last_peered":"2024-09-13T19:07:50.657938+0000","last_clean":"2024-09-13T19:07:50.657938+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:07:50.657938+0000","last_undegraded":"2024-09-13T19:07:50.657938+0000","last_fullsized":"2024-09-13T19:07:50.657938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.476452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.729168+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:09:37.729168+0000","last_peered":"2024-09-13T19:09:37.729168+0000","last_clean":"2024-09-13T19:09:37.729168+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:09:37.729168+0000","last_undegraded":"2024-09-13T19:09:37.729168+0000","last_fullsized":"2024-09-13T19:09:37.729168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:54.868067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327588+0000","last_change":"2024-09-13T19:06:23.249243+0000","last_active":"2024-09-13T19:06:58.327588+0000","last_peered":"2024-09-13T19:06:58.327588+0000","last_clean":"2024-09-13T19:06:58.327588+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:06:58.327588+0000","last_undegraded":"2024-09-13T19:06:58.327588+0000","last_fullsized":"2024-09-13T19:06:58.327588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.817765+0000","last_change":"2024-09-13T19:06:25.282586+0000","last_active":"2024-09-13T19:10:03.817765+0000","last_peered":"2024-09-13T19:10:03.817765+0000","last_clean":"2024-09-13T19:10:03.817765+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:03.817765+0000","last_undegraded":"2024-09-13T19:10:03.817765+0000","last_fullsized":"2024-09-13T19:10:03.817765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.800732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326947+0000","last_change":"2024-09-13T19:06:27.313481+0000","last_active":"2024-09-13T19:06:58.326947+0000","last_peered":"2024-09-13T19:06:58.326947+0000","last_clean":"2024-09-13T19:06:58.326947+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:06:58.326947+0000","last_undegraded":"2024-09-13T19:06:58.326947+0000","last_fullsized":"2024-09-13T19:06:58.326947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.751983+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:09:38.751983+0000","last_peered":"2024-09-13T19:09:38.751983+0000","last_clean":"2024-09-13T19:09:38.751983+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:09:38.751983+0000","last_undegraded":"2024-09-13T19:09:38.751983+0000","last_fullsized":"2024-09-13T19:09:38.751983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:28.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255473+0000","last_change":"2024-09-13T19:06:21.254823+0000","last_active":"2024-09-13T19:09:38.255473+0000","last_peered":"2024-09-13T19:09:38.255473+0000","last_clean":"2024-09-13T19:09:38.255473+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:09:38.255473+0000","last_undegraded":"2024-09-13T19:09:38.255473+0000","last_fullsized":"2024-09-13T19:09:38.255473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.117376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329744+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:06:58.329744+0000","last_peered":"2024-09-13T19:06:58.329744+0000","last_clean":"2024-09-13T19:06:58.329744+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:06:58.329744+0000","last_undegraded":"2024-09-13T19:06:58.329744+0000","last_fullsized":"2024-09-13T19:06:58.329744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.658155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333104+0000","last_change":"2024-09-13T19:06:23.253330+0000","last_active":"2024-09-13T19:06:58.333104+0000","last_peered":"2024-09-13T19:06:58.333104+0000","last_clean":"2024-09-13T19:06:58.333104+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:06:58.333104+0000","last_undegraded":"2024-09-13T19:06:58.333104+0000","last_fullsized":"2024-09-13T19:06:58.333104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:06.158565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'36","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.645785+0000","last_change":"2024-09-13T19:06:25.281709+0000","last_active":"2024-09-13T19:10:03.645785+0000","last_peered":"2024-09-13T19:10:03.645785+0000","last_clean":"2024-09-13T19:10:03.645785+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:03.645785+0000","last_undegraded":"2024-09-13T19:10:03.645785+0000","last_fullsized":"2024-09-13T19:10:03.645785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:30.269921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354536+0000","last_change":"2024-09-13T19:06:27.302986+0000","last_active":"2024-09-13T19:06:58.354536+0000","last_peered":"2024-09-13T19:06:58.354536+0000","last_clean":"2024-09-13T19:06:58.354536+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:06:58.354536+0000","last_undegraded":"2024-09-13T19:06:58.354536+0000","last_fullsized":"2024-09-13T19:06:58.354536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:39.152741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.342251+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:08:33.342251+0000","last_peered":"2024-09-13T19:08:33.342251+0000","last_clean":"2024-09-13T19:08:33.342251+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:08:33.342251+0000","last_undegraded":"2024-09-13T19:08:33.342251+0000","last_fullsized":"2024-09-13T19:08:33.342251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:56.624697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.349011+0000","last_change":"2024-09-13T19:06:21.267040+0000","last_active":"2024-09-13T19:06:58.349011+0000","last_peered":"2024-09-13T19:06:58.349011+0000","last_clean":"2024-09-13T19:06:58.349011+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:06:58.349011+0000","last_undegraded":"2024-09-13T19:06:58.349011+0000","last_fullsized":"2024-09-13T19:06:58.349011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:49.679514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.338851+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:06:58.338851+0000","last_peered":"2024-09-13T19:06:58.338851+0000","last_clean":"2024-09-13T19:06:58.338851+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:06:58.338851+0000","last_undegraded":"2024-09-13T19:06:58.338851+0000","last_fullsized":"2024-09-13T19:06:58.338851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:51.658861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328141+0000","last_change":"2024-09-13T19:06:23.258329+0000","last_active":"2024-09-13T19:06:58.328141+0000","last_peered":"2024-09-13T19:06:58.328141+0000","last_clean":"2024-09-13T19:06:58.328141+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:06:58.328141+0000","last_undegraded":"2024-09-13T19:06:58.328141+0000","last_fullsized":"2024-09-13T19:06:58.328141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:19.236853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.872887+0000","last_change":"2024-09-13T19:06:25.286826+0000","last_active":"2024-09-13T19:10:03.872887+0000","last_peered":"2024-09-13T19:10:03.872887+0000","last_clean":"2024-09-13T19:10:03.872887+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:03.872887+0000","last_undegraded":"2024-09-13T19:10:03.872887+0000","last_fullsized":"2024-09-13T19:10:03.872887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:08.372479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":436,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.530748+0000","last_change":"2024-09-13T19:06:27.328186+0000","last_active":"2024-09-13T19:10:03.530748+0000","last_peered":"2024-09-13T19:10:03.530748+0000","last_clean":"2024-09-13T19:10:03.530748+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:03.530748+0000","last_undegraded":"2024-09-13T19:10:03.530748+0000","last_fullsized":"2024-09-13T19:10:03.530748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:01.872002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.922026+0000","last_change":"2024-09-13T19:06:29.297215+0000","last_active":"2024-09-13T19:08:36.922026+0000","last_peered":"2024-09-13T19:08:36.922026+0000","last_clean":"2024-09-13T19:08:36.922026+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:08:36.922026+0000","last_undegraded":"2024-09-13T19:08:36.922026+0000","last_fullsized":"2024-09-13T19:08:36.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.039686+0000","last_change":"2024-09-13T19:06:21.255658+0000","last_active":"2024-09-13T19:09:38.039686+0000","last_peered":"2024-09-13T19:09:38.039686+0000","last_clean":"2024-09-13T19:09:38.039686+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:09:38.039686+0000","last_undegraded":"2024-09-13T19:09:38.039686+0000","last_fullsized":"2024-09-13T19:09:38.039686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724793+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:07:05.724793+0000","last_peered":"2024-09-13T19:07:05.724793+0000","last_clean":"2024-09-13T19:07:05.724793+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:07:05.724793+0000","last_undegraded":"2024-09-13T19:07:05.724793+0000","last_fullsized":"2024-09-13T19:07:05.724793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.606992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.500049+0000","last_change":"2024-09-13T19:06:23.268138+0000","last_active":"2024-09-13T19:10:03.500049+0000","last_peered":"2024-09-13T19:10:03.500049+0000","last_clean":"2024-09-13T19:10:03.500049+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:03.500049+0000","last_undegraded":"2024-09-13T19:10:03.500049+0000","last_fullsized":"2024-09-13T19:10:03.500049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.704741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004313+0000","last_change":"2024-09-13T19:06:25.281762+0000","last_active":"2024-09-13T19:08:44.004313+0000","last_peered":"2024-09-13T19:08:44.004313+0000","last_clean":"2024-09-13T19:08:44.004313+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:08:44.004313+0000","last_undegraded":"2024-09-13T19:08:44.004313+0000","last_fullsized":"2024-09-13T19:08:44.004313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:51.768718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":473,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.532388+0000","last_change":"2024-09-13T19:06:27.321351+0000","last_active":"2024-09-13T19:10:03.532388+0000","last_peered":"2024-09-13T19:10:03.532388+0000","last_clean":"2024-09-13T19:10:03.532388+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:03.532388+0000","last_undegraded":"2024-09-13T19:10:03.532388+0000","last_fullsized":"2024-09-13T19:10:03.532388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.413797+0000","last_change":"2024-09-13T19:06:29.303776+0000","last_active":"2024-09-13T19:08:36.413797+0000","last_peered":"2024-09-13T19:08:36.413797+0000","last_clean":"2024-09-13T19:08:36.413797+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:08:36.413797+0000","last_undegraded":"2024-09-13T19:08:36.413797+0000","last_fullsized":"2024-09-13T19:08:36.413797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:42.497813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455777+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.455777+0000","last_peered":"2024-09-13T19:09:38.455777+0000","last_clean":"2024-09-13T19:09:38.455777+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.455777+0000","last_undegraded":"2024-09-13T19:09:38.455777+0000","last_fullsized":"2024-09-13T19:09:38.455777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:54.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336035+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:06:58.336035+0000","last_peered":"2024-09-13T19:06:58.336035+0000","last_clean":"2024-09-13T19:06:58.336035+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:06:58.336035+0000","last_undegraded":"2024-09-13T19:06:58.336035+0000","last_fullsized":"2024-09-13T19:06:58.336035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:35.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354619+0000","last_change":"2024-09-13T19:06:23.278499+0000","last_active":"2024-09-13T19:06:58.354619+0000","last_peered":"2024-09-13T19:06:58.354619+0000","last_clean":"2024-09-13T19:06:58.354619+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:06:58.354619+0000","last_undegraded":"2024-09-13T19:06:58.354619+0000","last_fullsized":"2024-09-13T19:06:58.354619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:05.943867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.739993+0000","last_change":"2024-09-13T19:06:25.280810+0000","last_active":"2024-09-13T19:10:03.739993+0000","last_peered":"2024-09-13T19:10:03.739993+0000","last_clean":"2024-09-13T19:10:03.739993+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:03.739993+0000","last_undegraded":"2024-09-13T19:10:03.739993+0000","last_fullsized":"2024-09-13T19:10:03.739993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.687336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330438+0000","last_change":"2024-09-13T19:06:27.327479+0000","last_active":"2024-09-13T19:06:58.330438+0000","last_peered":"2024-09-13T19:06:58.330438+0000","last_clean":"2024-09-13T19:06:58.330438+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:06:58.330438+0000","last_undegraded":"2024-09-13T19:06:58.330438+0000","last_fullsized":"2024-09-13T19:06:58.330438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:32.856579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.552955+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:09:38.552955+0000","last_peered":"2024-09-13T19:09:38.552955+0000","last_clean":"2024-09-13T19:09:38.552955+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:09:38.552955+0000","last_undegraded":"2024-09-13T19:09:38.552955+0000","last_fullsized":"2024-09-13T19:09:38.552955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:43.406563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.038245+0000","last_change":"2024-09-13T19:06:21.266428+0000","last_active":"2024-09-13T19:07:08.038245+0000","last_peered":"2024-09-13T19:07:08.038245+0000","last_clean":"2024-09-13T19:07:08.038245+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:07:08.038245+0000","last_undegraded":"2024-09-13T19:07:08.038245+0000","last_fullsized":"2024-09-13T19:07:08.038245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:15.353078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353237+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:58.353237+0000","last_peered":"2024-09-13T19:06:58.353237+0000","last_clean":"2024-09-13T19:06:58.353237+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:58.353237+0000","last_undegraded":"2024-09-13T19:06:58.353237+0000","last_fullsized":"2024-09-13T19:06:58.353237+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341613+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:58.341613+0000","last_peered":"2024-09-13T19:06:58.341613+0000","last_clean":"2024-09-13T19:06:58.341613+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:58.341613+0000","last_undegraded":"2024-09-13T19:06:58.341613+0000","last_fullsized":"2024-09-13T19:06:58.341613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.642212+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:07:50.642212+0000","last_peered":"2024-09-13T19:07:50.642212+0000","last_clean":"2024-09-13T19:07:50.642212+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:07:50.642212+0000","last_undegraded":"2024-09-13T19:07:50.642212+0000","last_fullsized":"2024-09-13T19:07:50.642212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:05.311607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343001+0000","last_change":"2024-09-13T19:06:23.274175+0000","last_active":"2024-09-13T19:06:58.343001+0000","last_peered":"2024-09-13T19:06:58.343001+0000","last_clean":"2024-09-13T19:06:58.343001+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:06:58.343001+0000","last_undegraded":"2024-09-13T19:06:58.343001+0000","last_fullsized":"2024-09-13T19:06:58.343001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:15.978917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.852857+0000","last_change":"2024-09-13T19:06:25.277544+0000","last_active":"2024-09-13T19:10:03.852857+0000","last_peered":"2024-09-13T19:10:03.852857+0000","last_clean":"2024-09-13T19:10:03.852857+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:03.852857+0000","last_undegraded":"2024-09-13T19:10:03.852857+0000","last_fullsized":"2024-09-13T19:10:03.852857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:24.442610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333055+0000","last_change":"2024-09-13T19:06:27.299350+0000","last_active":"2024-09-13T19:06:58.333055+0000","last_peered":"2024-09-13T19:06:58.333055+0000","last_clean":"2024-09-13T19:06:58.333055+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:06:58.333055+0000","last_undegraded":"2024-09-13T19:06:58.333055+0000","last_fullsized":"2024-09-13T19:06:58.333055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:10.979684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.482335+0000","last_change":"2024-09-13T19:06:29.300679+0000","last_active":"2024-09-13T19:09:38.482335+0000","last_peered":"2024-09-13T19:09:38.482335+0000","last_clean":"2024-09-13T19:09:38.482335+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:09:38.482335+0000","last_undegraded":"2024-09-13T19:09:38.482335+0000","last_fullsized":"2024-09-13T19:09:38.482335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:18.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.325242+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:07:07.325242+0000","last_peered":"2024-09-13T19:07:07.325242+0000","last_clean":"2024-09-13T19:07:07.325242+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:07:07.325242+0000","last_undegraded":"2024-09-13T19:07:07.325242+0000","last_fullsized":"2024-09-13T19:07:07.325242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:10.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335353+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:58.335353+0000","last_peered":"2024-09-13T19:06:58.335353+0000","last_clean":"2024-09-13T19:06:58.335353+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:58.335353+0000","last_undegraded":"2024-09-13T19:06:58.335353+0000","last_fullsized":"2024-09-13T19:06:58.335353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327250+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:06:58.327250+0000","last_peered":"2024-09-13T19:06:58.327250+0000","last_clean":"2024-09-13T19:06:58.327250+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:06:58.327250+0000","last_undegraded":"2024-09-13T19:06:58.327250+0000","last_fullsized":"2024-09-13T19:06:58.327250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'4","reported_seq":228,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.486257+0000","last_change":"2024-09-13T19:06:23.276941+0000","last_active":"2024-09-13T19:10:03.486257+0000","last_peered":"2024-09-13T19:10:03.486257+0000","last_clean":"2024-09-13T19:10:03.486257+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:03.486257+0000","last_undegraded":"2024-09-13T19:10:03.486257+0000","last_fullsized":"2024-09-13T19:10:03.486257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:43.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":502,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.752345+0000","last_change":"2024-09-13T19:06:25.284975+0000","last_active":"2024-09-13T19:10:03.752345+0000","last_peered":"2024-09-13T19:10:03.752345+0000","last_clean":"2024-09-13T19:10:03.752345+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:03.752345+0000","last_undegraded":"2024-09-13T19:10:03.752345+0000","last_fullsized":"2024-09-13T19:10:03.752345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:14.778552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342538+0000","last_change":"2024-09-13T19:06:27.305676+0000","last_active":"2024-09-13T19:06:58.342538+0000","last_peered":"2024-09-13T19:06:58.342538+0000","last_clean":"2024-09-13T19:06:58.342538+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:06:58.342538+0000","last_undegraded":"2024-09-13T19:06:58.342538+0000","last_fullsized":"2024-09-13T19:06:58.342538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:49.829980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.388695+0000","last_change":"2024-09-13T19:06:29.319214+0000","last_active":"2024-09-13T19:07:50.388695+0000","last_peered":"2024-09-13T19:07:50.388695+0000","last_clean":"2024-09-13T19:07:50.388695+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:07:50.388695+0000","last_undegraded":"2024-09-13T19:07:50.388695+0000","last_fullsized":"2024-09-13T19:07:50.388695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:33.276278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.256520+0000","last_change":"2024-09-13T19:06:21.260320+0000","last_active":"2024-09-13T19:09:38.256520+0000","last_peered":"2024-09-13T19:09:38.256520+0000","last_clean":"2024-09-13T19:09:38.256520+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:09:38.256520+0000","last_undegraded":"2024-09-13T19:09:38.256520+0000","last_fullsized":"2024-09-13T19:09:38.256520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329531+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:58.329531+0000","last_peered":"2024-09-13T19:06:58.329531+0000","last_clean":"2024-09-13T19:06:58.329531+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:58.329531+0000","last_undegraded":"2024-09-13T19:06:58.329531+0000","last_fullsized":"2024-09-13T19:06:58.329531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326113+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:06:58.326113+0000","last_peered":"2024-09-13T19:06:58.326113+0000","last_clean":"2024-09-13T19:06:58.326113+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:06:58.326113+0000","last_undegraded":"2024-09-13T19:06:58.326113+0000","last_fullsized":"2024-09-13T19:06:58.326113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.371226+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:06:58.371226+0000","last_peered":"2024-09-13T19:06:58.371226+0000","last_clean":"2024-09-13T19:06:58.371226+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:06:58.371226+0000","last_undegraded":"2024-09-13T19:06:58.371226+0000","last_fullsized":"2024-09-13T19:06:58.371226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:30.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518498+0000","last_change":"2024-09-13T19:06:25.297340+0000","last_active":"2024-09-13T19:09:38.518498+0000","last_peered":"2024-09-13T19:09:38.518498+0000","last_clean":"2024-09-13T19:09:38.518498+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:09:38.518498+0000","last_undegraded":"2024-09-13T19:09:38.518498+0000","last_fullsized":"2024-09-13T19:09:38.518498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:59.204433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329583+0000","last_change":"2024-09-13T19:06:27.303087+0000","last_active":"2024-09-13T19:06:58.329583+0000","last_peered":"2024-09-13T19:06:58.329583+0000","last_clean":"2024-09-13T19:06:58.329583+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:06:58.329583+0000","last_undegraded":"2024-09-13T19:06:58.329583+0000","last_fullsized":"2024-09-13T19:06:58.329583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:15.260803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335697+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:06:58.335697+0000","last_peered":"2024-09-13T19:06:58.335697+0000","last_clean":"2024-09-13T19:06:58.335697+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:06:58.335697+0000","last_undegraded":"2024-09-13T19:06:58.335697+0000","last_fullsized":"2024-09-13T19:06:58.335697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:02.339869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.032925+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:07:08.032925+0000","last_peered":"2024-09-13T19:07:08.032925+0000","last_clean":"2024-09-13T19:07:08.032925+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:07:08.032925+0000","last_undegraded":"2024-09-13T19:07:08.032925+0000","last_fullsized":"2024-09-13T19:07:08.032925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336137+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:58.336137+0000","last_peered":"2024-09-13T19:06:58.336137+0000","last_clean":"2024-09-13T19:06:58.336137+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:58.336137+0000","last_undegraded":"2024-09-13T19:06:58.336137+0000","last_fullsized":"2024-09-13T19:06:58.336137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330472+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:06:58.330472+0000","last_peered":"2024-09-13T19:06:58.330472+0000","last_clean":"2024-09-13T19:06:58.330472+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:06:58.330472+0000","last_undegraded":"2024-09-13T19:06:58.330472+0000","last_fullsized":"2024-09-13T19:06:58.330472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330688+0000","last_change":"2024-09-13T19:06:23.247010+0000","last_active":"2024-09-13T19:06:58.330688+0000","last_peered":"2024-09-13T19:06:58.330688+0000","last_clean":"2024-09-13T19:06:58.330688+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:06:58.330688+0000","last_undegraded":"2024-09-13T19:06:58.330688+0000","last_fullsized":"2024-09-13T19:06:58.330688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:39.504976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.165710+0000","last_change":"2024-09-13T19:06:25.277155+0000","last_active":"2024-09-13T19:09:37.165710+0000","last_peered":"2024-09-13T19:09:37.165710+0000","last_clean":"2024-09-13T19:09:37.165710+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:09:37.165710+0000","last_undegraded":"2024-09-13T19:09:37.165710+0000","last_fullsized":"2024-09-13T19:09:37.165710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:35.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353918+0000","last_change":"2024-09-13T19:06:27.303059+0000","last_active":"2024-09-13T19:06:58.353918+0000","last_peered":"2024-09-13T19:06:58.353918+0000","last_clean":"2024-09-13T19:06:58.353918+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:06:58.353918+0000","last_undegraded":"2024-09-13T19:06:58.353918+0000","last_fullsized":"2024-09-13T19:06:58.353918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:37.515962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.452185+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:08:36.452185+0000","last_peered":"2024-09-13T19:08:36.452185+0000","last_clean":"2024-09-13T19:08:36.452185+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:08:36.452185+0000","last_undegraded":"2024-09-13T19:08:36.452185+0000","last_fullsized":"2024-09-13T19:08:36.452185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.652660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.037885+0000","last_change":"2024-09-13T19:06:21.264605+0000","last_active":"2024-09-13T19:07:08.037885+0000","last_peered":"2024-09-13T19:07:08.037885+0000","last_clean":"2024-09-13T19:07:08.037885+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:07:08.037885+0000","last_undegraded":"2024-09-13T19:07:08.037885+0000","last_fullsized":"2024-09-13T19:07:08.037885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331265+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:06:58.331265+0000","last_peered":"2024-09-13T19:06:58.331265+0000","last_clean":"2024-09-13T19:06:58.331265+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:06:58.331265+0000","last_undegraded":"2024-09-13T19:06:58.331265+0000","last_fullsized":"2024-09-13T19:06:58.331265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328957+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:58.328957+0000","last_peered":"2024-09-13T19:06:58.328957+0000","last_clean":"2024-09-13T19:06:58.328957+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:58.328957+0000","last_undegraded":"2024-09-13T19:06:58.328957+0000","last_fullsized":"2024-09-13T19:06:58.328957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.827365+0000","last_change":"2024-09-13T19:06:23.246897+0000","last_active":"2024-09-13T19:09:38.827365+0000","last_peered":"2024-09-13T19:09:38.827365+0000","last_clean":"2024-09-13T19:09:38.827365+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:09:38.827365+0000","last_undegraded":"2024-09-13T19:09:38.827365+0000","last_fullsized":"2024-09-13T19:09:38.827365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:02.627136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'69","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.864640+0000","last_change":"2024-09-13T19:06:25.271746+0000","last_active":"2024-09-13T19:10:03.864640+0000","last_peered":"2024-09-13T19:10:03.864640+0000","last_clean":"2024-09-13T19:10:03.864640+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:03.864640+0000","last_undegraded":"2024-09-13T19:10:03.864640+0000","last_fullsized":"2024-09-13T19:10:03.864640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:48.903655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328017+0000","last_change":"2024-09-13T19:06:27.327868+0000","last_active":"2024-09-13T19:06:58.328017+0000","last_peered":"2024-09-13T19:06:58.328017+0000","last_clean":"2024-09-13T19:06:58.328017+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:06:58.328017+0000","last_undegraded":"2024-09-13T19:06:58.328017+0000","last_fullsized":"2024-09-13T19:06:58.328017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:58.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.927178+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:36.927178+0000","last_peered":"2024-09-13T19:08:36.927178+0000","last_clean":"2024-09-13T19:08:36.927178+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:36.927178+0000","last_undegraded":"2024-09-13T19:08:36.927178+0000","last_fullsized":"2024-09-13T19:08:36.927178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:18.960181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474863+0000","last_change":"2024-09-13T19:06:21.256957+0000","last_active":"2024-09-13T19:09:38.474863+0000","last_peered":"2024-09-13T19:09:38.474863+0000","last_clean":"2024-09-13T19:09:38.474863+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:09:38.474863+0000","last_undegraded":"2024-09-13T19:09:38.474863+0000","last_fullsized":"2024-09-13T19:09:38.474863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.052247+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:08:37.052247+0000","last_peered":"2024-09-13T19:08:37.052247+0000","last_clean":"2024-09-13T19:08:37.052247+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:08:37.052247+0000","last_undegraded":"2024-09-13T19:08:37.052247+0000","last_fullsized":"2024-09-13T19:08:37.052247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344720+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:58.344720+0000","last_peered":"2024-09-13T19:06:58.344720+0000","last_clean":"2024-09-13T19:06:58.344720+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:58.344720+0000","last_undegraded":"2024-09-13T19:06:58.344720+0000","last_fullsized":"2024-09-13T19:06:58.344720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.357946+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:06:58.357946+0000","last_peered":"2024-09-13T19:06:58.357946+0000","last_clean":"2024-09-13T19:06:58.357946+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:06:58.357946+0000","last_undegraded":"2024-09-13T19:06:58.357946+0000","last_fullsized":"2024-09-13T19:06:58.357946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:53.053072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.352663+0000","last_change":"2024-09-13T19:06:25.289221+0000","last_active":"2024-09-13T19:06:58.352663+0000","last_peered":"2024-09-13T19:06:58.352663+0000","last_clean":"2024-09-13T19:06:58.352663+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:06:58.352663+0000","last_undegraded":"2024-09-13T19:06:58.352663+0000","last_fullsized":"2024-09-13T19:06:58.352663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:24.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.526101+0000","last_change":"2024-09-13T19:06:27.322042+0000","last_active":"2024-09-13T19:10:03.526101+0000","last_peered":"2024-09-13T19:10:03.526101+0000","last_clean":"2024-09-13T19:10:03.526101+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:03.526101+0000","last_undegraded":"2024-09-13T19:10:03.526101+0000","last_fullsized":"2024-09-13T19:10:03.526101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350581+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:06:58.350581+0000","last_peered":"2024-09-13T19:06:58.350581+0000","last_clean":"2024-09-13T19:06:58.350581+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:06:58.350581+0000","last_undegraded":"2024-09-13T19:06:58.350581+0000","last_fullsized":"2024-09-13T19:06:58.350581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:14.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336082+0000","last_change":"2024-09-13T19:06:21.259985+0000","last_active":"2024-09-13T19:06:58.336082+0000","last_peered":"2024-09-13T19:06:58.336082+0000","last_clean":"2024-09-13T19:06:58.336082+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:06:58.336082+0000","last_undegraded":"2024-09-13T19:06:58.336082+0000","last_fullsized":"2024-09-13T19:06:58.336082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.974707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.356451+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:06:58.356451+0000","last_peered":"2024-09-13T19:06:58.356451+0000","last_clean":"2024-09-13T19:06:58.356451+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:06:58.356451+0000","last_undegraded":"2024-09-13T19:06:58.356451+0000","last_fullsized":"2024-09-13T19:06:58.356451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:21.325723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333377+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:58.333377+0000","last_peered":"2024-09-13T19:06:58.333377+0000","last_clean":"2024-09-13T19:06:58.333377+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:58.333377+0000","last_undegraded":"2024-09-13T19:06:58.333377+0000","last_fullsized":"2024-09-13T19:06:58.333377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336839+0000","last_change":"2024-09-13T19:06:23.278519+0000","last_active":"2024-09-13T19:06:58.336839+0000","last_peered":"2024-09-13T19:06:58.336839+0000","last_clean":"2024-09-13T19:06:58.336839+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:06:58.336839+0000","last_undegraded":"2024-09-13T19:06:58.336839+0000","last_fullsized":"2024-09-13T19:06:58.336839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:56.056319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337965+0000","last_change":"2024-09-13T19:06:25.303816+0000","last_active":"2024-09-13T19:06:58.337965+0000","last_peered":"2024-09-13T19:06:58.337965+0000","last_clean":"2024-09-13T19:06:58.337965+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:06:58.337965+0000","last_undegraded":"2024-09-13T19:06:58.337965+0000","last_fullsized":"2024-09-13T19:06:58.337965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:40.157012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.536212+0000","last_change":"2024-09-13T19:06:27.282458+0000","last_active":"2024-09-13T19:10:03.536212+0000","last_peered":"2024-09-13T19:10:03.536212+0000","last_clean":"2024-09-13T19:10:03.536212+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:03.536212+0000","last_undegraded":"2024-09-13T19:10:03.536212+0000","last_fullsized":"2024-09-13T19:10:03.536212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341741+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:06:58.341741+0000","last_peered":"2024-09-13T19:06:58.341741+0000","last_clean":"2024-09-13T19:06:58.341741+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:06:58.341741+0000","last_undegraded":"2024-09-13T19:06:58.341741+0000","last_fullsized":"2024-09-13T19:06:58.341741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:28.410267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474093+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:09:38.474093+0000","last_peered":"2024-09-13T19:09:38.474093+0000","last_clean":"2024-09-13T19:09:38.474093+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:09:38.474093+0000","last_undegraded":"2024-09-13T19:09:38.474093+0000","last_fullsized":"2024-09-13T19:09:38.474093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:40.974350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359033+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:06:58.359033+0000","last_peered":"2024-09-13T19:06:58.359033+0000","last_clean":"2024-09-13T19:06:58.359033+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:06:58.359033+0000","last_undegraded":"2024-09-13T19:06:58.359033+0000","last_fullsized":"2024-09-13T19:06:58.359033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355963+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:58.355963+0000","last_peered":"2024-09-13T19:06:58.355963+0000","last_clean":"2024-09-13T19:06:58.355963+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:58.355963+0000","last_undegraded":"2024-09-13T19:06:58.355963+0000","last_fullsized":"2024-09-13T19:06:58.355963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335083+0000","last_change":"2024-09-13T19:06:23.258816+0000","last_active":"2024-09-13T19:06:58.335083+0000","last_peered":"2024-09-13T19:06:58.335083+0000","last_clean":"2024-09-13T19:06:58.335083+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:06:58.335083+0000","last_undegraded":"2024-09-13T19:06:58.335083+0000","last_fullsized":"2024-09-13T19:06:58.335083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.723416+0000","last_change":"2024-09-13T19:06:25.297079+0000","last_active":"2024-09-13T19:10:03.723416+0000","last_peered":"2024-09-13T19:10:03.723416+0000","last_clean":"2024-09-13T19:10:03.723416+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:03.723416+0000","last_undegraded":"2024-09-13T19:10:03.723416+0000","last_fullsized":"2024-09-13T19:10:03.723416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:41.508588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326963+0000","last_change":"2024-09-13T19:06:27.313781+0000","last_active":"2024-09-13T19:06:58.326963+0000","last_peered":"2024-09-13T19:06:58.326963+0000","last_clean":"2024-09-13T19:06:58.326963+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:06:58.326963+0000","last_undegraded":"2024-09-13T19:06:58.326963+0000","last_fullsized":"2024-09-13T19:06:58.326963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:40.346062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342617+0000","last_change":"2024-09-13T19:06:29.312253+0000","last_active":"2024-09-13T19:06:58.342617+0000","last_peered":"2024-09-13T19:06:58.342617+0000","last_clean":"2024-09-13T19:06:58.342617+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:06:58.342617+0000","last_undegraded":"2024-09-13T19:06:58.342617+0000","last_fullsized":"2024-09-13T19:06:58.342617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:42.361204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.616193+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:09:38.616193+0000","last_peered":"2024-09-13T19:09:38.616193+0000","last_clean":"2024-09-13T19:09:38.616193+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:09:38.616193+0000","last_undegraded":"2024-09-13T19:09:38.616193+0000","last_fullsized":"2024-09-13T19:09:38.616193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:59.779490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.391281+0000","last_change":"2024-09-13T19:06:21.254116+0000","last_active":"2024-09-13T19:09:38.391281+0000","last_peered":"2024-09-13T19:09:38.391281+0000","last_clean":"2024-09-13T19:09:38.391281+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:09:38.391281+0000","last_undegraded":"2024-09-13T19:09:38.391281+0000","last_fullsized":"2024-09-13T19:09:38.391281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344342+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:06:58.344342+0000","last_peered":"2024-09-13T19:06:58.344342+0000","last_clean":"2024-09-13T19:06:58.344342+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:06:58.344342+0000","last_undegraded":"2024-09-13T19:06:58.344342+0000","last_fullsized":"2024-09-13T19:06:58.344342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:27.824459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340835+0000","last_change":"2024-09-13T19:06:23.271978+0000","last_active":"2024-09-13T19:06:58.340835+0000","last_peered":"2024-09-13T19:06:58.340835+0000","last_clean":"2024-09-13T19:06:58.340835+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:06:58.340835+0000","last_undegraded":"2024-09-13T19:06:58.340835+0000","last_fullsized":"2024-09-13T19:06:58.340835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:00.312157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'37","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.795271+0000","last_change":"2024-09-13T19:06:25.283177+0000","last_active":"2024-09-13T19:10:03.795271+0000","last_peered":"2024-09-13T19:10:03.795271+0000","last_clean":"2024-09-13T19:10:03.795271+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:03.795271+0000","last_undegraded":"2024-09-13T19:10:03.795271+0000","last_fullsized":"2024-09-13T19:10:03.795271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:04.407822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336859+0000","last_change":"2024-09-13T19:06:27.325440+0000","last_active":"2024-09-13T19:06:58.336859+0000","last_peered":"2024-09-13T19:06:58.336859+0000","last_clean":"2024-09-13T19:06:58.336859+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:06:58.336859+0000","last_undegraded":"2024-09-13T19:06:58.336859+0000","last_fullsized":"2024-09-13T19:06:58.336859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:33.587433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.338476+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:09:38.338476+0000","last_peered":"2024-09-13T19:09:38.338476+0000","last_clean":"2024-09-13T19:09:38.338476+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:09:38.338476+0000","last_undegraded":"2024-09-13T19:09:38.338476+0000","last_fullsized":"2024-09-13T19:09:38.338476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:15.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.333822+0000","last_change":"2024-09-13T19:06:21.258397+0000","last_active":"2024-09-13T19:08:31.333822+0000","last_peered":"2024-09-13T19:08:31.333822+0000","last_clean":"2024-09-13T19:08:31.333822+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:08:31.333822+0000","last_undegraded":"2024-09-13T19:08:31.333822+0000","last_fullsized":"2024-09-13T19:08:31.333822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.700100+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:09:37.700100+0000","last_peered":"2024-09-13T19:09:37.700100+0000","last_clean":"2024-09-13T19:09:37.700100+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:09:37.700100+0000","last_undegraded":"2024-09-13T19:09:37.700100+0000","last_fullsized":"2024-09-13T19:09:37.700100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337678+0000","last_change":"2024-09-13T19:06:23.263752+0000","last_active":"2024-09-13T19:06:58.337678+0000","last_peered":"2024-09-13T19:06:58.337678+0000","last_clean":"2024-09-13T19:06:58.337678+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:06:58.337678+0000","last_undegraded":"2024-09-13T19:06:58.337678+0000","last_fullsized":"2024-09-13T19:06:58.337678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:11.243897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.175973+0000","last_change":"2024-09-13T19:06:25.282738+0000","last_active":"2024-09-13T19:09:37.175973+0000","last_peered":"2024-09-13T19:09:37.175973+0000","last_clean":"2024-09-13T19:09:37.175973+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:09:37.175973+0000","last_undegraded":"2024-09-13T19:09:37.175973+0000","last_fullsized":"2024-09-13T19:09:37.175973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:30.312744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329003+0000","last_change":"2024-09-13T19:06:27.319132+0000","last_active":"2024-09-13T19:06:58.329003+0000","last_peered":"2024-09-13T19:06:58.329003+0000","last_clean":"2024-09-13T19:06:58.329003+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:06:58.329003+0000","last_undegraded":"2024-09-13T19:06:58.329003+0000","last_fullsized":"2024-09-13T19:06:58.329003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:50.916949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329771+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:06:58.329771+0000","last_peered":"2024-09-13T19:06:58.329771+0000","last_clean":"2024-09-13T19:06:58.329771+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:06:58.329771+0000","last_undegraded":"2024-09-13T19:06:58.329771+0000","last_fullsized":"2024-09-13T19:06:58.329771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:34.489280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328516+0000","last_change":"2024-09-13T19:06:21.244155+0000","last_active":"2024-09-13T19:06:58.328516+0000","last_peered":"2024-09-13T19:06:58.328516+0000","last_clean":"2024-09-13T19:06:58.328516+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:06:58.328516+0000","last_undegraded":"2024-09-13T19:06:58.328516+0000","last_fullsized":"2024-09-13T19:06:58.328516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345339+0000","last_change":"2024-09-13T19:06:19.272180+0000","last_active":"2024-09-13T19:06:58.345339+0000","last_peered":"2024-09-13T19:06:58.345339+0000","last_clean":"2024-09-13T19:06:58.345339+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:06:58.345339+0000","last_undegraded":"2024-09-13T19:06:58.345339+0000","last_fullsized":"2024-09-13T19:06:58.345339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329720+0000","last_change":"2024-09-13T19:06:23.263616+0000","last_active":"2024-09-13T19:06:58.329720+0000","last_peered":"2024-09-13T19:06:58.329720+0000","last_clean":"2024-09-13T19:06:58.329720+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:06:58.329720+0000","last_undegraded":"2024-09-13T19:06:58.329720+0000","last_fullsized":"2024-09-13T19:06:58.329720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:38.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.683631+0000","last_change":"2024-09-13T19:06:25.270269+0000","last_active":"2024-09-13T19:10:03.683631+0000","last_peered":"2024-09-13T19:10:03.683631+0000","last_clean":"2024-09-13T19:10:03.683631+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:03.683631+0000","last_undegraded":"2024-09-13T19:10:03.683631+0000","last_fullsized":"2024-09-13T19:10:03.683631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:42.960440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.339704+0000","last_change":"2024-09-13T19:06:27.320991+0000","last_active":"2024-09-13T19:06:58.339704+0000","last_peered":"2024-09-13T19:06:58.339704+0000","last_clean":"2024-09-13T19:06:58.339704+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:06:58.339704+0000","last_undegraded":"2024-09-13T19:06:58.339704+0000","last_fullsized":"2024-09-13T19:06:58.339704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.378906+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.378906+0000","last_peered":"2024-09-13T19:09:37.378906+0000","last_clean":"2024-09-13T19:09:37.378906+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.378906+0000","last_undegraded":"2024-09-13T19:09:37.378906+0000","last_fullsized":"2024-09-13T19:09:37.378906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:43.618866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.383880+0000","last_change":"2024-09-13T19:06:21.259679+0000","last_active":"2024-09-13T19:07:50.383880+0000","last_peered":"2024-09-13T19:07:50.383880+0000","last_clean":"2024-09-13T19:07:50.383880+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:07:50.383880+0000","last_undegraded":"2024-09-13T19:07:50.383880+0000","last_fullsized":"2024-09-13T19:07:50.383880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:13.988925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.722225+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:07:05.722225+0000","last_peered":"2024-09-13T19:07:05.722225+0000","last_clean":"2024-09-13T19:07:05.722225+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:07:05.722225+0000","last_undegraded":"2024-09-13T19:07:05.722225+0000","last_fullsized":"2024-09-13T19:07:05.722225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336516+0000","last_change":"2024-09-13T19:06:23.274472+0000","last_active":"2024-09-13T19:06:58.336516+0000","last_peered":"2024-09-13T19:06:58.336516+0000","last_clean":"2024-09-13T19:06:58.336516+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:06:58.336516+0000","last_undegraded":"2024-09-13T19:06:58.336516+0000","last_fullsized":"2024-09-13T19:06:58.336516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:17.488278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.661860+0000","last_change":"2024-09-13T19:06:25.301056+0000","last_active":"2024-09-13T19:10:03.661860+0000","last_peered":"2024-09-13T19:10:03.661860+0000","last_clean":"2024-09-13T19:10:03.661860+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:03.661860+0000","last_undegraded":"2024-09-13T19:10:03.661860+0000","last_fullsized":"2024-09-13T19:10:03.661860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:47.795992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329265+0000","last_change":"2024-09-13T19:06:27.294666+0000","last_active":"2024-09-13T19:06:58.329265+0000","last_peered":"2024-09-13T19:06:58.329265+0000","last_clean":"2024-09-13T19:06:58.329265+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:06:58.329265+0000","last_undegraded":"2024-09-13T19:06:58.329265+0000","last_fullsized":"2024-09-13T19:06:58.329265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.973735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000048+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:08:29.000048+0000","last_peered":"2024-09-13T19:08:29.000048+0000","last_clean":"2024-09-13T19:08:29.000048+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:08:29.000048+0000","last_undegraded":"2024-09-13T19:08:29.000048+0000","last_fullsized":"2024-09-13T19:08:29.000048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:37.935118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335394+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:06:58.335394+0000","last_peered":"2024-09-13T19:06:58.335394+0000","last_clean":"2024-09-13T19:06:58.335394+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:06:58.335394+0000","last_undegraded":"2024-09-13T19:06:58.335394+0000","last_fullsized":"2024-09-13T19:06:58.335394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.587940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333770+0000","last_change":"2024-09-13T19:06:23.248415+0000","last_active":"2024-09-13T19:06:58.333770+0000","last_peered":"2024-09-13T19:06:58.333770+0000","last_clean":"2024-09-13T19:06:58.333770+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:06:58.333770+0000","last_undegraded":"2024-09-13T19:06:58.333770+0000","last_fullsized":"2024-09-13T19:06:58.333770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.792380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.845619+0000","last_change":"2024-09-13T19:06:25.283923+0000","last_active":"2024-09-13T19:10:03.845619+0000","last_peered":"2024-09-13T19:10:03.845619+0000","last_clean":"2024-09-13T19:10:03.845619+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:03.845619+0000","last_undegraded":"2024-09-13T19:10:03.845619+0000","last_fullsized":"2024-09-13T19:10:03.845619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:12.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330187+0000","last_change":"2024-09-13T19:06:27.303955+0000","last_active":"2024-09-13T19:06:58.330187+0000","last_peered":"2024-09-13T19:06:58.330187+0000","last_clean":"2024-09-13T19:06:58.330187+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:06:58.330187+0000","last_undegraded":"2024-09-13T19:06:58.330187+0000","last_fullsized":"2024-09-13T19:06:58.330187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:14.386556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.917251+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:36.917251+0000","last_peered":"2024-09-13T19:08:36.917251+0000","last_clean":"2024-09-13T19:08:36.917251+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:36.917251+0000","last_undegraded":"2024-09-13T19:08:36.917251+0000","last_fullsized":"2024-09-13T19:08:36.917251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:57.870673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.318999+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:08:31.318999+0000","last_peered":"2024-09-13T19:08:31.318999+0000","last_clean":"2024-09-13T19:08:31.318999+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:08:31.318999+0000","last_undegraded":"2024-09-13T19:08:31.318999+0000","last_fullsized":"2024-09-13T19:08:31.318999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724569+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:07:05.724569+0000","last_peered":"2024-09-13T19:07:05.724569+0000","last_clean":"2024-09-13T19:07:05.724569+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:07:05.724569+0000","last_undegraded":"2024-09-13T19:07:05.724569+0000","last_fullsized":"2024-09-13T19:07:05.724569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337604+0000","last_change":"2024-09-13T19:06:23.257527+0000","last_active":"2024-09-13T19:06:58.337604+0000","last_peered":"2024-09-13T19:06:58.337604+0000","last_clean":"2024-09-13T19:06:58.337604+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:06:58.337604+0000","last_undegraded":"2024-09-13T19:06:58.337604+0000","last_fullsized":"2024-09-13T19:06:58.337604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:25.565333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.667527+0000","last_change":"2024-09-13T19:06:25.294450+0000","last_active":"2024-09-13T19:10:03.667527+0000","last_peered":"2024-09-13T19:10:03.667527+0000","last_clean":"2024-09-13T19:10:03.667527+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:03.667527+0000","last_undegraded":"2024-09-13T19:10:03.667527+0000","last_fullsized":"2024-09-13T19:10:03.667527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:37.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359493+0000","last_change":"2024-09-13T19:06:27.318412+0000","last_active":"2024-09-13T19:06:58.359493+0000","last_peered":"2024-09-13T19:06:58.359493+0000","last_clean":"2024-09-13T19:06:58.359493+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:06:58.359493+0000","last_undegraded":"2024-09-13T19:06:58.359493+0000","last_fullsized":"2024-09-13T19:06:58.359493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335274+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:06:58.335274+0000","last_peered":"2024-09-13T19:06:58.335274+0000","last_clean":"2024-09-13T19:06:58.335274+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:06:58.335274+0000","last_undegraded":"2024-09-13T19:06:58.335274+0000","last_fullsized":"2024-09-13T19:06:58.335274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:55.890196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.122252+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:08:37.122252+0000","last_peered":"2024-09-13T19:08:37.122252+0000","last_clean":"2024-09-13T19:08:37.122252+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:08:37.122252+0000","last_undegraded":"2024-09-13T19:08:37.122252+0000","last_fullsized":"2024-09-13T19:08:37.122252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.738508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724550+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:07:05.724550+0000","last_peered":"2024-09-13T19:07:05.724550+0000","last_clean":"2024-09-13T19:07:05.724550+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:07:05.724550+0000","last_undegraded":"2024-09-13T19:07:05.724550+0000","last_fullsized":"2024-09-13T19:07:05.724550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"25'1","reported_seq":220,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.487441+0000","last_change":"2024-09-13T19:06:23.260000+0000","last_active":"2024-09-13T19:10:03.487441+0000","last_peered":"2024-09-13T19:10:03.487441+0000","last_clean":"2024-09-13T19:10:03.487441+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:03.487441+0000","last_undegraded":"2024-09-13T19:10:03.487441+0000","last_fullsized":"2024-09-13T19:10:03.487441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.210958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.827796+0000","last_change":"2024-09-13T19:06:25.266493+0000","last_active":"2024-09-13T19:10:03.827796+0000","last_peered":"2024-09-13T19:10:03.827796+0000","last_clean":"2024-09-13T19:10:03.827796+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:03.827796+0000","last_undegraded":"2024-09-13T19:10:03.827796+0000","last_fullsized":"2024-09-13T19:10:03.827796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:30.843285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331097+0000","last_change":"2024-09-13T19:06:27.282770+0000","last_active":"2024-09-13T19:06:58.331097+0000","last_peered":"2024-09-13T19:06:58.331097+0000","last_clean":"2024-09-13T19:06:58.331097+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:06:58.331097+0000","last_undegraded":"2024-09-13T19:06:58.331097+0000","last_fullsized":"2024-09-13T19:06:58.331097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:40.940281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.927729+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:37.927729+0000","last_peered":"2024-09-13T19:09:37.927729+0000","last_clean":"2024-09-13T19:09:37.927729+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:37.927729+0000","last_undegraded":"2024-09-13T19:09:37.927729+0000","last_fullsized":"2024-09-13T19:09:37.927729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:02.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040188+0000","last_change":"2024-09-13T19:06:21.255465+0000","last_active":"2024-09-13T19:09:38.040188+0000","last_peered":"2024-09-13T19:09:38.040188+0000","last_clean":"2024-09-13T19:09:38.040188+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:09:38.040188+0000","last_undegraded":"2024-09-13T19:09:38.040188+0000","last_fullsized":"2024-09-13T19:09:38.040188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.833948+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.833948+0000","last_peered":"2024-09-13T19:09:37.833948+0000","last_clean":"2024-09-13T19:09:37.833948+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.833948+0000","last_undegraded":"2024-09-13T19:09:37.833948+0000","last_fullsized":"2024-09-13T19:09:37.833948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.989504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359878+0000","last_change":"2024-09-13T19:06:23.268155+0000","last_active":"2024-09-13T19:06:58.359878+0000","last_peered":"2024-09-13T19:06:58.359878+0000","last_clean":"2024-09-13T19:06:58.359878+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:06:58.359878+0000","last_undegraded":"2024-09-13T19:06:58.359878+0000","last_fullsized":"2024-09-13T19:06:58.359878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:03.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351172+0000","last_change":"2024-09-13T19:06:25.299007+0000","last_active":"2024-09-13T19:06:58.351172+0000","last_peered":"2024-09-13T19:06:58.351172+0000","last_clean":"2024-09-13T19:06:58.351172+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:06:58.351172+0000","last_undegraded":"2024-09-13T19:06:58.351172+0000","last_fullsized":"2024-09-13T19:06:58.351172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:41.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.522595+0000","last_change":"2024-09-13T19:06:27.327682+0000","last_active":"2024-09-13T19:10:03.522595+0000","last_peered":"2024-09-13T19:10:03.522595+0000","last_clean":"2024-09-13T19:10:03.522595+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:03.522595+0000","last_undegraded":"2024-09-13T19:10:03.522595+0000","last_fullsized":"2024-09-13T19:10:03.522595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:21.374194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334429+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:06:58.334429+0000","last_peered":"2024-09-13T19:06:58.334429+0000","last_clean":"2024-09-13T19:06:58.334429+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:06:58.334429+0000","last_undegraded":"2024-09-13T19:06:58.334429+0000","last_fullsized":"2024-09-13T19:06:58.334429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:51.144768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.656707+0000","last_change":"2024-09-13T19:06:21.254380+0000","last_active":"2024-09-13T19:07:50.656707+0000","last_peered":"2024-09-13T19:07:50.656707+0000","last_clean":"2024-09-13T19:07:50.656707+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:07:50.656707+0000","last_undegraded":"2024-09-13T19:07:50.656707+0000","last_fullsized":"2024-09-13T19:07:50.656707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.222552+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.222552+0000","last_peered":"2024-09-13T19:09:38.222552+0000","last_clean":"2024-09-13T19:09:38.222552+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.222552+0000","last_undegraded":"2024-09-13T19:09:38.222552+0000","last_fullsized":"2024-09-13T19:09:38.222552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340885+0000","last_change":"2024-09-13T19:06:23.273729+0000","last_active":"2024-09-13T19:06:58.340885+0000","last_peered":"2024-09-13T19:06:58.340885+0000","last_clean":"2024-09-13T19:06:58.340885+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:06:58.340885+0000","last_undegraded":"2024-09-13T19:06:58.340885+0000","last_fullsized":"2024-09-13T19:06:58.340885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.611514+0000","last_change":"2024-09-13T19:06:25.276088+0000","last_active":"2024-09-13T19:10:03.611514+0000","last_peered":"2024-09-13T19:10:03.611514+0000","last_clean":"2024-09-13T19:10:03.611514+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:03.611514+0000","last_undegraded":"2024-09-13T19:10:03.611514+0000","last_fullsized":"2024-09-13T19:10:03.611514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:19.360900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326495+0000","last_change":"2024-09-13T19:06:27.298155+0000","last_active":"2024-09-13T19:06:58.326495+0000","last_peered":"2024-09-13T19:06:58.326495+0000","last_clean":"2024-09-13T19:06:58.326495+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:06:58.326495+0000","last_undegraded":"2024-09-13T19:06:58.326495+0000","last_fullsized":"2024-09-13T19:06:58.326495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359715+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:06:58.359715+0000","last_peered":"2024-09-13T19:06:58.359715+0000","last_clean":"2024-09-13T19:06:58.359715+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:06:58.359715+0000","last_undegraded":"2024-09-13T19:06:58.359715+0000","last_fullsized":"2024-09-13T19:06:58.359715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040383+0000","last_change":"2024-09-13T19:06:21.253912+0000","last_active":"2024-09-13T19:09:38.040383+0000","last_peered":"2024-09-13T19:09:38.040383+0000","last_clean":"2024-09-13T19:09:38.040383+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:09:38.040383+0000","last_undegraded":"2024-09-13T19:09:38.040383+0000","last_fullsized":"2024-09-13T19:09:38.040383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.709655+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:36.709655+0000","last_peered":"2024-09-13T19:08:36.709655+0000","last_clean":"2024-09-13T19:08:36.709655+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:36.709655+0000","last_undegraded":"2024-09-13T19:08:36.709655+0000","last_fullsized":"2024-09-13T19:08:36.709655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:48.191162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331581+0000","last_change":"2024-09-13T19:06:23.249406+0000","last_active":"2024-09-13T19:06:58.331581+0000","last_peered":"2024-09-13T19:06:58.331581+0000","last_clean":"2024-09-13T19:06:58.331581+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:06:58.331581+0000","last_undegraded":"2024-09-13T19:06:58.331581+0000","last_fullsized":"2024-09-13T19:06:58.331581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:04.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.621212+0000","last_change":"2024-09-13T19:06:25.266112+0000","last_active":"2024-09-13T19:10:03.621212+0000","last_peered":"2024-09-13T19:10:03.621212+0000","last_clean":"2024-09-13T19:10:03.621212+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:03.621212+0000","last_undegraded":"2024-09-13T19:10:03.621212+0000","last_fullsized":"2024-09-13T19:10:03.621212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:56.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335590+0000","last_change":"2024-09-13T19:06:27.315327+0000","last_active":"2024-09-13T19:06:58.335590+0000","last_peered":"2024-09-13T19:06:58.335590+0000","last_clean":"2024-09-13T19:06:58.335590+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:06:58.335590+0000","last_undegraded":"2024-09-13T19:06:58.335590+0000","last_fullsized":"2024-09-13T19:06:58.335590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:49.675039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.040455+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:07:08.040455+0000","last_peered":"2024-09-13T19:07:08.040455+0000","last_clean":"2024-09-13T19:07:08.040455+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:07:08.040455+0000","last_undegraded":"2024-09-13T19:07:08.040455+0000","last_fullsized":"2024-09-13T19:07:08.040455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:46.491796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.331808+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:08:31.331808+0000","last_peered":"2024-09-13T19:08:31.331808+0000","last_clean":"2024-09-13T19:08:31.331808+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:08:31.331808+0000","last_undegraded":"2024-09-13T19:08:31.331808+0000","last_fullsized":"2024-09-13T19:08:31.331808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:41.004998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333723+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:06:58.333723+0000","last_peered":"2024-09-13T19:06:58.333723+0000","last_clean":"2024-09-13T19:06:58.333723+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:06:58.333723+0000","last_undegraded":"2024-09-13T19:06:58.333723+0000","last_fullsized":"2024-09-13T19:06:58.333723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342542+0000","last_change":"2024-09-13T19:06:23.259969+0000","last_active":"2024-09-13T19:06:58.342542+0000","last_peered":"2024-09-13T19:06:58.342542+0000","last_clean":"2024-09-13T19:06:58.342542+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:06:58.342542+0000","last_undegraded":"2024-09-13T19:06:58.342542+0000","last_fullsized":"2024-09-13T19:06:58.342542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.810545+0000","last_change":"2024-09-13T19:06:25.289764+0000","last_active":"2024-09-13T19:10:03.810545+0000","last_peered":"2024-09-13T19:10:03.810545+0000","last_clean":"2024-09-13T19:10:03.810545+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:03.810545+0000","last_undegraded":"2024-09-13T19:10:03.810545+0000","last_fullsized":"2024-09-13T19:10:03.810545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.324875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336001+0000","last_change":"2024-09-13T19:06:27.319266+0000","last_active":"2024-09-13T19:06:58.336001+0000","last_peered":"2024-09-13T19:06:58.336001+0000","last_clean":"2024-09-13T19:06:58.336001+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:06:58.336001+0000","last_undegraded":"2024-09-13T19:06:58.336001+0000","last_fullsized":"2024-09-13T19:06:58.336001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:43.390934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.046344+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.046344+0000","last_peered":"2024-09-13T19:09:38.046344+0000","last_clean":"2024-09-13T19:09:38.046344+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.046344+0000","last_undegraded":"2024-09-13T19:09:38.046344+0000","last_fullsized":"2024-09-13T19:09:38.046344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:45.313091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.272488+0000","last_change":"2024-09-13T19:06:21.251997+0000","last_active":"2024-09-13T19:09:38.272488+0000","last_peered":"2024-09-13T19:09:38.272488+0000","last_clean":"2024-09-13T19:09:38.272488+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:09:38.272488+0000","last_undegraded":"2024-09-13T19:09:38.272488+0000","last_fullsized":"2024-09-13T19:09:38.272488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:59.294405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359505+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:06:58.359505+0000","last_peered":"2024-09-13T19:06:58.359505+0000","last_clean":"2024-09-13T19:06:58.359505+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:06:58.359505+0000","last_undegraded":"2024-09-13T19:06:58.359505+0000","last_fullsized":"2024-09-13T19:06:58.359505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.875646+0000","last_change":"2024-09-13T19:06:23.274237+0000","last_active":"2024-09-13T19:08:31.875646+0000","last_peered":"2024-09-13T19:08:31.875646+0000","last_clean":"2024-09-13T19:08:31.875646+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:08:31.875646+0000","last_undegraded":"2024-09-13T19:08:31.875646+0000","last_fullsized":"2024-09-13T19:08:31.875646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.993135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.835389+0000","last_change":"2024-09-13T19:06:25.303807+0000","last_active":"2024-09-13T19:10:03.835389+0000","last_peered":"2024-09-13T19:10:03.835389+0000","last_clean":"2024-09-13T19:10:03.835389+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:03.835389+0000","last_undegraded":"2024-09-13T19:10:03.835389+0000","last_fullsized":"2024-09-13T19:10:03.835389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:40.599519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327617+0000","last_change":"2024-09-13T19:06:27.299682+0000","last_active":"2024-09-13T19:06:58.327617+0000","last_peered":"2024-09-13T19:06:58.327617+0000","last_clean":"2024-09-13T19:06:58.327617+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:06:58.327617+0000","last_undegraded":"2024-09-13T19:06:58.327617+0000","last_fullsized":"2024-09-13T19:06:58.327617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.813468+0000","last_change":"2024-09-13T19:06:29.310143+0000","last_active":"2024-09-13T19:08:33.813468+0000","last_peered":"2024-09-13T19:08:33.813468+0000","last_clean":"2024-09-13T19:08:33.813468+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:08:33.813468+0000","last_undegraded":"2024-09-13T19:08:33.813468+0000","last_fullsized":"2024-09-13T19:08:33.813468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:12.690041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.275471+0000","last_change":"2024-09-13T19:06:21.260509+0000","last_active":"2024-09-13T19:09:38.275471+0000","last_peered":"2024-09-13T19:09:38.275471+0000","last_clean":"2024-09-13T19:09:38.275471+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:09:38.275471+0000","last_undegraded":"2024-09-13T19:09:38.275471+0000","last_fullsized":"2024-09-13T19:09:38.275471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:30.336072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327522+0000","last_change":"2024-09-13T19:06:19.270097+0000","last_active":"2024-09-13T19:06:58.327522+0000","last_peered":"2024-09-13T19:06:58.327522+0000","last_clean":"2024-09-13T19:06:58.327522+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:06:58.327522+0000","last_undegraded":"2024-09-13T19:06:58.327522+0000","last_fullsized":"2024-09-13T19:06:58.327522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.966727+0000","last_change":"2024-09-13T19:06:21.255097+0000","last_active":"2024-09-13T19:07:06.966727+0000","last_peered":"2024-09-13T19:07:06.966727+0000","last_clean":"2024-09-13T19:07:06.966727+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:07:06.966727+0000","last_undegraded":"2024-09-13T19:07:06.966727+0000","last_fullsized":"2024-09-13T19:07:06.966727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.750144+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:09:37.750144+0000","last_peered":"2024-09-13T19:09:37.750144+0000","last_clean":"2024-09-13T19:09:37.750144+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:09:37.750144+0000","last_undegraded":"2024-09-13T19:09:37.750144+0000","last_fullsized":"2024-09-13T19:09:37.750144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.881877+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:09:37.881877+0000","last_peered":"2024-09-13T19:09:37.881877+0000","last_clean":"2024-09-13T19:09:37.881877+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:09:37.881877+0000","last_undegraded":"2024-09-13T19:09:37.881877+0000","last_fullsized":"2024-09-13T19:09:37.881877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:14.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.302528+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:07:07.302528+0000","last_peered":"2024-09-13T19:07:07.302528+0000","last_clean":"2024-09-13T19:07:07.302528+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:07:07.302528+0000","last_undegraded":"2024-09-13T19:07:07.302528+0000","last_fullsized":"2024-09-13T19:07:07.302528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:57.289705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329300+0000","last_change":"2024-09-13T19:06:21.255692+0000","last_active":"2024-09-13T19:06:58.329300+0000","last_peered":"2024-09-13T19:06:58.329300+0000","last_clean":"2024-09-13T19:06:58.329300+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:06:58.329300+0000","last_undegraded":"2024-09-13T19:06:58.329300+0000","last_fullsized":"2024-09-13T19:06:58.329300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.441511+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:09:38.441511+0000","last_peered":"2024-09-13T19:09:38.441511+0000","last_clean":"2024-09-13T19:09:38.441511+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:09:38.441511+0000","last_undegraded":"2024-09-13T19:09:38.441511+0000","last_fullsized":"2024-09-13T19:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:20.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.502701+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:07:06.502701+0000","last_peered":"2024-09-13T19:07:06.502701+0000","last_clean":"2024-09-13T19:07:06.502701+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:07:06.502701+0000","last_undegraded":"2024-09-13T19:07:06.502701+0000","last_fullsized":"2024-09-13T19:07:06.502701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:31.414170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.683930+0000","last_change":"2024-09-13T19:06:19.281225+0000","last_active":"2024-09-13T19:09:37.683930+0000","last_peered":"2024-09-13T19:09:37.683930+0000","last_clean":"2024-09-13T19:09:37.683930+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:09:37.683930+0000","last_undegraded":"2024-09-13T19:09:37.683930+0000","last_fullsized":"2024-09-13T19:09:37.683930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.043438+0000","last_change":"2024-09-13T19:06:21.264248+0000","last_active":"2024-09-13T19:09:38.043438+0000","last_peered":"2024-09-13T19:09:38.043438+0000","last_clean":"2024-09-13T19:09:38.043438+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:09:38.043438+0000","last_undegraded":"2024-09-13T19:09:38.043438+0000","last_fullsized":"2024-09-13T19:09:38.043438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.360068+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:06:58.360068+0000","last_peered":"2024-09-13T19:06:58.360068+0000","last_clean":"2024-09-13T19:06:58.360068+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:06:58.360068+0000","last_undegraded":"2024-09-13T19:06:58.360068+0000","last_fullsized":"2024-09-13T19:06:58.360068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.456067+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:09:38.456067+0000","last_peered":"2024-09-13T19:09:38.456067+0000","last_clean":"2024-09-13T19:09:38.456067+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:09:38.456067+0000","last_undegraded":"2024-09-13T19:09:38.456067+0000","last_fullsized":"2024-09-13T19:09:38.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345491+0000","last_change":"2024-09-13T19:06:19.271992+0000","last_active":"2024-09-13T19:06:58.345491+0000","last_peered":"2024-09-13T19:06:58.345491+0000","last_clean":"2024-09-13T19:06:58.345491+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:06:58.345491+0000","last_undegraded":"2024-09-13T19:06:58.345491+0000","last_fullsized":"2024-09-13T19:06:58.345491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885011+0000","last_change":"2024-09-13T19:06:21.262337+0000","last_active":"2024-09-13T19:09:37.885011+0000","last_peered":"2024-09-13T19:09:37.885011+0000","last_clean":"2024-09-13T19:09:37.885011+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:09:37.885011+0000","last_undegraded":"2024-09-13T19:09:37.885011+0000","last_fullsized":"2024-09-13T19:09:37.885011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334715+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:06:58.334715+0000","last_peered":"2024-09-13T19:06:58.334715+0000","last_clean":"2024-09-13T19:06:58.334715+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:06:58.334715+0000","last_undegraded":"2024-09-13T19:06:58.334715+0000","last_fullsized":"2024-09-13T19:06:58.334715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.464999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455975+0000","last_change":"2024-09-13T19:06:21.260793+0000","last_active":"2024-09-13T19:09:38.455975+0000","last_peered":"2024-09-13T19:09:38.455975+0000","last_clean":"2024-09-13T19:09:38.455975+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:09:38.455975+0000","last_undegraded":"2024-09-13T19:09:38.455975+0000","last_fullsized":"2024-09-13T19:09:38.455975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.288268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335859+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:06:58.335859+0000","last_peered":"2024-09-13T19:06:58.335859+0000","last_clean":"2024-09-13T19:06:58.335859+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:06:58.335859+0000","last_undegraded":"2024-09-13T19:06:58.335859+0000","last_fullsized":"2024-09-13T19:06:58.335859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:41.941513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355462+0000","last_change":"2024-09-13T19:06:21.257594+0000","last_active":"2024-09-13T19:06:58.355462+0000","last_peered":"2024-09-13T19:06:58.355462+0000","last_clean":"2024-09-13T19:06:58.355462+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:06:58.355462+0000","last_undegraded":"2024-09-13T19:06:58.355462+0000","last_fullsized":"2024-09-13T19:06:58.355462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:55.850886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327779+0000","last_change":"2024-09-13T19:06:19.278186+0000","last_active":"2024-09-13T19:06:58.327779+0000","last_peered":"2024-09-13T19:06:58.327779+0000","last_clean":"2024-09-13T19:06:58.327779+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:06:58.327779+0000","last_undegraded":"2024-09-13T19:06:58.327779+0000","last_fullsized":"2024-09-13T19:06:58.327779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992857+0000","last_change":"2024-09-13T19:06:21.240787+0000","last_active":"2024-09-13T19:08:38.992857+0000","last_peered":"2024-09-13T19:08:38.992857+0000","last_clean":"2024-09-13T19:08:38.992857+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:08:38.992857+0000","last_undegraded":"2024-09-13T19:08:38.992857+0000","last_fullsized":"2024-09-13T19:08:38.992857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351873+0000","last_change":"2024-09-13T19:06:19.283567+0000","last_active":"2024-09-13T19:06:58.351873+0000","last_peered":"2024-09-13T19:06:58.351873+0000","last_clean":"2024-09-13T19:06:58.351873+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:06:58.351873+0000","last_undegraded":"2024-09-13T19:06:58.351873+0000","last_fullsized":"2024-09-13T19:06:58.351873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002423+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:08:39.002423+0000","last_peered":"2024-09-13T19:08:39.002423+0000","last_clean":"2024-09-13T19:08:39.002423+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:08:39.002423+0000","last_undegraded":"2024-09-13T19:08:39.002423+0000","last_fullsized":"2024-09-13T19:08:39.002423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:27.206747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341998+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:06:58.341998+0000","last_peered":"2024-09-13T19:06:58.341998+0000","last_clean":"2024-09-13T19:06:58.341998+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:06:58.341998+0000","last_undegraded":"2024-09-13T19:06:58.341998+0000","last_fullsized":"2024-09-13T19:06:58.341998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255695+0000","last_change":"2024-09-13T19:06:21.256504+0000","last_active":"2024-09-13T19:09:38.255695+0000","last_peered":"2024-09-13T19:09:38.255695+0000","last_clean":"2024-09-13T19:09:38.255695+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:09:38.255695+0000","last_undegraded":"2024-09-13T19:09:38.255695+0000","last_fullsized":"2024-09-13T19:09:38.255695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344894+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:06:58.344894+0000","last_peered":"2024-09-13T19:06:58.344894+0000","last_clean":"2024-09-13T19:06:58.344894+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:06:58.344894+0000","last_undegraded":"2024-09-13T19:06:58.344894+0000","last_fullsized":"2024-09-13T19:06:58.344894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:12.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375474+0000","last_change":"2024-09-13T19:06:21.264548+0000","last_active":"2024-09-13T19:09:38.375474+0000","last_peered":"2024-09-13T19:09:38.375474+0000","last_clean":"2024-09-13T19:09:38.375474+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:09:38.375474+0000","last_undegraded":"2024-09-13T19:09:38.375474+0000","last_fullsized":"2024-09-13T19:09:38.375474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345208+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:06:58.345208+0000","last_peered":"2024-09-13T19:06:58.345208+0000","last_clean":"2024-09-13T19:06:58.345208+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:06:58.345208+0000","last_undegraded":"2024-09-13T19:06:58.345208+0000","last_fullsized":"2024-09-13T19:06:58.345208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:43.433186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255037+0000","last_change":"2024-09-13T19:06:21.261602+0000","last_active":"2024-09-13T19:09:38.255037+0000","last_peered":"2024-09-13T19:09:38.255037+0000","last_clean":"2024-09-13T19:09:38.255037+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:09:38.255037+0000","last_undegraded":"2024-09-13T19:09:38.255037+0000","last_fullsized":"2024-09-13T19:09:38.255037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:01.086124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345905+0000","last_change":"2024-09-13T19:06:19.278323+0000","last_active":"2024-09-13T19:06:58.345905+0000","last_peered":"2024-09-13T19:06:58.345905+0000","last_clean":"2024-09-13T19:06:58.345905+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:06:58.345905+0000","last_undegraded":"2024-09-13T19:06:58.345905+0000","last_fullsized":"2024-09-13T19:06:58.345905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.374634+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:09:38.374634+0000","last_peered":"2024-09-13T19:09:38.374634+0000","last_clean":"2024-09-13T19:09:38.374634+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:09:38.374634+0000","last_undegraded":"2024-09-13T19:09:38.374634+0000","last_fullsized":"2024-09-13T19:09:38.374634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.231853+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.231853+0000","last_peered":"2024-09-13T19:09:38.231853+0000","last_clean":"2024-09-13T19:09:38.231853+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.231853+0000","last_undegraded":"2024-09-13T19:09:38.231853+0000","last_fullsized":"2024-09-13T19:09:38.231853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:03.445184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.725335+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:07:05.725335+0000","last_peered":"2024-09-13T19:07:05.725335+0000","last_clean":"2024-09-13T19:07:05.725335+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:07:05.725335+0000","last_undegraded":"2024-09-13T19:07:05.725335+0000","last_fullsized":"2024-09-13T19:07:05.725335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:32.143596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.655037+0000","last_change":"2024-09-13T19:06:21.261511+0000","last_active":"2024-09-13T19:07:50.655037+0000","last_peered":"2024-09-13T19:07:50.655037+0000","last_clean":"2024-09-13T19:07:50.655037+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:07:50.655037+0000","last_undegraded":"2024-09-13T19:07:50.655037+0000","last_fullsized":"2024-09-13T19:07:50.655037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327618+0000","last_change":"2024-09-13T19:06:19.278870+0000","last_active":"2024-09-13T19:06:58.327618+0000","last_peered":"2024-09-13T19:06:58.327618+0000","last_clean":"2024-09-13T19:06:58.327618+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:06:58.327618+0000","last_undegraded":"2024-09-13T19:06:58.327618+0000","last_fullsized":"2024-09-13T19:06:58.327618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'23","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.274840+0000","last_change":"2024-09-13T19:06:21.255155+0000","last_active":"2024-09-13T19:09:38.274840+0000","last_peered":"2024-09-13T19:09:38.274840+0000","last_clean":"2024-09-13T19:09:38.274840+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:09:38.274840+0000","last_undegraded":"2024-09-13T19:09:38.274840+0000","last_fullsized":"2024-09-13T19:09:38.274840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:04.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9346959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48348,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323492,"statfs":{"total":96636764160,"available":96587255808,"internally_reserved":0,"allocated":9056256,"data_stored":8758411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:05.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T19:10:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.347+0000 7fc506e70640 1 Processor -- start 2024-09-13T19:10:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.347+0000 7fc506e70640 1 -- start start 2024-09-13T19:10:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.347+0000 7fc506e70640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc50006dbd0 0x7fc500131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.347+0000 7fc506e70640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc500071c10 con 0x7fc50006d0e0 2024-09-13T19:10:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.347+0000 7fc506e70640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc500072230 con 0x7fc50006dbd0 2024-09-13T19:10:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4fffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc50006dbd0 0x7fc500131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc504c0c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc50006d0e0 0x7fc50006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40280/0 (socket says 172.21.15.12:40280) 2024-09-13T19:10:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc504c0c640 1 -- 172.21.15.12:0/1229561408 learned_addr learned my addr 172.21.15.12:0/1229561408 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4fffff640 1 -- 172.21.15.12:0/1229561408 >> v1:172.21.15.12:6789/0 conn(0x7fc50006d0e0 legacy=0x7fc50006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4fffff640 1 -- 172.21.15.12:0/1229561408 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5000709e0 con 0x7fc50006dbd0 2024-09-13T19:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4fffff640 1 --2- 172.21.15.12:0/1229561408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006dbd0 0x7fc500131e60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009740 tx=0x7fc4f401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d401f7c44a62f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4ff7fe640 1 -- 172.21.15.12:0/1229561408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f40b0070 con 0x7fc50006dbd0 2024-09-13T19:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4ff7fe640 1 -- 172.21.15.12:0/1229561408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f40ab530 con 0x7fc50006dbd0 2024-09-13T19:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc4ff7fe640 1 -- 172.21.15.12:0/1229561408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f40ab830 con 0x7fc50006dbd0 2024-09-13T19:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 -- 172.21.15.12:0/1229561408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006dbd0 msgr2=0x7fc500131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 --2- 172.21.15.12:0/1229561408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006dbd0 0x7fc500131e60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009740 tx=0x7fc4f401c370 comp rx=0 tx=0).stop 2024-09-13T19:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 -- 172.21.15.12:0/1229561408 shutdown_connections 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 --2- 172.21.15.12:0/1229561408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006dbd0 0x7fc500131e60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 -- 172.21.15.12:0/1229561408 >> 172.21.15.12:0/1229561408 conn(0x7fc500099a50 msgr2=0x7fc5000972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 -- 172.21.15.12:0/1229561408 shutdown_connections 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.351+0000 7fc506e70640 1 -- 172.21.15.12:0/1229561408 wait complete. 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 Processor -- start 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 -- start start 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc500134d40 con 0x7fc50006d0e0 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc504c0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc504c0c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43644/0 (socket says 172.21.15.12:43644) 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc504c0c640 1 -- 172.21.15.12:0/2422579838 learned_addr learned my addr 172.21.15.12:0/2422579838 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:05.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc504c0c640 1 -- 172.21.15.12:0/2422579838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc500096e90 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc504c0c640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c480 tx=0x7fc4f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0017070 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005c20 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4f0007070 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc50006fb70 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc50008b1a0 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4f001a070 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc50006d4c0 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 0x7fc4ec038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc4f00484f0 con 0x7fc50006d0e0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.355+0000 7fc4fffff640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 0x7fc4ec038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:05.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.359+0000 7fc4fffff640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 0x7fc4ec038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40ad000 tx=0x7fc4f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:05.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.359+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4f001a760 con 0x7fc50006d0e0 2024-09-13T19:10:05.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.519+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc500072710 con 0x7fc50006d0e0 2024-09-13T19:10:05.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc4fd7fa640 1 -- 172.21.15.12:0/2422579838 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21206 (secure 0 0 0) 0x7fc4f0007210 con 0x7fc50006d0e0 2024-09-13T19:10:05.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:05.527 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"fsid":"0ec6a80a-19c9-443d-b0bf-f69600ef4862","created":"2024-09-13T19:05:52.274780+0000","modified":"2024-09-13T19:06:58.316340+0000","last_up_change":"2024-09-13T19:06:03.013143+0000","last_in_change":"2024-09-13T19:05:53.411410+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T19:06:04.971530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-13T19:06:08.067884+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-13T19:06:17.259262+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-13T19:06:19.616217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-13T19:06:21.524399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-13T19:06:23.426374+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-13T19:06:25.342562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-13T19:06:27.500103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6eb345cc-c71e-45dc-9a86-b90a714a9166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6801","nonce":3844244554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6803","nonce":3844244554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6807","nonce":3844244554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":3844244554},{"type":"v1","addr":"172.21.15.12:6805","nonce":3844244554}]},"public_addr":"172.21.15.12:6801/3844244554","cluster_addr":"172.21.15.12:6803/3844244554","heartbeat_back_addr":"172.21.15.12:6807/3844244554","heartbeat_front_addr":"172.21.15.12:6805/3844244554","state":["exists","up"]},{"osd":1,"uuid":"4214a92f-35bb-448a-8a0f-4e50ce770961","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6817","nonce":4016279334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6819","nonce":4016279334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6823","nonce":4016279334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":4016279334},{"type":"v1","addr":"172.21.15.151:6821","nonce":4016279334}]},"public_addr":"172.21.15.151:6817/4016279334","cluster_addr":"172.21.15.151:6819/4016279334","heartbeat_back_addr":"172.21.15.151:6823/4016279334","heartbeat_front_addr":"172.21.15.151:6821/4016279334","state":["exists","up"]},{"osd":2,"uuid":"4f5e1e40-7bab-4580-ba99-278403516cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6809","nonce":3546065622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6811","nonce":3546065622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6815","nonce":3546065622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":3546065622},{"type":"v1","addr":"172.21.15.151:6813","nonce":3546065622}]},"public_addr":"172.21.15.151:6809/3546065622","cluster_addr":"172.21.15.151:6811/3546065622","heartbeat_back_addr":"172.21.15.151:6815/3546065622","heartbeat_front_addr":"172.21.15.151:6813/3546065622","state":["exists","up"]},{"osd":3,"uuid":"c07cde09-7729-4895-a716-4926f111d78b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6801","nonce":3085220080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6803","nonce":3085220080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6807","nonce":3085220080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":3085220080},{"type":"v1","addr":"172.21.15.151:6805","nonce":3085220080}]},"public_addr":"172.21.15.151:6801/3085220080","cluster_addr":"172.21.15.151:6803/3085220080","heartbeat_back_addr":"172.21.15.151:6807/3085220080","heartbeat_front_addr":"172.21.15.151:6805/3085220080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.627416+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.890789+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.751149+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T19:06:00.612481+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]},{"pgid":"5.2","mappings":[{"from":0,"to":2}]},{"pgid":"5.6","mappings":[{"from":0,"to":1}]},{"pgid":"5.8","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T19:10:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 msgr2=0x7fc4ec038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 0x7fc4ec038270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40ad000 tx=0x7fc4f40a6000 comp rx=0 tx=0).stop 2024-09-13T19:10:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 msgr2=0x7fc50006e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000c480 tx=0x7fc4f000c940 comp rx=0 tx=0).stop 2024-09-13T19:10:05.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 shutdown_connections 2024-09-13T19:10:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fc4ec035db0 0x7fc4ec038270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 --2- 172.21.15.12:0/2422579838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc50006d0e0 0x7fc50006e1f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 >> 172.21.15.12:0/2422579838 conn(0x7fc500099a50 msgr2=0x7fc50012aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 shutdown_connections 2024-09-13T19:10:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:05.523+0000 7fc506e70640 1 -- 172.21.15.12:0/2422579838 wait complete. 2024-09-13T19:10:06.547 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T19:10:06.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4fe0cf640 1 Processor -- start 2024-09-13T19:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4fe0cf640 1 -- start start 2024-09-13T19:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4fe0cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4f8132090 0x7fe4f8134480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4fe0cf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4f80992b0 con 0x7fe4f8099c70 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4fe0cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f809d270 con 0x7fe4f8132090 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4f6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4f8132090 0x7fe4f8134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4f77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe4f8099c70 0x7fe4f809a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35128/0 (socket says 172.21.15.12:35128) 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4f77fe640 1 -- 172.21.15.12:0/4149308961 learned_addr learned my addr 172.21.15.12:0/4149308961 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.678+0000 7fe4f6ffd640 1 --2- 172.21.15.12:0/4149308961 >> v2:172.21.15.12:3300/0 conn(0x7fe4f8132090 0x7fe4f8134480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35266/0 (socket says 172.21.15.12:35266) 2024-09-13T19:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f67fc640 1 -- 172.21.15.12:0/4149308961 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255184609 0 0) 0x7fe4f80992b0 con 0x7fe4f8099c70 2024-09-13T19:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f67fc640 1 -- 172.21.15.12:0/4149308961 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4e0003530 con 0x7fe4f8099c70 2024-09-13T19:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f6ffd640 1 -- 172.21.15.12:0/4149308961 >> v1:172.21.15.12:6789/0 conn(0x7fe4f8099c70 legacy=0x7fe4f809a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f6ffd640 1 -- 172.21.15.12:0/4149308961 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f809a760 con 0x7fe4f8132090 2024-09-13T19:10:06.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f6ffd640 1 --2- 172.21.15.12:0/4149308961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8132090 0x7fe4f8134480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009740 tx=0x7fe4ec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48348f58c48d09be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f67fc640 1 -- 172.21.15.12:0/4149308961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4ec0b1070 con 0x7fe4f8132090 2024-09-13T19:10:06.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f67fc640 1 -- 172.21.15.12:0/4149308961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0ac520 con 0x7fe4f8132090 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4f67fc640 1 -- 172.21.15.12:0/4149308961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4ec0ac800 con 0x7fe4f8132090 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/4149308961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8132090 msgr2=0x7fe4f8134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/4149308961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8132090 0x7fe4f8134480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009740 tx=0x7fe4ec01c370 comp rx=0 tx=0).stop 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/4149308961 shutdown_connections 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/4149308961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8132090 0x7fe4f8134480 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/4149308961 >> 172.21.15.12:0/4149308961 conn(0x7fe4f806d570 msgr2=0x7fe4f806d980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/4149308961 shutdown_connections 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.682+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/4149308961 wait complete. 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 Processor -- start 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 -- start start 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f81373f0 con 0x7fe4f8099c70 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35274/0 (socket says 172.21.15.12:35274) 2024-09-13T19:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f77fe640 1 -- 172.21.15.12:0/2354345584 learned_addr learned my addr 172.21.15.12:0/2354345584 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f77fe640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f81305b0 con 0x7fe4f8099c70 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f77fe640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c3d0 tx=0x7fe4e800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8017070 con 0x7fe4f8099c70 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8005ce0 con 0x7fe4f8099c70 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f8131900 con 0x7fe4f8099c70 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4e80070d0 con 0x7fe4f8099c70 2024-09-13T19:10:06.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f8130a40 con 0x7fe4f8099c70 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4f809a050 con 0x7fe4f8099c70 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4e801a070 con 0x7fe4f8099c70 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 0x7fe4e4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe4e80485a0 con 0x7fe4f8099c70 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 0x7fe4e40446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4e8016ec0 con 0x7fe4e4042220 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe4e804f050 con 0x7fe4f8099c70 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f7fff640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 0x7fe4e40446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f6ffd640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 0x7fe4e4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.686+0000 7fe4f7fff640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 0x7fe4e40446c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.690+0000 7fe4f6ffd640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 0x7fe4e4038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009740 tx=0x7fe4ec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.690+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== osd.0 v2:172.21.15.12:6800/3844244554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4e8016ec0 con 0x7fe4e4042220 2024-09-13T19:10:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 --> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe4f8130c70 con 0x7fe4e4042220 2024-09-13T19:10:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4dffff640 1 -- 172.21.15.12:0/2354345584 <== osd.0 v2:172.21.15.12:6800/3844244554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe4f8130c70 con 0x7fe4e4042220 2024-09-13T19:10:06.708 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-13T19:10:06.709 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:10:06.709 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 msgr2=0x7fe4e40446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 0x7fe4e40446c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 msgr2=0x7fe4e4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 0x7fe4e4038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009740 tx=0x7fe4ec0a7000 comp rx=0 tx=0).stop 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 msgr2=0x7fe4f80972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c3d0 tx=0x7fe4e800c890 comp rx=0 tx=0).stop 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 shutdown_connections 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fe4e4035db0 0x7fe4e4038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:6800/3844244554,v1:172.21.15.12:6801/3844244554] conn(0x7fe4e4042220 0x7fe4e40446c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 --2- 172.21.15.12:0/2354345584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4f8099c70 0x7fe4f80972f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 >> 172.21.15.12:0/2354345584 conn(0x7fe4f806d570 msgr2=0x7fe4f809edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 shutdown_connections 2024-09-13T19:10:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.702+0000 7fe4fe0cf640 1 -- 172.21.15.12:0/2354345584 wait complete. 2024-09-13T19:10:06.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T19:10:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51c038f640 1 Processor -- start 2024-09-13T19:10:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51c038f640 1 -- start start 2024-09-13T19:10:06.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51c038f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51b812e760 0x7f51b812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51c038f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b80984f0 con 0x7f51b812f1c0 2024-09-13T19:10:06.840 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51c038f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f51b8098dc0 con 0x7f51b812e760 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51be12b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51b812e760 0x7f51b812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51bd92a640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f51b812f1c0 0x7f51b812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35140/0 (socket says 172.21.15.12:35140) 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51bd92a640 1 -- 172.21.15.12:0/2790136769 learned_addr learned my addr 172.21.15.12:0/2790136769 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51bd129640 1 -- 172.21.15.12:0/2790136769 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568919943 0 0) 0x7f51b80984f0 con 0x7f51b812f1c0 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51bd129640 1 -- 172.21.15.12:0/2790136769 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a4003530 con 0x7f51b812f1c0 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51be12b640 1 -- 172.21.15.12:0/2790136769 >> v1:172.21.15.12:6789/0 conn(0x7f51b812f1c0 legacy=0x7f51b812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.834+0000 7f51be12b640 1 -- 172.21.15.12:0/2790136769 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b812f5a0 con 0x7f51b812e760 2024-09-13T19:10:06.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51be12b640 1 --2- 172.21.15.12:0/2790136769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b812ec80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009740 tx=0x7f51b401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e061b1b2dc71f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51bd129640 1 -- 172.21.15.12:0/2790136769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b40b0070 con 0x7f51b812e760 2024-09-13T19:10:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51bd129640 1 -- 172.21.15.12:0/2790136769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b40ab530 con 0x7f51b812e760 2024-09-13T19:10:06.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51bd129640 1 -- 172.21.15.12:0/2790136769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b40ab810 con 0x7f51b812e760 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- 172.21.15.12:0/2790136769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 msgr2=0x7f51b812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 --2- 172.21.15.12:0/2790136769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b812ec80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009740 tx=0x7f51b401c400 comp rx=0 tx=0).stop 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- 172.21.15.12:0/2790136769 shutdown_connections 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 --2- 172.21.15.12:0/2790136769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b812ec80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- 172.21.15.12:0/2790136769 >> 172.21.15.12:0/2790136769 conn(0x7f51b80a10a0 msgr2=0x7f51b80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- 172.21.15.12:0/2790136769 shutdown_connections 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- 172.21.15.12:0/2790136769 wait complete. 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 Processor -- start 2024-09-13T19:10:06.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- start start 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51c038f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f51b8136e30 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51be12b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51be12b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35288/0 (socket says 172.21.15.12:35288) 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.838+0000 7f51be12b640 1 -- 172.21.15.12:0/2772781071 learned_addr learned my addr 172.21.15.12:0/2772781071 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51be12b640 1 -- 172.21.15.12:0/2772781071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b809e490 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51be12b640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f51b401a030 tx=0x7f51b401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b40b0050 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b40b1040 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b81321a0 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51b40b75a0 con 0x7f51b812e760 2024-09-13T19:10:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b809dc00 con 0x7f51b812e760 2024-09-13T19:10:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b8131550 con 0x7f51b812e760 2024-09-13T19:10:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51b40be030 con 0x7f51b812e760 2024-09-13T19:10:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 0x7f519c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f51b40bc070 con 0x7f51b812e760 2024-09-13T19:10:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51bd92a640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 0x7f519c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.842+0000 7f51bd92a640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 0x7f519c038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007fd0 tx=0x7f51a8007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:06.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:06.846+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f51b40c5060 con 0x7f51b812e760 2024-09-13T19:10:07.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.010+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f51b81317f0 con 0x7f519c035db0 2024-09-13T19:10:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.010+0000 7f51aeffd640 1 -- 172.21.15.12:0/2772781071 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f51a80058c0 con 0x7f519c035db0 2024-09-13T19:10:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T19:10:07.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 msgr2=0x7f519c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 0x7f519c038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007fd0 tx=0x7f51a8007980 comp rx=0 tx=0).stop 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 msgr2=0x7f51b81c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f51b401a030 tx=0x7f51b401ac40 comp rx=0 tx=0).stop 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 shutdown_connections 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f519c035db0 0x7f519c038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 --2- 172.21.15.12:0/2772781071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b812e760 0x7f51b81c64a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 >> 172.21.15.12:0/2772781071 conn(0x7f51b80a10a0 msgr2=0x7f51b812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 shutdown_connections 2024-09-13T19:10:07.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.014+0000 7f51c038f640 1 -- 172.21.15.12:0/2772781071 wait complete. 2024-09-13T19:10:07.035 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T19:10:07.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:10:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f193c1c5640 1 Processor -- start 2024-09-13T19:10:07.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f193c1c5640 1 -- start start 2024-09-13T19:10:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f193c1c5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19341281c0 0x7f19341285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f193c1c5640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1934098840 con 0x7f1934128ae0 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f193c1c5640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f193406f7b0 con 0x7f19341281c0 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f1939f61640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19341281c0 0x7f19341285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f1939760640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1934128ae0 0x7f193406e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35146/0 (socket says 172.21.15.12:35146) 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f1939760640 1 -- 172.21.15.12:0/3815806152 learned_addr learned my addr 172.21.15.12:0/3815806152 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f1939f61640 1 -- 172.21.15.12:0/3815806152 >> v1:172.21.15.12:6789/0 conn(0x7f1934128ae0 legacy=0x7f193406e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.146+0000 7f1939f61640 1 -- 172.21.15.12:0/3815806152 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1934127fa0 con 0x7f19341281c0 2024-09-13T19:10:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1939f61640 1 --2- 172.21.15.12:0/3815806152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f19341285a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f193000ba10 tx=0x7f193001e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08c2094fd31107a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1938f5f640 1 -- 172.21.15.12:0/3815806152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19300b4070 con 0x7f19341281c0 2024-09-13T19:10:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1938f5f640 1 -- 172.21.15.12:0/3815806152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300a78c0 con 0x7f19341281c0 2024-09-13T19:10:07.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1938f5f640 1 -- 172.21.15.12:0/3815806152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19300a7bc0 con 0x7f19341281c0 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- 172.21.15.12:0/3815806152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 msgr2=0x7f19341285a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3815806152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f19341285a0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f193000ba10 tx=0x7f193001e9e0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- 172.21.15.12:0/3815806152 shutdown_connections 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3815806152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f19341285a0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- 172.21.15.12:0/3815806152 >> 172.21.15.12:0/3815806152 conn(0x7f19340998a0 msgr2=0x7f1934099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- 172.21.15.12:0/3815806152 shutdown_connections 2024-09-13T19:10:07.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- 172.21.15.12:0/3815806152 wait complete. 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 Processor -- start 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- start start 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f193c1c5640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f193406d2f0 con 0x7f19341281c0 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1939f61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1939f61640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35306/0 (socket says 172.21.15.12:35306) 2024-09-13T19:10:07.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.150+0000 7f1939f61640 1 -- 172.21.15.12:0/3444760038 learned_addr learned my addr 172.21.15.12:0/3444760038 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f1939f61640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1934130ea0 con 0x7f19341281c0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f1939f61640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f19300b2040 tx=0x7f193001b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19300b4040 con 0x7f19341281c0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300af730 con 0x7f19341281c0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1934125b80 con 0x7f19341281c0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19300afa10 con 0x7f19341281c0 2024-09-13T19:10:07.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1934130a00 con 0x7f19341281c0 2024-09-13T19:10:07.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f19341285a0 con 0x7f19341281c0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f19300afbb0 con 0x7f19341281c0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 0x7f1918038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f19300e3870 con 0x7f19341281c0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 0x7f19180446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19300b5e50 con 0x7f1918042220 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f19300ea050 con 0x7f19341281c0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f1939760640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 0x7f1918038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f193a762640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 0x7f19180446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f193a762640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 0x7f19180446c0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.154+0000 7f1939760640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 0x7f1918038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f70 tx=0x7f1924007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.158+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== osd.1 v2:172.21.15.151:6816/4016279334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f19300b5e50 con 0x7f1918042220 2024-09-13T19:10:07.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 --> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1934128ae0 con 0x7f1918042220 2024-09-13T19:10:07.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f192a7fc640 1 -- 172.21.15.12:0/3444760038 <== osd.1 v2:172.21.15.151:6816/4016279334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1934128ae0 con 0x7f1918042220 2024-09-13T19:10:07.176 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-13T19:10:07.177 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:10:07.177 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 msgr2=0x7f19180446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 0x7f19180446c0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 msgr2=0x7f1918038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 0x7f1918038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f70 tx=0x7f1924007a90 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 msgr2=0x7f193408afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f19300b2040 tx=0x7f193001b7e0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 shutdown_connections 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1918035db0 0x7f1918038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.151:6816/4016279334,v1:172.21.15.151:6817/4016279334] conn(0x7f1918042220 0x7f19180446c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 --2- 172.21.15.12:0/3444760038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19341281c0 0x7f193408afd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 >> 172.21.15.12:0/3444760038 conn(0x7f19340998a0 msgr2=0x7f193409b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 shutdown_connections 2024-09-13T19:10:07.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.170+0000 7f193c1c5640 1 -- 172.21.15.12:0/3444760038 wait complete. 2024-09-13T19:10:07.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2ccd4f8640 1 Processor -- start 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2ccd4f8640 1 -- start start 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2ccd4f8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2cc806dbd0 0x7f2cc8131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2ccd4f8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc8071c10 con 0x7f2cc806d0e0 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2ccd4f8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc8072230 con 0x7f2cc806dbd0 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2cc806d0e0 0x7f2cc806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35160/0 (socket says 172.21.15.12:35160) 2024-09-13T19:10:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc6ffd640 1 -- 172.21.15.12:0/1274898049 learned_addr learned my addr 172.21.15.12:0/1274898049 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:07.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc67fc640 1 --2- 172.21.15.12:0/1274898049 >> v2:172.21.15.12:3300/0 conn(0x7f2cc806dbd0 0x7f2cc8131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc5ffb640 1 -- 172.21.15.12:0/1274898049 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192023663 0 0) 0x7f2cc8071c10 con 0x7f2cc806d0e0 2024-09-13T19:10:07.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc5ffb640 1 -- 172.21.15.12:0/1274898049 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb0003530 con 0x7f2cc806d0e0 2024-09-13T19:10:07.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc67fc640 1 -- 172.21.15.12:0/1274898049 >> v1:172.21.15.12:6789/0 conn(0x7f2cc806d0e0 legacy=0x7f2cc806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc67fc640 1 -- 172.21.15.12:0/1274898049 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc80709e0 con 0x7f2cc806dbd0 2024-09-13T19:10:07.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc67fc640 1 --2- 172.21.15.12:0/1274898049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806dbd0 0x7f2cc8131e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009740 tx=0x7f2cb801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6709b377bfda095 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc5ffb640 1 -- 172.21.15.12:0/1274898049 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80b0070 con 0x7f2cc806dbd0 2024-09-13T19:10:07.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc5ffb640 1 -- 172.21.15.12:0/1274898049 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb80ab530 con 0x7f2cc806dbd0 2024-09-13T19:10:07.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.298+0000 7f2cc5ffb640 1 -- 172.21.15.12:0/1274898049 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cb80ab830 con 0x7f2cc806dbd0 2024-09-13T19:10:07.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/1274898049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806dbd0 msgr2=0x7f2cc8131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/1274898049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806dbd0 0x7f2cc8131e60 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8009740 tx=0x7f2cb801c370 comp rx=0 tx=0).stop 2024-09-13T19:10:07.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/1274898049 shutdown_connections 2024-09-13T19:10:07.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/1274898049 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806dbd0 0x7f2cc8131e60 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/1274898049 >> 172.21.15.12:0/1274898049 conn(0x7f2cc8099a50 msgr2=0x7f2cc80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/1274898049 shutdown_connections 2024-09-13T19:10:07.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/1274898049 wait complete. 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 Processor -- start 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- start start 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc8134d40 con 0x7f2cc806d0e0 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2cc6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35330/0 (socket says 172.21.15.12:35330) 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2cc6ffd640 1 -- 172.21.15.12:0/2845112907 learned_addr learned my addr 172.21.15.12:0/2845112907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:07.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2cc6ffd640 1 -- 172.21.15.12:0/2845112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc8094290 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2cc6ffd640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c450 tx=0x7f2cbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc017070 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cbc005c20 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc8095250 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2cbc007070 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc8095690 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2cbc01a070 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc806d4c0 con 0x7f2cc806d0e0 2024-09-13T19:10:07.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 0x7f2cb4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.302+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2cbc048420 con 0x7f2cc806d0e0 2024-09-13T19:10:07.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.306+0000 7f2cc67fc640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 0x7f2cb4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.306+0000 7f2cc67fc640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 0x7f2cb4038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80ad000 tx=0x7f2cb80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.310+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2cbc01ac10 con 0x7f2cc806d0e0 2024-09-13T19:10:07.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.462+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2cc8073790 con 0x7f2cb4035db0 2024-09-13T19:10:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2caf7fe640 1 -- 172.21.15.12:0/2845112907 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2cc8073790 con 0x7f2cb4035db0 2024-09-13T19:10:07.470 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T19:10:07.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 msgr2=0x7f2cb4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 0x7f2cb4038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80ad000 tx=0x7f2cb80a6000 comp rx=0 tx=0).stop 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 msgr2=0x7f2cc8092090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00c450 tx=0x7f2cbc00c910 comp rx=0 tx=0).stop 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 shutdown_connections 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f2cb4035db0 0x7f2cb4038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 --2- 172.21.15.12:0/2845112907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cc806d0e0 0x7f2cc8092090 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 >> 172.21.15.12:0/2845112907 conn(0x7f2cc8099a50 msgr2=0x7f2cc808afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 shutdown_connections 2024-09-13T19:10:07.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.466+0000 7f2ccd4f8640 1 -- 172.21.15.12:0/2845112907 wait complete. 2024-09-13T19:10:07.487 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T19:10:07.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:10:07.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd583515640 1 Processor -- start 2024-09-13T19:10:07.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd583515640 1 -- start start 2024-09-13T19:10:07.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd583515640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd57c06d170 0x7fd57c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd583515640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd57c098840 con 0x7fd57c06da90 2024-09-13T19:10:07.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd583515640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd57c0709c0 con 0x7fd57c06d170 2024-09-13T19:10:07.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd5812b1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd57c06d170 0x7fd57c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd580ab0640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd57c06da90 0x7fd57c130b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35172/0 (socket says 172.21.15.12:35172) 2024-09-13T19:10:07.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd580ab0640 1 -- 172.21.15.12:0/290768813 learned_addr learned my addr 172.21.15.12:0/290768813 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd5812b1640 1 -- 172.21.15.12:0/290768813 >> v1:172.21.15.12:6789/0 conn(0x7fd57c06da90 legacy=0x7fd57c130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.598+0000 7fd5812b1640 1 -- 172.21.15.12:0/290768813 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c071e20 con 0x7fd57c06d170 2024-09-13T19:10:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 --2- 172.21.15.12:0/290768813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c06d550 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009740 tx=0x7fd56c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c9d1e63ec0588d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd57bfff640 1 -- 172.21.15.12:0/290768813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0b0070 con 0x7fd57c06d170 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd57bfff640 1 -- 172.21.15.12:0/290768813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c0ab530 con 0x7fd57c06d170 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd57bfff640 1 -- 172.21.15.12:0/290768813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0ab830 con 0x7fd57c06d170 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/290768813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 msgr2=0x7fd57c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 --2- 172.21.15.12:0/290768813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c06d550 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd56c009740 tx=0x7fd56c01c370 comp rx=0 tx=0).stop 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/290768813 shutdown_connections 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 --2- 172.21.15.12:0/290768813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c06d550 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/290768813 >> 172.21.15.12:0/290768813 conn(0x7fd57c0998a0 msgr2=0x7fd57c099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/290768813 shutdown_connections 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/290768813 wait complete. 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 Processor -- start 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- start start 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd57c134bf0 con 0x7fd57c06d170 2024-09-13T19:10:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35336/0 (socket says 172.21.15.12:35336) 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 -- 172.21.15.12:0/3931364957 learned_addr learned my addr 172.21.15.12:0/3931364957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd57c095110 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd5812b1640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd56c019fa0 tx=0x7fd56c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0b0050 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd56c0b1040 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c123c70 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd56c0b5740 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd57c1240b0 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd57c06d550 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.602+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd56c0be030 con 0x7fd57c06d170 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 0x7fd568038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd56c0bc070 con 0x7fd57c06d170 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 0x7fd5680446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd56c0bde80 con 0x7fd568042220 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd56c0ea050 con 0x7fd57c06d170 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd580ab0640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 0x7fd568038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd581ab2640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 0x7fd5680446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd580ab0640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 0x7fd568038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd570002090 tx=0x7fd570001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd581ab2640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 0x7fd5680446c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.606+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== osd.2 v2:172.21.15.151:6808/3546065622 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd56c0bde80 con 0x7fd568042220 2024-09-13T19:10:07.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.618+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 --> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd57c122cb0 con 0x7fd568042220 2024-09-13T19:10:07.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd579ffb640 1 -- 172.21.15.12:0/3931364957 <== osd.2 v2:172.21.15.151:6808/3546065622 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd57c122cb0 con 0x7fd568042220 2024-09-13T19:10:07.627 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-13T19:10:07.627 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:10:07.628 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-13T19:10:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 msgr2=0x7fd5680446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 0x7fd5680446c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 msgr2=0x7fd568038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 0x7fd568038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd570002090 tx=0x7fd570001680 comp rx=0 tx=0).stop 2024-09-13T19:10:07.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 msgr2=0x7fd57c121a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd56c019fa0 tx=0x7fd56c01abb0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 shutdown_connections 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6808/3546065622,v1:172.21.15.151:6809/3546065622] conn(0x7fd568042220 0x7fd5680446c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fd568035db0 0x7fd568038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 --2- 172.21.15.12:0/3931364957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57c06d170 0x7fd57c121a60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 >> 172.21.15.12:0/3931364957 conn(0x7fd57c0998a0 msgr2=0x7fd57c09bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 shutdown_connections 2024-09-13T19:10:07.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.622+0000 7fd583515640 1 -- 172.21.15.12:0/3931364957 wait complete. 2024-09-13T19:10:07.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T19:10:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc1a8e7640 1 Processor -- start 2024-09-13T19:10:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc1a8e7640 1 -- start start 2024-09-13T19:10:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc1a8e7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc1412e760 0x7fdc1412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc1a8e7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc140984f0 con 0x7fdc1412f1c0 2024-09-13T19:10:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc1a8e7640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdc14098dc0 con 0x7fdc1412e760 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc13fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc1412e760 0x7fdc1412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc13fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdc1412e760 0x7fdc1412ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35340/0 (socket says 172.21.15.12:35340) 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc137fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdc1412f1c0 0x7fdc1412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35186/0 (socket says 172.21.15.12:35186) 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc13fff640 1 -- 172.21.15.12:0/83639489 learned_addr learned my addr 172.21.15.12:0/83639489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc13fff640 1 -- 172.21.15.12:0/83639489 >> v1:172.21.15.12:6789/0 conn(0x7fdc1412f1c0 legacy=0x7fdc1412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.742+0000 7fdc13fff640 1 -- 172.21.15.12:0/83639489 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1412f5a0 con 0x7fdc1412e760 2024-09-13T19:10:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 --2- 172.21.15.12:0/83639489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1412ec80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097f0 tx=0x7fdc0801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3332b36bbeb0c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc12ffd640 1 -- 172.21.15.12:0/83639489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc080b0070 con 0x7fdc1412e760 2024-09-13T19:10:07.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc12ffd640 1 -- 172.21.15.12:0/83639489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080ab530 con 0x7fdc1412e760 2024-09-13T19:10:07.752 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc12ffd640 1 -- 172.21.15.12:0/83639489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc080ab830 con 0x7fdc1412e760 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/83639489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 msgr2=0x7fdc1412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/83639489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1412ec80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fdc080097f0 tx=0x7fdc0801c4c0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/83639489 shutdown_connections 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/83639489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1412ec80 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/83639489 >> 172.21.15.12:0/83639489 conn(0x7fdc140a10a0 msgr2=0x7fdc140a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/83639489 shutdown_connections 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/83639489 wait complete. 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 Processor -- start 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- start start 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14136e30 con 0x7fdc1412e760 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35342/0 (socket says 172.21.15.12:35342) 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 -- 172.21.15.12:0/549855304 learned_addr learned my addr 172.21.15.12:0/549855304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 -- 172.21.15.12:0/549855304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc14130510 con 0x7fdc1412e760 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc13fff640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdc0801a0f0 tx=0x7fdc0801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc080ba020 con 0x7fdc1412e760 2024-09-13T19:10:07.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080b6420 con 0x7fdc1412e760 2024-09-13T19:10:07.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc080b0040 con 0x7fdc1412e760 2024-09-13T19:10:07.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc14130c10 con 0x7fdc1412e760 2024-09-13T19:10:07.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.746+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1409ce60 con 0x7fdc1412e760 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1409e3a0 con 0x7fdc1412e760 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdc080bd020 con 0x7fdc1412e760 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc10ff9640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 0x7fdc00038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdc080e3480 con 0x7fdc1412e760 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc137fe640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 0x7fdc00038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.750+0000 7fdc137fe640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 0x7fdc00038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001620 tx=0x7fdc04007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.754+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc080c4030 con 0x7fdc1412e760 2024-09-13T19:10:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.910+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fdc14130780 con 0x7fdc00035db0 2024-09-13T19:10:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.910+0000 7fdc10ff9640 1 -- 172.21.15.12:0/549855304 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc040070d0 con 0x7fdc00035db0 2024-09-13T19:10:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T19:10:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 msgr2=0x7fdc00038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 0x7fdc00038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc04001620 tx=0x7fdc04007a10 comp rx=0 tx=0).stop 2024-09-13T19:10:07.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 msgr2=0x7fdc1409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdc0801a0f0 tx=0x7fdc0801ad00 comp rx=0 tx=0).stop 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 shutdown_connections 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdc00035db0 0x7fdc00038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 --2- 172.21.15.12:0/549855304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc1412e760 0x7fdc1409c920 secure :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fdc0801a0f0 tx=0x7fdc0801ad00 comp rx=0 tx=0).stop 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 >> 172.21.15.12:0/549855304 conn(0x7fdc140a10a0 msgr2=0x7fdc14095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 shutdown_connections 2024-09-13T19:10:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:07.914+0000 7fdc1a8e7640 1 -- 172.21.15.12:0/549855304 wait complete. 2024-09-13T19:10:07.935 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T19:10:07.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T19:10:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f45565fe640 1 Processor -- start 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f45565fe640 1 -- start start 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f45565fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f455006d170 0x7f455006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f45565fe640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4550098840 con 0x7f455006da90 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f45565fe640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f45500709c0 con 0x7f455006d170 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f455006d170 0x7f455006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f455006da90 0x7f4550130b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35190/0 (socket says 172.21.15.12:35190) 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454f7fe640 1 -- 172.21.15.12:0/2243590381 learned_addr learned my addr 172.21.15.12:0/2243590381 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454ffff640 1 -- 172.21.15.12:0/2243590381 >> v1:172.21.15.12:6789/0 conn(0x7f455006da90 legacy=0x7f4550130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454effd640 1 -- 172.21.15.12:0/2243590381 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766272944 0 0) 0x7f4550098840 con 0x7f455006da90 2024-09-13T19:10:08.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.050+0000 7f454ffff640 1 -- 172.21.15.12:0/2243590381 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550071e20 con 0x7f455006d170 2024-09-13T19:10:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454ffff640 1 --2- 172.21.15.12:0/2243590381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f455006d550 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4538009740 tx=0x7f453801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c3ed9b9939e96f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454effd640 1 -- 172.21.15.12:0/2243590381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45380b0070 con 0x7f455006d170 2024-09-13T19:10:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454effd640 1 -- 172.21.15.12:0/2243590381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45380ab530 con 0x7f455006d170 2024-09-13T19:10:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454effd640 1 -- 172.21.15.12:0/2243590381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45380ab830 con 0x7f455006d170 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- 172.21.15.12:0/2243590381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 msgr2=0x7f455006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 --2- 172.21.15.12:0/2243590381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f455006d550 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4538009740 tx=0x7f453801c370 comp rx=0 tx=0).stop 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- 172.21.15.12:0/2243590381 shutdown_connections 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 --2- 172.21.15.12:0/2243590381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f455006d550 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- 172.21.15.12:0/2243590381 >> 172.21.15.12:0/2243590381 conn(0x7f45500998a0 msgr2=0x7f4550099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- 172.21.15.12:0/2243590381 shutdown_connections 2024-09-13T19:10:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- 172.21.15.12:0/2243590381 wait complete. 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 Processor -- start 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- start start 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f45565fe640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4550134bf0 con 0x7f455006d170 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35358/0 (socket says 172.21.15.12:35358) 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454ffff640 1 -- 172.21.15.12:0/2476325957 learned_addr learned my addr 172.21.15.12:0/2476325957 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.054+0000 7f454ffff640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4550132080 con 0x7f455006d170 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454ffff640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4538019fa0 tx=0x7f453801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45380b0050 con 0x7f455006d170 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45380b1040 con 0x7f455006d170 2024-09-13T19:10:08.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4550092830 con 0x7f455006d170 2024-09-13T19:10:08.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45380b5740 con 0x7f455006d170 2024-09-13T19:10:08.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4550093960 con 0x7f455006d170 2024-09-13T19:10:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f455006d550 con 0x7f455006d170 2024-09-13T19:10:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f45380be030 con 0x7f455006d170 2024-09-13T19:10:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 0x7f4530038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f45380bc070 con 0x7f455006d170 2024-09-13T19:10:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 0x7f45300446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45380bde80 con 0x7f4530042220 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f45380ea050 con 0x7f455006d170 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454f7fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 0x7f4530038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f4554b9b640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 0x7f45300446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f4554b9b640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 0x7f45300446c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.058+0000 7f454f7fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 0x7f4530038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f90 tx=0x7f45400016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.062+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== osd.3 v2:172.21.15.151:6800/3085220080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f45380bde80 con 0x7f4530042220 2024-09-13T19:10:08.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 --> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f455006da90 con 0x7f4530042220 2024-09-13T19:10:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f454cff9640 1 -- 172.21.15.12:0/2476325957 <== osd.3 v2:172.21.15.151:6800/3085220080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f455006da90 con 0x7f4530042220 2024-09-13T19:10:08.081 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-09-13T19:10:08.081 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T19:10:08.081 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-09-13T19:10:08.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 msgr2=0x7f45300446c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 0x7f45300446c0 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 msgr2=0x7f4530038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 0x7f4530038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4540000f90 tx=0x7f45400016c0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 msgr2=0x7f45501c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4538019fa0 tx=0x7f453801abb0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 shutdown_connections 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6800/3085220080,v1:172.21.15.151:6801/3085220080] conn(0x7f4530042220 0x7f45300446c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f4530035db0 0x7f4530038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 --2- 172.21.15.12:0/2476325957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f455006d170 0x7f45501c4020 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 >> 172.21.15.12:0/2476325957 conn(0x7f45500998a0 msgr2=0x7f455012ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 shutdown_connections 2024-09-13T19:10:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.074+0000 7f45565fe640 1 -- 172.21.15.12:0/2476325957 wait complete. 2024-09-13T19:10:08.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5107fd1640 1 Processor -- start 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5107fd1640 1 -- start start 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5107fd1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f510012e760 0x7f510012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5107fd1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51000984f0 con 0x7f510012f1c0 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5107fd1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5100098dc0 con 0x7f510012e760 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5105d6d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f510012e760 0x7f510012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f510556c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f510012f1c0 0x7f510012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35198/0 (socket says 172.21.15.12:35198) 2024-09-13T19:10:08.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f510556c640 1 -- 172.21.15.12:0/2119387169 learned_addr learned my addr 172.21.15.12:0/2119387169 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:08.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5105d6d640 1 -- 172.21.15.12:0/2119387169 >> v1:172.21.15.12:6789/0 conn(0x7f510012f1c0 legacy=0x7f510012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5105d6d640 1 -- 172.21.15.12:0/2119387169 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510012f5a0 con 0x7f510012e760 2024-09-13T19:10:08.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.198+0000 7f5104d6b640 1 -- 172.21.15.12:0/2119387169 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043518431 0 0) 0x7f51000984f0 con 0x7f510012f1c0 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 --2- 172.21.15.12:0/2119387169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f510012ec80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009740 tx=0x7f50fc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9593b7edd48c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5104d6b640 1 -- 172.21.15.12:0/2119387169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50fc0b0070 con 0x7f510012e760 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5104d6b640 1 -- 172.21.15.12:0/2119387169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0ab530 con 0x7f510012e760 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5104d6b640 1 -- 172.21.15.12:0/2119387169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50fc0ab830 con 0x7f510012e760 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- 172.21.15.12:0/2119387169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 msgr2=0x7f510012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 --2- 172.21.15.12:0/2119387169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f510012ec80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009740 tx=0x7f50fc01c400 comp rx=0 tx=0).stop 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- 172.21.15.12:0/2119387169 shutdown_connections 2024-09-13T19:10:08.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 --2- 172.21.15.12:0/2119387169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f510012ec80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- 172.21.15.12:0/2119387169 >> 172.21.15.12:0/2119387169 conn(0x7f51000a10a0 msgr2=0x7f51000a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- 172.21.15.12:0/2119387169 shutdown_connections 2024-09-13T19:10:08.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- 172.21.15.12:0/2119387169 wait complete. 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 Processor -- start 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- start start 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5107fd1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5100136e30 con 0x7f510012e760 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35376/0 (socket says 172.21.15.12:35376) 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 -- 172.21.15.12:0/4229240854 learned_addr learned my addr 172.21.15.12:0/4229240854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 -- 172.21.15.12:0/4229240854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5100132f70 con 0x7f510012e760 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.202+0000 7f5105d6d640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f50fc01a030 tx=0x7f50fc01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50fc0b0050 con 0x7f510012e760 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0b1040 con 0x7f510012e760 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50fc0b5740 con 0x7f510012e760 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5100133430 con 0x7f510012e760 2024-09-13T19:10:08.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5100130f20 con 0x7f510012e760 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5100132300 con 0x7f510012e760 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f50fc0be030 con 0x7f510012e760 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 0x7f50e4038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f50fc0bc070 con 0x7f510012e760 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f510556c640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 0x7f50e4038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.206+0000 7f510556c640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 0x7f50e4038220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f50f0007fd0 tx=0x7f50f0007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.210+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f50fc0c5020 con 0x7f510012e760 2024-09-13T19:10:08.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.366+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f510012ec80 con 0x7f50e4035d60 2024-09-13T19:10:08.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.366+0000 7f50f67fc640 1 -- 172.21.15.12:0/4229240854 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f510012ec80 con 0x7f50e4035d60 2024-09-13T19:10:08.374 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 msgr2=0x7f50e4038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 0x7f50e4038220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f50f0007fd0 tx=0x7f50f0007980 comp rx=0 tx=0).stop 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 msgr2=0x7f51001309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f50fc01a030 tx=0x7f50fc01ac40 comp rx=0 tx=0).stop 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 shutdown_connections 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f50e4035d60 0x7f50e4038220 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 --2- 172.21.15.12:0/4229240854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510012e760 0x7f51001309e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 >> 172.21.15.12:0/4229240854 conn(0x7f51000a10a0 msgr2=0x7f510012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 shutdown_connections 2024-09-13T19:10:08.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.370+0000 7f5107fd1640 1 -- 172.21.15.12:0/4229240854 wait complete. 2024-09-13T19:10:08.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.498+0000 7fb47e411640 1 Processor -- start 2024-09-13T19:10:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.498+0000 7fb47e411640 1 -- start start 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb47812f390 0x7fb478133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4780984f0 con 0x7fb47812e760 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb478098dc0 con 0x7fb47812f390 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb477fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb47812e760 0x7fb47812ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35214/0 (socket says 172.21.15.12:35214) 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb4777fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb47812f390 0x7fb478133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb477fff640 1 -- 172.21.15.12:0/4082795924 learned_addr learned my addr 172.21.15.12:0/4082795924 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb4777fe640 1 -- 172.21.15.12:0/4082795924 >> v1:172.21.15.12:6789/0 conn(0x7fb47812e760 legacy=0x7fb47812ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb4777fe640 1 -- 172.21.15.12:0/4082795924 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4780981a0 con 0x7fb47812f390 2024-09-13T19:10:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb4777fe640 1 --2- 172.21.15.12:0/4082795924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812f390 0x7fb478133a80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb460009740 tx=0x7fb46001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac39cf2a5dbb5fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb476ffd640 1 -- 172.21.15.12:0/4082795924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4600b1070 con 0x7fb47812f390 2024-09-13T19:10:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb476ffd640 1 -- 172.21.15.12:0/4082795924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4600ac570 con 0x7fb47812f390 2024-09-13T19:10:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb476ffd640 1 -- 172.21.15.12:0/4082795924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4600ac870 con 0x7fb47812f390 2024-09-13T19:10:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- 172.21.15.12:0/4082795924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812f390 msgr2=0x7fb478133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 --2- 172.21.15.12:0/4082795924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812f390 0x7fb478133a80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb460009740 tx=0x7fb46001c400 comp rx=0 tx=0).stop 2024-09-13T19:10:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- 172.21.15.12:0/4082795924 shutdown_connections 2024-09-13T19:10:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 --2- 172.21.15.12:0/4082795924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812f390 0x7fb478133a80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- 172.21.15.12:0/4082795924 >> 172.21.15.12:0/4082795924 conn(0x7fb4780a10a0 msgr2=0x7fb4780a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- 172.21.15.12:0/4082795924 shutdown_connections 2024-09-13T19:10:08.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.502+0000 7fb47e411640 1 -- 172.21.15.12:0/4082795924 wait complete. 2024-09-13T19:10:08.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 Processor -- start 2024-09-13T19:10:08.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 -- start start 2024-09-13T19:10:08.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb478136b70 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb477fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb477fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35406/0 (socket says 172.21.15.12:35406) 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb477fff640 1 -- 172.21.15.12:0/1118631199 learned_addr learned my addr 172.21.15.12:0/1118631199 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb477fff640 1 -- 172.21.15.12:0/1118631199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb478131730 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb477fff640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c480 tx=0x7fb46800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb468017070 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb468005c20 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb468007070 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb478128f50 con 0x7fb47812e760 2024-09-13T19:10:08.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb478131da0 con 0x7fb47812e760 2024-09-13T19:10:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb47812de00 con 0x7fb47812e760 2024-09-13T19:10:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb46801a070 con 0x7fb47812e760 2024-09-13T19:10:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:08.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb4680483d0 con 0x7fb47812e760 2024-09-13T19:10:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.506+0000 7fb4777fe640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:08.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.510+0000 7fb4777fe640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 0x7fb458038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ae000 tx=0x7fb460008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:08.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.510+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb478131730 con 0x7fb47812e760 2024-09-13T19:10:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.666+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb47812ec80 con 0x7fb458035db0 2024-09-13T19:10:08.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.714+0000 7fb474ff9640 1 -- 172.21.15.12:0/1118631199 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665989 (secure 0 0 0) 0x7fb47812ec80 con 0x7fb458035db0 2024-09-13T19:10:08.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:08.729 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 msgr2=0x7fb458038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 0x7fb458038270 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ae000 tx=0x7fb460008040 comp rx=0 tx=0).stop 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 msgr2=0x7fb4780963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c480 tx=0x7fb46800c940 comp rx=0 tx=0).stop 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 shutdown_connections 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb458035db0 0x7fb458038270 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 --2- 172.21.15.12:0/1118631199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb47812e760 0x7fb4780963d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 >> 172.21.15.12:0/1118631199 conn(0x7fb4780a10a0 msgr2=0x7fb4780972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 shutdown_connections 2024-09-13T19:10:08.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:08.718+0000 7fb47e411640 1 -- 172.21.15.12:0/1118631199 wait complete. 2024-09-13T19:10:08.739 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T19:10:07.015465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4610,"ondisk_log_size":4610,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":169424,"kb_used_data":19720,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377317936,"statfs":{"total":386547056640,"available":386373566464,"internally_reserved":0,"allocated":20193280,"data_stored":18999916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-25811502,"num_objects":-7,"num_object_clones":0,"num_object_copies":-28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":0,"num_read":216,"num_read_kb":220,"num_write":73,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007155"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337381+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:06:58.337381+0000","last_peered":"2024-09-13T19:06:58.337381+0000","last_clean":"2024-09-13T19:06:58.337381+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:06:58.337381+0000","last_undegraded":"2024-09-13T19:06:58.337381+0000","last_fullsized":"2024-09-13T19:06:58.337381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.324626+0000","last_change":"2024-09-13T19:06:21.265691+0000","last_active":"2024-09-13T19:07:07.324626+0000","last_peered":"2024-09-13T19:07:07.324626+0000","last_clean":"2024-09-13T19:07:07.324626+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:07:07.324626+0000","last_undegraded":"2024-09-13T19:07:07.324626+0000","last_fullsized":"2024-09-13T19:07:07.324626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.241844+0000","last_change":"2024-09-13T19:06:19.281253+0000","last_active":"2024-09-13T19:09:38.241844+0000","last_peered":"2024-09-13T19:09:38.241844+0000","last_clean":"2024-09-13T19:09:38.241844+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:09:38.241844+0000","last_undegraded":"2024-09-13T19:09:38.241844+0000","last_fullsized":"2024-09-13T19:09:38.241844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343896+0000","last_change":"2024-09-13T19:06:21.257152+0000","last_active":"2024-09-13T19:06:58.343896+0000","last_peered":"2024-09-13T19:06:58.343896+0000","last_clean":"2024-09-13T19:06:58.343896+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:06:58.343896+0000","last_undegraded":"2024-09-13T19:06:58.343896+0000","last_fullsized":"2024-09-13T19:06:58.343896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:59.192920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.348389+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:06:58.348389+0000","last_peered":"2024-09-13T19:06:58.348389+0000","last_clean":"2024-09-13T19:06:58.348389+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:06:58.348389+0000","last_undegraded":"2024-09-13T19:06:58.348389+0000","last_fullsized":"2024-09-13T19:06:58.348389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:19.158740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040680+0000","last_change":"2024-09-13T19:06:21.257435+0000","last_active":"2024-09-13T19:09:38.040680+0000","last_peered":"2024-09-13T19:09:38.040680+0000","last_clean":"2024-09-13T19:09:38.040680+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:09:38.040680+0000","last_undegraded":"2024-09-13T19:09:38.040680+0000","last_fullsized":"2024-09-13T19:09:38.040680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:15.700530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.754971+0000","last_change":"2024-09-13T19:06:19.272048+0000","last_active":"2024-09-13T19:09:37.754971+0000","last_peered":"2024-09-13T19:09:37.754971+0000","last_clean":"2024-09-13T19:09:37.754971+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:09:37.754971+0000","last_undegraded":"2024-09-13T19:09:37.754971+0000","last_fullsized":"2024-09-13T19:09:37.754971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.254845+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.254845+0000","last_peered":"2024-09-13T19:09:38.254845+0000","last_clean":"2024-09-13T19:09:38.254845+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.254845+0000","last_undegraded":"2024-09-13T19:09:38.254845+0000","last_fullsized":"2024-09-13T19:09:38.254845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:26.262099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341432+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:06:58.341432+0000","last_peered":"2024-09-13T19:06:58.341432+0000","last_clean":"2024-09-13T19:06:58.341432+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:06:58.341432+0000","last_undegraded":"2024-09-13T19:06:58.341432+0000","last_fullsized":"2024-09-13T19:06:58.341432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:58.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455588+0000","last_change":"2024-09-13T19:06:21.261907+0000","last_active":"2024-09-13T19:09:38.455588+0000","last_peered":"2024-09-13T19:09:38.455588+0000","last_clean":"2024-09-13T19:09:38.455588+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:09:38.455588+0000","last_undegraded":"2024-09-13T19:09:38.455588+0000","last_fullsized":"2024-09-13T19:09:38.455588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.618385+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:09:37.618385+0000","last_peered":"2024-09-13T19:09:37.618385+0000","last_clean":"2024-09-13T19:09:37.618385+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:09:37.618385+0000","last_undegraded":"2024-09-13T19:09:37.618385+0000","last_fullsized":"2024-09-13T19:09:37.618385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.654845+0000","last_change":"2024-09-13T19:06:21.266198+0000","last_active":"2024-09-13T19:07:50.654845+0000","last_peered":"2024-09-13T19:07:50.654845+0000","last_clean":"2024-09-13T19:07:50.654845+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:07:50.654845+0000","last_undegraded":"2024-09-13T19:07:50.654845+0000","last_fullsized":"2024-09-13T19:07:50.654845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:26.835463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.307843+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:07:07.307843+0000","last_peered":"2024-09-13T19:07:07.307843+0000","last_clean":"2024-09-13T19:07:07.307843+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:07:07.307843+0000","last_undegraded":"2024-09-13T19:07:07.307843+0000","last_fullsized":"2024-09-13T19:07:07.307843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:38.969649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'5","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474547+0000","last_change":"2024-09-13T19:06:21.255493+0000","last_active":"2024-09-13T19:09:38.474547+0000","last_peered":"2024-09-13T19:09:38.474547+0000","last_clean":"2024-09-13T19:09:38.474547+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:09:38.474547+0000","last_undegraded":"2024-09-13T19:09:38.474547+0000","last_fullsized":"2024-09-13T19:09:38.474547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327422+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:06:58.327422+0000","last_peered":"2024-09-13T19:06:58.327422+0000","last_clean":"2024-09-13T19:06:58.327422+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:06:58.327422+0000","last_undegraded":"2024-09-13T19:06:58.327422+0000","last_fullsized":"2024-09-13T19:06:58.327422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.906061+0000","last_change":"2024-09-13T19:06:21.259423+0000","last_active":"2024-09-13T19:09:37.906061+0000","last_peered":"2024-09-13T19:09:37.906061+0000","last_clean":"2024-09-13T19:09:37.906061+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:09:37.906061+0000","last_undegraded":"2024-09-13T19:09:37.906061+0000","last_fullsized":"2024-09-13T19:09:37.906061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.971735+0000","last_change":"2024-09-13T19:06:21.257261+0000","last_active":"2024-09-13T19:07:06.971735+0000","last_peered":"2024-09-13T19:07:06.971735+0000","last_clean":"2024-09-13T19:07:06.971735+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:07:06.971735+0000","last_undegraded":"2024-09-13T19:07:06.971735+0000","last_fullsized":"2024-09-13T19:07:06.971735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:38.952619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.296557+0000","last_change":"2024-09-13T19:06:19.287823+0000","last_active":"2024-09-13T19:07:07.296557+0000","last_peered":"2024-09-13T19:07:07.296557+0000","last_clean":"2024-09-13T19:07:07.296557+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:07:07.296557+0000","last_undegraded":"2024-09-13T19:07:07.296557+0000","last_fullsized":"2024-09-13T19:07:07.296557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475773+0000","last_change":"2024-09-13T19:06:21.263484+0000","last_active":"2024-09-13T19:09:38.475773+0000","last_peered":"2024-09-13T19:09:38.475773+0000","last_clean":"2024-09-13T19:09:38.475773+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:09:38.475773+0000","last_undegraded":"2024-09-13T19:09:38.475773+0000","last_fullsized":"2024-09-13T19:09:38.475773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.370620+0000","last_change":"2024-09-13T19:06:19.276357+0000","last_active":"2024-09-13T19:07:50.370620+0000","last_peered":"2024-09-13T19:07:50.370620+0000","last_clean":"2024-09-13T19:07:50.370620+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:07:50.370620+0000","last_undegraded":"2024-09-13T19:07:50.370620+0000","last_fullsized":"2024-09-13T19:07:50.370620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.121880+0000","last_change":"2024-09-13T19:06:21.265579+0000","last_active":"2024-09-13T19:08:37.121880+0000","last_peered":"2024-09-13T19:08:37.121880+0000","last_clean":"2024-09-13T19:08:37.121880+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:08:37.121880+0000","last_undegraded":"2024-09-13T19:08:37.121880+0000","last_fullsized":"2024-09-13T19:08:37.121880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.785658+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.785658+0000","last_peered":"2024-09-13T19:09:37.785658+0000","last_clean":"2024-09-13T19:09:37.785658+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.785658+0000","last_undegraded":"2024-09-13T19:09:37.785658+0000","last_fullsized":"2024-09-13T19:09:37.785658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885359+0000","last_change":"2024-09-13T19:06:21.253936+0000","last_active":"2024-09-13T19:09:37.885359+0000","last_peered":"2024-09-13T19:09:37.885359+0000","last_clean":"2024-09-13T19:09:37.885359+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:09:37.885359+0000","last_undegraded":"2024-09-13T19:09:37.885359+0000","last_fullsized":"2024-09-13T19:09:37.885359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342316+0000","last_change":"2024-09-13T19:06:19.281986+0000","last_active":"2024-09-13T19:06:58.342316+0000","last_peered":"2024-09-13T19:06:58.342316+0000","last_clean":"2024-09-13T19:06:58.342316+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:06:58.342316+0000","last_undegraded":"2024-09-13T19:06:58.342316+0000","last_fullsized":"2024-09-13T19:06:58.342316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:31.901929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392252+0000","last_change":"2024-09-13T19:06:21.254760+0000","last_active":"2024-09-13T19:09:38.392252+0000","last_peered":"2024-09-13T19:09:38.392252+0000","last_clean":"2024-09-13T19:09:38.392252+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:09:38.392252+0000","last_undegraded":"2024-09-13T19:09:38.392252+0000","last_fullsized":"2024-09-13T19:09:38.392252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:14.792775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.215043+0000","last_change":"2024-09-13T19:06:19.278861+0000","last_active":"2024-09-13T19:09:38.215043+0000","last_peered":"2024-09-13T19:09:38.215043+0000","last_clean":"2024-09-13T19:09:38.215043+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:09:38.215043+0000","last_undegraded":"2024-09-13T19:09:38.215043+0000","last_fullsized":"2024-09-13T19:09:38.215043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:09.190817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.880925+0000","last_change":"2024-09-13T19:06:21.265434+0000","last_active":"2024-09-13T19:09:37.880925+0000","last_peered":"2024-09-13T19:09:37.880925+0000","last_clean":"2024-09-13T19:09:37.880925+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:09:37.880925+0000","last_undegraded":"2024-09-13T19:09:37.880925+0000","last_fullsized":"2024-09-13T19:09:37.880925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:23.561123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337225+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:06:58.337225+0000","last_peered":"2024-09-13T19:06:58.337225+0000","last_clean":"2024-09-13T19:06:58.337225+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:06:58.337225+0000","last_undegraded":"2024-09-13T19:06:58.337225+0000","last_fullsized":"2024-09-13T19:06:58.337225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:26.485200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.318135+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.318135+0000","last_peered":"2024-09-13T19:09:38.318135+0000","last_clean":"2024-09-13T19:09:38.318135+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.318135+0000","last_undegraded":"2024-09-13T19:09:38.318135+0000","last_fullsized":"2024-09-13T19:09:38.318135+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:07.774766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004272+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:08:44.004272+0000","last_peered":"2024-09-13T19:08:44.004272+0000","last_clean":"2024-09-13T19:08:44.004272+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:08:44.004272+0000","last_undegraded":"2024-09-13T19:08:44.004272+0000","last_fullsized":"2024-09-13T19:08:44.004272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:52.354210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.648816+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:09:37.648816+0000","last_peered":"2024-09-13T19:09:37.648816+0000","last_clean":"2024-09-13T19:09:37.648816+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:09:37.648816+0000","last_undegraded":"2024-09-13T19:09:37.648816+0000","last_fullsized":"2024-09-13T19:09:37.648816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:09.471752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344167+0000","last_change":"2024-09-13T19:06:23.276780+0000","last_active":"2024-09-13T19:06:58.344167+0000","last_peered":"2024-09-13T19:06:58.344167+0000","last_clean":"2024-09-13T19:06:58.344167+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:06:58.344167+0000","last_undegraded":"2024-09-13T19:06:58.344167+0000","last_fullsized":"2024-09-13T19:06:58.344167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:36.923375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.731353+0000","last_change":"2024-09-13T19:06:25.281596+0000","last_active":"2024-09-13T19:10:03.731353+0000","last_peered":"2024-09-13T19:10:03.731353+0000","last_clean":"2024-09-13T19:10:03.731353+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:03.731353+0000","last_undegraded":"2024-09-13T19:10:03.731353+0000","last_fullsized":"2024-09-13T19:10:03.731353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:11.221079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359118+0000","last_change":"2024-09-13T19:06:27.318504+0000","last_active":"2024-09-13T19:06:58.359118+0000","last_peered":"2024-09-13T19:06:58.359118+0000","last_clean":"2024-09-13T19:06:58.359118+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:06:58.359118+0000","last_undegraded":"2024-09-13T19:06:58.359118+0000","last_fullsized":"2024-09-13T19:06:58.359118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.391456+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:07:50.391456+0000","last_peered":"2024-09-13T19:07:50.391456+0000","last_clean":"2024-09-13T19:07:50.391456+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:07:50.391456+0000","last_undegraded":"2024-09-13T19:07:50.391456+0000","last_fullsized":"2024-09-13T19:07:50.391456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:43.269034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.454561+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.454561+0000","last_peered":"2024-09-13T19:09:38.454561+0000","last_clean":"2024-09-13T19:09:38.454561+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.454561+0000","last_undegraded":"2024-09-13T19:09:38.454561+0000","last_fullsized":"2024-09-13T19:09:38.454561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:44.895833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328877+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:06:58.328877+0000","last_peered":"2024-09-13T19:06:58.328877+0000","last_clean":"2024-09-13T19:06:58.328877+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:06:58.328877+0000","last_undegraded":"2024-09-13T19:06:58.328877+0000","last_fullsized":"2024-09-13T19:06:58.328877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327809+0000","last_change":"2024-09-13T19:06:23.252446+0000","last_active":"2024-09-13T19:06:58.327809+0000","last_peered":"2024-09-13T19:06:58.327809+0000","last_clean":"2024-09-13T19:06:58.327809+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:06:58.327809+0000","last_undegraded":"2024-09-13T19:06:58.327809+0000","last_fullsized":"2024-09-13T19:06:58.327809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358498+0000","last_change":"2024-09-13T19:06:25.281296+0000","last_active":"2024-09-13T19:06:58.358498+0000","last_peered":"2024-09-13T19:06:58.358498+0000","last_clean":"2024-09-13T19:06:58.358498+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:06:58.358498+0000","last_undegraded":"2024-09-13T19:06:58.358498+0000","last_fullsized":"2024-09-13T19:06:58.358498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:03.200742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358756+0000","last_change":"2024-09-13T19:06:27.324894+0000","last_active":"2024-09-13T19:06:58.358756+0000","last_peered":"2024-09-13T19:06:58.358756+0000","last_clean":"2024-09-13T19:06:58.358756+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:06:58.358756+0000","last_undegraded":"2024-09-13T19:06:58.358756+0000","last_fullsized":"2024-09-13T19:06:58.358756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326789+0000","last_change":"2024-09-13T19:06:29.300886+0000","last_active":"2024-09-13T19:06:58.326789+0000","last_peered":"2024-09-13T19:06:58.326789+0000","last_clean":"2024-09-13T19:06:58.326789+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:06:58.326789+0000","last_undegraded":"2024-09-13T19:06:58.326789+0000","last_fullsized":"2024-09-13T19:06:58.326789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.372361+0000","last_change":"2024-09-13T19:06:21.256421+0000","last_active":"2024-09-13T19:09:38.372361+0000","last_peered":"2024-09-13T19:09:38.372361+0000","last_clean":"2024-09-13T19:09:38.372361+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:09:38.372361+0000","last_undegraded":"2024-09-13T19:09:38.372361+0000","last_fullsized":"2024-09-13T19:09:38.372361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:08.365440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337123+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:06:58.337123+0000","last_peered":"2024-09-13T19:06:58.337123+0000","last_clean":"2024-09-13T19:06:58.337123+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:06:58.337123+0000","last_undegraded":"2024-09-13T19:06:58.337123+0000","last_fullsized":"2024-09-13T19:06:58.337123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:05.346402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336788+0000","last_change":"2024-09-13T19:06:23.258127+0000","last_active":"2024-09-13T19:06:58.336788+0000","last_peered":"2024-09-13T19:06:58.336788+0000","last_clean":"2024-09-13T19:06:58.336788+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:06:58.336788+0000","last_undegraded":"2024-09-13T19:06:58.336788+0000","last_fullsized":"2024-09-13T19:06:58.336788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331611+0000","last_change":"2024-09-13T19:06:25.297719+0000","last_active":"2024-09-13T19:06:58.331611+0000","last_peered":"2024-09-13T19:06:58.331611+0000","last_clean":"2024-09-13T19:06:58.331611+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:06:58.331611+0000","last_undegraded":"2024-09-13T19:06:58.331611+0000","last_fullsized":"2024-09-13T19:06:58.331611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:21.240465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.528863+0000","last_change":"2024-09-13T19:06:27.301544+0000","last_active":"2024-09-13T19:10:03.528863+0000","last_peered":"2024-09-13T19:10:03.528863+0000","last_clean":"2024-09-13T19:10:03.528863+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:03.528863+0000","last_undegraded":"2024-09-13T19:10:03.528863+0000","last_fullsized":"2024-09-13T19:10:03.528863+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:57:19.445306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328744+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:06:58.328744+0000","last_peered":"2024-09-13T19:06:58.328744+0000","last_clean":"2024-09-13T19:06:58.328744+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:06:58.328744+0000","last_undegraded":"2024-09-13T19:06:58.328744+0000","last_fullsized":"2024-09-13T19:06:58.328744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:06.414507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.042619+0000","last_change":"2024-09-13T19:06:21.259001+0000","last_active":"2024-09-13T19:09:38.042619+0000","last_peered":"2024-09-13T19:09:38.042619+0000","last_clean":"2024-09-13T19:09:38.042619+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:09:38.042619+0000","last_undegraded":"2024-09-13T19:09:38.042619+0000","last_fullsized":"2024-09-13T19:09:38.042619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.358360+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:06:58.358360+0000","last_peered":"2024-09-13T19:06:58.358360+0000","last_clean":"2024-09-13T19:06:58.358360+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:06:58.358360+0000","last_undegraded":"2024-09-13T19:06:58.358360+0000","last_fullsized":"2024-09-13T19:06:58.358360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:48.716510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350380+0000","last_change":"2024-09-13T19:06:23.276603+0000","last_active":"2024-09-13T19:06:58.350380+0000","last_peered":"2024-09-13T19:06:58.350380+0000","last_clean":"2024-09-13T19:06:58.350380+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:06:58.350380+0000","last_undegraded":"2024-09-13T19:06:58.350380+0000","last_fullsized":"2024-09-13T19:06:58.350380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:06.962778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.690187+0000","last_change":"2024-09-13T19:06:25.297031+0000","last_active":"2024-09-13T19:10:03.690187+0000","last_peered":"2024-09-13T19:10:03.690187+0000","last_clean":"2024-09-13T19:10:03.690187+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:03.690187+0000","last_undegraded":"2024-09-13T19:10:03.690187+0000","last_fullsized":"2024-09-13T19:10:03.690187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:32.765951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":446,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.538399+0000","last_change":"2024-09-13T19:06:27.283769+0000","last_active":"2024-09-13T19:10:03.538399+0000","last_peered":"2024-09-13T19:10:03.538399+0000","last_clean":"2024-09-13T19:10:03.538399+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:03.538399+0000","last_undegraded":"2024-09-13T19:10:03.538399+0000","last_fullsized":"2024-09-13T19:10:03.538399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:00.073225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375233+0000","last_change":"2024-09-13T19:06:21.259478+0000","last_active":"2024-09-13T19:09:38.375233+0000","last_peered":"2024-09-13T19:09:38.375233+0000","last_clean":"2024-09-13T19:09:38.375233+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:09:38.375233+0000","last_undegraded":"2024-09-13T19:09:38.375233+0000","last_fullsized":"2024-09-13T19:09:38.375233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:26.304922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.779034+0000","last_change":"2024-09-13T19:06:19.264318+0000","last_active":"2024-09-13T19:08:36.779034+0000","last_peered":"2024-09-13T19:08:36.779034+0000","last_clean":"2024-09-13T19:08:36.779034+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:08:36.779034+0000","last_undegraded":"2024-09-13T19:08:36.779034+0000","last_fullsized":"2024-09-13T19:08:36.779034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341484+0000","last_change":"2024-09-13T19:06:23.274173+0000","last_active":"2024-09-13T19:06:58.341484+0000","last_peered":"2024-09-13T19:06:58.341484+0000","last_clean":"2024-09-13T19:06:58.341484+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:06:58.341484+0000","last_undegraded":"2024-09-13T19:06:58.341484+0000","last_fullsized":"2024-09-13T19:06:58.341484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:57.200822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.767664+0000","last_change":"2024-09-13T19:06:25.302087+0000","last_active":"2024-09-13T19:10:03.767664+0000","last_peered":"2024-09-13T19:10:03.767664+0000","last_clean":"2024-09-13T19:10:03.767664+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:03.767664+0000","last_undegraded":"2024-09-13T19:10:03.767664+0000","last_fullsized":"2024-09-13T19:10:03.767664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:04.630747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330037+0000","last_change":"2024-09-13T19:06:27.297316+0000","last_active":"2024-09-13T19:06:58.330037+0000","last_peered":"2024-09-13T19:06:58.330037+0000","last_clean":"2024-09-13T19:06:58.330037+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:06:58.330037+0000","last_undegraded":"2024-09-13T19:06:58.330037+0000","last_fullsized":"2024-09-13T19:06:58.330037+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:15.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.394157+0000","last_change":"2024-09-13T19:06:29.313617+0000","last_active":"2024-09-13T19:07:50.394157+0000","last_peered":"2024-09-13T19:07:50.394157+0000","last_clean":"2024-09-13T19:07:50.394157+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:07:50.394157+0000","last_undegraded":"2024-09-13T19:07:50.394157+0000","last_fullsized":"2024-09-13T19:07:50.394157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:24.043207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.390167+0000","last_change":"2024-09-13T19:06:21.258654+0000","last_active":"2024-09-13T19:09:38.390167+0000","last_peered":"2024-09-13T19:09:38.390167+0000","last_clean":"2024-09-13T19:09:38.390167+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:09:38.390167+0000","last_undegraded":"2024-09-13T19:09:38.390167+0000","last_fullsized":"2024-09-13T19:09:38.390167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.205636+0000","last_change":"2024-09-13T19:06:19.273587+0000","last_active":"2024-09-13T19:09:38.205636+0000","last_peered":"2024-09-13T19:09:38.205636+0000","last_clean":"2024-09-13T19:09:38.205636+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:09:38.205636+0000","last_undegraded":"2024-09-13T19:09:38.205636+0000","last_fullsized":"2024-09-13T19:09:38.205636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.978035+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:06:58.978035+0000","last_peered":"2024-09-13T19:06:58.978035+0000","last_clean":"2024-09-13T19:06:58.978035+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:06:58.978035+0000","last_undegraded":"2024-09-13T19:06:58.978035+0000","last_fullsized":"2024-09-13T19:06:58.978035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.097899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.625888+0000","last_change":"2024-09-13T19:06:25.280611+0000","last_active":"2024-09-13T19:10:03.625888+0000","last_peered":"2024-09-13T19:10:03.625888+0000","last_clean":"2024-09-13T19:10:03.625888+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:03.625888+0000","last_undegraded":"2024-09-13T19:10:03.625888+0000","last_fullsized":"2024-09-13T19:10:03.625888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:29.037601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328820+0000","last_change":"2024-09-13T19:06:27.297989+0000","last_active":"2024-09-13T19:06:58.328820+0000","last_peered":"2024-09-13T19:06:58.328820+0000","last_clean":"2024-09-13T19:06:58.328820+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:06:58.328820+0000","last_undegraded":"2024-09-13T19:06:58.328820+0000","last_fullsized":"2024-09-13T19:06:58.328820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:44.711664+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:07:44.711664+0000","last_peered":"2024-09-13T19:07:44.711664+0000","last_clean":"2024-09-13T19:07:44.711664+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:07:44.711664+0000","last_undegraded":"2024-09-13T19:07:44.711664+0000","last_fullsized":"2024-09-13T19:07:44.711664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610491+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:09:38.610491+0000","last_peered":"2024-09-13T19:09:38.610491+0000","last_clean":"2024-09-13T19:09:38.610491+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:09:38.610491+0000","last_undegraded":"2024-09-13T19:09:38.610491+0000","last_fullsized":"2024-09-13T19:09:38.610491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:03.939657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.460726+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:07:06.460726+0000","last_peered":"2024-09-13T19:07:06.460726+0000","last_clean":"2024-09-13T19:07:06.460726+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:07:06.460726+0000","last_undegraded":"2024-09-13T19:07:06.460726+0000","last_fullsized":"2024-09-13T19:07:06.460726+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:30.862085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328791+0000","last_change":"2024-09-13T19:06:23.258115+0000","last_active":"2024-09-13T19:06:58.328791+0000","last_peered":"2024-09-13T19:06:58.328791+0000","last_clean":"2024-09-13T19:06:58.328791+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:06:58.328791+0000","last_undegraded":"2024-09-13T19:06:58.328791+0000","last_fullsized":"2024-09-13T19:06:58.328791+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.802675+0000","last_change":"2024-09-13T19:06:25.289758+0000","last_active":"2024-09-13T19:10:03.802675+0000","last_peered":"2024-09-13T19:10:03.802675+0000","last_clean":"2024-09-13T19:10:03.802675+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:03.802675+0000","last_undegraded":"2024-09-13T19:10:03.802675+0000","last_fullsized":"2024-09-13T19:10:03.802675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:14.931744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.541481+0000","last_change":"2024-09-13T19:06:27.298298+0000","last_active":"2024-09-13T19:10:03.541481+0000","last_peered":"2024-09-13T19:10:03.541481+0000","last_clean":"2024-09-13T19:10:03.541481+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:03.541481+0000","last_undegraded":"2024-09-13T19:10:03.541481+0000","last_fullsized":"2024-09-13T19:10:03.541481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:37.409404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.115703+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:08:37.115703+0000","last_peered":"2024-09-13T19:08:37.115703+0000","last_clean":"2024-09-13T19:08:37.115703+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:08:37.115703+0000","last_undegraded":"2024-09-13T19:08:37.115703+0000","last_fullsized":"2024-09-13T19:08:37.115703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:12.648419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.657938+0000","last_change":"2024-09-13T19:06:21.254633+0000","last_active":"2024-09-13T19:07:50.657938+0000","last_peered":"2024-09-13T19:07:50.657938+0000","last_clean":"2024-09-13T19:07:50.657938+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:07:50.657938+0000","last_undegraded":"2024-09-13T19:07:50.657938+0000","last_fullsized":"2024-09-13T19:07:50.657938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.476452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.729168+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:09:37.729168+0000","last_peered":"2024-09-13T19:09:37.729168+0000","last_clean":"2024-09-13T19:09:37.729168+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:09:37.729168+0000","last_undegraded":"2024-09-13T19:09:37.729168+0000","last_fullsized":"2024-09-13T19:09:37.729168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:54.868067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327588+0000","last_change":"2024-09-13T19:06:23.249243+0000","last_active":"2024-09-13T19:06:58.327588+0000","last_peered":"2024-09-13T19:06:58.327588+0000","last_clean":"2024-09-13T19:06:58.327588+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:06:58.327588+0000","last_undegraded":"2024-09-13T19:06:58.327588+0000","last_fullsized":"2024-09-13T19:06:58.327588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:39.852019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.817765+0000","last_change":"2024-09-13T19:06:25.282586+0000","last_active":"2024-09-13T19:10:03.817765+0000","last_peered":"2024-09-13T19:10:03.817765+0000","last_clean":"2024-09-13T19:10:03.817765+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:03.817765+0000","last_undegraded":"2024-09-13T19:10:03.817765+0000","last_fullsized":"2024-09-13T19:10:03.817765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:25.800732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326947+0000","last_change":"2024-09-13T19:06:27.313481+0000","last_active":"2024-09-13T19:06:58.326947+0000","last_peered":"2024-09-13T19:06:58.326947+0000","last_clean":"2024-09-13T19:06:58.326947+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:06:58.326947+0000","last_undegraded":"2024-09-13T19:06:58.326947+0000","last_fullsized":"2024-09-13T19:06:58.326947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.751983+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:09:38.751983+0000","last_peered":"2024-09-13T19:09:38.751983+0000","last_clean":"2024-09-13T19:09:38.751983+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:09:38.751983+0000","last_undegraded":"2024-09-13T19:09:38.751983+0000","last_fullsized":"2024-09-13T19:09:38.751983+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:28.423405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255473+0000","last_change":"2024-09-13T19:06:21.254823+0000","last_active":"2024-09-13T19:09:38.255473+0000","last_peered":"2024-09-13T19:09:38.255473+0000","last_clean":"2024-09-13T19:09:38.255473+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:09:38.255473+0000","last_undegraded":"2024-09-13T19:09:38.255473+0000","last_fullsized":"2024-09-13T19:09:38.255473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:37.117376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329744+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:06:58.329744+0000","last_peered":"2024-09-13T19:06:58.329744+0000","last_clean":"2024-09-13T19:06:58.329744+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:06:58.329744+0000","last_undegraded":"2024-09-13T19:06:58.329744+0000","last_fullsized":"2024-09-13T19:06:58.329744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:04.658155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333104+0000","last_change":"2024-09-13T19:06:23.253330+0000","last_active":"2024-09-13T19:06:58.333104+0000","last_peered":"2024-09-13T19:06:58.333104+0000","last_clean":"2024-09-13T19:06:58.333104+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:06:58.333104+0000","last_undegraded":"2024-09-13T19:06:58.333104+0000","last_fullsized":"2024-09-13T19:06:58.333104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:06.158565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'36","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.645785+0000","last_change":"2024-09-13T19:06:25.281709+0000","last_active":"2024-09-13T19:10:03.645785+0000","last_peered":"2024-09-13T19:10:03.645785+0000","last_clean":"2024-09-13T19:10:03.645785+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:03.645785+0000","last_undegraded":"2024-09-13T19:10:03.645785+0000","last_fullsized":"2024-09-13T19:10:03.645785+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:30.269921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354536+0000","last_change":"2024-09-13T19:06:27.302986+0000","last_active":"2024-09-13T19:06:58.354536+0000","last_peered":"2024-09-13T19:06:58.354536+0000","last_clean":"2024-09-13T19:06:58.354536+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:06:58.354536+0000","last_undegraded":"2024-09-13T19:06:58.354536+0000","last_fullsized":"2024-09-13T19:06:58.354536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:39.152741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.342251+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:08:33.342251+0000","last_peered":"2024-09-13T19:08:33.342251+0000","last_clean":"2024-09-13T19:08:33.342251+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:08:33.342251+0000","last_undegraded":"2024-09-13T19:08:33.342251+0000","last_fullsized":"2024-09-13T19:08:33.342251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:17:56.624697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.349011+0000","last_change":"2024-09-13T19:06:21.267040+0000","last_active":"2024-09-13T19:06:58.349011+0000","last_peered":"2024-09-13T19:06:58.349011+0000","last_clean":"2024-09-13T19:06:58.349011+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:06:58.349011+0000","last_undegraded":"2024-09-13T19:06:58.349011+0000","last_fullsized":"2024-09-13T19:06:58.349011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:49.679514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.338851+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:06:58.338851+0000","last_peered":"2024-09-13T19:06:58.338851+0000","last_clean":"2024-09-13T19:06:58.338851+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:06:58.338851+0000","last_undegraded":"2024-09-13T19:06:58.338851+0000","last_fullsized":"2024-09-13T19:06:58.338851+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:51.658861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328141+0000","last_change":"2024-09-13T19:06:23.258329+0000","last_active":"2024-09-13T19:06:58.328141+0000","last_peered":"2024-09-13T19:06:58.328141+0000","last_clean":"2024-09-13T19:06:58.328141+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:06:58.328141+0000","last_undegraded":"2024-09-13T19:06:58.328141+0000","last_fullsized":"2024-09-13T19:06:58.328141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:19.236853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.872887+0000","last_change":"2024-09-13T19:06:25.286826+0000","last_active":"2024-09-13T19:10:03.872887+0000","last_peered":"2024-09-13T19:10:03.872887+0000","last_clean":"2024-09-13T19:10:03.872887+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:03.872887+0000","last_undegraded":"2024-09-13T19:10:03.872887+0000","last_fullsized":"2024-09-13T19:10:03.872887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:08.372479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":436,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.530748+0000","last_change":"2024-09-13T19:06:27.328186+0000","last_active":"2024-09-13T19:10:03.530748+0000","last_peered":"2024-09-13T19:10:03.530748+0000","last_clean":"2024-09-13T19:10:03.530748+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:03.530748+0000","last_undegraded":"2024-09-13T19:10:03.530748+0000","last_fullsized":"2024-09-13T19:10:03.530748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:01.872002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.922026+0000","last_change":"2024-09-13T19:06:29.297215+0000","last_active":"2024-09-13T19:08:36.922026+0000","last_peered":"2024-09-13T19:08:36.922026+0000","last_clean":"2024-09-13T19:08:36.922026+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:08:36.922026+0000","last_undegraded":"2024-09-13T19:08:36.922026+0000","last_fullsized":"2024-09-13T19:08:36.922026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:33.820676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.039686+0000","last_change":"2024-09-13T19:06:21.255658+0000","last_active":"2024-09-13T19:09:38.039686+0000","last_peered":"2024-09-13T19:09:38.039686+0000","last_clean":"2024-09-13T19:09:38.039686+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:09:38.039686+0000","last_undegraded":"2024-09-13T19:09:38.039686+0000","last_fullsized":"2024-09-13T19:09:38.039686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724793+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:07:05.724793+0000","last_peered":"2024-09-13T19:07:05.724793+0000","last_clean":"2024-09-13T19:07:05.724793+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:07:05.724793+0000","last_undegraded":"2024-09-13T19:07:05.724793+0000","last_fullsized":"2024-09-13T19:07:05.724793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:35.606992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.500049+0000","last_change":"2024-09-13T19:06:23.268138+0000","last_active":"2024-09-13T19:10:03.500049+0000","last_peered":"2024-09-13T19:10:03.500049+0000","last_clean":"2024-09-13T19:10:03.500049+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:03.500049+0000","last_undegraded":"2024-09-13T19:10:03.500049+0000","last_fullsized":"2024-09-13T19:10:03.500049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:17.704741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'11","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004313+0000","last_change":"2024-09-13T19:06:25.281762+0000","last_active":"2024-09-13T19:08:44.004313+0000","last_peered":"2024-09-13T19:08:44.004313+0000","last_clean":"2024-09-13T19:08:44.004313+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:08:44.004313+0000","last_undegraded":"2024-09-13T19:08:44.004313+0000","last_fullsized":"2024-09-13T19:08:44.004313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:51.768718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":473,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.532388+0000","last_change":"2024-09-13T19:06:27.321351+0000","last_active":"2024-09-13T19:10:03.532388+0000","last_peered":"2024-09-13T19:10:03.532388+0000","last_clean":"2024-09-13T19:10:03.532388+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:03.532388+0000","last_undegraded":"2024-09-13T19:10:03.532388+0000","last_fullsized":"2024-09-13T19:10:03.532388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.413797+0000","last_change":"2024-09-13T19:06:29.303776+0000","last_active":"2024-09-13T19:08:36.413797+0000","last_peered":"2024-09-13T19:08:36.413797+0000","last_clean":"2024-09-13T19:08:36.413797+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:08:36.413797+0000","last_undegraded":"2024-09-13T19:08:36.413797+0000","last_fullsized":"2024-09-13T19:08:36.413797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:42.497813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455777+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.455777+0000","last_peered":"2024-09-13T19:09:38.455777+0000","last_clean":"2024-09-13T19:09:38.455777+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.455777+0000","last_undegraded":"2024-09-13T19:09:38.455777+0000","last_fullsized":"2024-09-13T19:09:38.455777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:54.545505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336035+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:06:58.336035+0000","last_peered":"2024-09-13T19:06:58.336035+0000","last_clean":"2024-09-13T19:06:58.336035+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:06:58.336035+0000","last_undegraded":"2024-09-13T19:06:58.336035+0000","last_fullsized":"2024-09-13T19:06:58.336035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:35.638994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.354619+0000","last_change":"2024-09-13T19:06:23.278499+0000","last_active":"2024-09-13T19:06:58.354619+0000","last_peered":"2024-09-13T19:06:58.354619+0000","last_clean":"2024-09-13T19:06:58.354619+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:06:58.354619+0000","last_undegraded":"2024-09-13T19:06:58.354619+0000","last_fullsized":"2024-09-13T19:06:58.354619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:05.943867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.739993+0000","last_change":"2024-09-13T19:06:25.280810+0000","last_active":"2024-09-13T19:10:03.739993+0000","last_peered":"2024-09-13T19:10:03.739993+0000","last_clean":"2024-09-13T19:10:03.739993+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:03.739993+0000","last_undegraded":"2024-09-13T19:10:03.739993+0000","last_fullsized":"2024-09-13T19:10:03.739993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:53.687336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330438+0000","last_change":"2024-09-13T19:06:27.327479+0000","last_active":"2024-09-13T19:06:58.330438+0000","last_peered":"2024-09-13T19:06:58.330438+0000","last_clean":"2024-09-13T19:06:58.330438+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:06:58.330438+0000","last_undegraded":"2024-09-13T19:06:58.330438+0000","last_fullsized":"2024-09-13T19:06:58.330438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:32.856579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.552955+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:09:38.552955+0000","last_peered":"2024-09-13T19:09:38.552955+0000","last_clean":"2024-09-13T19:09:38.552955+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:09:38.552955+0000","last_undegraded":"2024-09-13T19:09:38.552955+0000","last_fullsized":"2024-09-13T19:09:38.552955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:43.406563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.038245+0000","last_change":"2024-09-13T19:06:21.266428+0000","last_active":"2024-09-13T19:07:08.038245+0000","last_peered":"2024-09-13T19:07:08.038245+0000","last_clean":"2024-09-13T19:07:08.038245+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:07:08.038245+0000","last_undegraded":"2024-09-13T19:07:08.038245+0000","last_fullsized":"2024-09-13T19:07:08.038245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:15.353078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353237+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:06:58.353237+0000","last_peered":"2024-09-13T19:06:58.353237+0000","last_clean":"2024-09-13T19:06:58.353237+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:06:58.353237+0000","last_undegraded":"2024-09-13T19:06:58.353237+0000","last_fullsized":"2024-09-13T19:06:58.353237+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:47.946552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341613+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:06:58.341613+0000","last_peered":"2024-09-13T19:06:58.341613+0000","last_clean":"2024-09-13T19:06:58.341613+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:06:58.341613+0000","last_undegraded":"2024-09-13T19:06:58.341613+0000","last_fullsized":"2024-09-13T19:06:58.341613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:29.851626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.642212+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:07:50.642212+0000","last_peered":"2024-09-13T19:07:50.642212+0000","last_clean":"2024-09-13T19:07:50.642212+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:07:50.642212+0000","last_undegraded":"2024-09-13T19:07:50.642212+0000","last_fullsized":"2024-09-13T19:07:50.642212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:05.311607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.343001+0000","last_change":"2024-09-13T19:06:23.274175+0000","last_active":"2024-09-13T19:06:58.343001+0000","last_peered":"2024-09-13T19:06:58.343001+0000","last_clean":"2024-09-13T19:06:58.343001+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:06:58.343001+0000","last_undegraded":"2024-09-13T19:06:58.343001+0000","last_fullsized":"2024-09-13T19:06:58.343001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:15.978917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":166,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.852857+0000","last_change":"2024-09-13T19:06:25.277544+0000","last_active":"2024-09-13T19:10:03.852857+0000","last_peered":"2024-09-13T19:10:03.852857+0000","last_clean":"2024-09-13T19:10:03.852857+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:03.852857+0000","last_undegraded":"2024-09-13T19:10:03.852857+0000","last_fullsized":"2024-09-13T19:10:03.852857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:24.442610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333055+0000","last_change":"2024-09-13T19:06:27.299350+0000","last_active":"2024-09-13T19:06:58.333055+0000","last_peered":"2024-09-13T19:06:58.333055+0000","last_clean":"2024-09-13T19:06:58.333055+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:06:58.333055+0000","last_undegraded":"2024-09-13T19:06:58.333055+0000","last_fullsized":"2024-09-13T19:06:58.333055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:10.979684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.482335+0000","last_change":"2024-09-13T19:06:29.300679+0000","last_active":"2024-09-13T19:09:38.482335+0000","last_peered":"2024-09-13T19:09:38.482335+0000","last_clean":"2024-09-13T19:09:38.482335+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:09:38.482335+0000","last_undegraded":"2024-09-13T19:09:38.482335+0000","last_fullsized":"2024-09-13T19:09:38.482335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:18.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.325242+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:07:07.325242+0000","last_peered":"2024-09-13T19:07:07.325242+0000","last_clean":"2024-09-13T19:07:07.325242+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:07:07.325242+0000","last_undegraded":"2024-09-13T19:07:07.325242+0000","last_fullsized":"2024-09-13T19:07:07.325242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:10.770730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335353+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:06:58.335353+0000","last_peered":"2024-09-13T19:06:58.335353+0000","last_clean":"2024-09-13T19:06:58.335353+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:06:58.335353+0000","last_undegraded":"2024-09-13T19:06:58.335353+0000","last_fullsized":"2024-09-13T19:06:58.335353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:01.898416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327250+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:06:58.327250+0000","last_peered":"2024-09-13T19:06:58.327250+0000","last_clean":"2024-09-13T19:06:58.327250+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:06:58.327250+0000","last_undegraded":"2024-09-13T19:06:58.327250+0000","last_fullsized":"2024-09-13T19:06:58.327250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'4","reported_seq":228,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.486257+0000","last_change":"2024-09-13T19:06:23.276941+0000","last_active":"2024-09-13T19:10:03.486257+0000","last_peered":"2024-09-13T19:10:03.486257+0000","last_clean":"2024-09-13T19:10:03.486257+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:03.486257+0000","last_undegraded":"2024-09-13T19:10:03.486257+0000","last_fullsized":"2024-09-13T19:10:03.486257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:43.009208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'284","reported_seq":502,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.752345+0000","last_change":"2024-09-13T19:06:25.284975+0000","last_active":"2024-09-13T19:10:03.752345+0000","last_peered":"2024-09-13T19:10:03.752345+0000","last_clean":"2024-09-13T19:10:03.752345+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:03.752345+0000","last_undegraded":"2024-09-13T19:10:03.752345+0000","last_fullsized":"2024-09-13T19:10:03.752345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:14.778552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342538+0000","last_change":"2024-09-13T19:06:27.305676+0000","last_active":"2024-09-13T19:06:58.342538+0000","last_peered":"2024-09-13T19:06:58.342538+0000","last_clean":"2024-09-13T19:06:58.342538+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:06:58.342538+0000","last_undegraded":"2024-09-13T19:06:58.342538+0000","last_fullsized":"2024-09-13T19:06:58.342538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:49.829980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.388695+0000","last_change":"2024-09-13T19:06:29.319214+0000","last_active":"2024-09-13T19:07:50.388695+0000","last_peered":"2024-09-13T19:07:50.388695+0000","last_clean":"2024-09-13T19:07:50.388695+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:07:50.388695+0000","last_undegraded":"2024-09-13T19:07:50.388695+0000","last_fullsized":"2024-09-13T19:07:50.388695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:33.276278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.256520+0000","last_change":"2024-09-13T19:06:21.260320+0000","last_active":"2024-09-13T19:09:38.256520+0000","last_peered":"2024-09-13T19:09:38.256520+0000","last_clean":"2024-09-13T19:09:38.256520+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:09:38.256520+0000","last_undegraded":"2024-09-13T19:09:38.256520+0000","last_fullsized":"2024-09-13T19:09:38.256520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329531+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:06:58.329531+0000","last_peered":"2024-09-13T19:06:58.329531+0000","last_clean":"2024-09-13T19:06:58.329531+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:06:58.329531+0000","last_undegraded":"2024-09-13T19:06:58.329531+0000","last_fullsized":"2024-09-13T19:06:58.329531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:19.819813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326113+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:06:58.326113+0000","last_peered":"2024-09-13T19:06:58.326113+0000","last_clean":"2024-09-13T19:06:58.326113+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:06:58.326113+0000","last_undegraded":"2024-09-13T19:06:58.326113+0000","last_fullsized":"2024-09-13T19:06:58.326113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.371226+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:06:58.371226+0000","last_peered":"2024-09-13T19:06:58.371226+0000","last_clean":"2024-09-13T19:06:58.371226+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:06:58.371226+0000","last_undegraded":"2024-09-13T19:06:58.371226+0000","last_fullsized":"2024-09-13T19:06:58.371226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:30.620612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.518498+0000","last_change":"2024-09-13T19:06:25.297340+0000","last_active":"2024-09-13T19:09:38.518498+0000","last_peered":"2024-09-13T19:09:38.518498+0000","last_clean":"2024-09-13T19:09:38.518498+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:09:38.518498+0000","last_undegraded":"2024-09-13T19:09:38.518498+0000","last_fullsized":"2024-09-13T19:09:38.518498+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:59.204433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329583+0000","last_change":"2024-09-13T19:06:27.303087+0000","last_active":"2024-09-13T19:06:58.329583+0000","last_peered":"2024-09-13T19:06:58.329583+0000","last_clean":"2024-09-13T19:06:58.329583+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:06:58.329583+0000","last_undegraded":"2024-09-13T19:06:58.329583+0000","last_fullsized":"2024-09-13T19:06:58.329583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:15.260803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335697+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:06:58.335697+0000","last_peered":"2024-09-13T19:06:58.335697+0000","last_clean":"2024-09-13T19:06:58.335697+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:06:58.335697+0000","last_undegraded":"2024-09-13T19:06:58.335697+0000","last_fullsized":"2024-09-13T19:06:58.335697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:02.339869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.032925+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:07:08.032925+0000","last_peered":"2024-09-13T19:07:08.032925+0000","last_clean":"2024-09-13T19:07:08.032925+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:07:08.032925+0000","last_undegraded":"2024-09-13T19:07:08.032925+0000","last_fullsized":"2024-09-13T19:07:08.032925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336137+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:06:58.336137+0000","last_peered":"2024-09-13T19:06:58.336137+0000","last_clean":"2024-09-13T19:06:58.336137+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:06:58.336137+0000","last_undegraded":"2024-09-13T19:06:58.336137+0000","last_fullsized":"2024-09-13T19:06:58.336137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:02.542559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330472+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:06:58.330472+0000","last_peered":"2024-09-13T19:06:58.330472+0000","last_clean":"2024-09-13T19:06:58.330472+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:06:58.330472+0000","last_undegraded":"2024-09-13T19:06:58.330472+0000","last_fullsized":"2024-09-13T19:06:58.330472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330688+0000","last_change":"2024-09-13T19:06:23.247010+0000","last_active":"2024-09-13T19:06:58.330688+0000","last_peered":"2024-09-13T19:06:58.330688+0000","last_clean":"2024-09-13T19:06:58.330688+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:06:58.330688+0000","last_undegraded":"2024-09-13T19:06:58.330688+0000","last_fullsized":"2024-09-13T19:06:58.330688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:39.504976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.165710+0000","last_change":"2024-09-13T19:06:25.277155+0000","last_active":"2024-09-13T19:09:37.165710+0000","last_peered":"2024-09-13T19:09:37.165710+0000","last_clean":"2024-09-13T19:09:37.165710+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:09:37.165710+0000","last_undegraded":"2024-09-13T19:09:37.165710+0000","last_fullsized":"2024-09-13T19:09:37.165710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:35.421991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.353918+0000","last_change":"2024-09-13T19:06:27.303059+0000","last_active":"2024-09-13T19:06:58.353918+0000","last_peered":"2024-09-13T19:06:58.353918+0000","last_clean":"2024-09-13T19:06:58.353918+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:06:58.353918+0000","last_undegraded":"2024-09-13T19:06:58.353918+0000","last_fullsized":"2024-09-13T19:06:58.353918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:37.515962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.452185+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:08:36.452185+0000","last_peered":"2024-09-13T19:08:36.452185+0000","last_clean":"2024-09-13T19:08:36.452185+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:08:36.452185+0000","last_undegraded":"2024-09-13T19:08:36.452185+0000","last_fullsized":"2024-09-13T19:08:36.452185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.652660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.037885+0000","last_change":"2024-09-13T19:06:21.264605+0000","last_active":"2024-09-13T19:07:08.037885+0000","last_peered":"2024-09-13T19:07:08.037885+0000","last_clean":"2024-09-13T19:07:08.037885+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:07:08.037885+0000","last_undegraded":"2024-09-13T19:07:08.037885+0000","last_fullsized":"2024-09-13T19:07:08.037885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:53:07.316308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331265+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:06:58.331265+0000","last_peered":"2024-09-13T19:06:58.331265+0000","last_clean":"2024-09-13T19:06:58.331265+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:06:58.331265+0000","last_undegraded":"2024-09-13T19:06:58.331265+0000","last_fullsized":"2024-09-13T19:06:58.331265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328957+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:06:58.328957+0000","last_peered":"2024-09-13T19:06:58.328957+0000","last_clean":"2024-09-13T19:06:58.328957+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:06:58.328957+0000","last_undegraded":"2024-09-13T19:06:58.328957+0000","last_fullsized":"2024-09-13T19:06:58.328957+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:44.563284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.827365+0000","last_change":"2024-09-13T19:06:23.246897+0000","last_active":"2024-09-13T19:09:38.827365+0000","last_peered":"2024-09-13T19:09:38.827365+0000","last_clean":"2024-09-13T19:09:38.827365+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:09:38.827365+0000","last_undegraded":"2024-09-13T19:09:38.827365+0000","last_fullsized":"2024-09-13T19:09:38.827365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:02.627136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'69","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.864640+0000","last_change":"2024-09-13T19:06:25.271746+0000","last_active":"2024-09-13T19:10:03.864640+0000","last_peered":"2024-09-13T19:10:03.864640+0000","last_clean":"2024-09-13T19:10:03.864640+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:03.864640+0000","last_undegraded":"2024-09-13T19:10:03.864640+0000","last_fullsized":"2024-09-13T19:10:03.864640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:48.903655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328017+0000","last_change":"2024-09-13T19:06:27.327868+0000","last_active":"2024-09-13T19:06:58.328017+0000","last_peered":"2024-09-13T19:06:58.328017+0000","last_clean":"2024-09-13T19:06:58.328017+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:06:58.328017+0000","last_undegraded":"2024-09-13T19:06:58.328017+0000","last_fullsized":"2024-09-13T19:06:58.328017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:58.375326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.927178+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:36.927178+0000","last_peered":"2024-09-13T19:08:36.927178+0000","last_clean":"2024-09-13T19:08:36.927178+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:36.927178+0000","last_undegraded":"2024-09-13T19:08:36.927178+0000","last_fullsized":"2024-09-13T19:08:36.927178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:18.960181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'7","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474863+0000","last_change":"2024-09-13T19:06:21.256957+0000","last_active":"2024-09-13T19:09:38.474863+0000","last_peered":"2024-09-13T19:09:38.474863+0000","last_clean":"2024-09-13T19:09:38.474863+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:09:38.474863+0000","last_undegraded":"2024-09-13T19:09:38.474863+0000","last_fullsized":"2024-09-13T19:09:38.474863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:21.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.052247+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:08:37.052247+0000","last_peered":"2024-09-13T19:08:37.052247+0000","last_clean":"2024-09-13T19:08:37.052247+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:08:37.052247+0000","last_undegraded":"2024-09-13T19:08:37.052247+0000","last_fullsized":"2024-09-13T19:08:37.052247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344720+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:06:58.344720+0000","last_peered":"2024-09-13T19:06:58.344720+0000","last_clean":"2024-09-13T19:06:58.344720+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:06:58.344720+0000","last_undegraded":"2024-09-13T19:06:58.344720+0000","last_fullsized":"2024-09-13T19:06:58.344720+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:09.392771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.357946+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:06:58.357946+0000","last_peered":"2024-09-13T19:06:58.357946+0000","last_clean":"2024-09-13T19:06:58.357946+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:06:58.357946+0000","last_undegraded":"2024-09-13T19:06:58.357946+0000","last_fullsized":"2024-09-13T19:06:58.357946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:53.053072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.352663+0000","last_change":"2024-09-13T19:06:25.289221+0000","last_active":"2024-09-13T19:06:58.352663+0000","last_peered":"2024-09-13T19:06:58.352663+0000","last_clean":"2024-09-13T19:06:58.352663+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:06:58.352663+0000","last_undegraded":"2024-09-13T19:06:58.352663+0000","last_fullsized":"2024-09-13T19:06:58.352663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:24.895515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.526101+0000","last_change":"2024-09-13T19:06:27.322042+0000","last_active":"2024-09-13T19:10:03.526101+0000","last_peered":"2024-09-13T19:10:03.526101+0000","last_clean":"2024-09-13T19:10:03.526101+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:03.526101+0000","last_undegraded":"2024-09-13T19:10:03.526101+0000","last_fullsized":"2024-09-13T19:10:03.526101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:21.505184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.350581+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:06:58.350581+0000","last_peered":"2024-09-13T19:06:58.350581+0000","last_clean":"2024-09-13T19:06:58.350581+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:06:58.350581+0000","last_undegraded":"2024-09-13T19:06:58.350581+0000","last_fullsized":"2024-09-13T19:06:58.350581+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:22:14.229365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336082+0000","last_change":"2024-09-13T19:06:21.259985+0000","last_active":"2024-09-13T19:06:58.336082+0000","last_peered":"2024-09-13T19:06:58.336082+0000","last_clean":"2024-09-13T19:06:58.336082+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:06:58.336082+0000","last_undegraded":"2024-09-13T19:06:58.336082+0000","last_fullsized":"2024-09-13T19:06:58.336082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.974707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.356451+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:06:58.356451+0000","last_peered":"2024-09-13T19:06:58.356451+0000","last_clean":"2024-09-13T19:06:58.356451+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:06:58.356451+0000","last_undegraded":"2024-09-13T19:06:58.356451+0000","last_fullsized":"2024-09-13T19:06:58.356451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:21.325723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333377+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:06:58.333377+0000","last_peered":"2024-09-13T19:06:58.333377+0000","last_clean":"2024-09-13T19:06:58.333377+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:06:58.333377+0000","last_undegraded":"2024-09-13T19:06:58.333377+0000","last_fullsized":"2024-09-13T19:06:58.333377+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:32.387056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336839+0000","last_change":"2024-09-13T19:06:23.278519+0000","last_active":"2024-09-13T19:06:58.336839+0000","last_peered":"2024-09-13T19:06:58.336839+0000","last_clean":"2024-09-13T19:06:58.336839+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:06:58.336839+0000","last_undegraded":"2024-09-13T19:06:58.336839+0000","last_fullsized":"2024-09-13T19:06:58.336839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:56.056319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337965+0000","last_change":"2024-09-13T19:06:25.303816+0000","last_active":"2024-09-13T19:06:58.337965+0000","last_peered":"2024-09-13T19:06:58.337965+0000","last_clean":"2024-09-13T19:06:58.337965+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:06:58.337965+0000","last_undegraded":"2024-09-13T19:06:58.337965+0000","last_fullsized":"2024-09-13T19:06:58.337965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:40.157012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.536212+0000","last_change":"2024-09-13T19:06:27.282458+0000","last_active":"2024-09-13T19:10:03.536212+0000","last_peered":"2024-09-13T19:10:03.536212+0000","last_clean":"2024-09-13T19:10:03.536212+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:03.536212+0000","last_undegraded":"2024-09-13T19:10:03.536212+0000","last_fullsized":"2024-09-13T19:10:03.536212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:06.303389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341741+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:06:58.341741+0000","last_peered":"2024-09-13T19:06:58.341741+0000","last_clean":"2024-09-13T19:06:58.341741+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:06:58.341741+0000","last_undegraded":"2024-09-13T19:06:58.341741+0000","last_fullsized":"2024-09-13T19:06:58.341741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:28.410267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474093+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:09:38.474093+0000","last_peered":"2024-09-13T19:09:38.474093+0000","last_clean":"2024-09-13T19:09:38.474093+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:09:38.474093+0000","last_undegraded":"2024-09-13T19:09:38.474093+0000","last_fullsized":"2024-09-13T19:09:38.474093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:35:40.974350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359033+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:06:58.359033+0000","last_peered":"2024-09-13T19:06:58.359033+0000","last_clean":"2024-09-13T19:06:58.359033+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:06:58.359033+0000","last_undegraded":"2024-09-13T19:06:58.359033+0000","last_fullsized":"2024-09-13T19:06:58.359033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:47.246830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355963+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:06:58.355963+0000","last_peered":"2024-09-13T19:06:58.355963+0000","last_clean":"2024-09-13T19:06:58.355963+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:06:58.355963+0000","last_undegraded":"2024-09-13T19:06:58.355963+0000","last_fullsized":"2024-09-13T19:06:58.355963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:20.965568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335083+0000","last_change":"2024-09-13T19:06:23.258816+0000","last_active":"2024-09-13T19:06:58.335083+0000","last_peered":"2024-09-13T19:06:58.335083+0000","last_clean":"2024-09-13T19:06:58.335083+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:06:58.335083+0000","last_undegraded":"2024-09-13T19:06:58.335083+0000","last_fullsized":"2024-09-13T19:06:58.335083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.392498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.723416+0000","last_change":"2024-09-13T19:06:25.297079+0000","last_active":"2024-09-13T19:10:03.723416+0000","last_peered":"2024-09-13T19:10:03.723416+0000","last_clean":"2024-09-13T19:10:03.723416+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:03.723416+0000","last_undegraded":"2024-09-13T19:10:03.723416+0000","last_fullsized":"2024-09-13T19:10:03.723416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:41.508588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326963+0000","last_change":"2024-09-13T19:06:27.313781+0000","last_active":"2024-09-13T19:06:58.326963+0000","last_peered":"2024-09-13T19:06:58.326963+0000","last_clean":"2024-09-13T19:06:58.326963+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:06:58.326963+0000","last_undegraded":"2024-09-13T19:06:58.326963+0000","last_fullsized":"2024-09-13T19:06:58.326963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:40.346062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342617+0000","last_change":"2024-09-13T19:06:29.312253+0000","last_active":"2024-09-13T19:06:58.342617+0000","last_peered":"2024-09-13T19:06:58.342617+0000","last_clean":"2024-09-13T19:06:58.342617+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:06:58.342617+0000","last_undegraded":"2024-09-13T19:06:58.342617+0000","last_fullsized":"2024-09-13T19:06:58.342617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:42.361204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.616193+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:09:38.616193+0000","last_peered":"2024-09-13T19:09:38.616193+0000","last_clean":"2024-09-13T19:09:38.616193+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:09:38.616193+0000","last_undegraded":"2024-09-13T19:09:38.616193+0000","last_fullsized":"2024-09-13T19:09:38.616193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:59.779490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.391281+0000","last_change":"2024-09-13T19:06:21.254116+0000","last_active":"2024-09-13T19:09:38.391281+0000","last_peered":"2024-09-13T19:09:38.391281+0000","last_clean":"2024-09-13T19:09:38.391281+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:09:38.391281+0000","last_undegraded":"2024-09-13T19:09:38.391281+0000","last_fullsized":"2024-09-13T19:09:38.391281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344342+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:06:58.344342+0000","last_peered":"2024-09-13T19:06:58.344342+0000","last_clean":"2024-09-13T19:06:58.344342+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:06:58.344342+0000","last_undegraded":"2024-09-13T19:06:58.344342+0000","last_fullsized":"2024-09-13T19:06:58.344342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:27.824459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340835+0000","last_change":"2024-09-13T19:06:23.271978+0000","last_active":"2024-09-13T19:06:58.340835+0000","last_peered":"2024-09-13T19:06:58.340835+0000","last_clean":"2024-09-13T19:06:58.340835+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:06:58.340835+0000","last_undegraded":"2024-09-13T19:06:58.340835+0000","last_fullsized":"2024-09-13T19:06:58.340835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:00.312157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'37","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.795271+0000","last_change":"2024-09-13T19:06:25.283177+0000","last_active":"2024-09-13T19:10:03.795271+0000","last_peered":"2024-09-13T19:10:03.795271+0000","last_clean":"2024-09-13T19:10:03.795271+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:03.795271+0000","last_undegraded":"2024-09-13T19:10:03.795271+0000","last_fullsized":"2024-09-13T19:10:03.795271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:04.407822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336859+0000","last_change":"2024-09-13T19:06:27.325440+0000","last_active":"2024-09-13T19:06:58.336859+0000","last_peered":"2024-09-13T19:06:58.336859+0000","last_clean":"2024-09-13T19:06:58.336859+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:06:58.336859+0000","last_undegraded":"2024-09-13T19:06:58.336859+0000","last_fullsized":"2024-09-13T19:06:58.336859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:31:33.587433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.338476+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:09:38.338476+0000","last_peered":"2024-09-13T19:09:38.338476+0000","last_clean":"2024-09-13T19:09:38.338476+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:09:38.338476+0000","last_undegraded":"2024-09-13T19:09:38.338476+0000","last_fullsized":"2024-09-13T19:09:38.338476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:15.586703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.333822+0000","last_change":"2024-09-13T19:06:21.258397+0000","last_active":"2024-09-13T19:08:31.333822+0000","last_peered":"2024-09-13T19:08:31.333822+0000","last_clean":"2024-09-13T19:08:31.333822+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:08:31.333822+0000","last_undegraded":"2024-09-13T19:08:31.333822+0000","last_fullsized":"2024-09-13T19:08:31.333822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:23.330424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.700100+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:09:37.700100+0000","last_peered":"2024-09-13T19:09:37.700100+0000","last_clean":"2024-09-13T19:09:37.700100+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:09:37.700100+0000","last_undegraded":"2024-09-13T19:09:37.700100+0000","last_fullsized":"2024-09-13T19:09:37.700100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337678+0000","last_change":"2024-09-13T19:06:23.263752+0000","last_active":"2024-09-13T19:06:58.337678+0000","last_peered":"2024-09-13T19:06:58.337678+0000","last_clean":"2024-09-13T19:06:58.337678+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:06:58.337678+0000","last_undegraded":"2024-09-13T19:06:58.337678+0000","last_fullsized":"2024-09-13T19:06:58.337678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:11.243897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.175973+0000","last_change":"2024-09-13T19:06:25.282738+0000","last_active":"2024-09-13T19:09:37.175973+0000","last_peered":"2024-09-13T19:09:37.175973+0000","last_clean":"2024-09-13T19:09:37.175973+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:09:37.175973+0000","last_undegraded":"2024-09-13T19:09:37.175973+0000","last_fullsized":"2024-09-13T19:09:37.175973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:30.312744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329003+0000","last_change":"2024-09-13T19:06:27.319132+0000","last_active":"2024-09-13T19:06:58.329003+0000","last_peered":"2024-09-13T19:06:58.329003+0000","last_clean":"2024-09-13T19:06:58.329003+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:06:58.329003+0000","last_undegraded":"2024-09-13T19:06:58.329003+0000","last_fullsized":"2024-09-13T19:06:58.329003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:50.916949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329771+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:06:58.329771+0000","last_peered":"2024-09-13T19:06:58.329771+0000","last_clean":"2024-09-13T19:06:58.329771+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:06:58.329771+0000","last_undegraded":"2024-09-13T19:06:58.329771+0000","last_fullsized":"2024-09-13T19:06:58.329771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:34.489280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.328516+0000","last_change":"2024-09-13T19:06:21.244155+0000","last_active":"2024-09-13T19:06:58.328516+0000","last_peered":"2024-09-13T19:06:58.328516+0000","last_clean":"2024-09-13T19:06:58.328516+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:06:58.328516+0000","last_undegraded":"2024-09-13T19:06:58.328516+0000","last_fullsized":"2024-09-13T19:06:58.328516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345339+0000","last_change":"2024-09-13T19:06:19.272180+0000","last_active":"2024-09-13T19:06:58.345339+0000","last_peered":"2024-09-13T19:06:58.345339+0000","last_clean":"2024-09-13T19:06:58.345339+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:06:58.345339+0000","last_undegraded":"2024-09-13T19:06:58.345339+0000","last_fullsized":"2024-09-13T19:06:58.345339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:05.643287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329720+0000","last_change":"2024-09-13T19:06:23.263616+0000","last_active":"2024-09-13T19:06:58.329720+0000","last_peered":"2024-09-13T19:06:58.329720+0000","last_clean":"2024-09-13T19:06:58.329720+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:06:58.329720+0000","last_undegraded":"2024-09-13T19:06:58.329720+0000","last_fullsized":"2024-09-13T19:06:58.329720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:38.234529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.683631+0000","last_change":"2024-09-13T19:06:25.270269+0000","last_active":"2024-09-13T19:10:03.683631+0000","last_peered":"2024-09-13T19:10:03.683631+0000","last_clean":"2024-09-13T19:10:03.683631+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:03.683631+0000","last_undegraded":"2024-09-13T19:10:03.683631+0000","last_fullsized":"2024-09-13T19:10:03.683631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:42.960440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.339704+0000","last_change":"2024-09-13T19:06:27.320991+0000","last_active":"2024-09-13T19:06:58.339704+0000","last_peered":"2024-09-13T19:06:58.339704+0000","last_clean":"2024-09-13T19:06:58.339704+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:06:58.339704+0000","last_undegraded":"2024-09-13T19:06:58.339704+0000","last_fullsized":"2024-09-13T19:06:58.339704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.378906+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.378906+0000","last_peered":"2024-09-13T19:09:37.378906+0000","last_clean":"2024-09-13T19:09:37.378906+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.378906+0000","last_undegraded":"2024-09-13T19:09:37.378906+0000","last_fullsized":"2024-09-13T19:09:37.378906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:43.618866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.383880+0000","last_change":"2024-09-13T19:06:21.259679+0000","last_active":"2024-09-13T19:07:50.383880+0000","last_peered":"2024-09-13T19:07:50.383880+0000","last_clean":"2024-09-13T19:07:50.383880+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:07:50.383880+0000","last_undegraded":"2024-09-13T19:07:50.383880+0000","last_fullsized":"2024-09-13T19:07:50.383880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:13.988925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.722225+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:07:05.722225+0000","last_peered":"2024-09-13T19:07:05.722225+0000","last_clean":"2024-09-13T19:07:05.722225+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:07:05.722225+0000","last_undegraded":"2024-09-13T19:07:05.722225+0000","last_fullsized":"2024-09-13T19:07:05.722225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336516+0000","last_change":"2024-09-13T19:06:23.274472+0000","last_active":"2024-09-13T19:06:58.336516+0000","last_peered":"2024-09-13T19:06:58.336516+0000","last_clean":"2024-09-13T19:06:58.336516+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:06:58.336516+0000","last_undegraded":"2024-09-13T19:06:58.336516+0000","last_fullsized":"2024-09-13T19:06:58.336516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:17.488278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.661860+0000","last_change":"2024-09-13T19:06:25.301056+0000","last_active":"2024-09-13T19:10:03.661860+0000","last_peered":"2024-09-13T19:10:03.661860+0000","last_clean":"2024-09-13T19:10:03.661860+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:03.661860+0000","last_undegraded":"2024-09-13T19:10:03.661860+0000","last_fullsized":"2024-09-13T19:10:03.661860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:47.795992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329265+0000","last_change":"2024-09-13T19:06:27.294666+0000","last_active":"2024-09-13T19:06:58.329265+0000","last_peered":"2024-09-13T19:06:58.329265+0000","last_clean":"2024-09-13T19:06:58.329265+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:06:58.329265+0000","last_undegraded":"2024-09-13T19:06:58.329265+0000","last_fullsized":"2024-09-13T19:06:58.329265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:44.973735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000048+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:08:29.000048+0000","last_peered":"2024-09-13T19:08:29.000048+0000","last_clean":"2024-09-13T19:08:29.000048+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:08:29.000048+0000","last_undegraded":"2024-09-13T19:08:29.000048+0000","last_fullsized":"2024-09-13T19:08:29.000048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:37.935118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335394+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:06:58.335394+0000","last_peered":"2024-09-13T19:06:58.335394+0000","last_clean":"2024-09-13T19:06:58.335394+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:06:58.335394+0000","last_undegraded":"2024-09-13T19:06:58.335394+0000","last_fullsized":"2024-09-13T19:06:58.335394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:45.587940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333770+0000","last_change":"2024-09-13T19:06:23.248415+0000","last_active":"2024-09-13T19:06:58.333770+0000","last_peered":"2024-09-13T19:06:58.333770+0000","last_clean":"2024-09-13T19:06:58.333770+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:06:58.333770+0000","last_undegraded":"2024-09-13T19:06:58.333770+0000","last_fullsized":"2024-09-13T19:06:58.333770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:45.792380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'62","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.845619+0000","last_change":"2024-09-13T19:06:25.283923+0000","last_active":"2024-09-13T19:10:03.845619+0000","last_peered":"2024-09-13T19:10:03.845619+0000","last_clean":"2024-09-13T19:10:03.845619+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:03.845619+0000","last_undegraded":"2024-09-13T19:10:03.845619+0000","last_fullsized":"2024-09-13T19:10:03.845619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:12.373262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.330187+0000","last_change":"2024-09-13T19:06:27.303955+0000","last_active":"2024-09-13T19:06:58.330187+0000","last_peered":"2024-09-13T19:06:58.330187+0000","last_clean":"2024-09-13T19:06:58.330187+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:06:58.330187+0000","last_undegraded":"2024-09-13T19:06:58.330187+0000","last_fullsized":"2024-09-13T19:06:58.330187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:14.386556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.917251+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:36.917251+0000","last_peered":"2024-09-13T19:08:36.917251+0000","last_clean":"2024-09-13T19:08:36.917251+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:36.917251+0000","last_undegraded":"2024-09-13T19:08:36.917251+0000","last_fullsized":"2024-09-13T19:08:36.917251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:57.870673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.318999+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:08:31.318999+0000","last_peered":"2024-09-13T19:08:31.318999+0000","last_clean":"2024-09-13T19:08:31.318999+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:08:31.318999+0000","last_undegraded":"2024-09-13T19:08:31.318999+0000","last_fullsized":"2024-09-13T19:08:31.318999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:02.158739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724569+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:07:05.724569+0000","last_peered":"2024-09-13T19:07:05.724569+0000","last_clean":"2024-09-13T19:07:05.724569+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:07:05.724569+0000","last_undegraded":"2024-09-13T19:07:05.724569+0000","last_fullsized":"2024-09-13T19:07:05.724569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.337604+0000","last_change":"2024-09-13T19:06:23.257527+0000","last_active":"2024-09-13T19:06:58.337604+0000","last_peered":"2024-09-13T19:06:58.337604+0000","last_clean":"2024-09-13T19:06:58.337604+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:06:58.337604+0000","last_undegraded":"2024-09-13T19:06:58.337604+0000","last_fullsized":"2024-09-13T19:06:58.337604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:25.565333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.667527+0000","last_change":"2024-09-13T19:06:25.294450+0000","last_active":"2024-09-13T19:10:03.667527+0000","last_peered":"2024-09-13T19:10:03.667527+0000","last_clean":"2024-09-13T19:10:03.667527+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:03.667527+0000","last_undegraded":"2024-09-13T19:10:03.667527+0000","last_fullsized":"2024-09-13T19:10:03.667527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:37.388059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359493+0000","last_change":"2024-09-13T19:06:27.318412+0000","last_active":"2024-09-13T19:06:58.359493+0000","last_peered":"2024-09-13T19:06:58.359493+0000","last_clean":"2024-09-13T19:06:58.359493+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:06:58.359493+0000","last_undegraded":"2024-09-13T19:06:58.359493+0000","last_fullsized":"2024-09-13T19:06:58.359493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:02.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335274+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:06:58.335274+0000","last_peered":"2024-09-13T19:06:58.335274+0000","last_clean":"2024-09-13T19:06:58.335274+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:06:58.335274+0000","last_undegraded":"2024-09-13T19:06:58.335274+0000","last_fullsized":"2024-09-13T19:06:58.335274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:55.890196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:37.122252+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:08:37.122252+0000","last_peered":"2024-09-13T19:08:37.122252+0000","last_clean":"2024-09-13T19:08:37.122252+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:08:37.122252+0000","last_undegraded":"2024-09-13T19:08:37.122252+0000","last_fullsized":"2024-09-13T19:08:37.122252+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.738508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.724550+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:07:05.724550+0000","last_peered":"2024-09-13T19:07:05.724550+0000","last_clean":"2024-09-13T19:07:05.724550+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:07:05.724550+0000","last_undegraded":"2024-09-13T19:07:05.724550+0000","last_fullsized":"2024-09-13T19:07:05.724550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:40.692465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"25'1","reported_seq":220,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.487441+0000","last_change":"2024-09-13T19:06:23.260000+0000","last_active":"2024-09-13T19:10:03.487441+0000","last_peered":"2024-09-13T19:10:03.487441+0000","last_clean":"2024-09-13T19:10:03.487441+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:03.487441+0000","last_undegraded":"2024-09-13T19:10:03.487441+0000","last_fullsized":"2024-09-13T19:10:03.487441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:29.210958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.827796+0000","last_change":"2024-09-13T19:06:25.266493+0000","last_active":"2024-09-13T19:10:03.827796+0000","last_peered":"2024-09-13T19:10:03.827796+0000","last_clean":"2024-09-13T19:10:03.827796+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:03.827796+0000","last_undegraded":"2024-09-13T19:10:03.827796+0000","last_fullsized":"2024-09-13T19:10:03.827796+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:30:30.843285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331097+0000","last_change":"2024-09-13T19:06:27.282770+0000","last_active":"2024-09-13T19:06:58.331097+0000","last_peered":"2024-09-13T19:06:58.331097+0000","last_clean":"2024-09-13T19:06:58.331097+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:06:58.331097+0000","last_undegraded":"2024-09-13T19:06:58.331097+0000","last_fullsized":"2024-09-13T19:06:58.331097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:40.940281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.927729+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:37.927729+0000","last_peered":"2024-09-13T19:09:37.927729+0000","last_clean":"2024-09-13T19:09:37.927729+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:37.927729+0000","last_undegraded":"2024-09-13T19:09:37.927729+0000","last_fullsized":"2024-09-13T19:09:37.927729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:15:02.555548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040188+0000","last_change":"2024-09-13T19:06:21.255465+0000","last_active":"2024-09-13T19:09:38.040188+0000","last_peered":"2024-09-13T19:09:38.040188+0000","last_clean":"2024-09-13T19:09:38.040188+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:09:38.040188+0000","last_undegraded":"2024-09-13T19:09:38.040188+0000","last_fullsized":"2024-09-13T19:09:38.040188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.833948+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.833948+0000","last_peered":"2024-09-13T19:09:37.833948+0000","last_clean":"2024-09-13T19:09:37.833948+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.833948+0000","last_undegraded":"2024-09-13T19:09:37.833948+0000","last_fullsized":"2024-09-13T19:09:37.833948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:40.989504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359878+0000","last_change":"2024-09-13T19:06:23.268155+0000","last_active":"2024-09-13T19:06:58.359878+0000","last_peered":"2024-09-13T19:06:58.359878+0000","last_clean":"2024-09-13T19:06:58.359878+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:06:58.359878+0000","last_undegraded":"2024-09-13T19:06:58.359878+0000","last_fullsized":"2024-09-13T19:06:58.359878+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:03.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351172+0000","last_change":"2024-09-13T19:06:25.299007+0000","last_active":"2024-09-13T19:06:58.351172+0000","last_peered":"2024-09-13T19:06:58.351172+0000","last_clean":"2024-09-13T19:06:58.351172+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:06:58.351172+0000","last_undegraded":"2024-09-13T19:06:58.351172+0000","last_fullsized":"2024-09-13T19:06:58.351172+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:06:41.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":371,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.522595+0000","last_change":"2024-09-13T19:06:27.327682+0000","last_active":"2024-09-13T19:10:03.522595+0000","last_peered":"2024-09-13T19:10:03.522595+0000","last_clean":"2024-09-13T19:10:03.522595+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:03.522595+0000","last_undegraded":"2024-09-13T19:10:03.522595+0000","last_fullsized":"2024-09-13T19:10:03.522595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:21.374194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334429+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:06:58.334429+0000","last_peered":"2024-09-13T19:06:58.334429+0000","last_clean":"2024-09-13T19:06:58.334429+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:06:58.334429+0000","last_undegraded":"2024-09-13T19:06:58.334429+0000","last_fullsized":"2024-09-13T19:06:58.334429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:51.144768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.656707+0000","last_change":"2024-09-13T19:06:21.254380+0000","last_active":"2024-09-13T19:07:50.656707+0000","last_peered":"2024-09-13T19:07:50.656707+0000","last_clean":"2024-09-13T19:07:50.656707+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:07:50.656707+0000","last_undegraded":"2024-09-13T19:07:50.656707+0000","last_fullsized":"2024-09-13T19:07:50.656707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:53.663562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.222552+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.222552+0000","last_peered":"2024-09-13T19:09:38.222552+0000","last_clean":"2024-09-13T19:09:38.222552+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.222552+0000","last_undegraded":"2024-09-13T19:09:38.222552+0000","last_fullsized":"2024-09-13T19:09:38.222552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.340885+0000","last_change":"2024-09-13T19:06:23.273729+0000","last_active":"2024-09-13T19:06:58.340885+0000","last_peered":"2024-09-13T19:06:58.340885+0000","last_clean":"2024-09-13T19:06:58.340885+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:06:58.340885+0000","last_undegraded":"2024-09-13T19:06:58.340885+0000","last_fullsized":"2024-09-13T19:06:58.340885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:06.368867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'40","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.611514+0000","last_change":"2024-09-13T19:06:25.276088+0000","last_active":"2024-09-13T19:10:03.611514+0000","last_peered":"2024-09-13T19:10:03.611514+0000","last_clean":"2024-09-13T19:10:03.611514+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:03.611514+0000","last_undegraded":"2024-09-13T19:10:03.611514+0000","last_fullsized":"2024-09-13T19:10:03.611514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:19.360900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.326495+0000","last_change":"2024-09-13T19:06:27.298155+0000","last_active":"2024-09-13T19:06:58.326495+0000","last_peered":"2024-09-13T19:06:58.326495+0000","last_clean":"2024-09-13T19:06:58.326495+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:06:58.326495+0000","last_undegraded":"2024-09-13T19:06:58.326495+0000","last_fullsized":"2024-09-13T19:06:58.326495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:42:57.764348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359715+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:06:58.359715+0000","last_peered":"2024-09-13T19:06:58.359715+0000","last_clean":"2024-09-13T19:06:58.359715+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:06:58.359715+0000","last_undegraded":"2024-09-13T19:06:58.359715+0000","last_fullsized":"2024-09-13T19:06:58.359715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:22.380375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.040383+0000","last_change":"2024-09-13T19:06:21.253912+0000","last_active":"2024-09-13T19:09:38.040383+0000","last_peered":"2024-09-13T19:09:38.040383+0000","last_clean":"2024-09-13T19:09:38.040383+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:09:38.040383+0000","last_undegraded":"2024-09-13T19:09:38.040383+0000","last_fullsized":"2024-09-13T19:09:38.040383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.709655+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:36.709655+0000","last_peered":"2024-09-13T19:08:36.709655+0000","last_clean":"2024-09-13T19:08:36.709655+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:36.709655+0000","last_undegraded":"2024-09-13T19:08:36.709655+0000","last_fullsized":"2024-09-13T19:08:36.709655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:48.191162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.331581+0000","last_change":"2024-09-13T19:06:23.249406+0000","last_active":"2024-09-13T19:06:58.331581+0000","last_peered":"2024-09-13T19:06:58.331581+0000","last_clean":"2024-09-13T19:06:58.331581+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:06:58.331581+0000","last_undegraded":"2024-09-13T19:06:58.331581+0000","last_fullsized":"2024-09-13T19:06:58.331581+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:04.162949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'34","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.621212+0000","last_change":"2024-09-13T19:06:25.266112+0000","last_active":"2024-09-13T19:10:03.621212+0000","last_peered":"2024-09-13T19:10:03.621212+0000","last_clean":"2024-09-13T19:10:03.621212+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:03.621212+0000","last_undegraded":"2024-09-13T19:10:03.621212+0000","last_fullsized":"2024-09-13T19:10:03.621212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:56.362031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335590+0000","last_change":"2024-09-13T19:06:27.315327+0000","last_active":"2024-09-13T19:06:58.335590+0000","last_peered":"2024-09-13T19:06:58.335590+0000","last_clean":"2024-09-13T19:06:58.335590+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:06:58.335590+0000","last_undegraded":"2024-09-13T19:06:58.335590+0000","last_fullsized":"2024-09-13T19:06:58.335590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:49.675039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:08.040455+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:07:08.040455+0000","last_peered":"2024-09-13T19:07:08.040455+0000","last_clean":"2024-09-13T19:07:08.040455+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:07:08.040455+0000","last_undegraded":"2024-09-13T19:07:08.040455+0000","last_fullsized":"2024-09-13T19:07:08.040455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:46.491796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.331808+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:08:31.331808+0000","last_peered":"2024-09-13T19:08:31.331808+0000","last_clean":"2024-09-13T19:08:31.331808+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:08:31.331808+0000","last_undegraded":"2024-09-13T19:08:31.331808+0000","last_fullsized":"2024-09-13T19:08:31.331808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:41.004998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.333723+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:06:58.333723+0000","last_peered":"2024-09-13T19:06:58.333723+0000","last_clean":"2024-09-13T19:06:58.333723+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:06:58.333723+0000","last_undegraded":"2024-09-13T19:06:58.333723+0000","last_fullsized":"2024-09-13T19:06:58.333723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:30.177285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.342542+0000","last_change":"2024-09-13T19:06:23.259969+0000","last_active":"2024-09-13T19:06:58.342542+0000","last_peered":"2024-09-13T19:06:58.342542+0000","last_clean":"2024-09-13T19:06:58.342542+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:06:58.342542+0000","last_undegraded":"2024-09-13T19:06:58.342542+0000","last_fullsized":"2024-09-13T19:06:58.342542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:30.762340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.810545+0000","last_change":"2024-09-13T19:06:25.289764+0000","last_active":"2024-09-13T19:10:03.810545+0000","last_peered":"2024-09-13T19:10:03.810545+0000","last_clean":"2024-09-13T19:10:03.810545+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:03.810545+0000","last_undegraded":"2024-09-13T19:10:03.810545+0000","last_fullsized":"2024-09-13T19:10:03.810545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:57.324875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.336001+0000","last_change":"2024-09-13T19:06:27.319266+0000","last_active":"2024-09-13T19:06:58.336001+0000","last_peered":"2024-09-13T19:06:58.336001+0000","last_clean":"2024-09-13T19:06:58.336001+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:06:58.336001+0000","last_undegraded":"2024-09-13T19:06:58.336001+0000","last_fullsized":"2024-09-13T19:06:58.336001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:43.390934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.046344+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.046344+0000","last_peered":"2024-09-13T19:09:38.046344+0000","last_clean":"2024-09-13T19:09:38.046344+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.046344+0000","last_undegraded":"2024-09-13T19:09:38.046344+0000","last_fullsized":"2024-09-13T19:09:38.046344+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:45.313091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.272488+0000","last_change":"2024-09-13T19:06:21.251997+0000","last_active":"2024-09-13T19:09:38.272488+0000","last_peered":"2024-09-13T19:09:38.272488+0000","last_clean":"2024-09-13T19:09:38.272488+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:09:38.272488+0000","last_undegraded":"2024-09-13T19:09:38.272488+0000","last_fullsized":"2024-09-13T19:09:38.272488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:59.294405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.359505+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:06:58.359505+0000","last_peered":"2024-09-13T19:06:58.359505+0000","last_clean":"2024-09-13T19:06:58.359505+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:06:58.359505+0000","last_undegraded":"2024-09-13T19:06:58.359505+0000","last_fullsized":"2024-09-13T19:06:58.359505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.475463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:31.875646+0000","last_change":"2024-09-13T19:06:23.274237+0000","last_active":"2024-09-13T19:08:31.875646+0000","last_peered":"2024-09-13T19:08:31.875646+0000","last_clean":"2024-09-13T19:08:31.875646+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:08:31.875646+0000","last_undegraded":"2024-09-13T19:08:31.875646+0000","last_fullsized":"2024-09-13T19:08:31.875646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.993135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.835389+0000","last_change":"2024-09-13T19:06:25.303807+0000","last_active":"2024-09-13T19:10:03.835389+0000","last_peered":"2024-09-13T19:10:03.835389+0000","last_clean":"2024-09-13T19:10:03.835389+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:03.835389+0000","last_undegraded":"2024-09-13T19:10:03.835389+0000","last_fullsized":"2024-09-13T19:10:03.835389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:40.599519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327617+0000","last_change":"2024-09-13T19:06:27.299682+0000","last_active":"2024-09-13T19:06:58.327617+0000","last_peered":"2024-09-13T19:06:58.327617+0000","last_clean":"2024-09-13T19:06:58.327617+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:06:58.327617+0000","last_undegraded":"2024-09-13T19:06:58.327617+0000","last_fullsized":"2024-09-13T19:06:58.327617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:48:37.359636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.813468+0000","last_change":"2024-09-13T19:06:29.310143+0000","last_active":"2024-09-13T19:08:33.813468+0000","last_peered":"2024-09-13T19:08:33.813468+0000","last_clean":"2024-09-13T19:08:33.813468+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:08:33.813468+0000","last_undegraded":"2024-09-13T19:08:33.813468+0000","last_fullsized":"2024-09-13T19:08:33.813468+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:12.690041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.275471+0000","last_change":"2024-09-13T19:06:21.260509+0000","last_active":"2024-09-13T19:09:38.275471+0000","last_peered":"2024-09-13T19:09:38.275471+0000","last_clean":"2024-09-13T19:09:38.275471+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:09:38.275471+0000","last_undegraded":"2024-09-13T19:09:38.275471+0000","last_fullsized":"2024-09-13T19:09:38.275471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:53:30.336072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327522+0000","last_change":"2024-09-13T19:06:19.270097+0000","last_active":"2024-09-13T19:06:58.327522+0000","last_peered":"2024-09-13T19:06:58.327522+0000","last_clean":"2024-09-13T19:06:58.327522+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:06:58.327522+0000","last_undegraded":"2024-09-13T19:06:58.327522+0000","last_fullsized":"2024-09-13T19:06:58.327522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.966727+0000","last_change":"2024-09-13T19:06:21.255097+0000","last_active":"2024-09-13T19:07:06.966727+0000","last_peered":"2024-09-13T19:07:06.966727+0000","last_clean":"2024-09-13T19:07:06.966727+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:07:06.966727+0000","last_undegraded":"2024-09-13T19:07:06.966727+0000","last_fullsized":"2024-09-13T19:07:06.966727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:32.866785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.750144+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:09:37.750144+0000","last_peered":"2024-09-13T19:09:37.750144+0000","last_clean":"2024-09-13T19:09:37.750144+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:09:37.750144+0000","last_undegraded":"2024-09-13T19:09:37.750144+0000","last_fullsized":"2024-09-13T19:09:37.750144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.881877+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:09:37.881877+0000","last_peered":"2024-09-13T19:09:37.881877+0000","last_clean":"2024-09-13T19:09:37.881877+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:09:37.881877+0000","last_undegraded":"2024-09-13T19:09:37.881877+0000","last_fullsized":"2024-09-13T19:09:37.881877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:14.919059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:07.302528+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:07:07.302528+0000","last_peered":"2024-09-13T19:07:07.302528+0000","last_clean":"2024-09-13T19:07:07.302528+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:07:07.302528+0000","last_undegraded":"2024-09-13T19:07:07.302528+0000","last_fullsized":"2024-09-13T19:07:07.302528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:57.289705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.329300+0000","last_change":"2024-09-13T19:06:21.255692+0000","last_active":"2024-09-13T19:06:58.329300+0000","last_peered":"2024-09-13T19:06:58.329300+0000","last_clean":"2024-09-13T19:06:58.329300+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:06:58.329300+0000","last_undegraded":"2024-09-13T19:06:58.329300+0000","last_fullsized":"2024-09-13T19:06:58.329300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.441511+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:09:38.441511+0000","last_peered":"2024-09-13T19:09:38.441511+0000","last_clean":"2024-09-13T19:09:38.441511+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:09:38.441511+0000","last_undegraded":"2024-09-13T19:09:38.441511+0000","last_fullsized":"2024-09-13T19:09:38.441511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:29:20.209984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:06.502701+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:07:06.502701+0000","last_peered":"2024-09-13T19:07:06.502701+0000","last_clean":"2024-09-13T19:07:06.502701+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:07:06.502701+0000","last_undegraded":"2024-09-13T19:07:06.502701+0000","last_fullsized":"2024-09-13T19:07:06.502701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:31.414170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.683930+0000","last_change":"2024-09-13T19:06:19.281225+0000","last_active":"2024-09-13T19:09:37.683930+0000","last_peered":"2024-09-13T19:09:37.683930+0000","last_clean":"2024-09-13T19:09:37.683930+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:09:37.683930+0000","last_undegraded":"2024-09-13T19:09:37.683930+0000","last_fullsized":"2024-09-13T19:09:37.683930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:57.571959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.043438+0000","last_change":"2024-09-13T19:06:21.264248+0000","last_active":"2024-09-13T19:09:38.043438+0000","last_peered":"2024-09-13T19:09:38.043438+0000","last_clean":"2024-09-13T19:09:38.043438+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:09:38.043438+0000","last_undegraded":"2024-09-13T19:09:38.043438+0000","last_fullsized":"2024-09-13T19:09:38.043438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.872768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.360068+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:06:58.360068+0000","last_peered":"2024-09-13T19:06:58.360068+0000","last_clean":"2024-09-13T19:06:58.360068+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:06:58.360068+0000","last_undegraded":"2024-09-13T19:06:58.360068+0000","last_fullsized":"2024-09-13T19:06:58.360068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:56.335986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.456067+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:09:38.456067+0000","last_peered":"2024-09-13T19:09:38.456067+0000","last_clean":"2024-09-13T19:09:38.456067+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:09:38.456067+0000","last_undegraded":"2024-09-13T19:09:38.456067+0000","last_fullsized":"2024-09-13T19:09:38.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:55:07.351103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345491+0000","last_change":"2024-09-13T19:06:19.271992+0000","last_active":"2024-09-13T19:06:58.345491+0000","last_peered":"2024-09-13T19:06:58.345491+0000","last_clean":"2024-09-13T19:06:58.345491+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:06:58.345491+0000","last_undegraded":"2024-09-13T19:06:58.345491+0000","last_fullsized":"2024-09-13T19:06:58.345491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:20.080812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.885011+0000","last_change":"2024-09-13T19:06:21.262337+0000","last_active":"2024-09-13T19:09:37.885011+0000","last_peered":"2024-09-13T19:09:37.885011+0000","last_clean":"2024-09-13T19:09:37.885011+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:09:37.885011+0000","last_undegraded":"2024-09-13T19:09:37.885011+0000","last_fullsized":"2024-09-13T19:09:37.885011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:29.829159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.334715+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:06:58.334715+0000","last_peered":"2024-09-13T19:06:58.334715+0000","last_clean":"2024-09-13T19:06:58.334715+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:06:58.334715+0000","last_undegraded":"2024-09-13T19:06:58.334715+0000","last_fullsized":"2024-09-13T19:06:58.334715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.464999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.455975+0000","last_change":"2024-09-13T19:06:21.260793+0000","last_active":"2024-09-13T19:09:38.455975+0000","last_peered":"2024-09-13T19:09:38.455975+0000","last_clean":"2024-09-13T19:09:38.455975+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:09:38.455975+0000","last_undegraded":"2024-09-13T19:09:38.455975+0000","last_fullsized":"2024-09-13T19:09:38.455975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:47.288268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.335859+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:06:58.335859+0000","last_peered":"2024-09-13T19:06:58.335859+0000","last_clean":"2024-09-13T19:06:58.335859+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:06:58.335859+0000","last_undegraded":"2024-09-13T19:06:58.335859+0000","last_fullsized":"2024-09-13T19:06:58.335859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:37:41.941513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.355462+0000","last_change":"2024-09-13T19:06:21.257594+0000","last_active":"2024-09-13T19:06:58.355462+0000","last_peered":"2024-09-13T19:06:58.355462+0000","last_clean":"2024-09-13T19:06:58.355462+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:06:58.355462+0000","last_undegraded":"2024-09-13T19:06:58.355462+0000","last_fullsized":"2024-09-13T19:06:58.355462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:55.850886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327779+0000","last_change":"2024-09-13T19:06:19.278186+0000","last_active":"2024-09-13T19:06:58.327779+0000","last_peered":"2024-09-13T19:06:58.327779+0000","last_clean":"2024-09-13T19:06:58.327779+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:06:58.327779+0000","last_undegraded":"2024-09-13T19:06:58.327779+0000","last_fullsized":"2024-09-13T19:06:58.327779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:32.495657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992857+0000","last_change":"2024-09-13T19:06:21.240787+0000","last_active":"2024-09-13T19:08:38.992857+0000","last_peered":"2024-09-13T19:08:38.992857+0000","last_clean":"2024-09-13T19:08:38.992857+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:08:38.992857+0000","last_undegraded":"2024-09-13T19:08:38.992857+0000","last_fullsized":"2024-09-13T19:08:38.992857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:45.437886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.351873+0000","last_change":"2024-09-13T19:06:19.283567+0000","last_active":"2024-09-13T19:06:58.351873+0000","last_peered":"2024-09-13T19:06:58.351873+0000","last_clean":"2024-09-13T19:06:58.351873+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:06:58.351873+0000","last_undegraded":"2024-09-13T19:06:58.351873+0000","last_fullsized":"2024-09-13T19:06:58.351873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:12.187820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002423+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:08:39.002423+0000","last_peered":"2024-09-13T19:08:39.002423+0000","last_clean":"2024-09-13T19:08:39.002423+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:08:39.002423+0000","last_undegraded":"2024-09-13T19:08:39.002423+0000","last_fullsized":"2024-09-13T19:08:39.002423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:27.206747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.341998+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:06:58.341998+0000","last_peered":"2024-09-13T19:06:58.341998+0000","last_clean":"2024-09-13T19:06:58.341998+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:06:58.341998+0000","last_undegraded":"2024-09-13T19:06:58.341998+0000","last_fullsized":"2024-09-13T19:06:58.341998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:50.012957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255695+0000","last_change":"2024-09-13T19:06:21.256504+0000","last_active":"2024-09-13T19:09:38.255695+0000","last_peered":"2024-09-13T19:09:38.255695+0000","last_clean":"2024-09-13T19:09:38.255695+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:09:38.255695+0000","last_undegraded":"2024-09-13T19:09:38.255695+0000","last_fullsized":"2024-09-13T19:09:38.255695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:05.449884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.344894+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:06:58.344894+0000","last_peered":"2024-09-13T19:06:58.344894+0000","last_clean":"2024-09-13T19:06:58.344894+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:06:58.344894+0000","last_undegraded":"2024-09-13T19:06:58.344894+0000","last_fullsized":"2024-09-13T19:06:58.344894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:12.788074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.375474+0000","last_change":"2024-09-13T19:06:21.264548+0000","last_active":"2024-09-13T19:09:38.375474+0000","last_peered":"2024-09-13T19:09:38.375474+0000","last_clean":"2024-09-13T19:09:38.375474+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:09:38.375474+0000","last_undegraded":"2024-09-13T19:09:38.375474+0000","last_fullsized":"2024-09-13T19:09:38.375474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:50.195863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345208+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:06:58.345208+0000","last_peered":"2024-09-13T19:06:58.345208+0000","last_clean":"2024-09-13T19:06:58.345208+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:06:58.345208+0000","last_undegraded":"2024-09-13T19:06:58.345208+0000","last_fullsized":"2024-09-13T19:06:58.345208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:43.433186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.255037+0000","last_change":"2024-09-13T19:06:21.261602+0000","last_active":"2024-09-13T19:09:38.255037+0000","last_peered":"2024-09-13T19:09:38.255037+0000","last_clean":"2024-09-13T19:09:38.255037+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:09:38.255037+0000","last_undegraded":"2024-09-13T19:09:38.255037+0000","last_fullsized":"2024-09-13T19:09:38.255037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:30:01.086124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.345905+0000","last_change":"2024-09-13T19:06:19.278323+0000","last_active":"2024-09-13T19:06:58.345905+0000","last_peered":"2024-09-13T19:06:58.345905+0000","last_clean":"2024-09-13T19:06:58.345905+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:06:58.345905+0000","last_undegraded":"2024-09-13T19:06:58.345905+0000","last_fullsized":"2024-09-13T19:06:58.345905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:26.752037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.374634+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:09:38.374634+0000","last_peered":"2024-09-13T19:09:38.374634+0000","last_clean":"2024-09-13T19:09:38.374634+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:09:38.374634+0000","last_undegraded":"2024-09-13T19:09:38.374634+0000","last_fullsized":"2024-09-13T19:09:38.374634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:37.611693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.231853+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.231853+0000","last_peered":"2024-09-13T19:09:38.231853+0000","last_clean":"2024-09-13T19:09:38.231853+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.231853+0000","last_undegraded":"2024-09-13T19:09:38.231853+0000","last_fullsized":"2024-09-13T19:09:38.231853+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:03.445184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:05.725335+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:07:05.725335+0000","last_peered":"2024-09-13T19:07:05.725335+0000","last_clean":"2024-09-13T19:07:05.725335+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:07:05.725335+0000","last_undegraded":"2024-09-13T19:07:05.725335+0000","last_fullsized":"2024-09-13T19:07:05.725335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:32.143596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:07:50.655037+0000","last_change":"2024-09-13T19:06:21.261511+0000","last_active":"2024-09-13T19:07:50.655037+0000","last_peered":"2024-09-13T19:07:50.655037+0000","last_clean":"2024-09-13T19:07:50.655037+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:07:50.655037+0000","last_undegraded":"2024-09-13T19:07:50.655037+0000","last_fullsized":"2024-09-13T19:07:50.655037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:36.230319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:06:58.327618+0000","last_change":"2024-09-13T19:06:19.278870+0000","last_active":"2024-09-13T19:06:58.327618+0000","last_peered":"2024-09-13T19:06:58.327618+0000","last_clean":"2024-09-13T19:06:58.327618+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:06:58.327618+0000","last_undegraded":"2024-09-13T19:06:58.327618+0000","last_fullsized":"2024-09-13T19:06:58.327618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:09.548649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'23","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.274840+0000","last_change":"2024-09-13T19:06:21.255155+0000","last_active":"2024-09-13T19:09:38.274840+0000","last_peered":"2024-09-13T19:09:38.274840+0000","last_clean":"2024-09-13T19:09:38.274840+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:09:38.274840+0000","last_undegraded":"2024-09-13T19:09:38.274840+0000","last_fullsized":"2024-09-13T19:09:38.274840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:04.154355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705715,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39980,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331860,"statfs":{"total":96636764160,"available":96595824640,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44736,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327104,"statfs":{"total":96636764160,"available":96590954496,"internally_reserved":0,"allocated":9617408,"data_stored":9346959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48348,"kb_used_data":8844,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323492,"statfs":{"total":96636764160,"available":96587255808,"internally_reserved":0,"allocated":9056256,"data_stored":8758411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.750 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.751 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.752 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.753 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.754 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.755 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.756 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.757 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.758 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.759 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.760 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:06:05.016117+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.761 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.762 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.763 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.764 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.765 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.766 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.767 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.768 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.769 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.770 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.771 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.772 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.773 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.774 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.775 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.776 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.777 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.778 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:08.779 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:10:28.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:28.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.906+0000 7fdb03bec640 1 Processor -- start 2024-09-13T19:10:28.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.906+0000 7fdb03bec640 1 -- start start 2024-09-13T19:10:28.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdafc12e760 0x7fdafc12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:28.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdafc0984f0 con 0x7fdafc12f1c0 2024-09-13T19:10:28.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdafc098dc0 con 0x7fdafc12e760 2024-09-13T19:10:28.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdafc12e760 0x7fdafc12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:28.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdafc12e760 0x7fdafc12ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48922/0 (socket says 172.21.15.12:48922) 2024-09-13T19:10:28.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 -- 172.21.15.12:0/2875568876 learned_addr learned my addr 172.21.15.12:0/2875568876 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:28.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01187640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdafc12f1c0 0x7fdafc12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49684/0 (socket says 172.21.15.12:49684) 2024-09-13T19:10:28.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 -- 172.21.15.12:0/2875568876 >> v1:172.21.15.12:6789/0 conn(0x7fdafc12f1c0 legacy=0x7fdafc12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:28.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 -- 172.21.15.12:0/2875568876 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc12f5a0 con 0x7fdafc12e760 2024-09-13T19:10:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb01988640 1 --2- 172.21.15.12:0/2875568876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc12ec80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80097f0 tx=0x7fdaf801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879b1b4291cb3f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:28.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb00986640 1 -- 172.21.15.12:0/2875568876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf80b0070 con 0x7fdafc12e760 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb00986640 1 -- 172.21.15.12:0/2875568876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80ab530 con 0x7fdafc12e760 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb00986640 1 -- 172.21.15.12:0/2875568876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf80ab830 con 0x7fdafc12e760 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- 172.21.15.12:0/2875568876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 msgr2=0x7fdafc12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 --2- 172.21.15.12:0/2875568876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc12ec80 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80097f0 tx=0x7fdaf801c4c0 comp rx=0 tx=0).stop 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- 172.21.15.12:0/2875568876 shutdown_connections 2024-09-13T19:10:28.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 --2- 172.21.15.12:0/2875568876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc12ec80 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- 172.21.15.12:0/2875568876 >> 172.21.15.12:0/2875568876 conn(0x7fdafc0a10a0 msgr2=0x7fdafc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- 172.21.15.12:0/2875568876 shutdown_connections 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.910+0000 7fdb03bec640 1 -- 172.21.15.12:0/2875568876 wait complete. 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 Processor -- start 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 -- start start 2024-09-13T19:10:28.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdafc136e30 con 0x7fdafc12e760 2024-09-13T19:10:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01988640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01988640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48928/0 (socket says 172.21.15.12:48928) 2024-09-13T19:10:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01988640 1 -- 172.21.15.12:0/1620818216 learned_addr learned my addr 172.21.15.12:0/1620818216 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:28.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01988640 1 -- 172.21.15.12:0/1620818216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdafc130510 con 0x7fdafc12e760 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01988640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdaf801a0f0 tx=0x7fdaf801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf80ba020 con 0x7fdafc12e760 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaf80b6420 con 0x7fdafc12e760 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaf80b0040 con 0x7fdafc12e760 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdafc130c10 con 0x7fdafc12e760 2024-09-13T19:10:28.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdafc09ce60 con 0x7fdafc12e760 2024-09-13T19:10:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdafc09e3a0 con 0x7fdafc12e760 2024-09-13T19:10:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdaf80bd020 con 0x7fdafc12e760 2024-09-13T19:10:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 0x7fdae0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdaf80e3540 con 0x7fdafc12e760 2024-09-13T19:10:28.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.914+0000 7fdb01187640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 0x7fdae0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.918+0000 7fdb01187640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 0x7fdae0038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001620 tx=0x7fdaec007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:28.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:28.918+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdaf80c4030 con 0x7fdafc12e760 2024-09-13T19:10:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.078+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdafc130780 con 0x7fdae0035db0 2024-09-13T19:10:29.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.122+0000 7fdaf27fc640 1 -- 172.21.15.12:0/1620818216 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+659116 (secure 0 0 0) 0x7fdaec0070d0 con 0x7fdae0035db0 2024-09-13T19:10:29.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:29.142 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:29.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 msgr2=0x7fdae0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 0x7fdae0038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdaec001620 tx=0x7fdaec007a10 comp rx=0 tx=0).stop 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 msgr2=0x7fdafc09c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fdaf801a0f0 tx=0x7fdaf801ad00 comp rx=0 tx=0).stop 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 shutdown_connections 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fdae0035db0 0x7fdae0038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 --2- 172.21.15.12:0/1620818216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdafc12e760 0x7fdafc09c920 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 >> 172.21.15.12:0/1620818216 conn(0x7fdafc0a10a0 msgr2=0x7fdafc095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 shutdown_connections 2024-09-13T19:10:29.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:29.130+0000 7fdb03bec640 1 -- 172.21.15.12:0/1620818216 wait complete. 2024-09-13T19:10:29.158 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-13T19:10:29.026803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4734,"ondisk_log_size":4734,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1788524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006008"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916989+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:10:07.916989+0000","last_peered":"2024-09-13T19:10:07.916989+0000","last_clean":"2024-09-13T19:10:07.916989+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:10:07.916989+0000","last_undegraded":"2024-09-13T19:10:07.916989+0000","last_fullsized":"2024-09-13T19:10:07.916989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007388+0000","last_change":"2024-09-13T19:06:21.265691+0000","last_active":"2024-09-13T19:08:54.007388+0000","last_peered":"2024-09-13T19:08:54.007388+0000","last_clean":"2024-09-13T19:08:54.007388+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:08:54.007388+0000","last_undegraded":"2024-09-13T19:08:54.007388+0000","last_fullsized":"2024-09-13T19:08:54.007388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016813+0000","last_change":"2024-09-13T19:06:19.281253+0000","last_active":"2024-09-13T19:10:07.016813+0000","last_peered":"2024-09-13T19:10:07.016813+0000","last_clean":"2024-09-13T19:10:07.016813+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:10:07.016813+0000","last_undegraded":"2024-09-13T19:10:07.016813+0000","last_fullsized":"2024-09-13T19:10:07.016813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007904+0000","last_change":"2024-09-13T19:06:21.257152+0000","last_active":"2024-09-13T19:08:54.007904+0000","last_peered":"2024-09-13T19:08:54.007904+0000","last_clean":"2024-09-13T19:08:54.007904+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:08:54.007904+0000","last_undegraded":"2024-09-13T19:08:54.007904+0000","last_fullsized":"2024-09-13T19:08:54.007904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.998082+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:08:23.998082+0000","last_peered":"2024-09-13T19:08:23.998082+0000","last_clean":"2024-09-13T19:08:23.998082+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:08:23.998082+0000","last_undegraded":"2024-09-13T19:08:23.998082+0000","last_fullsized":"2024-09-13T19:08:23.998082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.056201+0000","last_change":"2024-09-13T19:06:21.257435+0000","last_active":"2024-09-13T19:09:38.056201+0000","last_peered":"2024-09-13T19:09:38.056201+0000","last_clean":"2024-09-13T19:09:38.056201+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:09:38.056201+0000","last_undegraded":"2024-09-13T19:09:38.056201+0000","last_fullsized":"2024-09-13T19:09:38.056201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916970+0000","last_change":"2024-09-13T19:06:19.272048+0000","last_active":"2024-09-13T19:10:07.916970+0000","last_peered":"2024-09-13T19:10:07.916970+0000","last_clean":"2024-09-13T19:10:07.916970+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:10:07.916970+0000","last_undegraded":"2024-09-13T19:10:07.916970+0000","last_fullsized":"2024-09-13T19:10:07.916970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.271214+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.271214+0000","last_peered":"2024-09-13T19:09:38.271214+0000","last_clean":"2024-09-13T19:09:38.271214+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.271214+0000","last_undegraded":"2024-09-13T19:09:38.271214+0000","last_fullsized":"2024-09-13T19:09:38.271214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006250+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:08:49.006250+0000","last_peered":"2024-09-13T19:08:49.006250+0000","last_clean":"2024-09-13T19:08:49.006250+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:08:49.006250+0000","last_undegraded":"2024-09-13T19:08:49.006250+0000","last_fullsized":"2024-09-13T19:08:49.006250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.470353+0000","last_change":"2024-09-13T19:06:21.261907+0000","last_active":"2024-09-13T19:10:07.470353+0000","last_peered":"2024-09-13T19:10:07.470353+0000","last_clean":"2024-09-13T19:10:07.470353+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:10:07.470353+0000","last_undegraded":"2024-09-13T19:10:07.470353+0000","last_fullsized":"2024-09-13T19:10:07.470353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.783980+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:10:03.783980+0000","last_peered":"2024-09-13T19:10:03.783980+0000","last_clean":"2024-09-13T19:10:03.783980+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:10:03.783980+0000","last_undegraded":"2024-09-13T19:10:03.783980+0000","last_fullsized":"2024-09-13T19:10:03.783980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999795+0000","last_change":"2024-09-13T19:06:21.266198+0000","last_active":"2024-09-13T19:08:28.999795+0000","last_peered":"2024-09-13T19:08:28.999795+0000","last_clean":"2024-09-13T19:08:28.999795+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:08:28.999795+0000","last_undegraded":"2024-09-13T19:08:28.999795+0000","last_fullsized":"2024-09-13T19:08:28.999795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005953+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:08:49.005953+0000","last_peered":"2024-09-13T19:08:49.005953+0000","last_clean":"2024-09-13T19:08:49.005953+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:08:49.005953+0000","last_undegraded":"2024-09-13T19:08:49.005953+0000","last_fullsized":"2024-09-13T19:08:49.005953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.612568+0000","last_change":"2024-09-13T19:06:21.255493+0000","last_active":"2024-09-13T19:09:38.612568+0000","last_peered":"2024-09-13T19:09:38.612568+0000","last_clean":"2024-09-13T19:09:38.612568+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:09:38.612568+0000","last_undegraded":"2024-09-13T19:09:38.612568+0000","last_fullsized":"2024-09-13T19:09:38.612568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:48.995277+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:08:48.995277+0000","last_peered":"2024-09-13T19:08:48.995277+0000","last_clean":"2024-09-13T19:08:48.995277+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:08:48.995277+0000","last_undegraded":"2024-09-13T19:08:48.995277+0000","last_fullsized":"2024-09-13T19:08:48.995277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.907215+0000","last_change":"2024-09-13T19:06:21.259423+0000","last_active":"2024-09-13T19:09:37.907215+0000","last_peered":"2024-09-13T19:09:37.907215+0000","last_clean":"2024-09-13T19:09:37.907215+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:09:37.907215+0000","last_undegraded":"2024-09-13T19:09:37.907215+0000","last_fullsized":"2024-09-13T19:09:37.907215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003890+0000","last_change":"2024-09-13T19:06:21.257261+0000","last_active":"2024-09-13T19:08:44.003890+0000","last_peered":"2024-09-13T19:08:44.003890+0000","last_clean":"2024-09-13T19:08:44.003890+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:08:44.003890+0000","last_undegraded":"2024-09-13T19:08:44.003890+0000","last_fullsized":"2024-09-13T19:08:44.003890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004569+0000","last_change":"2024-09-13T19:06:19.287823+0000","last_active":"2024-09-13T19:08:44.004569+0000","last_peered":"2024-09-13T19:08:44.004569+0000","last_clean":"2024-09-13T19:08:44.004569+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:08:44.004569+0000","last_undegraded":"2024-09-13T19:08:44.004569+0000","last_fullsized":"2024-09-13T19:08:44.004569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.476065+0000","last_change":"2024-09-13T19:06:21.263484+0000","last_active":"2024-09-13T19:09:38.476065+0000","last_peered":"2024-09-13T19:09:38.476065+0000","last_clean":"2024-09-13T19:09:38.476065+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:09:38.476065+0000","last_undegraded":"2024-09-13T19:09:38.476065+0000","last_fullsized":"2024-09-13T19:09:38.476065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002595+0000","last_change":"2024-09-13T19:06:19.276357+0000","last_active":"2024-09-13T19:08:44.002595+0000","last_peered":"2024-09-13T19:08:44.002595+0000","last_clean":"2024-09-13T19:08:44.002595+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:08:44.002595+0000","last_undegraded":"2024-09-13T19:08:44.002595+0000","last_fullsized":"2024-09-13T19:08:44.002595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004025+0000","last_change":"2024-09-13T19:06:21.265579+0000","last_active":"2024-09-13T19:08:44.004025+0000","last_peered":"2024-09-13T19:08:44.004025+0000","last_clean":"2024-09-13T19:08:44.004025+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:08:44.004025+0000","last_undegraded":"2024-09-13T19:08:44.004025+0000","last_fullsized":"2024-09-13T19:08:44.004025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.793007+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.793007+0000","last_peered":"2024-09-13T19:09:37.793007+0000","last_clean":"2024-09-13T19:09:37.793007+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.793007+0000","last_undegraded":"2024-09-13T19:09:37.793007+0000","last_fullsized":"2024-09-13T19:09:37.793007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.905501+0000","last_change":"2024-09-13T19:06:21.253936+0000","last_active":"2024-09-13T19:09:37.905501+0000","last_peered":"2024-09-13T19:09:37.905501+0000","last_clean":"2024-09-13T19:09:37.905501+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:09:37.905501+0000","last_undegraded":"2024-09-13T19:09:37.905501+0000","last_fullsized":"2024-09-13T19:09:37.905501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004154+0000","last_change":"2024-09-13T19:06:19.281986+0000","last_active":"2024-09-13T19:08:44.004154+0000","last_peered":"2024-09-13T19:08:44.004154+0000","last_clean":"2024-09-13T19:08:44.004154+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:08:44.004154+0000","last_undegraded":"2024-09-13T19:08:44.004154+0000","last_fullsized":"2024-09-13T19:08:44.004154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392675+0000","last_change":"2024-09-13T19:06:21.254760+0000","last_active":"2024-09-13T19:09:38.392675+0000","last_peered":"2024-09-13T19:09:38.392675+0000","last_clean":"2024-09-13T19:09:38.392675+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:09:38.392675+0000","last_undegraded":"2024-09-13T19:09:38.392675+0000","last_fullsized":"2024-09-13T19:09:38.392675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.222644+0000","last_change":"2024-09-13T19:06:19.278861+0000","last_active":"2024-09-13T19:09:38.222644+0000","last_peered":"2024-09-13T19:09:38.222644+0000","last_clean":"2024-09-13T19:09:38.222644+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:09:38.222644+0000","last_undegraded":"2024-09-13T19:09:38.222644+0000","last_fullsized":"2024-09-13T19:09:38.222644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.904722+0000","last_change":"2024-09-13T19:06:21.265434+0000","last_active":"2024-09-13T19:09:37.904722+0000","last_peered":"2024-09-13T19:09:37.904722+0000","last_clean":"2024-09-13T19:09:37.904722+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:09:37.904722+0000","last_undegraded":"2024-09-13T19:09:37.904722+0000","last_fullsized":"2024-09-13T19:09:37.904722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002356+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:08:39.002356+0000","last_peered":"2024-09-13T19:08:39.002356+0000","last_clean":"2024-09-13T19:08:39.002356+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:08:39.002356+0000","last_undegraded":"2024-09-13T19:08:39.002356+0000","last_fullsized":"2024-09-13T19:08:39.002356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.498496+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.498496+0000","last_peered":"2024-09-13T19:09:38.498496+0000","last_clean":"2024-09-13T19:09:38.498496+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.498496+0000","last_undegraded":"2024-09-13T19:09:38.498496+0000","last_fullsized":"2024-09-13T19:09:38.498496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610166+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:09:38.610166+0000","last_peered":"2024-09-13T19:09:38.610166+0000","last_clean":"2024-09-13T19:09:38.610166+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:09:38.610166+0000","last_undegraded":"2024-09-13T19:09:38.610166+0000","last_fullsized":"2024-09-13T19:09:38.610166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.789415+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:10:03.789415+0000","last_peered":"2024-09-13T19:10:03.789415+0000","last_clean":"2024-09-13T19:10:03.789415+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:10:03.789415+0000","last_undegraded":"2024-09-13T19:10:03.789415+0000","last_fullsized":"2024-09-13T19:10:03.789415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.972877+0000","last_change":"2024-09-13T19:10:12.972934+0000","last_active":"2024-09-13T19:10:12.972877+0000","last_peered":"2024-09-13T19:10:12.972877+0000","last_clean":"2024-09-13T19:10:12.972877+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:10:12.972877+0000","last_undegraded":"2024-09-13T19:10:12.972877+0000","last_fullsized":"2024-09-13T19:10:12.972877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.972679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:27.296223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.842913+0000","last_change":"2024-09-13T19:10:19.843011+0000","last_active":"2024-09-13T19:10:19.842913+0000","last_peered":"2024-09-13T19:10:19.842913+0000","last_clean":"2024-09-13T19:10:19.842913+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:19.842913+0000","last_undegraded":"2024-09-13T19:10:19.842913+0000","last_fullsized":"2024-09-13T19:10:19.842913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.842729+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:36.209477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.887782+0000","last_change":"2024-09-13T19:10:15.887880+0000","last_active":"2024-09-13T19:10:15.887782+0000","last_peered":"2024-09-13T19:10:15.887782+0000","last_clean":"2024-09-13T19:10:15.887782+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:10:15.887782+0000","last_undegraded":"2024-09-13T19:10:15.887782+0000","last_fullsized":"2024-09-13T19:10:15.887782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.887546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:39.150730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007497+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:08:54.007497+0000","last_peered":"2024-09-13T19:08:54.007497+0000","last_clean":"2024-09-13T19:08:54.007497+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:08:54.007497+0000","last_undegraded":"2024-09-13T19:08:54.007497+0000","last_fullsized":"2024-09-13T19:08:54.007497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.473235+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.473235+0000","last_peered":"2024-09-13T19:09:38.473235+0000","last_clean":"2024-09-13T19:09:38.473235+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.473235+0000","last_undegraded":"2024-09-13T19:09:38.473235+0000","last_fullsized":"2024-09-13T19:09:38.473235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001240+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:08:39.001240+0000","last_peered":"2024-09-13T19:08:39.001240+0000","last_clean":"2024-09-13T19:08:39.001240+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:08:39.001240+0000","last_undegraded":"2024-09-13T19:08:39.001240+0000","last_fullsized":"2024-09-13T19:08:39.001240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.432429+0000","last_change":"2024-09-13T19:10:27.432482+0000","last_active":"2024-09-13T19:10:27.432429+0000","last_peered":"2024-09-13T19:10:27.432429+0000","last_clean":"2024-09-13T19:10:27.432429+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:10:27.432429+0000","last_undegraded":"2024-09-13T19:10:27.432429+0000","last_fullsized":"2024-09-13T19:10:27.432429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.432228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:29.048350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.866941+0000","last_change":"2024-09-13T19:10:10.867013+0000","last_active":"2024-09-13T19:10:10.866941+0000","last_peered":"2024-09-13T19:10:10.866941+0000","last_clean":"2024-09-13T19:10:10.866941+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:10:10.866941+0000","last_undegraded":"2024-09-13T19:10:10.866941+0000","last_fullsized":"2024-09-13T19:10:10.866941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.866745+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:48.102941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007781+0000","last_change":"2024-09-13T19:06:27.324894+0000","last_active":"2024-09-13T19:08:54.007781+0000","last_peered":"2024-09-13T19:08:54.007781+0000","last_clean":"2024-09-13T19:08:54.007781+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:08:54.007781+0000","last_undegraded":"2024-09-13T19:08:54.007781+0000","last_fullsized":"2024-09-13T19:08:54.007781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:58.998085+0000","last_change":"2024-09-13T19:06:29.300886+0000","last_active":"2024-09-13T19:08:58.998085+0000","last_peered":"2024-09-13T19:08:58.998085+0000","last_clean":"2024-09-13T19:08:58.998085+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:08:58.998085+0000","last_undegraded":"2024-09-13T19:08:58.998085+0000","last_fullsized":"2024-09-13T19:08:58.998085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.391021+0000","last_change":"2024-09-13T19:06:21.256421+0000","last_active":"2024-09-13T19:09:38.391021+0000","last_peered":"2024-09-13T19:09:38.391021+0000","last_clean":"2024-09-13T19:09:38.391021+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:09:38.391021+0000","last_undegraded":"2024-09-13T19:09:38.391021+0000","last_fullsized":"2024-09-13T19:09:38.391021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002201+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:08:39.002201+0000","last_peered":"2024-09-13T19:08:39.002201+0000","last_clean":"2024-09-13T19:08:39.002201+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:08:39.002201+0000","last_undegraded":"2024-09-13T19:08:39.002201+0000","last_fullsized":"2024-09-13T19:08:39.002201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.425940+0000","last_change":"2024-09-13T19:10:25.425993+0000","last_active":"2024-09-13T19:10:25.425940+0000","last_peered":"2024-09-13T19:10:25.425940+0000","last_clean":"2024-09-13T19:10:25.425940+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:10:25.425940+0000","last_undegraded":"2024-09-13T19:10:25.425940+0000","last_fullsized":"2024-09-13T19:10:25.425940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.425753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:37.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.253203+0000","last_change":"2024-09-13T19:10:18.253379+0000","last_active":"2024-09-13T19:10:18.253203+0000","last_peered":"2024-09-13T19:10:18.253203+0000","last_clean":"2024-09-13T19:10:18.253203+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:10:18.253203+0000","last_undegraded":"2024-09-13T19:10:18.253203+0000","last_fullsized":"2024-09-13T19:10:18.253203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.252941+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:40.725492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.888053+0000","last_change":"2024-09-13T19:06:27.301544+0000","last_active":"2024-09-13T19:10:03.888053+0000","last_peered":"2024-09-13T19:10:03.888053+0000","last_clean":"2024-09-13T19:10:03.888053+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:03.888053+0000","last_undegraded":"2024-09-13T19:10:03.888053+0000","last_fullsized":"2024-09-13T19:10:03.888053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:59.005825+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:08:59.005825+0000","last_peered":"2024-09-13T19:08:59.005825+0000","last_clean":"2024-09-13T19:08:59.005825+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:08:59.005825+0000","last_undegraded":"2024-09-13T19:08:59.005825+0000","last_fullsized":"2024-09-13T19:08:59.005825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.059314+0000","last_change":"2024-09-13T19:06:21.259001+0000","last_active":"2024-09-13T19:09:38.059314+0000","last_peered":"2024-09-13T19:09:38.059314+0000","last_clean":"2024-09-13T19:09:38.059314+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:09:38.059314+0000","last_undegraded":"2024-09-13T19:09:38.059314+0000","last_fullsized":"2024-09-13T19:09:38.059314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002173+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:08:39.002173+0000","last_peered":"2024-09-13T19:08:39.002173+0000","last_clean":"2024-09-13T19:08:39.002173+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:08:39.002173+0000","last_undegraded":"2024-09-13T19:08:39.002173+0000","last_fullsized":"2024-09-13T19:08:39.002173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.881704+0000","last_change":"2024-09-13T19:10:14.881765+0000","last_active":"2024-09-13T19:10:14.881704+0000","last_peered":"2024-09-13T19:10:14.881704+0000","last_clean":"2024-09-13T19:10:14.881704+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:10:14.881704+0000","last_undegraded":"2024-09-13T19:10:14.881704+0000","last_fullsized":"2024-09-13T19:10:14.881704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.881511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:35.275730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.131235+0000","last_change":"2024-09-13T19:10:22.131313+0000","last_active":"2024-09-13T19:10:22.131235+0000","last_peered":"2024-09-13T19:10:22.131235+0000","last_clean":"2024-09-13T19:10:22.131235+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:22.131235+0000","last_undegraded":"2024-09-13T19:10:22.131235+0000","last_fullsized":"2024-09-13T19:10:22.131235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.131038+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:23.920744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":455,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.561363+0000","last_change":"2024-09-13T19:10:11.561428+0000","last_active":"2024-09-13T19:10:11.561363+0000","last_peered":"2024-09-13T19:10:11.561363+0000","last_clean":"2024-09-13T19:10:11.561363+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:11.561363+0000","last_undegraded":"2024-09-13T19:10:11.561363+0000","last_fullsized":"2024-09-13T19:10:11.561363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.561170+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:17.766610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392375+0000","last_change":"2024-09-13T19:06:21.259478+0000","last_active":"2024-09-13T19:09:38.392375+0000","last_peered":"2024-09-13T19:09:38.392375+0000","last_clean":"2024-09-13T19:09:38.392375+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:09:38.392375+0000","last_undegraded":"2024-09-13T19:09:38.392375+0000","last_fullsized":"2024-09-13T19:09:38.392375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:36.786345+0000","last_change":"2024-09-13T19:06:19.264318+0000","last_active":"2024-09-13T19:08:36.786345+0000","last_peered":"2024-09-13T19:08:36.786345+0000","last_clean":"2024-09-13T19:08:36.786345+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:08:36.786345+0000","last_undegraded":"2024-09-13T19:08:36.786345+0000","last_fullsized":"2024-09-13T19:08:36.786345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.843921+0000","last_change":"2024-09-13T19:10:14.843983+0000","last_active":"2024-09-13T19:10:14.843921+0000","last_peered":"2024-09-13T19:10:14.843921+0000","last_clean":"2024-09-13T19:10:14.843921+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:10:14.843921+0000","last_undegraded":"2024-09-13T19:10:14.843921+0000","last_fullsized":"2024-09-13T19:10:14.843921+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.843733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.242513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.232394+0000","last_change":"2024-09-13T19:10:15.232478+0000","last_active":"2024-09-13T19:10:15.232394+0000","last_peered":"2024-09-13T19:10:15.232394+0000","last_clean":"2024-09-13T19:10:15.232394+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:15.232394+0000","last_undegraded":"2024-09-13T19:10:15.232394+0000","last_fullsized":"2024-09-13T19:10:15.232394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.232187+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:36.639820+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.572971+0000","last_change":"2024-09-13T19:10:10.573027+0000","last_active":"2024-09-13T19:10:10.572971+0000","last_peered":"2024-09-13T19:10:10.572971+0000","last_clean":"2024-09-13T19:10:10.572971+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:10:10.572971+0000","last_undegraded":"2024-09-13T19:10:10.572971+0000","last_fullsized":"2024-09-13T19:10:10.572971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.572736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:15.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000164+0000","last_change":"2024-09-13T19:06:29.313617+0000","last_active":"2024-09-13T19:08:34.000164+0000","last_peered":"2024-09-13T19:08:34.000164+0000","last_clean":"2024-09-13T19:08:34.000164+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:08:34.000164+0000","last_undegraded":"2024-09-13T19:08:34.000164+0000","last_fullsized":"2024-09-13T19:08:34.000164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.611716+0000","last_change":"2024-09-13T19:06:21.258654+0000","last_active":"2024-09-13T19:09:38.611716+0000","last_peered":"2024-09-13T19:09:38.611716+0000","last_clean":"2024-09-13T19:09:38.611716+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:09:38.611716+0000","last_undegraded":"2024-09-13T19:09:38.611716+0000","last_fullsized":"2024-09-13T19:09:38.611716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.212514+0000","last_change":"2024-09-13T19:06:19.273587+0000","last_active":"2024-09-13T19:09:38.212514+0000","last_peered":"2024-09-13T19:09:38.212514+0000","last_clean":"2024-09-13T19:09:38.212514+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:09:38.212514+0000","last_undegraded":"2024-09-13T19:09:38.212514+0000","last_fullsized":"2024-09-13T19:09:38.212514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:09.007818+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:09:09.007818+0000","last_peered":"2024-09-13T19:09:09.007818+0000","last_clean":"2024-09-13T19:09:09.007818+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:09:09.007818+0000","last_undegraded":"2024-09-13T19:09:09.007818+0000","last_fullsized":"2024-09-13T19:09:09.007818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.869537+0000","last_change":"2024-09-13T19:10:15.869718+0000","last_active":"2024-09-13T19:10:15.869537+0000","last_peered":"2024-09-13T19:10:15.869537+0000","last_clean":"2024-09-13T19:10:15.869537+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:15.869537+0000","last_undegraded":"2024-09-13T19:10:15.869537+0000","last_fullsized":"2024-09-13T19:10:15.869537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.869314+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.537473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.581906+0000","last_change":"2024-09-13T19:10:09.581959+0000","last_active":"2024-09-13T19:10:09.581906+0000","last_peered":"2024-09-13T19:10:09.581906+0000","last_clean":"2024-09-13T19:10:09.581906+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:10:09.581906+0000","last_undegraded":"2024-09-13T19:10:09.581906+0000","last_fullsized":"2024-09-13T19:10:09.581906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.581716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:02.986719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001128+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:08:34.001128+0000","last_peered":"2024-09-13T19:08:34.001128+0000","last_clean":"2024-09-13T19:08:34.001128+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:08:34.001128+0000","last_undegraded":"2024-09-13T19:08:34.001128+0000","last_fullsized":"2024-09-13T19:08:34.001128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.611322+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:09:38.611322+0000","last_peered":"2024-09-13T19:09:38.611322+0000","last_clean":"2024-09-13T19:09:38.611322+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:09:38.611322+0000","last_undegraded":"2024-09-13T19:09:38.611322+0000","last_fullsized":"2024-09-13T19:09:38.611322+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001084+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:08:34.001084+0000","last_peered":"2024-09-13T19:08:34.001084+0000","last_clean":"2024-09-13T19:08:34.001084+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:08:34.001084+0000","last_undegraded":"2024-09-13T19:08:34.001084+0000","last_fullsized":"2024-09-13T19:08:34.001084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.463266+0000","last_change":"2024-09-13T19:10:26.463320+0000","last_active":"2024-09-13T19:10:26.463266+0000","last_peered":"2024-09-13T19:10:26.463266+0000","last_clean":"2024-09-13T19:10:26.463266+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:10:26.463266+0000","last_undegraded":"2024-09-13T19:10:26.463266+0000","last_fullsized":"2024-09-13T19:10:26.463266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.463075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:13.599270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.804885+0000","last_change":"2024-09-13T19:06:25.289758+0000","last_active":"2024-09-13T19:10:03.804885+0000","last_peered":"2024-09-13T19:10:03.804885+0000","last_clean":"2024-09-13T19:10:03.804885+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:03.804885+0000","last_undegraded":"2024-09-13T19:10:03.804885+0000","last_fullsized":"2024-09-13T19:10:03.804885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":362,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.631616+0000","last_change":"2024-09-13T19:10:07.631641+0000","last_active":"2024-09-13T19:10:07.631616+0000","last_peered":"2024-09-13T19:10:07.631616+0000","last_clean":"2024-09-13T19:10:07.631616+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:07.631616+0000","last_undegraded":"2024-09-13T19:10:07.631616+0000","last_fullsized":"2024-09-13T19:10:07.631616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.631538+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:44.867733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992884+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:08:38.992884+0000","last_peered":"2024-09-13T19:08:38.992884+0000","last_clean":"2024-09-13T19:08:38.992884+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:08:38.992884+0000","last_undegraded":"2024-09-13T19:08:38.992884+0000","last_fullsized":"2024-09-13T19:08:38.992884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001293+0000","last_change":"2024-09-13T19:06:21.254633+0000","last_active":"2024-09-13T19:08:39.001293+0000","last_peered":"2024-09-13T19:08:39.001293+0000","last_clean":"2024-09-13T19:08:39.001293+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:08:39.001293+0000","last_undegraded":"2024-09-13T19:08:39.001293+0000","last_fullsized":"2024-09-13T19:08:39.001293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.788872+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:10:03.788872+0000","last_peered":"2024-09-13T19:10:03.788872+0000","last_clean":"2024-09-13T19:10:03.788872+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:10:03.788872+0000","last_undegraded":"2024-09-13T19:10:03.788872+0000","last_fullsized":"2024-09-13T19:10:03.788872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.991302+0000","last_change":"2024-09-13T19:06:23.249243+0000","last_active":"2024-09-13T19:08:33.991302+0000","last_peered":"2024-09-13T19:08:33.991302+0000","last_clean":"2024-09-13T19:08:33.991302+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:08:33.991302+0000","last_undegraded":"2024-09-13T19:08:33.991302+0000","last_fullsized":"2024-09-13T19:08:33.991302+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'64","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.751189+0000","last_change":"2024-09-13T19:10:23.751268+0000","last_active":"2024-09-13T19:10:23.751189+0000","last_peered":"2024-09-13T19:10:23.751189+0000","last_clean":"2024-09-13T19:10:23.751189+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:23.751189+0000","last_undegraded":"2024-09-13T19:10:23.751189+0000","last_fullsized":"2024-09-13T19:10:23.751189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'64","last_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_deep_scrub":"34'64","last_deep_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.750999+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:41.816580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.394391+0000","last_change":"2024-09-13T19:10:24.394449+0000","last_active":"2024-09-13T19:10:24.394391+0000","last_peered":"2024-09-13T19:10:24.394391+0000","last_clean":"2024-09-13T19:10:24.394391+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:10:24.394391+0000","last_undegraded":"2024-09-13T19:10:24.394391+0000","last_fullsized":"2024-09-13T19:10:24.394391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.394197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:46.758833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.762348+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:09:38.762348+0000","last_peered":"2024-09-13T19:09:38.762348+0000","last_clean":"2024-09-13T19:09:38.762348+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:09:38.762348+0000","last_undegraded":"2024-09-13T19:09:38.762348+0000","last_fullsized":"2024-09-13T19:09:38.762348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.276764+0000","last_change":"2024-09-13T19:06:21.254823+0000","last_active":"2024-09-13T19:09:38.276764+0000","last_peered":"2024-09-13T19:09:38.276764+0000","last_clean":"2024-09-13T19:09:38.276764+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:09:38.276764+0000","last_undegraded":"2024-09-13T19:09:38.276764+0000","last_fullsized":"2024-09-13T19:09:38.276764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.991363+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:08:33.991363+0000","last_peered":"2024-09-13T19:08:33.991363+0000","last_clean":"2024-09-13T19:08:33.991363+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:08:33.991363+0000","last_undegraded":"2024-09-13T19:08:33.991363+0000","last_fullsized":"2024-09-13T19:08:33.991363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.036382+0000","last_change":"2024-09-13T19:10:28.036506+0000","last_active":"2024-09-13T19:10:28.036382+0000","last_peered":"2024-09-13T19:10:28.036382+0000","last_clean":"2024-09-13T19:10:28.036382+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:10:28.036382+0000","last_undegraded":"2024-09-13T19:10:28.036382+0000","last_fullsized":"2024-09-13T19:10:28.036382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.036142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:37.355498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.832677+0000","last_change":"2024-09-13T19:10:09.832750+0000","last_active":"2024-09-13T19:10:09.832677+0000","last_peered":"2024-09-13T19:10:09.832677+0000","last_clean":"2024-09-13T19:10:09.832677+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:09.832677+0000","last_undegraded":"2024-09-13T19:10:09.832677+0000","last_fullsized":"2024-09-13T19:10:09.832677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.832440+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:33.388702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004558+0000","last_change":"2024-09-13T19:06:27.302986+0000","last_active":"2024-09-13T19:08:44.004558+0000","last_peered":"2024-09-13T19:08:44.004558+0000","last_clean":"2024-09-13T19:08:44.004558+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:08:44.004558+0000","last_undegraded":"2024-09-13T19:08:44.004558+0000","last_fullsized":"2024-09-13T19:08:44.004558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.621216+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:09:38.621216+0000","last_peered":"2024-09-13T19:09:38.621216+0000","last_clean":"2024-09-13T19:09:38.621216+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:09:38.621216+0000","last_undegraded":"2024-09-13T19:09:38.621216+0000","last_fullsized":"2024-09-13T19:09:38.621216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.793593+0000","last_change":"2024-09-13T19:10:20.793652+0000","last_active":"2024-09-13T19:10:20.793593+0000","last_peered":"2024-09-13T19:10:20.793593+0000","last_clean":"2024-09-13T19:10:20.793593+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:10:20.793593+0000","last_undegraded":"2024-09-13T19:10:20.793593+0000","last_fullsized":"2024-09-13T19:10:20.793593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.793393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:48.213611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999651+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:08:28.999651+0000","last_peered":"2024-09-13T19:08:28.999651+0000","last_clean":"2024-09-13T19:08:28.999651+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:08:28.999651+0000","last_undegraded":"2024-09-13T19:08:28.999651+0000","last_fullsized":"2024-09-13T19:08:28.999651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.412627+0000","last_change":"2024-09-13T19:10:23.412680+0000","last_active":"2024-09-13T19:10:23.412627+0000","last_peered":"2024-09-13T19:10:23.412627+0000","last_clean":"2024-09-13T19:10:23.412627+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:10:23.412627+0000","last_undegraded":"2024-09-13T19:10:23.412627+0000","last_fullsized":"2024-09-13T19:10:23.412627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.412440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.127338+0000","last_change":"2024-09-13T19:10:23.127417+0000","last_active":"2024-09-13T19:10:23.127338+0000","last_peered":"2024-09-13T19:10:23.127338+0000","last_clean":"2024-09-13T19:10:23.127338+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:23.127338+0000","last_undegraded":"2024-09-13T19:10:23.127338+0000","last_fullsized":"2024-09-13T19:10:23.127338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.127136+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:43.153291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.210911+0000","last_change":"2024-09-13T19:10:13.210977+0000","last_active":"2024-09-13T19:10:13.210911+0000","last_peered":"2024-09-13T19:10:13.210911+0000","last_clean":"2024-09-13T19:10:13.210911+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:13.210911+0000","last_undegraded":"2024-09-13T19:10:13.210911+0000","last_fullsized":"2024-09-13T19:10:13.210911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.210704+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:44.040477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'12","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.627634+0000","last_change":"2024-09-13T19:06:29.297215+0000","last_active":"2024-09-13T19:09:38.627634+0000","last_peered":"2024-09-13T19:09:38.627634+0000","last_clean":"2024-09-13T19:09:38.627634+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:09:38.627634+0000","last_undegraded":"2024-09-13T19:09:38.627634+0000","last_fullsized":"2024-09-13T19:09:38.627634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.058254+0000","last_change":"2024-09-13T19:06:21.255658+0000","last_active":"2024-09-13T19:09:38.058254+0000","last_peered":"2024-09-13T19:09:38.058254+0000","last_clean":"2024-09-13T19:09:38.058254+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:09:38.058254+0000","last_undegraded":"2024-09-13T19:09:38.058254+0000","last_fullsized":"2024-09-13T19:09:38.058254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999520+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:08:28.999520+0000","last_peered":"2024-09-13T19:08:28.999520+0000","last_clean":"2024-09-13T19:08:28.999520+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:08:28.999520+0000","last_undegraded":"2024-09-13T19:08:28.999520+0000","last_fullsized":"2024-09-13T19:08:28.999520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.959044+0000","last_change":"2024-09-13T19:10:22.959117+0000","last_active":"2024-09-13T19:10:22.959044+0000","last_peered":"2024-09-13T19:10:22.959044+0000","last_clean":"2024-09-13T19:10:22.959044+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:22.959044+0000","last_undegraded":"2024-09-13T19:10:22.959044+0000","last_fullsized":"2024-09-13T19:10:22.959044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.958854+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.913099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.814541+0000","last_change":"2024-09-13T19:10:21.814619+0000","last_active":"2024-09-13T19:10:21.814541+0000","last_peered":"2024-09-13T19:10:21.814541+0000","last_clean":"2024-09-13T19:10:21.814541+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:10:21.814541+0000","last_undegraded":"2024-09-13T19:10:21.814541+0000","last_fullsized":"2024-09-13T19:10:21.814541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.814367+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:33.492669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":482,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.986750+0000","last_change":"2024-09-13T19:10:23.986876+0000","last_active":"2024-09-13T19:10:23.986750+0000","last_peered":"2024-09-13T19:10:23.986750+0000","last_clean":"2024-09-13T19:10:23.986750+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:23.986750+0000","last_undegraded":"2024-09-13T19:10:23.986750+0000","last_fullsized":"2024-09-13T19:10:23.986750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.986531+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:04.057824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.150305+0000","last_change":"2024-09-13T19:10:21.150372+0000","last_active":"2024-09-13T19:10:21.150305+0000","last_peered":"2024-09-13T19:10:21.150305+0000","last_clean":"2024-09-13T19:10:21.150305+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:10:21.150305+0000","last_undegraded":"2024-09-13T19:10:21.150305+0000","last_fullsized":"2024-09-13T19:10:21.150305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.150108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:27.355549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474558+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.474558+0000","last_peered":"2024-09-13T19:09:38.474558+0000","last_clean":"2024-09-13T19:09:38.474558+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.474558+0000","last_undegraded":"2024-09-13T19:09:38.474558+0000","last_fullsized":"2024-09-13T19:09:38.474558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999366+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:08:28.999366+0000","last_peered":"2024-09-13T19:08:28.999366+0000","last_clean":"2024-09-13T19:08:28.999366+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:08:28.999366+0000","last_undegraded":"2024-09-13T19:08:28.999366+0000","last_fullsized":"2024-09-13T19:08:28.999366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.991513+0000","last_change":"2024-09-13T19:10:09.991613+0000","last_active":"2024-09-13T19:10:09.991513+0000","last_peered":"2024-09-13T19:10:09.991513+0000","last_clean":"2024-09-13T19:10:09.991513+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:10:09.991513+0000","last_undegraded":"2024-09-13T19:10:09.991513+0000","last_fullsized":"2024-09-13T19:10:09.991513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.991280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.624094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.862400+0000","last_change":"2024-09-13T19:10:12.862549+0000","last_active":"2024-09-13T19:10:12.862400+0000","last_peered":"2024-09-13T19:10:12.862400+0000","last_clean":"2024-09-13T19:10:12.862400+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:12.862400+0000","last_undegraded":"2024-09-13T19:10:12.862400+0000","last_fullsized":"2024-09-13T19:10:12.862400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.862157+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:03.704078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.251198+0000","last_change":"2024-09-13T19:10:10.251305+0000","last_active":"2024-09-13T19:10:10.251198+0000","last_peered":"2024-09-13T19:10:10.251198+0000","last_clean":"2024-09-13T19:10:10.251198+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:10:10.251198+0000","last_undegraded":"2024-09-13T19:10:10.251198+0000","last_fullsized":"2024-09-13T19:10:10.251198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.250951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:14.638874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.755840+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:09:38.755840+0000","last_peered":"2024-09-13T19:09:38.755840+0000","last_clean":"2024-09-13T19:09:38.755840+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:09:38.755840+0000","last_undegraded":"2024-09-13T19:09:38.755840+0000","last_fullsized":"2024-09-13T19:09:38.755840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.788754+0000","last_change":"2024-09-13T19:10:22.788819+0000","last_active":"2024-09-13T19:10:22.788754+0000","last_peered":"2024-09-13T19:10:22.788754+0000","last_clean":"2024-09-13T19:10:22.788754+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:10:22.788754+0000","last_undegraded":"2024-09-13T19:10:22.788754+0000","last_fullsized":"2024-09-13T19:10:22.788754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.788534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:11.221320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469143+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:10:07.469143+0000","last_peered":"2024-09-13T19:10:07.469143+0000","last_clean":"2024-09-13T19:10:07.469143+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:10:07.469143+0000","last_undegraded":"2024-09-13T19:10:07.469143+0000","last_fullsized":"2024-09-13T19:10:07.469143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373046+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:10:08.373046+0000","last_peered":"2024-09-13T19:10:08.373046+0000","last_clean":"2024-09-13T19:10:08.373046+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:10:08.373046+0000","last_undegraded":"2024-09-13T19:10:08.373046+0000","last_fullsized":"2024-09-13T19:10:08.373046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.997854+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:08:23.997854+0000","last_peered":"2024-09-13T19:08:23.997854+0000","last_clean":"2024-09-13T19:08:23.997854+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:08:23.997854+0000","last_undegraded":"2024-09-13T19:08:23.997854+0000","last_fullsized":"2024-09-13T19:08:23.997854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.925669+0000","last_change":"2024-09-13T19:10:17.925770+0000","last_active":"2024-09-13T19:10:17.925669+0000","last_peered":"2024-09-13T19:10:17.925669+0000","last_clean":"2024-09-13T19:10:17.925669+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:10:17.925669+0000","last_undegraded":"2024-09-13T19:10:17.925669+0000","last_fullsized":"2024-09-13T19:10:17.925669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.925452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:48.521596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.929458+0000","last_change":"2024-09-13T19:10:13.929532+0000","last_active":"2024-09-13T19:10:13.929458+0000","last_peered":"2024-09-13T19:10:13.929458+0000","last_clean":"2024-09-13T19:10:13.929458+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:13.929458+0000","last_undegraded":"2024-09-13T19:10:13.929458+0000","last_fullsized":"2024-09-13T19:10:13.929458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.929281+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:35.787824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.567208+0000","last_change":"2024-09-13T19:10:12.567264+0000","last_active":"2024-09-13T19:10:12.567208+0000","last_peered":"2024-09-13T19:10:12.567208+0000","last_clean":"2024-09-13T19:10:12.567208+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:10:12.567208+0000","last_undegraded":"2024-09-13T19:10:12.567208+0000","last_fullsized":"2024-09-13T19:10:12.567208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.567011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:35.830195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":174,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.197250+0000","last_change":"2024-09-13T19:10:17.197379+0000","last_active":"2024-09-13T19:10:17.197250+0000","last_peered":"2024-09-13T19:10:17.197250+0000","last_clean":"2024-09-13T19:10:17.197250+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:10:17.197250+0000","last_undegraded":"2024-09-13T19:10:17.197250+0000","last_fullsized":"2024-09-13T19:10:17.197250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.197010+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:54.433206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001133+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:08:34.001133+0000","last_peered":"2024-09-13T19:08:34.001133+0000","last_clean":"2024-09-13T19:08:34.001133+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:08:34.001133+0000","last_undegraded":"2024-09-13T19:08:34.001133+0000","last_fullsized":"2024-09-13T19:08:34.001133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373040+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:10:08.373040+0000","last_peered":"2024-09-13T19:10:08.373040+0000","last_clean":"2024-09-13T19:10:08.373040+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:10:08.373040+0000","last_undegraded":"2024-09-13T19:10:08.373040+0000","last_fullsized":"2024-09-13T19:10:08.373040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016586+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:10:07.016586+0000","last_peered":"2024-09-13T19:10:07.016586+0000","last_clean":"2024-09-13T19:10:07.016586+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:10:07.016586+0000","last_undegraded":"2024-09-13T19:10:07.016586+0000","last_fullsized":"2024-09-13T19:10:07.016586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.969481+0000","last_change":"2024-09-13T19:10:10.969550+0000","last_active":"2024-09-13T19:10:10.969481+0000","last_peered":"2024-09-13T19:10:10.969481+0000","last_clean":"2024-09-13T19:10:10.969481+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:10.969481+0000","last_undegraded":"2024-09-13T19:10:10.969481+0000","last_fullsized":"2024-09-13T19:10:10.969481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.969289+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:28.059258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":517,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.847805+0000","last_change":"2024-09-13T19:10:08.847892+0000","last_active":"2024-09-13T19:10:08.847805+0000","last_peered":"2024-09-13T19:10:08.847805+0000","last_clean":"2024-09-13T19:10:08.847805+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:08.847805+0000","last_undegraded":"2024-09-13T19:10:08.847805+0000","last_fullsized":"2024-09-13T19:10:08.847805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'290","last_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_deep_scrub":"34'290","last_deep_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.847620+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:34.001690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001022+0000","last_change":"2024-09-13T19:06:27.305676+0000","last_active":"2024-09-13T19:08:34.001022+0000","last_peered":"2024-09-13T19:08:34.001022+0000","last_clean":"2024-09-13T19:08:34.001022+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:08:34.001022+0000","last_undegraded":"2024-09-13T19:08:34.001022+0000","last_fullsized":"2024-09-13T19:08:34.001022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002256+0000","last_change":"2024-09-13T19:06:29.319214+0000","last_active":"2024-09-13T19:08:39.002256+0000","last_peered":"2024-09-13T19:08:39.002256+0000","last_clean":"2024-09-13T19:08:39.002256+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:08:39.002256+0000","last_undegraded":"2024-09-13T19:08:39.002256+0000","last_fullsized":"2024-09-13T19:08:39.002256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.277453+0000","last_change":"2024-09-13T19:06:21.260320+0000","last_active":"2024-09-13T19:09:38.277453+0000","last_peered":"2024-09-13T19:09:38.277453+0000","last_clean":"2024-09-13T19:09:38.277453+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:09:38.277453+0000","last_undegraded":"2024-09-13T19:09:38.277453+0000","last_fullsized":"2024-09-13T19:09:38.277453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916384+0000","last_change":"2024-09-13T19:06:11.423145+0000","last_active":"2024-09-13T19:10:07.916384+0000","last_peered":"2024-09-13T19:10:07.916384+0000","last_clean":"2024-09-13T19:10:07.916384+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:10:07.916384+0000","last_undegraded":"2024-09-13T19:10:07.916384+0000","last_fullsized":"2024-09-13T19:10:07.916384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016531+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:10:07.016531+0000","last_peered":"2024-09-13T19:10:07.016531+0000","last_clean":"2024-09-13T19:10:07.016531+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:10:07.016531+0000","last_undegraded":"2024-09-13T19:10:07.016531+0000","last_fullsized":"2024-09-13T19:10:07.016531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000231+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:08:34.000231+0000","last_peered":"2024-09-13T19:08:34.000231+0000","last_clean":"2024-09-13T19:08:34.000231+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:08:34.000231+0000","last_undegraded":"2024-09-13T19:08:34.000231+0000","last_fullsized":"2024-09-13T19:08:34.000231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.258336+0000","last_change":"2024-09-13T19:10:19.258425+0000","last_active":"2024-09-13T19:10:19.258336+0000","last_peered":"2024-09-13T19:10:19.258336+0000","last_clean":"2024-09-13T19:10:19.258336+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:10:19.258336+0000","last_undegraded":"2024-09-13T19:10:19.258336+0000","last_fullsized":"2024-09-13T19:10:19.258336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.258136+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:12.663138+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.475834+0000","last_change":"2024-09-13T19:10:20.475886+0000","last_active":"2024-09-13T19:10:20.475834+0000","last_peered":"2024-09-13T19:10:20.475834+0000","last_clean":"2024-09-13T19:10:20.475834+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:10:20.475834+0000","last_undegraded":"2024-09-13T19:10:20.475834+0000","last_fullsized":"2024-09-13T19:10:20.475834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.475636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:23.310735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004088+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:08:44.004088+0000","last_peered":"2024-09-13T19:08:44.004088+0000","last_clean":"2024-09-13T19:08:44.004088+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:08:44.004088+0000","last_undegraded":"2024-09-13T19:08:44.004088+0000","last_fullsized":"2024-09-13T19:08:44.004088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990110+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:08:28.990110+0000","last_peered":"2024-09-13T19:08:28.990110+0000","last_clean":"2024-09-13T19:08:28.990110+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:08:28.990110+0000","last_undegraded":"2024-09-13T19:08:28.990110+0000","last_fullsized":"2024-09-13T19:08:28.990110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373053+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:10:08.373053+0000","last_peered":"2024-09-13T19:10:08.373053+0000","last_clean":"2024-09-13T19:10:08.373053+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:10:08.373053+0000","last_undegraded":"2024-09-13T19:10:08.373053+0000","last_fullsized":"2024-09-13T19:10:08.373053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916431+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:10:07.916431+0000","last_peered":"2024-09-13T19:10:07.916431+0000","last_clean":"2024-09-13T19:10:07.916431+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:10:07.916431+0000","last_undegraded":"2024-09-13T19:10:07.916431+0000","last_fullsized":"2024-09-13T19:10:07.916431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990140+0000","last_change":"2024-09-13T19:06:23.247010+0000","last_active":"2024-09-13T19:08:28.990140+0000","last_peered":"2024-09-13T19:08:28.990140+0000","last_clean":"2024-09-13T19:08:28.990140+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:08:28.990140+0000","last_undegraded":"2024-09-13T19:08:28.990140+0000","last_fullsized":"2024-09-13T19:08:28.990140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.988066+0000","last_change":"2024-09-13T19:10:11.988168+0000","last_active":"2024-09-13T19:10:11.988066+0000","last_peered":"2024-09-13T19:10:11.988066+0000","last_clean":"2024-09-13T19:10:11.988066+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:10:11.988066+0000","last_undegraded":"2024-09-13T19:10:11.988066+0000","last_fullsized":"2024-09-13T19:10:11.988066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.987853+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.357172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002630+0000","last_change":"2024-09-13T19:06:27.303059+0000","last_active":"2024-09-13T19:08:39.002630+0000","last_peered":"2024-09-13T19:08:39.002630+0000","last_clean":"2024-09-13T19:08:39.002630+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:08:39.002630+0000","last_undegraded":"2024-09-13T19:08:39.002630+0000","last_fullsized":"2024-09-13T19:08:39.002630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002096+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:08:39.002096+0000","last_peered":"2024-09-13T19:08:39.002096+0000","last_clean":"2024-09-13T19:08:39.002096+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:08:39.002096+0000","last_undegraded":"2024-09-13T19:08:39.002096+0000","last_fullsized":"2024-09-13T19:08:39.002096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999869+0000","last_change":"2024-09-13T19:06:21.264605+0000","last_active":"2024-09-13T19:08:28.999869+0000","last_peered":"2024-09-13T19:08:28.999869+0000","last_clean":"2024-09-13T19:08:28.999869+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:08:28.999869+0000","last_undegraded":"2024-09-13T19:08:28.999869+0000","last_fullsized":"2024-09-13T19:08:28.999869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916555+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:10:07.916555+0000","last_peered":"2024-09-13T19:10:07.916555+0000","last_clean":"2024-09-13T19:10:07.916555+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:10:07.916555+0000","last_undegraded":"2024-09-13T19:10:07.916555+0000","last_fullsized":"2024-09-13T19:10:07.916555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016466+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:10:07.016466+0000","last_peered":"2024-09-13T19:10:07.016466+0000","last_clean":"2024-09-13T19:10:07.016466+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:10:07.016466+0000","last_undegraded":"2024-09-13T19:10:07.016466+0000","last_fullsized":"2024-09-13T19:10:07.016466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.519829+0000","last_change":"2024-09-13T19:06:23.246897+0000","last_active":"2024-09-13T19:10:03.519829+0000","last_peered":"2024-09-13T19:10:03.519829+0000","last_clean":"2024-09-13T19:10:03.519829+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:10:03.519829+0000","last_undegraded":"2024-09-13T19:10:03.519829+0000","last_fullsized":"2024-09-13T19:10:03.519829+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.564973+0000","last_change":"2024-09-13T19:10:18.564973+0000","last_active":"2024-09-13T19:10:18.564973+0000","last_peered":"2024-09-13T19:10:18.564973+0000","last_clean":"2024-09-13T19:10:18.564973+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:18.564973+0000","last_undegraded":"2024-09-13T19:10:18.564973+0000","last_fullsized":"2024-09-13T19:10:18.564973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.564713+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:02.178317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.287890+0000","last_change":"2024-09-13T19:10:09.287984+0000","last_active":"2024-09-13T19:10:09.287890+0000","last_peered":"2024-09-13T19:10:09.287890+0000","last_clean":"2024-09-13T19:10:09.287890+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:10:09.287890+0000","last_undegraded":"2024-09-13T19:10:09.287890+0000","last_fullsized":"2024-09-13T19:10:09.287890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.287642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:27.524091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:43.994238+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:43.994238+0000","last_peered":"2024-09-13T19:08:43.994238+0000","last_clean":"2024-09-13T19:08:43.994238+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:43.994238+0000","last_undegraded":"2024-09-13T19:08:43.994238+0000","last_fullsized":"2024-09-13T19:08:43.994238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'7","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.612294+0000","last_change":"2024-09-13T19:06:21.256957+0000","last_active":"2024-09-13T19:09:38.612294+0000","last_peered":"2024-09-13T19:09:38.612294+0000","last_clean":"2024-09-13T19:09:38.612294+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:09:38.612294+0000","last_undegraded":"2024-09-13T19:09:38.612294+0000","last_fullsized":"2024-09-13T19:09:38.612294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016625+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:10:07.016625+0000","last_peered":"2024-09-13T19:10:07.016625+0000","last_clean":"2024-09-13T19:10:07.016625+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:10:07.016625+0000","last_undegraded":"2024-09-13T19:10:07.016625+0000","last_fullsized":"2024-09-13T19:10:07.016625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373117+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:10:08.373117+0000","last_peered":"2024-09-13T19:10:08.373117+0000","last_clean":"2024-09-13T19:10:08.373117+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:10:08.373117+0000","last_undegraded":"2024-09-13T19:10:08.373117+0000","last_fullsized":"2024-09-13T19:10:08.373117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999570+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:08:28.999570+0000","last_peered":"2024-09-13T19:08:28.999570+0000","last_clean":"2024-09-13T19:08:28.999570+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:08:28.999570+0000","last_undegraded":"2024-09-13T19:08:28.999570+0000","last_fullsized":"2024-09-13T19:08:28.999570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.839494+0000","last_change":"2024-09-13T19:10:07.839664+0000","last_active":"2024-09-13T19:10:07.839494+0000","last_peered":"2024-09-13T19:10:07.839494+0000","last_clean":"2024-09-13T19:10:07.839494+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:10:07.839494+0000","last_undegraded":"2024-09-13T19:10:07.839494+0000","last_fullsized":"2024-09-13T19:10:07.839494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.839234+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.815476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":375,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.885363+0000","last_change":"2024-09-13T19:06:27.322042+0000","last_active":"2024-09-13T19:10:03.885363+0000","last_peered":"2024-09-13T19:10:03.885363+0000","last_clean":"2024-09-13T19:10:03.885363+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:03.885363+0000","last_undegraded":"2024-09-13T19:10:03.885363+0000","last_fullsized":"2024-09-13T19:10:03.885363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004522+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:08:44.004522+0000","last_peered":"2024-09-13T19:08:44.004522+0000","last_clean":"2024-09-13T19:08:44.004522+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:08:44.004522+0000","last_undegraded":"2024-09-13T19:08:44.004522+0000","last_fullsized":"2024-09-13T19:08:44.004522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374349+0000","last_change":"2024-09-13T19:06:21.259985+0000","last_active":"2024-09-13T19:10:08.374349+0000","last_peered":"2024-09-13T19:10:08.374349+0000","last_clean":"2024-09-13T19:10:08.374349+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:10:08.374349+0000","last_undegraded":"2024-09-13T19:10:08.374349+0000","last_fullsized":"2024-09-13T19:10:08.374349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000086+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:08:29.000086+0000","last_peered":"2024-09-13T19:08:29.000086+0000","last_clean":"2024-09-13T19:08:29.000086+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:08:29.000086+0000","last_undegraded":"2024-09-13T19:08:29.000086+0000","last_fullsized":"2024-09-13T19:08:29.000086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016453+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:10:07.016453+0000","last_peered":"2024-09-13T19:10:07.016453+0000","last_clean":"2024-09-13T19:10:07.016453+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:10:07.016453+0000","last_undegraded":"2024-09-13T19:10:07.016453+0000","last_fullsized":"2024-09-13T19:10:07.016453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.988330+0000","last_change":"2024-09-13T19:10:08.988381+0000","last_active":"2024-09-13T19:10:08.988330+0000","last_peered":"2024-09-13T19:10:08.988330+0000","last_clean":"2024-09-13T19:10:08.988330+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:10:08.988330+0000","last_undegraded":"2024-09-13T19:10:08.988330+0000","last_fullsized":"2024-09-13T19:10:08.988330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.988147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.969133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000919+0000","last_change":"2024-09-13T19:06:25.303816+0000","last_active":"2024-09-13T19:08:34.000919+0000","last_peered":"2024-09-13T19:08:34.000919+0000","last_clean":"2024-09-13T19:08:34.000919+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:08:34.000919+0000","last_undegraded":"2024-09-13T19:08:34.000919+0000","last_fullsized":"2024-09-13T19:08:34.000919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.530994+0000","last_change":"2024-09-13T19:10:14.531059+0000","last_active":"2024-09-13T19:10:14.530994+0000","last_peered":"2024-09-13T19:10:14.530994+0000","last_clean":"2024-09-13T19:10:14.530994+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:14.530994+0000","last_undegraded":"2024-09-13T19:10:14.530994+0000","last_fullsized":"2024-09-13T19:10:14.530994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.530810+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:54.291531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004109+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:08:44.004109+0000","last_peered":"2024-09-13T19:08:44.004109+0000","last_clean":"2024-09-13T19:08:44.004109+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:08:44.004109+0000","last_undegraded":"2024-09-13T19:08:44.004109+0000","last_fullsized":"2024-09-13T19:08:44.004109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474789+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:09:38.474789+0000","last_peered":"2024-09-13T19:09:38.474789+0000","last_clean":"2024-09-13T19:09:38.474789+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:09:38.474789+0000","last_undegraded":"2024-09-13T19:09:38.474789+0000","last_fullsized":"2024-09-13T19:09:38.474789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000173+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:08:29.000173+0000","last_peered":"2024-09-13T19:08:29.000173+0000","last_clean":"2024-09-13T19:08:29.000173+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:08:29.000173+0000","last_undegraded":"2024-09-13T19:08:29.000173+0000","last_fullsized":"2024-09-13T19:08:29.000173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:18.996376+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:08:18.996376+0000","last_peered":"2024-09-13T19:08:18.996376+0000","last_clean":"2024-09-13T19:08:18.996376+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:08:18.996376+0000","last_undegraded":"2024-09-13T19:08:18.996376+0000","last_fullsized":"2024-09-13T19:08:18.996376+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.832300+0000","last_change":"2024-09-13T19:10:18.832300+0000","last_active":"2024-09-13T19:10:18.832300+0000","last_peered":"2024-09-13T19:10:18.832300+0000","last_clean":"2024-09-13T19:10:18.832300+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:10:18.832300+0000","last_undegraded":"2024-09-13T19:10:18.832300+0000","last_fullsized":"2024-09-13T19:10:18.832300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.832064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:42.939752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":189,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.207917+0000","last_change":"2024-09-13T19:10:20.208010+0000","last_active":"2024-09-13T19:10:20.207917+0000","last_peered":"2024-09-13T19:10:20.207917+0000","last_clean":"2024-09-13T19:10:20.207917+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:20.207917+0000","last_undegraded":"2024-09-13T19:10:20.207917+0000","last_fullsized":"2024-09-13T19:10:20.207917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.207705+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:25.171811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.399243+0000","last_change":"2024-09-13T19:10:28.399306+0000","last_active":"2024-09-13T19:10:28.399243+0000","last_peered":"2024-09-13T19:10:28.399243+0000","last_clean":"2024-09-13T19:10:28.399243+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:10:28.399243+0000","last_undegraded":"2024-09-13T19:10:28.399243+0000","last_fullsized":"2024-09-13T19:10:28.399243+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.399039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:50.175378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.121145+0000","last_change":"2024-09-13T19:10:25.121202+0000","last_active":"2024-09-13T19:10:25.121145+0000","last_peered":"2024-09-13T19:10:25.121145+0000","last_clean":"2024-09-13T19:10:25.121145+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:10:25.121145+0000","last_undegraded":"2024-09-13T19:10:25.121145+0000","last_fullsized":"2024-09-13T19:10:25.121145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.120954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.704432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.794060+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:09:38.794060+0000","last_peered":"2024-09-13T19:09:38.794060+0000","last_clean":"2024-09-13T19:09:38.794060+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:09:38.794060+0000","last_undegraded":"2024-09-13T19:09:38.794060+0000","last_fullsized":"2024-09-13T19:09:38.794060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392828+0000","last_change":"2024-09-13T19:06:21.254116+0000","last_active":"2024-09-13T19:09:38.392828+0000","last_peered":"2024-09-13T19:09:38.392828+0000","last_clean":"2024-09-13T19:09:38.392828+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:09:38.392828+0000","last_undegraded":"2024-09-13T19:09:38.392828+0000","last_fullsized":"2024-09-13T19:09:38.392828+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002452+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:08:39.002452+0000","last_peered":"2024-09-13T19:08:39.002452+0000","last_clean":"2024-09-13T19:08:39.002452+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:08:39.002452+0000","last_undegraded":"2024-09-13T19:08:39.002452+0000","last_fullsized":"2024-09-13T19:08:39.002452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.945275+0000","last_change":"2024-09-13T19:10:20.945400+0000","last_active":"2024-09-13T19:10:20.945275+0000","last_peered":"2024-09-13T19:10:20.945275+0000","last_clean":"2024-09-13T19:10:20.945275+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:10:20.945275+0000","last_undegraded":"2024-09-13T19:10:20.945275+0000","last_fullsized":"2024-09-13T19:10:20.945275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.945028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:30.264384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.797610+0000","last_change":"2024-09-13T19:06:25.283177+0000","last_active":"2024-09-13T19:10:03.797610+0000","last_peered":"2024-09-13T19:10:03.797610+0000","last_clean":"2024-09-13T19:10:03.797610+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:03.797610+0000","last_undegraded":"2024-09-13T19:10:03.797610+0000","last_fullsized":"2024-09-13T19:10:03.797610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005827+0000","last_change":"2024-09-13T19:06:27.325440+0000","last_active":"2024-09-13T19:08:49.005827+0000","last_peered":"2024-09-13T19:08:49.005827+0000","last_clean":"2024-09-13T19:08:49.005827+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:08:49.005827+0000","last_undegraded":"2024-09-13T19:08:49.005827+0000","last_fullsized":"2024-09-13T19:08:49.005827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.018294+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:10:07.018294+0000","last_peered":"2024-09-13T19:10:07.018294+0000","last_clean":"2024-09-13T19:10:07.018294+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:10:07.018294+0000","last_undegraded":"2024-09-13T19:10:07.018294+0000","last_fullsized":"2024-09-13T19:10:07.018294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003966+0000","last_change":"2024-09-13T19:06:21.258397+0000","last_active":"2024-09-13T19:08:44.003966+0000","last_peered":"2024-09-13T19:08:44.003966+0000","last_clean":"2024-09-13T19:08:44.003966+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:08:44.003966+0000","last_undegraded":"2024-09-13T19:08:44.003966+0000","last_fullsized":"2024-09-13T19:08:44.003966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.783993+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:10:03.783993+0000","last_peered":"2024-09-13T19:10:03.783993+0000","last_clean":"2024-09-13T19:10:03.783993+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:10:03.783993+0000","last_undegraded":"2024-09-13T19:10:03.783993+0000","last_fullsized":"2024-09-13T19:10:03.783993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.867500+0000","last_change":"2024-09-13T19:10:17.867551+0000","last_active":"2024-09-13T19:10:17.867500+0000","last_peered":"2024-09-13T19:10:17.867500+0000","last_clean":"2024-09-13T19:10:17.867500+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:10:17.867500+0000","last_undegraded":"2024-09-13T19:10:17.867500+0000","last_fullsized":"2024-09-13T19:10:17.867500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.867308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:43.159936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.561458+0000","last_change":"2024-09-13T19:10:17.561532+0000","last_active":"2024-09-13T19:10:17.561458+0000","last_peered":"2024-09-13T19:10:17.561458+0000","last_clean":"2024-09-13T19:10:17.561458+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:10:17.561458+0000","last_undegraded":"2024-09-13T19:10:17.561458+0000","last_fullsized":"2024-09-13T19:10:17.561458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.561274+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:36.904388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.291015+0000","last_change":"2024-09-13T19:10:11.291104+0000","last_active":"2024-09-13T19:10:11.291015+0000","last_peered":"2024-09-13T19:10:11.291015+0000","last_clean":"2024-09-13T19:10:11.291015+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:10:11.291015+0000","last_undegraded":"2024-09-13T19:10:11.291015+0000","last_fullsized":"2024-09-13T19:10:11.291015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.290797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.828167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:58.998281+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:08:58.998281+0000","last_peered":"2024-09-13T19:08:58.998281+0000","last_clean":"2024-09-13T19:08:58.998281+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:08:58.998281+0000","last_undegraded":"2024-09-13T19:08:58.998281+0000","last_fullsized":"2024-09-13T19:08:58.998281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:43.993907+0000","last_change":"2024-09-13T19:06:21.244155+0000","last_active":"2024-09-13T19:08:43.993907+0000","last_peered":"2024-09-13T19:08:43.993907+0000","last_clean":"2024-09-13T19:08:43.993907+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:08:43.993907+0000","last_undegraded":"2024-09-13T19:08:43.993907+0000","last_fullsized":"2024-09-13T19:08:43.993907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.002567+0000","last_change":"2024-09-13T19:06:19.272180+0000","last_active":"2024-09-13T19:08:44.002567+0000","last_peered":"2024-09-13T19:08:44.002567+0000","last_clean":"2024-09-13T19:08:44.002567+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:08:44.002567+0000","last_undegraded":"2024-09-13T19:08:44.002567+0000","last_fullsized":"2024-09-13T19:08:44.002567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.162307+0000","last_change":"2024-09-13T19:10:24.162360+0000","last_active":"2024-09-13T19:10:24.162307+0000","last_peered":"2024-09-13T19:10:24.162307+0000","last_clean":"2024-09-13T19:10:24.162307+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:10:24.162307+0000","last_undegraded":"2024-09-13T19:10:24.162307+0000","last_fullsized":"2024-09-13T19:10:24.162307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.162112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:54.758256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.520870+0000","last_change":"2024-09-13T19:10:19.521044+0000","last_active":"2024-09-13T19:10:19.520870+0000","last_peered":"2024-09-13T19:10:19.520870+0000","last_clean":"2024-09-13T19:10:19.520870+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:19.520870+0000","last_undegraded":"2024-09-13T19:10:19.520870+0000","last_fullsized":"2024-09-13T19:10:19.520870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.520627+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.918610+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.960282+0000","last_change":"2024-09-13T19:10:19.960335+0000","last_active":"2024-09-13T19:10:19.960282+0000","last_peered":"2024-09-13T19:10:19.960282+0000","last_clean":"2024-09-13T19:10:19.960282+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:10:19.960282+0000","last_undegraded":"2024-09-13T19:10:19.960282+0000","last_fullsized":"2024-09-13T19:10:19.960282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.960093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:12.950423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.897900+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.897900+0000","last_peered":"2024-09-13T19:09:37.897900+0000","last_clean":"2024-09-13T19:09:37.897900+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.897900+0000","last_undegraded":"2024-09-13T19:09:37.897900+0000","last_fullsized":"2024-09-13T19:09:37.897900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003817+0000","last_change":"2024-09-13T19:06:21.259679+0000","last_active":"2024-09-13T19:08:44.003817+0000","last_peered":"2024-09-13T19:08:44.003817+0000","last_clean":"2024-09-13T19:08:44.003817+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:08:44.003817+0000","last_undegraded":"2024-09-13T19:08:44.003817+0000","last_fullsized":"2024-09-13T19:08:44.003817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004510+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:08:44.004510+0000","last_peered":"2024-09-13T19:08:44.004510+0000","last_clean":"2024-09-13T19:08:44.004510+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:08:44.004510+0000","last_undegraded":"2024-09-13T19:08:44.004510+0000","last_fullsized":"2024-09-13T19:08:44.004510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.848802+0000","last_change":"2024-09-13T19:10:16.848901+0000","last_active":"2024-09-13T19:10:16.848802+0000","last_peered":"2024-09-13T19:10:16.848802+0000","last_clean":"2024-09-13T19:10:16.848802+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:10:16.848802+0000","last_undegraded":"2024-09-13T19:10:16.848802+0000","last_fullsized":"2024-09-13T19:10:16.848802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.848588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:18.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.179107+0000","last_change":"2024-09-13T19:10:16.179195+0000","last_active":"2024-09-13T19:10:16.179107+0000","last_peered":"2024-09-13T19:10:16.179107+0000","last_clean":"2024-09-13T19:10:16.179107+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:16.179107+0000","last_undegraded":"2024-09-13T19:10:16.179107+0000","last_fullsized":"2024-09-13T19:10:16.179107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.178926+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:09.694689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.208382+0000","last_change":"2024-09-13T19:10:14.208442+0000","last_active":"2024-09-13T19:10:14.208382+0000","last_peered":"2024-09-13T19:10:14.208382+0000","last_clean":"2024-09-13T19:10:14.208382+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:10:14.208382+0000","last_undegraded":"2024-09-13T19:10:14.208382+0000","last_fullsized":"2024-09-13T19:10:14.208382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.208183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:58.825796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610274+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:09:38.610274+0000","last_peered":"2024-09-13T19:09:38.610274+0000","last_clean":"2024-09-13T19:09:38.610274+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:09:38.610274+0000","last_undegraded":"2024-09-13T19:09:38.610274+0000","last_fullsized":"2024-09-13T19:09:38.610274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003760+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:08:44.003760+0000","last_peered":"2024-09-13T19:08:44.003760+0000","last_clean":"2024-09-13T19:08:44.003760+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:08:44.003760+0000","last_undegraded":"2024-09-13T19:08:44.003760+0000","last_fullsized":"2024-09-13T19:08:44.003760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.017452+0000","last_change":"2024-09-13T19:06:23.248415+0000","last_active":"2024-09-13T19:10:07.017452+0000","last_peered":"2024-09-13T19:10:07.017452+0000","last_clean":"2024-09-13T19:10:07.017452+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:10:07.017452+0000","last_undegraded":"2024-09-13T19:10:07.017452+0000","last_fullsized":"2024-09-13T19:10:07.017452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.538829+0000","last_change":"2024-09-13T19:10:15.538905+0000","last_active":"2024-09-13T19:10:15.538829+0000","last_peered":"2024-09-13T19:10:15.538829+0000","last_clean":"2024-09-13T19:10:15.538829+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:15.538829+0000","last_undegraded":"2024-09-13T19:10:15.538829+0000","last_fullsized":"2024-09-13T19:10:15.538829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.538629+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.122107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.250816+0000","last_change":"2024-09-13T19:10:12.250870+0000","last_active":"2024-09-13T19:10:12.250816+0000","last_peered":"2024-09-13T19:10:12.250816+0000","last_clean":"2024-09-13T19:10:12.250816+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:10:12.250816+0000","last_undegraded":"2024-09-13T19:10:12.250816+0000","last_fullsized":"2024-09-13T19:10:12.250816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:10.938731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:48.995376+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:48.995376+0000","last_peered":"2024-09-13T19:08:48.995376+0000","last_clean":"2024-09-13T19:08:48.995376+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:48.995376+0000","last_undegraded":"2024-09-13T19:08:48.995376+0000","last_fullsized":"2024-09-13T19:08:48.995376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.017037+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:10:07.017037+0000","last_peered":"2024-09-13T19:10:07.017037+0000","last_clean":"2024-09-13T19:10:07.017037+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:10:07.017037+0000","last_undegraded":"2024-09-13T19:10:07.017037+0000","last_fullsized":"2024-09-13T19:10:07.017037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003758+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:08:44.003758+0000","last_peered":"2024-09-13T19:08:44.003758+0000","last_clean":"2024-09-13T19:08:44.003758+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:08:44.003758+0000","last_undegraded":"2024-09-13T19:08:44.003758+0000","last_fullsized":"2024-09-13T19:08:44.003758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.038741+0000","last_change":"2024-09-13T19:10:27.038792+0000","last_active":"2024-09-13T19:10:27.038741+0000","last_peered":"2024-09-13T19:10:27.038741+0000","last_clean":"2024-09-13T19:10:27.038741+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:10:27.038741+0000","last_undegraded":"2024-09-13T19:10:27.038741+0000","last_fullsized":"2024-09-13T19:10:27.038741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.038560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:46.381674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.669260+0000","last_change":"2024-09-13T19:06:25.294450+0000","last_active":"2024-09-13T19:10:03.669260+0000","last_peered":"2024-09-13T19:10:03.669260+0000","last_clean":"2024-09-13T19:10:03.669260+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:03.669260+0000","last_undegraded":"2024-09-13T19:10:03.669260+0000","last_fullsized":"2024-09-13T19:10:03.669260+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.871929+0000","last_change":"2024-09-13T19:10:11.872063+0000","last_active":"2024-09-13T19:10:11.871929+0000","last_peered":"2024-09-13T19:10:11.871929+0000","last_clean":"2024-09-13T19:10:11.871929+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:10:11.871929+0000","last_undegraded":"2024-09-13T19:10:11.871929+0000","last_fullsized":"2024-09-13T19:10:11.871929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.871702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.344253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006067+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:08:49.006067+0000","last_peered":"2024-09-13T19:08:49.006067+0000","last_clean":"2024-09-13T19:08:49.006067+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:08:49.006067+0000","last_undegraded":"2024-09-13T19:08:49.006067+0000","last_fullsized":"2024-09-13T19:08:49.006067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:29.012056+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:09:29.012056+0000","last_peered":"2024-09-13T19:09:29.012056+0000","last_clean":"2024-09-13T19:09:29.012056+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:09:29.012056+0000","last_undegraded":"2024-09-13T19:09:29.012056+0000","last_fullsized":"2024-09-13T19:09:29.012056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005947+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:08:49.005947+0000","last_peered":"2024-09-13T19:08:49.005947+0000","last_clean":"2024-09-13T19:08:49.005947+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:08:49.005947+0000","last_undegraded":"2024-09-13T19:08:49.005947+0000","last_fullsized":"2024-09-13T19:08:49.005947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.082445+0000","last_change":"2024-09-13T19:10:26.082518+0000","last_active":"2024-09-13T19:10:26.082445+0000","last_peered":"2024-09-13T19:10:26.082445+0000","last_clean":"2024-09-13T19:10:26.082445+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:26.082445+0000","last_undegraded":"2024-09-13T19:10:26.082445+0000","last_fullsized":"2024-09-13T19:10:26.082445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.082257+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.108750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.503886+0000","last_change":"2024-09-13T19:10:21.503964+0000","last_active":"2024-09-13T19:10:21.503886+0000","last_peered":"2024-09-13T19:10:21.503886+0000","last_clean":"2024-09-13T19:10:21.503886+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:21.503886+0000","last_undegraded":"2024-09-13T19:10:21.503886+0000","last_fullsized":"2024-09-13T19:10:21.503886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.503707+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:01.575001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.524503+0000","last_change":"2024-09-13T19:10:13.524503+0000","last_active":"2024-09-13T19:10:13.524503+0000","last_peered":"2024-09-13T19:10:13.524503+0000","last_clean":"2024-09-13T19:10:13.524503+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:10:13.524503+0000","last_undegraded":"2024-09-13T19:10:13.524503+0000","last_fullsized":"2024-09-13T19:10:13.524503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.524264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.550419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.266538+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:38.266538+0000","last_peered":"2024-09-13T19:09:38.266538+0000","last_clean":"2024-09-13T19:09:38.266538+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:38.266538+0000","last_undegraded":"2024-09-13T19:09:38.266538+0000","last_fullsized":"2024-09-13T19:09:38.266538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.060306+0000","last_change":"2024-09-13T19:06:21.255465+0000","last_active":"2024-09-13T19:09:38.060306+0000","last_peered":"2024-09-13T19:09:38.060306+0000","last_clean":"2024-09-13T19:09:38.060306+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:09:38.060306+0000","last_undegraded":"2024-09-13T19:09:38.060306+0000","last_fullsized":"2024-09-13T19:09:38.060306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.842133+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.842133+0000","last_peered":"2024-09-13T19:09:37.842133+0000","last_clean":"2024-09-13T19:09:37.842133+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.842133+0000","last_undegraded":"2024-09-13T19:09:37.842133+0000","last_fullsized":"2024-09-13T19:09:37.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.982887+0000","last_change":"2024-09-13T19:10:21.982937+0000","last_active":"2024-09-13T19:10:21.982887+0000","last_peered":"2024-09-13T19:10:21.982887+0000","last_clean":"2024-09-13T19:10:21.982887+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:10:21.982887+0000","last_undegraded":"2024-09-13T19:10:21.982887+0000","last_fullsized":"2024-09-13T19:10:21.982887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.982700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:30.750394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999947+0000","last_change":"2024-09-13T19:06:25.299007+0000","last_active":"2024-09-13T19:08:28.999947+0000","last_peered":"2024-09-13T19:08:28.999947+0000","last_clean":"2024-09-13T19:08:28.999947+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:08:28.999947+0000","last_undegraded":"2024-09-13T19:08:28.999947+0000","last_fullsized":"2024-09-13T19:08:28.999947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":380,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.250216+0000","last_change":"2024-09-13T19:10:08.250351+0000","last_active":"2024-09-13T19:10:08.250216+0000","last_peered":"2024-09-13T19:10:08.250216+0000","last_clean":"2024-09-13T19:10:08.250216+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:08.250216+0000","last_undegraded":"2024-09-13T19:10:08.250216+0000","last_fullsized":"2024-09-13T19:10:08.250216+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.249922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:42.550124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005700+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:08:49.005700+0000","last_peered":"2024-09-13T19:08:49.005700+0000","last_clean":"2024-09-13T19:08:49.005700+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:08:49.005700+0000","last_undegraded":"2024-09-13T19:08:49.005700+0000","last_fullsized":"2024-09-13T19:08:49.005700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.004823+0000","last_change":"2024-09-13T19:06:21.254380+0000","last_active":"2024-09-13T19:08:54.004823+0000","last_peered":"2024-09-13T19:08:54.004823+0000","last_clean":"2024-09-13T19:08:54.004823+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:08:54.004823+0000","last_undegraded":"2024-09-13T19:08:54.004823+0000","last_fullsized":"2024-09-13T19:08:54.004823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.230536+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.230536+0000","last_peered":"2024-09-13T19:09:38.230536+0000","last_clean":"2024-09-13T19:09:38.230536+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.230536+0000","last_undegraded":"2024-09-13T19:09:38.230536+0000","last_fullsized":"2024-09-13T19:09:38.230536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.937682+0000","last_change":"2024-09-13T19:10:18.937733+0000","last_active":"2024-09-13T19:10:18.937682+0000","last_peered":"2024-09-13T19:10:18.937682+0000","last_clean":"2024-09-13T19:10:18.937682+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:10:18.937682+0000","last_undegraded":"2024-09-13T19:10:18.937682+0000","last_fullsized":"2024-09-13T19:10:18.937682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.937494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:07.450855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.890149+0000","last_change":"2024-09-13T19:10:13.890226+0000","last_active":"2024-09-13T19:10:13.890149+0000","last_peered":"2024-09-13T19:10:13.890149+0000","last_clean":"2024-09-13T19:10:13.890149+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:13.890149+0000","last_undegraded":"2024-09-13T19:10:13.890149+0000","last_fullsized":"2024-09-13T19:10:13.890149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.889956+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:41.379481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.586378+0000","last_change":"2024-09-13T19:10:08.586502+0000","last_active":"2024-09-13T19:10:08.586378+0000","last_peered":"2024-09-13T19:10:08.586378+0000","last_clean":"2024-09-13T19:10:08.586378+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:10:08.586378+0000","last_undegraded":"2024-09-13T19:10:08.586378+0000","last_fullsized":"2024-09-13T19:10:08.586378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.586205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:31.058755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007927+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:08:54.007927+0000","last_peered":"2024-09-13T19:08:54.007927+0000","last_clean":"2024-09-13T19:08:54.007927+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:08:54.007927+0000","last_undegraded":"2024-09-13T19:08:54.007927+0000","last_fullsized":"2024-09-13T19:08:54.007927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.058748+0000","last_change":"2024-09-13T19:06:21.253912+0000","last_active":"2024-09-13T19:09:38.058748+0000","last_peered":"2024-09-13T19:09:38.058748+0000","last_clean":"2024-09-13T19:09:38.058748+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:09:38.058748+0000","last_undegraded":"2024-09-13T19:09:38.058748+0000","last_fullsized":"2024-09-13T19:09:38.058748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006472+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:49.006472+0000","last_peered":"2024-09-13T19:08:49.006472+0000","last_clean":"2024-09-13T19:08:49.006472+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:49.006472+0000","last_undegraded":"2024-09-13T19:08:49.006472+0000","last_fullsized":"2024-09-13T19:08:49.006472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.004848+0000","last_change":"2024-09-13T19:06:23.249406+0000","last_active":"2024-09-13T19:08:54.004848+0000","last_peered":"2024-09-13T19:08:54.004848+0000","last_clean":"2024-09-13T19:08:54.004848+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:08:54.004848+0000","last_undegraded":"2024-09-13T19:08:54.004848+0000","last_fullsized":"2024-09-13T19:08:54.004848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.454622+0000","last_change":"2024-09-13T19:10:22.454696+0000","last_active":"2024-09-13T19:10:22.454622+0000","last_peered":"2024-09-13T19:10:22.454622+0000","last_clean":"2024-09-13T19:10:22.454622+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:22.454622+0000","last_undegraded":"2024-09-13T19:10:22.454622+0000","last_fullsized":"2024-09-13T19:10:22.454622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.454429+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:00.959003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007806+0000","last_change":"2024-09-13T19:06:27.315327+0000","last_active":"2024-09-13T19:08:54.007806+0000","last_peered":"2024-09-13T19:08:54.007806+0000","last_clean":"2024-09-13T19:08:54.007806+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:08:54.007806+0000","last_undegraded":"2024-09-13T19:08:54.007806+0000","last_fullsized":"2024-09-13T19:08:54.007806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.008313+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:08:54.008313+0000","last_peered":"2024-09-13T19:08:54.008313+0000","last_clean":"2024-09-13T19:08:54.008313+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:08:54.008313+0000","last_undegraded":"2024-09-13T19:08:54.008313+0000","last_fullsized":"2024-09-13T19:08:54.008313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:24.010907+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:09:24.010907+0000","last_peered":"2024-09-13T19:09:24.010907+0000","last_clean":"2024-09-13T19:09:24.010907+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:09:24.010907+0000","last_undegraded":"2024-09-13T19:09:24.010907+0000","last_fullsized":"2024-09-13T19:09:24.010907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016536+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:10:07.016536+0000","last_peered":"2024-09-13T19:10:07.016536+0000","last_clean":"2024-09-13T19:10:07.016536+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:10:07.016536+0000","last_undegraded":"2024-09-13T19:10:07.016536+0000","last_fullsized":"2024-09-13T19:10:07.016536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005720+0000","last_change":"2024-09-13T19:06:23.259969+0000","last_active":"2024-09-13T19:08:49.005720+0000","last_peered":"2024-09-13T19:08:49.005720+0000","last_clean":"2024-09-13T19:08:49.005720+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:08:49.005720+0000","last_undegraded":"2024-09-13T19:08:49.005720+0000","last_fullsized":"2024-09-13T19:08:49.005720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.813086+0000","last_change":"2024-09-13T19:06:25.289764+0000","last_active":"2024-09-13T19:10:03.813086+0000","last_peered":"2024-09-13T19:10:03.813086+0000","last_clean":"2024-09-13T19:10:03.813086+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:03.813086+0000","last_undegraded":"2024-09-13T19:10:03.813086+0000","last_fullsized":"2024-09-13T19:10:03.813086+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:59.009573+0000","last_change":"2024-09-13T19:06:27.319266+0000","last_active":"2024-09-13T19:08:59.009573+0000","last_peered":"2024-09-13T19:08:59.009573+0000","last_clean":"2024-09-13T19:08:59.009573+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:08:59.009573+0000","last_undegraded":"2024-09-13T19:08:59.009573+0000","last_fullsized":"2024-09-13T19:08:59.009573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:26.240205+0000","last_clean_scrub_stamp":"2024-09-13T19:06:26.240205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.061934+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.061934+0000","last_peered":"2024-09-13T19:09:38.061934+0000","last_clean":"2024-09-13T19:09:38.061934+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.061934+0000","last_undegraded":"2024-09-13T19:09:38.061934+0000","last_fullsized":"2024-09-13T19:09:38.061934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.272711+0000","last_change":"2024-09-13T19:06:21.251997+0000","last_active":"2024-09-13T19:09:38.272711+0000","last_peered":"2024-09-13T19:09:38.272711+0000","last_clean":"2024-09-13T19:09:38.272711+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:09:38.272711+0000","last_undegraded":"2024-09-13T19:09:38.272711+0000","last_fullsized":"2024-09-13T19:09:38.272711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.998552+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:08:23.998552+0000","last_peered":"2024-09-13T19:08:23.998552+0000","last_clean":"2024-09-13T19:08:23.998552+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:08:23.998552+0000","last_undegraded":"2024-09-13T19:08:23.998552+0000","last_fullsized":"2024-09-13T19:08:23.998552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.902984+0000","last_change":"2024-09-13T19:10:16.903047+0000","last_active":"2024-09-13T19:10:16.902984+0000","last_peered":"2024-09-13T19:10:16.902984+0000","last_clean":"2024-09-13T19:10:16.902984+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:10:16.902984+0000","last_undegraded":"2024-09-13T19:10:16.902984+0000","last_fullsized":"2024-09-13T19:10:16.902984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.902806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:19.703828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.837753+0000","last_change":"2024-09-13T19:06:25.303807+0000","last_active":"2024-09-13T19:10:03.837753+0000","last_peered":"2024-09-13T19:10:03.837753+0000","last_clean":"2024-09-13T19:10:03.837753+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:03.837753+0000","last_undegraded":"2024-09-13T19:10:03.837753+0000","last_fullsized":"2024-09-13T19:10:03.837753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:24.226910+0000","last_clean_scrub_stamp":"2024-09-13T19:06:24.226910+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.519922+0000","last_change":"2024-09-13T19:10:16.520027+0000","last_active":"2024-09-13T19:10:16.519922+0000","last_peered":"2024-09-13T19:10:16.519922+0000","last_clean":"2024-09-13T19:10:16.519922+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:10:16.519922+0000","last_undegraded":"2024-09-13T19:10:16.519922+0000","last_fullsized":"2024-09-13T19:10:16.519922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.519636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:59.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006313+0000","last_change":"2024-09-13T19:06:29.310143+0000","last_active":"2024-09-13T19:08:49.006313+0000","last_peered":"2024-09-13T19:08:49.006313+0000","last_clean":"2024-09-13T19:08:49.006313+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:08:49.006313+0000","last_undegraded":"2024-09-13T19:08:49.006313+0000","last_fullsized":"2024-09-13T19:08:49.006313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.611236+0000","last_change":"2024-09-13T19:06:21.260509+0000","last_active":"2024-09-13T19:09:38.611236+0000","last_peered":"2024-09-13T19:09:38.611236+0000","last_clean":"2024-09-13T19:09:38.611236+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:09:38.611236+0000","last_undegraded":"2024-09-13T19:09:38.611236+0000","last_fullsized":"2024-09-13T19:09:38.611236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916714+0000","last_change":"2024-09-13T19:06:19.270097+0000","last_active":"2024-09-13T19:10:07.916714+0000","last_peered":"2024-09-13T19:10:07.916714+0000","last_clean":"2024-09-13T19:10:07.916714+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:10:07.916714+0000","last_undegraded":"2024-09-13T19:10:07.916714+0000","last_fullsized":"2024-09-13T19:10:07.916714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.991556+0000","last_change":"2024-09-13T19:06:21.255097+0000","last_active":"2024-09-13T19:08:33.991556+0000","last_peered":"2024-09-13T19:08:33.991556+0000","last_clean":"2024-09-13T19:08:33.991556+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:08:33.991556+0000","last_undegraded":"2024-09-13T19:08:33.991556+0000","last_fullsized":"2024-09-13T19:08:33.991556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016684+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:10:07.016684+0000","last_peered":"2024-09-13T19:10:07.016684+0000","last_clean":"2024-09-13T19:10:07.016684+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:10:07.016684+0000","last_undegraded":"2024-09-13T19:10:07.016684+0000","last_fullsized":"2024-09-13T19:10:07.016684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.903578+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:09:37.903578+0000","last_peered":"2024-09-13T19:09:37.903578+0000","last_clean":"2024-09-13T19:09:37.903578+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:09:37.903578+0000","last_undegraded":"2024-09-13T19:09:37.903578+0000","last_fullsized":"2024-09-13T19:09:37.903578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:23.997810+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:08:23.997810+0000","last_peered":"2024-09-13T19:08:23.997810+0000","last_clean":"2024-09-13T19:08:23.997810+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:08:23.997810+0000","last_undegraded":"2024-09-13T19:08:23.997810+0000","last_fullsized":"2024-09-13T19:08:23.997810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.991468+0000","last_change":"2024-09-13T19:06:21.255692+0000","last_active":"2024-09-13T19:08:33.991468+0000","last_peered":"2024-09-13T19:08:33.991468+0000","last_clean":"2024-09-13T19:08:33.991468+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:08:33.991468+0000","last_undegraded":"2024-09-13T19:08:33.991468+0000","last_fullsized":"2024-09-13T19:08:33.991468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016645+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:10:07.016645+0000","last_peered":"2024-09-13T19:10:07.016645+0000","last_clean":"2024-09-13T19:10:07.016645+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:10:07.016645+0000","last_undegraded":"2024-09-13T19:10:07.016645+0000","last_fullsized":"2024-09-13T19:10:07.016645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990005+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:08:28.990005+0000","last_peered":"2024-09-13T19:08:28.990005+0000","last_clean":"2024-09-13T19:08:28.990005+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:08:28.990005+0000","last_undegraded":"2024-09-13T19:08:28.990005+0000","last_fullsized":"2024-09-13T19:08:28.990005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.785067+0000","last_change":"2024-09-13T19:06:19.281225+0000","last_active":"2024-09-13T19:10:03.785067+0000","last_peered":"2024-09-13T19:10:03.785067+0000","last_clean":"2024-09-13T19:10:03.785067+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:10:03.785067+0000","last_undegraded":"2024-09-13T19:10:03.785067+0000","last_fullsized":"2024-09-13T19:10:03.785067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.057588+0000","last_change":"2024-09-13T19:06:21.264248+0000","last_active":"2024-09-13T19:09:38.057588+0000","last_peered":"2024-09-13T19:09:38.057588+0000","last_clean":"2024-09-13T19:09:38.057588+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:09:38.057588+0000","last_undegraded":"2024-09-13T19:09:38.057588+0000","last_fullsized":"2024-09-13T19:09:38.057588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:29.000106+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:08:29.000106+0000","last_peered":"2024-09-13T19:08:29.000106+0000","last_clean":"2024-09-13T19:08:29.000106+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:08:29.000106+0000","last_undegraded":"2024-09-13T19:08:29.000106+0000","last_fullsized":"2024-09-13T19:08:29.000106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475988+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:09:38.475988+0000","last_peered":"2024-09-13T19:09:38.475988+0000","last_clean":"2024-09-13T19:09:38.475988+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:09:38.475988+0000","last_undegraded":"2024-09-13T19:09:38.475988+0000","last_fullsized":"2024-09-13T19:09:38.475988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999331+0000","last_change":"2024-09-13T19:06:19.271992+0000","last_active":"2024-09-13T19:08:28.999331+0000","last_peered":"2024-09-13T19:08:28.999331+0000","last_clean":"2024-09-13T19:08:28.999331+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:08:28.999331+0000","last_undegraded":"2024-09-13T19:08:28.999331+0000","last_fullsized":"2024-09-13T19:08:28.999331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.905426+0000","last_change":"2024-09-13T19:06:21.262337+0000","last_active":"2024-09-13T19:09:37.905426+0000","last_peered":"2024-09-13T19:09:37.905426+0000","last_clean":"2024-09-13T19:09:37.905426+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:09:37.905426+0000","last_undegraded":"2024-09-13T19:09:37.905426+0000","last_fullsized":"2024-09-13T19:09:37.905426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.990234+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:08:28.990234+0000","last_peered":"2024-09-13T19:08:28.990234+0000","last_clean":"2024-09-13T19:08:28.990234+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:08:28.990234+0000","last_undegraded":"2024-09-13T19:08:28.990234+0000","last_fullsized":"2024-09-13T19:08:28.990234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.475721+0000","last_change":"2024-09-13T19:06:21.260793+0000","last_active":"2024-09-13T19:09:38.475721+0000","last_peered":"2024-09-13T19:09:38.475721+0000","last_clean":"2024-09-13T19:09:38.475721+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:09:38.475721+0000","last_undegraded":"2024-09-13T19:09:38.475721+0000","last_fullsized":"2024-09-13T19:09:38.475721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:28.999320+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:08:28.999320+0000","last_peered":"2024-09-13T19:08:28.999320+0000","last_clean":"2024-09-13T19:08:28.999320+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:08:28.999320+0000","last_undegraded":"2024-09-13T19:08:28.999320+0000","last_fullsized":"2024-09-13T19:08:28.999320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004471+0000","last_change":"2024-09-13T19:06:21.257594+0000","last_active":"2024-09-13T19:08:44.004471+0000","last_peered":"2024-09-13T19:08:44.004471+0000","last_clean":"2024-09-13T19:08:44.004471+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:08:44.004471+0000","last_undegraded":"2024-09-13T19:08:44.004471+0000","last_fullsized":"2024-09-13T19:08:44.004471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:33.991210+0000","last_change":"2024-09-13T19:06:19.278186+0000","last_active":"2024-09-13T19:08:33.991210+0000","last_peered":"2024-09-13T19:08:33.991210+0000","last_clean":"2024-09-13T19:08:33.991210+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:08:33.991210+0000","last_undegraded":"2024-09-13T19:08:33.991210+0000","last_fullsized":"2024-09-13T19:08:33.991210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'5","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.611851+0000","last_change":"2024-09-13T19:06:21.240787+0000","last_active":"2024-09-13T19:09:38.611851+0000","last_peered":"2024-09-13T19:09:38.611851+0000","last_clean":"2024-09-13T19:09:38.611851+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:09:38.611851+0000","last_undegraded":"2024-09-13T19:09:38.611851+0000","last_fullsized":"2024-09-13T19:09:38.611851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001012+0000","last_change":"2024-09-13T19:06:19.283567+0000","last_active":"2024-09-13T19:08:34.001012+0000","last_peered":"2024-09-13T19:08:34.001012+0000","last_clean":"2024-09-13T19:08:34.001012+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:08:34.001012+0000","last_undegraded":"2024-09-13T19:08:34.001012+0000","last_fullsized":"2024-09-13T19:08:34.001012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.612209+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:09:38.612209+0000","last_peered":"2024-09-13T19:09:38.612209+0000","last_clean":"2024-09-13T19:09:38.612209+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:09:38.612209+0000","last_undegraded":"2024-09-13T19:09:38.612209+0000","last_fullsized":"2024-09-13T19:09:38.612209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001057+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:08:34.001057+0000","last_peered":"2024-09-13T19:08:34.001057+0000","last_clean":"2024-09-13T19:08:34.001057+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:08:34.001057+0000","last_undegraded":"2024-09-13T19:08:34.001057+0000","last_fullsized":"2024-09-13T19:08:34.001057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.276736+0000","last_change":"2024-09-13T19:06:21.256504+0000","last_active":"2024-09-13T19:09:38.276736+0000","last_peered":"2024-09-13T19:09:38.276736+0000","last_clean":"2024-09-13T19:09:38.276736+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:09:38.276736+0000","last_undegraded":"2024-09-13T19:09:38.276736+0000","last_fullsized":"2024-09-13T19:09:38.276736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.000998+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:08:34.000998+0000","last_peered":"2024-09-13T19:08:34.000998+0000","last_clean":"2024-09-13T19:08:34.000998+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:08:34.000998+0000","last_undegraded":"2024-09-13T19:08:34.000998+0000","last_fullsized":"2024-09-13T19:08:34.000998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.392943+0000","last_change":"2024-09-13T19:06:21.264548+0000","last_active":"2024-09-13T19:09:38.392943+0000","last_peered":"2024-09-13T19:09:38.392943+0000","last_clean":"2024-09-13T19:09:38.392943+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:09:38.392943+0000","last_undegraded":"2024-09-13T19:09:38.392943+0000","last_fullsized":"2024-09-13T19:09:38.392943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:34.001069+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:08:34.001069+0000","last_peered":"2024-09-13T19:08:34.001069+0000","last_clean":"2024-09-13T19:08:34.001069+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:08:34.001069+0000","last_undegraded":"2024-09-13T19:08:34.001069+0000","last_fullsized":"2024-09-13T19:08:34.001069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.275798+0000","last_change":"2024-09-13T19:06:21.261602+0000","last_active":"2024-09-13T19:09:38.275798+0000","last_peered":"2024-09-13T19:09:38.275798+0000","last_clean":"2024-09-13T19:09:38.275798+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:09:38.275798+0000","last_undegraded":"2024-09-13T19:09:38.275798+0000","last_fullsized":"2024-09-13T19:09:38.275798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001428+0000","last_change":"2024-09-13T19:06:19.278323+0000","last_active":"2024-09-13T19:08:39.001428+0000","last_peered":"2024-09-13T19:08:39.001428+0000","last_clean":"2024-09-13T19:08:39.001428+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:08:39.001428+0000","last_undegraded":"2024-09-13T19:08:39.001428+0000","last_fullsized":"2024-09-13T19:08:39.001428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.390698+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:09:38.390698+0000","last_peered":"2024-09-13T19:09:38.390698+0000","last_clean":"2024-09-13T19:09:38.390698+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:09:38.390698+0000","last_undegraded":"2024-09-13T19:09:38.390698+0000","last_fullsized":"2024-09-13T19:09:38.390698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.239429+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.239429+0000","last_peered":"2024-09-13T19:09:38.239429+0000","last_clean":"2024-09-13T19:09:38.239429+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.239429+0000","last_undegraded":"2024-09-13T19:09:38.239429+0000","last_fullsized":"2024-09-13T19:09:38.239429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002127+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:08:39.002127+0000","last_peered":"2024-09-13T19:08:39.002127+0000","last_clean":"2024-09-13T19:08:39.002127+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:08:39.002127+0000","last_undegraded":"2024-09-13T19:08:39.002127+0000","last_fullsized":"2024-09-13T19:08:39.002127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:48.995760+0000","last_change":"2024-09-13T19:06:21.261511+0000","last_active":"2024-09-13T19:08:48.995760+0000","last_peered":"2024-09-13T19:08:48.995760+0000","last_clean":"2024-09-13T19:08:48.995760+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:08:48.995760+0000","last_undegraded":"2024-09-13T19:08:48.995760+0000","last_fullsized":"2024-09-13T19:08:48.995760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:38.992630+0000","last_change":"2024-09-13T19:06:19.278870+0000","last_active":"2024-09-13T19:08:38.992630+0000","last_peered":"2024-09-13T19:08:38.992630+0000","last_clean":"2024-09-13T19:08:38.992630+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:08:38.992630+0000","last_undegraded":"2024-09-13T19:08:38.992630+0000","last_fullsized":"2024-09-13T19:08:38.992630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'23","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.612273+0000","last_change":"2024-09-13T19:06:21.255155+0000","last_active":"2024-09-13T19:09:38.612273+0000","last_peered":"2024-09-13T19:09:38.612273+0000","last_clean":"2024-09-13T19:09:38.612273+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:09:38.612273+0000","last_undegraded":"2024-09-13T19:09:38.612273+0000","last_fullsized":"2024-09-13T19:09:38.612273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1493,"ondisk_log_size":1493,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705719,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":741263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":152715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.169 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.170 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.171 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.172 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.173 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.174 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.175 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.176 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:06:05.016117+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.177 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.178 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.179 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.180 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.181 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.182 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.183 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.184 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.185 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.186 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-13T19:06:26.240205+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-13T19:06:24.226910+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=24, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.187 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.188 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.189 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.190 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:29.191 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:10:49.193 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:10:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.325+0000 7fb2ed720640 1 Processor -- start 2024-09-13T19:10:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.325+0000 7fb2ed720640 1 -- start start 2024-09-13T19:10:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.325+0000 7fb2ed720640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb2e812e760 0x7fb2e812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.325+0000 7fb2ed720640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e80984f0 con 0x7fb2e812f1c0 2024-09-13T19:10:49.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.325+0000 7fb2ed720640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e8098dc0 con 0x7fb2e812e760 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb2e812e760 0x7fb2e812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e67fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb2e812f1c0 0x7fb2e812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42688/0 (socket says 172.21.15.12:42688) 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e67fc640 1 -- 172.21.15.12:0/4206830082 learned_addr learned my addr 172.21.15.12:0/4206830082 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e6ffd640 1 -- 172.21.15.12:0/4206830082 >> v1:172.21.15.12:6789/0 conn(0x7fb2e812f1c0 legacy=0x7fb2e812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e5ffb640 1 -- 172.21.15.12:0/4206830082 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325736321 0 0) 0x7fb2e80984f0 con 0x7fb2e812f1c0 2024-09-13T19:10:49.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e6ffd640 1 -- 172.21.15.12:0/4206830082 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e812f5a0 con 0x7fb2e812e760 2024-09-13T19:10:49.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e6ffd640 1 --2- 172.21.15.12:0/4206830082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e812ec80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009740 tx=0x7fb2d801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141c19733125cc2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:49.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e5ffb640 1 -- 172.21.15.12:0/4206830082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80b0070 con 0x7fb2e812e760 2024-09-13T19:10:49.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e5ffb640 1 -- 172.21.15.12:0/4206830082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d80ab530 con 0x7fb2e812e760 2024-09-13T19:10:49.335 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.329+0000 7fb2e5ffb640 1 -- 172.21.15.12:0/4206830082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80ab830 con 0x7fb2e812e760 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/4206830082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 msgr2=0x7fb2e812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 --2- 172.21.15.12:0/4206830082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e812ec80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009740 tx=0x7fb2d801c400 comp rx=0 tx=0).stop 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/4206830082 shutdown_connections 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 --2- 172.21.15.12:0/4206830082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e812ec80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/4206830082 >> 172.21.15.12:0/4206830082 conn(0x7fb2e80a10a0 msgr2=0x7fb2e80a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/4206830082 shutdown_connections 2024-09-13T19:10:49.336 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/4206830082 wait complete. 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 Processor -- start 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- start start 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e8136e30 con 0x7fb2e812e760 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2e6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42878/0 (socket says 172.21.15.12:42878) 2024-09-13T19:10:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2e6ffd640 1 -- 172.21.15.12:0/969046839 learned_addr learned my addr 172.21.15.12:0/969046839 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:10:49.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2e6ffd640 1 -- 172.21.15.12:0/969046839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e8132f70 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2e6ffd640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb2d801a030 tx=0x7fb2d801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80b0050 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2d80b1040 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e8133430 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2d80b5740 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e8130f20 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2d80be030 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 0x7fb2d4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e8132300 con 0x7fb2e812e760 2024-09-13T19:10:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.333+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb2d80bc070 con 0x7fb2e812e760 2024-09-13T19:10:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.337+0000 7fb2e67fc640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 0x7fb2d4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:10:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.337+0000 7fb2e67fc640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 0x7fb2d4038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007fd0 tx=0x7fb2dc007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:10:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.341+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb2d80c5020 con 0x7fb2e812e760 2024-09-13T19:10:49.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.501+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2e812ec80 con 0x7fb2d4035db0 2024-09-13T19:10:49.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.545+0000 7fb2cf7fe640 1 -- 172.21.15.12:0/969046839 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662614 (secure 0 0 0) 0x7fb2e812ec80 con 0x7fb2d4035db0 2024-09-13T19:10:49.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:10:49.563 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 msgr2=0x7fb2d4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 0x7fb2d4038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc007fd0 tx=0x7fb2dc007980 comp rx=0 tx=0).stop 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 msgr2=0x7fb2e81309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb2d801a030 tx=0x7fb2d801ac40 comp rx=0 tx=0).stop 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 shutdown_connections 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fb2d4035db0 0x7fb2d4038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 --2- 172.21.15.12:0/969046839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2e812e760 0x7fb2e81309e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 >> 172.21.15.12:0/969046839 conn(0x7fb2e80a10a0 msgr2=0x7fb2e812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 shutdown_connections 2024-09-13T19:10:49.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:10:49.553+0000 7fb2ed720640 1 -- 172.21.15.12:0/969046839 wait complete. 2024-09-13T19:10:49.576 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-13T19:10:49.037769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2872,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4777,"ondisk_log_size":4777,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1788524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006164"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916989+0000","last_change":"2024-09-13T19:06:19.266711+0000","last_active":"2024-09-13T19:10:07.916989+0000","last_peered":"2024-09-13T19:10:07.916989+0000","last_clean":"2024-09-13T19:10:07.916989+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:10:07.916989+0000","last_undegraded":"2024-09-13T19:10:07.916989+0000","last_fullsized":"2024-09-13T19:10:07.916989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.965072+0000","last_change":"2024-09-13T19:10:25.965129+0000","last_active":"2024-09-13T19:10:25.965072+0000","last_peered":"2024-09-13T19:10:25.965072+0000","last_clean":"2024-09-13T19:10:25.965072+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:10:25.965072+0000","last_undegraded":"2024-09-13T19:10:25.965072+0000","last_fullsized":"2024-09-13T19:10:25.965072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.964881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:55.311376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.386765+0000","last_change":"2024-09-13T19:10:39.386834+0000","last_active":"2024-09-13T19:10:39.386765+0000","last_peered":"2024-09-13T19:10:39.386765+0000","last_clean":"2024-09-13T19:10:39.386765+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:10:39.386765+0000","last_undegraded":"2024-09-13T19:10:39.386765+0000","last_fullsized":"2024-09-13T19:10:39.386765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.386575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:52.773701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.885413+0000","last_change":"2024-09-13T19:10:46.885532+0000","last_active":"2024-09-13T19:10:46.885413+0000","last_peered":"2024-09-13T19:10:46.885413+0000","last_clean":"2024-09-13T19:10:46.885413+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:10:46.885413+0000","last_undegraded":"2024-09-13T19:10:46.885413+0000","last_fullsized":"2024-09-13T19:10:46.885413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.885150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:36.242321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374522+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:10:08.374522+0000","last_peered":"2024-09-13T19:10:08.374522+0000","last_clean":"2024-09-13T19:10:08.374522+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:10:08.374522+0000","last_undegraded":"2024-09-13T19:10:08.374522+0000","last_fullsized":"2024-09-13T19:10:08.374522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.962210+0000","last_change":"2024-09-13T19:10:44.962280+0000","last_active":"2024-09-13T19:10:44.962210+0000","last_peered":"2024-09-13T19:10:44.962210+0000","last_clean":"2024-09-13T19:10:44.962210+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:10:44.962210+0000","last_undegraded":"2024-09-13T19:10:44.962210+0000","last_fullsized":"2024-09-13T19:10:44.962210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.961999+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:09.446134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.214987+0000","last_change":"2024-09-13T19:10:42.215120+0000","last_active":"2024-09-13T19:10:42.214987+0000","last_peered":"2024-09-13T19:10:42.214987+0000","last_clean":"2024-09-13T19:10:42.214987+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:10:42.214987+0000","last_undegraded":"2024-09-13T19:10:42.214987+0000","last_fullsized":"2024-09-13T19:10:42.214987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.214682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:21.166832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.271214+0000","last_change":"2024-09-13T19:06:21.255578+0000","last_active":"2024-09-13T19:09:38.271214+0000","last_peered":"2024-09-13T19:09:38.271214+0000","last_clean":"2024-09-13T19:09:38.271214+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:09:38.271214+0000","last_undegraded":"2024-09-13T19:09:38.271214+0000","last_fullsized":"2024-09-13T19:09:38.271214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006250+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:08:49.006250+0000","last_peered":"2024-09-13T19:08:49.006250+0000","last_clean":"2024-09-13T19:08:49.006250+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:08:49.006250+0000","last_undegraded":"2024-09-13T19:08:49.006250+0000","last_fullsized":"2024-09-13T19:08:49.006250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.014802+0000","last_change":"2024-09-13T19:10:37.014859+0000","last_active":"2024-09-13T19:10:37.014802+0000","last_peered":"2024-09-13T19:10:37.014802+0000","last_clean":"2024-09-13T19:10:37.014802+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:10:37.014802+0000","last_undegraded":"2024-09-13T19:10:37.014802+0000","last_fullsized":"2024-09-13T19:10:37.014802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.014649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:51.338193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.783980+0000","last_change":"2024-09-13T19:06:19.269750+0000","last_active":"2024-09-13T19:10:03.783980+0000","last_peered":"2024-09-13T19:10:03.783980+0000","last_clean":"2024-09-13T19:10:03.783980+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:10:03.783980+0000","last_undegraded":"2024-09-13T19:10:03.783980+0000","last_fullsized":"2024-09-13T19:10:03.783980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.711657+0000","last_change":"2024-09-13T19:10:24.711657+0000","last_active":"2024-09-13T19:10:24.711657+0000","last_peered":"2024-09-13T19:10:24.711657+0000","last_clean":"2024-09-13T19:10:24.711657+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:10:24.711657+0000","last_undegraded":"2024-09-13T19:10:24.711657+0000","last_fullsized":"2024-09-13T19:10:24.711657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.711412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:17.178317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005953+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:08:49.005953+0000","last_peered":"2024-09-13T19:08:49.005953+0000","last_clean":"2024-09-13T19:08:49.005953+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:08:49.005953+0000","last_undegraded":"2024-09-13T19:08:49.005953+0000","last_fullsized":"2024-09-13T19:08:49.005953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.239676+0000","last_change":"2024-09-13T19:10:41.239708+0000","last_active":"2024-09-13T19:10:41.239676+0000","last_peered":"2024-09-13T19:10:41.239676+0000","last_clean":"2024-09-13T19:10:41.239676+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:10:41.239676+0000","last_undegraded":"2024-09-13T19:10:41.239676+0000","last_fullsized":"2024-09-13T19:10:41.239676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.239600+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:03.210937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:48.995277+0000","last_change":"2024-09-13T19:06:19.266524+0000","last_active":"2024-09-13T19:08:48.995277+0000","last_peered":"2024-09-13T19:08:48.995277+0000","last_clean":"2024-09-13T19:08:48.995277+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:08:48.995277+0000","last_undegraded":"2024-09-13T19:08:48.995277+0000","last_fullsized":"2024-09-13T19:08:48.995277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.114062+0000","last_change":"2024-09-13T19:10:45.114122+0000","last_active":"2024-09-13T19:10:45.114062+0000","last_peered":"2024-09-13T19:10:45.114062+0000","last_clean":"2024-09-13T19:10:45.114062+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:10:45.114062+0000","last_undegraded":"2024-09-13T19:10:45.114062+0000","last_fullsized":"2024-09-13T19:10:45.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.113869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.972412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.915928+0000","last_change":"2024-09-13T19:10:45.915985+0000","last_active":"2024-09-13T19:10:45.915928+0000","last_peered":"2024-09-13T19:10:45.915928+0000","last_clean":"2024-09-13T19:10:45.915928+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:10:45.915928+0000","last_undegraded":"2024-09-13T19:10:45.915928+0000","last_fullsized":"2024-09-13T19:10:45.915928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.915738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:39.816239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.072063+0000","last_change":"2024-09-13T19:10:43.072129+0000","last_active":"2024-09-13T19:10:43.072063+0000","last_peered":"2024-09-13T19:10:43.072063+0000","last_clean":"2024-09-13T19:10:43.072063+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:10:43.072063+0000","last_undegraded":"2024-09-13T19:10:43.072063+0000","last_fullsized":"2024-09-13T19:10:43.072063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.071868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:07.179556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.974594+0000","last_change":"2024-09-13T19:10:33.974650+0000","last_active":"2024-09-13T19:10:33.974594+0000","last_peered":"2024-09-13T19:10:33.974594+0000","last_clean":"2024-09-13T19:10:33.974594+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:10:33.974594+0000","last_undegraded":"2024-09-13T19:10:33.974594+0000","last_fullsized":"2024-09-13T19:10:33.974594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.974412+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:55.945748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.173469+0000","last_change":"2024-09-13T19:10:36.173537+0000","last_active":"2024-09-13T19:10:36.173469+0000","last_peered":"2024-09-13T19:10:36.173469+0000","last_clean":"2024-09-13T19:10:36.173469+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:10:36.173469+0000","last_undegraded":"2024-09-13T19:10:36.173469+0000","last_fullsized":"2024-09-13T19:10:36.173469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.173259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:23.309455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.918988+0000","last_change":"2024-09-13T19:10:26.919051+0000","last_active":"2024-09-13T19:10:26.918988+0000","last_peered":"2024-09-13T19:10:26.918988+0000","last_clean":"2024-09-13T19:10:26.918988+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:10:26.918988+0000","last_undegraded":"2024-09-13T19:10:26.918988+0000","last_fullsized":"2024-09-13T19:10:26.918988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.918796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:56.283130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.793007+0000","last_change":"2024-09-13T19:06:19.274956+0000","last_active":"2024-09-13T19:09:37.793007+0000","last_peered":"2024-09-13T19:09:37.793007+0000","last_clean":"2024-09-13T19:09:37.793007+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:09:37.793007+0000","last_undegraded":"2024-09-13T19:09:37.793007+0000","last_fullsized":"2024-09-13T19:09:37.793007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.426223+0000","last_change":"2024-09-13T19:10:42.426283+0000","last_active":"2024-09-13T19:10:42.426223+0000","last_peered":"2024-09-13T19:10:42.426223+0000","last_clean":"2024-09-13T19:10:42.426223+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:10:42.426223+0000","last_undegraded":"2024-09-13T19:10:42.426223+0000","last_fullsized":"2024-09-13T19:10:42.426223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.425992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:20.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.051882+0000","last_change":"2024-09-13T19:10:47.052015+0000","last_active":"2024-09-13T19:10:47.051882+0000","last_peered":"2024-09-13T19:10:47.051882+0000","last_clean":"2024-09-13T19:10:47.051882+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:10:47.051882+0000","last_undegraded":"2024-09-13T19:10:47.051882+0000","last_fullsized":"2024-09-13T19:10:47.051882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.051626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:27.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.250949+0000","last_change":"2024-09-13T19:10:39.251015+0000","last_active":"2024-09-13T19:10:39.250949+0000","last_peered":"2024-09-13T19:10:39.250949+0000","last_clean":"2024-09-13T19:10:39.250949+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:10:39.250949+0000","last_undegraded":"2024-09-13T19:10:39.250949+0000","last_fullsized":"2024-09-13T19:10:39.250949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.250731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:13.731105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.465686+0000","last_change":"2024-09-13T19:10:43.465752+0000","last_active":"2024-09-13T19:10:43.465686+0000","last_peered":"2024-09-13T19:10:43.465686+0000","last_clean":"2024-09-13T19:10:43.465686+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:10:43.465686+0000","last_undegraded":"2024-09-13T19:10:43.465686+0000","last_fullsized":"2024-09-13T19:10:43.465686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.465496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:45.366067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.911687+0000","last_change":"2024-09-13T19:10:29.911854+0000","last_active":"2024-09-13T19:10:29.911687+0000","last_peered":"2024-09-13T19:10:29.911687+0000","last_clean":"2024-09-13T19:10:29.911687+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:10:29.911687+0000","last_undegraded":"2024-09-13T19:10:29.911687+0000","last_fullsized":"2024-09-13T19:10:29.911687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.911432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:31.527553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002356+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:08:39.002356+0000","last_peered":"2024-09-13T19:08:39.002356+0000","last_clean":"2024-09-13T19:08:39.002356+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:08:39.002356+0000","last_undegraded":"2024-09-13T19:08:39.002356+0000","last_fullsized":"2024-09-13T19:08:39.002356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'37","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.498496+0000","last_change":"2024-09-13T19:06:29.324436+0000","last_active":"2024-09-13T19:09:38.498496+0000","last_peered":"2024-09-13T19:09:38.498496+0000","last_clean":"2024-09-13T19:09:38.498496+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:09:38.498496+0000","last_undegraded":"2024-09-13T19:09:38.498496+0000","last_fullsized":"2024-09-13T19:09:38.498496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.610166+0000","last_change":"2024-09-13T19:06:21.248508+0000","last_active":"2024-09-13T19:09:38.610166+0000","last_peered":"2024-09-13T19:09:38.610166+0000","last_clean":"2024-09-13T19:09:38.610166+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:09:38.610166+0000","last_undegraded":"2024-09-13T19:09:38.610166+0000","last_fullsized":"2024-09-13T19:09:38.610166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.789415+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:10:03.789415+0000","last_peered":"2024-09-13T19:10:03.789415+0000","last_clean":"2024-09-13T19:10:03.789415+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:10:03.789415+0000","last_undegraded":"2024-09-13T19:10:03.789415+0000","last_fullsized":"2024-09-13T19:10:03.789415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.972877+0000","last_change":"2024-09-13T19:10:12.972934+0000","last_active":"2024-09-13T19:10:12.972877+0000","last_peered":"2024-09-13T19:10:12.972877+0000","last_clean":"2024-09-13T19:10:12.972877+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:10:12.972877+0000","last_undegraded":"2024-09-13T19:10:12.972877+0000","last_fullsized":"2024-09-13T19:10:12.972877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.972679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:27.296223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.842913+0000","last_change":"2024-09-13T19:10:19.843011+0000","last_active":"2024-09-13T19:10:19.842913+0000","last_peered":"2024-09-13T19:10:19.842913+0000","last_clean":"2024-09-13T19:10:19.842913+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:19.842913+0000","last_undegraded":"2024-09-13T19:10:19.842913+0000","last_fullsized":"2024-09-13T19:10:19.842913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.842729+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:36.209477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.887782+0000","last_change":"2024-09-13T19:10:15.887880+0000","last_active":"2024-09-13T19:10:15.887782+0000","last_peered":"2024-09-13T19:10:15.887782+0000","last_clean":"2024-09-13T19:10:15.887782+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:10:15.887782+0000","last_undegraded":"2024-09-13T19:10:15.887782+0000","last_fullsized":"2024-09-13T19:10:15.887782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.887546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:39.150730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007497+0000","last_change":"2024-09-13T19:06:29.325765+0000","last_active":"2024-09-13T19:08:54.007497+0000","last_peered":"2024-09-13T19:08:54.007497+0000","last_clean":"2024-09-13T19:08:54.007497+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:08:54.007497+0000","last_undegraded":"2024-09-13T19:08:54.007497+0000","last_fullsized":"2024-09-13T19:08:54.007497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.473235+0000","last_change":"2024-09-13T19:06:21.255879+0000","last_active":"2024-09-13T19:09:38.473235+0000","last_peered":"2024-09-13T19:09:38.473235+0000","last_clean":"2024-09-13T19:09:38.473235+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:09:38.473235+0000","last_undegraded":"2024-09-13T19:09:38.473235+0000","last_fullsized":"2024-09-13T19:09:38.473235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.001240+0000","last_change":"2024-09-13T19:06:19.270094+0000","last_active":"2024-09-13T19:08:39.001240+0000","last_peered":"2024-09-13T19:08:39.001240+0000","last_clean":"2024-09-13T19:08:39.001240+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:08:39.001240+0000","last_undegraded":"2024-09-13T19:08:39.001240+0000","last_fullsized":"2024-09-13T19:08:39.001240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.432429+0000","last_change":"2024-09-13T19:10:27.432482+0000","last_active":"2024-09-13T19:10:27.432429+0000","last_peered":"2024-09-13T19:10:27.432429+0000","last_clean":"2024-09-13T19:10:27.432429+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:10:27.432429+0000","last_undegraded":"2024-09-13T19:10:27.432429+0000","last_fullsized":"2024-09-13T19:10:27.432429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.432228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:29.048350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.866941+0000","last_change":"2024-09-13T19:10:10.867013+0000","last_active":"2024-09-13T19:10:10.866941+0000","last_peered":"2024-09-13T19:10:10.866941+0000","last_clean":"2024-09-13T19:10:10.866941+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:10:10.866941+0000","last_undegraded":"2024-09-13T19:10:10.866941+0000","last_fullsized":"2024-09-13T19:10:10.866941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.866745+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:48.102941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.912524+0000","last_change":"2024-09-13T19:10:31.912578+0000","last_active":"2024-09-13T19:10:31.912524+0000","last_peered":"2024-09-13T19:10:31.912524+0000","last_clean":"2024-09-13T19:10:31.912524+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:10:31.912524+0000","last_undegraded":"2024-09-13T19:10:31.912524+0000","last_fullsized":"2024-09-13T19:10:31.912524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:06.392672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.430859+0000","last_change":"2024-09-13T19:10:36.430935+0000","last_active":"2024-09-13T19:10:36.430859+0000","last_peered":"2024-09-13T19:10:36.430859+0000","last_clean":"2024-09-13T19:10:36.430859+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:10:36.430859+0000","last_undegraded":"2024-09-13T19:10:36.430859+0000","last_fullsized":"2024-09-13T19:10:36.430859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.430640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.689712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.931091+0000","last_change":"2024-09-13T19:10:48.931258+0000","last_active":"2024-09-13T19:10:48.931091+0000","last_peered":"2024-09-13T19:10:48.931091+0000","last_clean":"2024-09-13T19:10:48.931091+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:10:48.931091+0000","last_undegraded":"2024-09-13T19:10:48.931091+0000","last_fullsized":"2024-09-13T19:10:48.931091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.930858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:24.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002201+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:08:39.002201+0000","last_peered":"2024-09-13T19:08:39.002201+0000","last_clean":"2024-09-13T19:08:39.002201+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:08:39.002201+0000","last_undegraded":"2024-09-13T19:08:39.002201+0000","last_fullsized":"2024-09-13T19:08:39.002201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.425940+0000","last_change":"2024-09-13T19:10:25.425993+0000","last_active":"2024-09-13T19:10:25.425940+0000","last_peered":"2024-09-13T19:10:25.425940+0000","last_clean":"2024-09-13T19:10:25.425940+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:10:25.425940+0000","last_undegraded":"2024-09-13T19:10:25.425940+0000","last_fullsized":"2024-09-13T19:10:25.425940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.425753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:37.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.253203+0000","last_change":"2024-09-13T19:10:18.253379+0000","last_active":"2024-09-13T19:10:18.253203+0000","last_peered":"2024-09-13T19:10:18.253203+0000","last_clean":"2024-09-13T19:10:18.253203+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:10:18.253203+0000","last_undegraded":"2024-09-13T19:10:18.253203+0000","last_fullsized":"2024-09-13T19:10:18.253203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.252941+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:40.725492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":395,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.956351+0000","last_change":"2024-09-13T19:10:32.956410+0000","last_active":"2024-09-13T19:10:32.956351+0000","last_peered":"2024-09-13T19:10:32.956351+0000","last_clean":"2024-09-13T19:10:32.956351+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:32.956351+0000","last_undegraded":"2024-09-13T19:10:32.956351+0000","last_fullsized":"2024-09-13T19:10:32.956351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.956155+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:32.705617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:59.005825+0000","last_change":"2024-09-13T19:06:29.330766+0000","last_active":"2024-09-13T19:08:59.005825+0000","last_peered":"2024-09-13T19:08:59.005825+0000","last_clean":"2024-09-13T19:08:59.005825+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:08:59.005825+0000","last_undegraded":"2024-09-13T19:08:59.005825+0000","last_fullsized":"2024-09-13T19:08:59.005825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.435476+0000","last_change":"2024-09-13T19:10:37.435604+0000","last_active":"2024-09-13T19:10:37.435476+0000","last_peered":"2024-09-13T19:10:37.435476+0000","last_clean":"2024-09-13T19:10:37.435476+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:10:37.435476+0000","last_undegraded":"2024-09-13T19:10:37.435476+0000","last_fullsized":"2024-09-13T19:10:37.435476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.435250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:27.175964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002173+0000","last_change":"2024-09-13T19:06:19.272531+0000","last_active":"2024-09-13T19:08:39.002173+0000","last_peered":"2024-09-13T19:08:39.002173+0000","last_clean":"2024-09-13T19:08:39.002173+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:08:39.002173+0000","last_undegraded":"2024-09-13T19:08:39.002173+0000","last_fullsized":"2024-09-13T19:08:39.002173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.881704+0000","last_change":"2024-09-13T19:10:14.881765+0000","last_active":"2024-09-13T19:10:14.881704+0000","last_peered":"2024-09-13T19:10:14.881704+0000","last_clean":"2024-09-13T19:10:14.881704+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:10:14.881704+0000","last_undegraded":"2024-09-13T19:10:14.881704+0000","last_fullsized":"2024-09-13T19:10:14.881704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.881511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:35.275730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.131235+0000","last_change":"2024-09-13T19:10:22.131313+0000","last_active":"2024-09-13T19:10:22.131235+0000","last_peered":"2024-09-13T19:10:22.131235+0000","last_clean":"2024-09-13T19:10:22.131235+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:22.131235+0000","last_undegraded":"2024-09-13T19:10:22.131235+0000","last_fullsized":"2024-09-13T19:10:22.131235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.131038+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:23.920744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":455,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.561363+0000","last_change":"2024-09-13T19:10:11.561428+0000","last_active":"2024-09-13T19:10:11.561363+0000","last_peered":"2024-09-13T19:10:11.561363+0000","last_clean":"2024-09-13T19:10:11.561363+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:11.561363+0000","last_undegraded":"2024-09-13T19:10:11.561363+0000","last_fullsized":"2024-09-13T19:10:11.561363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.561170+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:17.766610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.929670+0000","last_change":"2024-09-13T19:10:41.929670+0000","last_active":"2024-09-13T19:10:41.929670+0000","last_peered":"2024-09-13T19:10:41.929670+0000","last_clean":"2024-09-13T19:10:41.929670+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:10:41.929670+0000","last_undegraded":"2024-09-13T19:10:41.929670+0000","last_fullsized":"2024-09-13T19:10:41.929670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.929268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.427604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.054552+0000","last_change":"2024-09-13T19:10:48.054552+0000","last_active":"2024-09-13T19:10:48.054552+0000","last_peered":"2024-09-13T19:10:48.054552+0000","last_clean":"2024-09-13T19:10:48.054552+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:10:48.054552+0000","last_undegraded":"2024-09-13T19:10:48.054552+0000","last_fullsized":"2024-09-13T19:10:48.054552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.054273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:42.086766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.843983+0000","last_change":"2024-09-13T19:10:14.843983+0000","last_active":"2024-09-13T19:10:14.843983+0000","last_peered":"2024-09-13T19:10:14.843983+0000","last_clean":"2024-09-13T19:10:14.843983+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:10:14.843983+0000","last_undegraded":"2024-09-13T19:10:14.843983+0000","last_fullsized":"2024-09-13T19:10:14.843983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.843733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.242513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.232478+0000","last_change":"2024-09-13T19:10:15.232478+0000","last_active":"2024-09-13T19:10:15.232478+0000","last_peered":"2024-09-13T19:10:15.232478+0000","last_clean":"2024-09-13T19:10:15.232478+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:15.232478+0000","last_undegraded":"2024-09-13T19:10:15.232478+0000","last_fullsized":"2024-09-13T19:10:15.232478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.232187+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:36.639820+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.572971+0000","last_change":"2024-09-13T19:10:10.573027+0000","last_active":"2024-09-13T19:10:10.572971+0000","last_peered":"2024-09-13T19:10:10.572971+0000","last_clean":"2024-09-13T19:10:10.572971+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:10:10.572971+0000","last_undegraded":"2024-09-13T19:10:10.572971+0000","last_fullsized":"2024-09-13T19:10:10.572971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.572736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:15.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.062803+0000","last_change":"2024-09-13T19:10:29.062803+0000","last_active":"2024-09-13T19:10:29.062803+0000","last_peered":"2024-09-13T19:10:29.062803+0000","last_clean":"2024-09-13T19:10:29.062803+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:10:29.062803+0000","last_undegraded":"2024-09-13T19:10:29.062803+0000","last_fullsized":"2024-09-13T19:10:29.062803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.062532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:37.830227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.057410+0000","last_change":"2024-09-13T19:10:44.057477+0000","last_active":"2024-09-13T19:10:44.057410+0000","last_peered":"2024-09-13T19:10:44.057410+0000","last_clean":"2024-09-13T19:10:44.057410+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:10:44.057410+0000","last_undegraded":"2024-09-13T19:10:44.057410+0000","last_fullsized":"2024-09-13T19:10:44.057410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.057221+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:09.781010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.232296+0000","last_change":"2024-09-13T19:10:38.232296+0000","last_active":"2024-09-13T19:10:38.232296+0000","last_peered":"2024-09-13T19:10:38.232296+0000","last_clean":"2024-09-13T19:10:38.232296+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:10:38.232296+0000","last_undegraded":"2024-09-13T19:10:38.232296+0000","last_fullsized":"2024-09-13T19:10:38.232296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.232043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:00.008382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:09.007818+0000","last_change":"2024-09-13T19:06:58.361588+0000","last_active":"2024-09-13T19:09:09.007818+0000","last_peered":"2024-09-13T19:09:09.007818+0000","last_clean":"2024-09-13T19:09:09.007818+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:09:09.007818+0000","last_undegraded":"2024-09-13T19:09:09.007818+0000","last_fullsized":"2024-09-13T19:09:09.007818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.869537+0000","last_change":"2024-09-13T19:10:15.869718+0000","last_active":"2024-09-13T19:10:15.869537+0000","last_peered":"2024-09-13T19:10:15.869537+0000","last_clean":"2024-09-13T19:10:15.869537+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:15.869537+0000","last_undegraded":"2024-09-13T19:10:15.869537+0000","last_fullsized":"2024-09-13T19:10:15.869537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.869314+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.537473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.581959+0000","last_change":"2024-09-13T19:10:09.581959+0000","last_active":"2024-09-13T19:10:09.581959+0000","last_peered":"2024-09-13T19:10:09.581959+0000","last_clean":"2024-09-13T19:10:09.581959+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:10:09.581959+0000","last_undegraded":"2024-09-13T19:10:09.581959+0000","last_fullsized":"2024-09-13T19:10:09.581959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.581716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:02.986719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.471150+0000","last_change":"2024-09-13T19:06:29.325710+0000","last_active":"2024-09-13T19:10:07.471150+0000","last_peered":"2024-09-13T19:10:07.471150+0000","last_clean":"2024-09-13T19:10:07.471150+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:10:07.471150+0000","last_undegraded":"2024-09-13T19:10:07.471150+0000","last_fullsized":"2024-09-13T19:10:07.471150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916910+0000","last_change":"2024-09-13T19:06:58.346343+0000","last_active":"2024-09-13T19:10:07.916910+0000","last_peered":"2024-09-13T19:10:07.916910+0000","last_clean":"2024-09-13T19:10:07.916910+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:10:07.916910+0000","last_undegraded":"2024-09-13T19:10:07.916910+0000","last_fullsized":"2024-09-13T19:10:07.916910+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373680+0000","last_change":"2024-09-13T19:06:19.296418+0000","last_active":"2024-09-13T19:10:08.373680+0000","last_peered":"2024-09-13T19:10:08.373680+0000","last_clean":"2024-09-13T19:10:08.373680+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:10:08.373680+0000","last_undegraded":"2024-09-13T19:10:08.373680+0000","last_fullsized":"2024-09-13T19:10:08.373680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.463266+0000","last_change":"2024-09-13T19:10:26.463320+0000","last_active":"2024-09-13T19:10:26.463266+0000","last_peered":"2024-09-13T19:10:26.463266+0000","last_clean":"2024-09-13T19:10:26.463266+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:10:26.463266+0000","last_undegraded":"2024-09-13T19:10:26.463266+0000","last_fullsized":"2024-09-13T19:10:26.463266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.463075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:13.599270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.935492+0000","last_change":"2024-09-13T19:10:40.935492+0000","last_active":"2024-09-13T19:10:40.935492+0000","last_peered":"2024-09-13T19:10:40.935492+0000","last_clean":"2024-09-13T19:10:40.935492+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:40.935492+0000","last_undegraded":"2024-09-13T19:10:40.935492+0000","last_fullsized":"2024-09-13T19:10:40.935492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.935209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.770064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.631641+0000","last_change":"2024-09-13T19:10:07.631641+0000","last_active":"2024-09-13T19:10:07.631641+0000","last_peered":"2024-09-13T19:10:07.631641+0000","last_clean":"2024-09-13T19:10:07.631641+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:07.631641+0000","last_undegraded":"2024-09-13T19:10:07.631641+0000","last_fullsized":"2024-09-13T19:10:07.631641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.631538+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:44.867733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.018150+0000","last_change":"2024-09-13T19:06:29.311218+0000","last_active":"2024-09-13T19:10:07.018150+0000","last_peered":"2024-09-13T19:10:07.018150+0000","last_clean":"2024-09-13T19:10:07.018150+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:10:07.018150+0000","last_undegraded":"2024-09-13T19:10:07.018150+0000","last_fullsized":"2024-09-13T19:10:07.018150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.213760+0000","last_change":"2024-09-13T19:10:37.213822+0000","last_active":"2024-09-13T19:10:37.213760+0000","last_peered":"2024-09-13T19:10:37.213760+0000","last_clean":"2024-09-13T19:10:37.213760+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:10:37.213760+0000","last_undegraded":"2024-09-13T19:10:37.213760+0000","last_fullsized":"2024-09-13T19:10:37.213760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.213576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:38.829697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373468+0000","last_change":"2024-09-13T19:06:19.290590+0000","last_active":"2024-09-13T19:10:08.373468+0000","last_peered":"2024-09-13T19:10:08.373468+0000","last_clean":"2024-09-13T19:10:08.373468+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:10:08.373468+0000","last_undegraded":"2024-09-13T19:10:08.373468+0000","last_fullsized":"2024-09-13T19:10:08.373468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.381653+0000","last_change":"2024-09-13T19:10:29.381653+0000","last_active":"2024-09-13T19:10:29.381653+0000","last_peered":"2024-09-13T19:10:29.381653+0000","last_clean":"2024-09-13T19:10:29.381653+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:10:29.381653+0000","last_undegraded":"2024-09-13T19:10:29.381653+0000","last_fullsized":"2024-09-13T19:10:29.381653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.381399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:03.861773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.751268+0000","last_change":"2024-09-13T19:10:23.751268+0000","last_active":"2024-09-13T19:10:23.751268+0000","last_peered":"2024-09-13T19:10:23.751268+0000","last_clean":"2024-09-13T19:10:23.751268+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:23.751268+0000","last_undegraded":"2024-09-13T19:10:23.751268+0000","last_fullsized":"2024-09-13T19:10:23.751268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'64","last_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_deep_scrub":"34'64","last_deep_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.750999+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:41.816580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.394449+0000","last_change":"2024-09-13T19:10:24.394449+0000","last_active":"2024-09-13T19:10:24.394449+0000","last_peered":"2024-09-13T19:10:24.394449+0000","last_clean":"2024-09-13T19:10:24.394449+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:10:24.394449+0000","last_undegraded":"2024-09-13T19:10:24.394449+0000","last_fullsized":"2024-09-13T19:10:24.394449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.394197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:46.758833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.017942+0000","last_change":"2024-09-13T19:06:29.302313+0000","last_active":"2024-09-13T19:10:07.017942+0000","last_peered":"2024-09-13T19:10:07.017942+0000","last_clean":"2024-09-13T19:10:07.017942+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:10:07.017942+0000","last_undegraded":"2024-09-13T19:10:07.017942+0000","last_fullsized":"2024-09-13T19:10:07.017942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.044055+0000","last_change":"2024-09-13T19:10:41.044112+0000","last_active":"2024-09-13T19:10:41.044055+0000","last_peered":"2024-09-13T19:10:41.044055+0000","last_clean":"2024-09-13T19:10:41.044055+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:10:41.044055+0000","last_undegraded":"2024-09-13T19:10:41.044055+0000","last_fullsized":"2024-09-13T19:10:41.044055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.043868+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:35.076360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016537+0000","last_change":"2024-09-13T19:06:19.275807+0000","last_active":"2024-09-13T19:10:07.016537+0000","last_peered":"2024-09-13T19:10:07.016537+0000","last_clean":"2024-09-13T19:10:07.016537+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:10:07.016537+0000","last_undegraded":"2024-09-13T19:10:07.016537+0000","last_fullsized":"2024-09-13T19:10:07.016537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.036382+0000","last_change":"2024-09-13T19:10:28.036506+0000","last_active":"2024-09-13T19:10:28.036382+0000","last_peered":"2024-09-13T19:10:28.036382+0000","last_clean":"2024-09-13T19:10:28.036382+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:10:28.036382+0000","last_undegraded":"2024-09-13T19:10:28.036382+0000","last_fullsized":"2024-09-13T19:10:28.036382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.036142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:37.355498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.832677+0000","last_change":"2024-09-13T19:10:09.832750+0000","last_active":"2024-09-13T19:10:09.832677+0000","last_peered":"2024-09-13T19:10:09.832677+0000","last_clean":"2024-09-13T19:10:09.832677+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:09.832677+0000","last_undegraded":"2024-09-13T19:10:09.832677+0000","last_fullsized":"2024-09-13T19:10:09.832677+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.832440+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:33.388702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.941049+0000","last_change":"2024-09-13T19:10:30.941102+0000","last_active":"2024-09-13T19:10:30.941049+0000","last_peered":"2024-09-13T19:10:30.941049+0000","last_clean":"2024-09-13T19:10:30.941049+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:10:30.941049+0000","last_undegraded":"2024-09-13T19:10:30.941049+0000","last_fullsized":"2024-09-13T19:10:30.941049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:05.758351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376155+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:10:08.376155+0000","last_peered":"2024-09-13T19:10:08.376155+0000","last_clean":"2024-09-13T19:10:08.376155+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:10:08.376155+0000","last_undegraded":"2024-09-13T19:10:08.376155+0000","last_fullsized":"2024-09-13T19:10:08.376155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.793593+0000","last_change":"2024-09-13T19:10:20.793652+0000","last_active":"2024-09-13T19:10:20.793593+0000","last_peered":"2024-09-13T19:10:20.793593+0000","last_clean":"2024-09-13T19:10:20.793593+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:10:20.793593+0000","last_undegraded":"2024-09-13T19:10:20.793593+0000","last_fullsized":"2024-09-13T19:10:20.793593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.793393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:48.213611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373460+0000","last_change":"2024-09-13T19:06:19.292068+0000","last_active":"2024-09-13T19:10:08.373460+0000","last_peered":"2024-09-13T19:10:08.373460+0000","last_clean":"2024-09-13T19:10:08.373460+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:10:08.373460+0000","last_undegraded":"2024-09-13T19:10:08.373460+0000","last_fullsized":"2024-09-13T19:10:08.373460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.412627+0000","last_change":"2024-09-13T19:10:23.412680+0000","last_active":"2024-09-13T19:10:23.412627+0000","last_peered":"2024-09-13T19:10:23.412627+0000","last_clean":"2024-09-13T19:10:23.412627+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:10:23.412627+0000","last_undegraded":"2024-09-13T19:10:23.412627+0000","last_fullsized":"2024-09-13T19:10:23.412627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.412440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.127338+0000","last_change":"2024-09-13T19:10:23.127417+0000","last_active":"2024-09-13T19:10:23.127338+0000","last_peered":"2024-09-13T19:10:23.127338+0000","last_clean":"2024-09-13T19:10:23.127338+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:23.127338+0000","last_undegraded":"2024-09-13T19:10:23.127338+0000","last_fullsized":"2024-09-13T19:10:23.127338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.127136+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:43.153291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":445,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.210911+0000","last_change":"2024-09-13T19:10:13.210977+0000","last_active":"2024-09-13T19:10:13.210911+0000","last_peered":"2024-09-13T19:10:13.210911+0000","last_clean":"2024-09-13T19:10:13.210911+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:13.210911+0000","last_undegraded":"2024-09-13T19:10:13.210911+0000","last_fullsized":"2024-09-13T19:10:13.210911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.210704+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:44.040477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.438358+0000","last_change":"2024-09-13T19:10:32.438358+0000","last_active":"2024-09-13T19:10:32.438358+0000","last_peered":"2024-09-13T19:10:32.438358+0000","last_clean":"2024-09-13T19:10:32.438358+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:10:32.438358+0000","last_undegraded":"2024-09-13T19:10:32.438358+0000","last_fullsized":"2024-09-13T19:10:32.438358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.438073+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:11.390223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.167380+0000","last_change":"2024-09-13T19:10:43.167545+0000","last_active":"2024-09-13T19:10:43.167380+0000","last_peered":"2024-09-13T19:10:43.167380+0000","last_clean":"2024-09-13T19:10:43.167380+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:10:43.167380+0000","last_undegraded":"2024-09-13T19:10:43.167380+0000","last_fullsized":"2024-09-13T19:10:43.167380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.167114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:09.024776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373513+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:10:08.373513+0000","last_peered":"2024-09-13T19:10:08.373513+0000","last_clean":"2024-09-13T19:10:08.373513+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:10:08.373513+0000","last_undegraded":"2024-09-13T19:10:08.373513+0000","last_fullsized":"2024-09-13T19:10:08.373513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.959044+0000","last_change":"2024-09-13T19:10:22.959117+0000","last_active":"2024-09-13T19:10:22.959044+0000","last_peered":"2024-09-13T19:10:22.959044+0000","last_clean":"2024-09-13T19:10:22.959044+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:22.959044+0000","last_undegraded":"2024-09-13T19:10:22.959044+0000","last_fullsized":"2024-09-13T19:10:22.959044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.958854+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.913099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.814541+0000","last_change":"2024-09-13T19:10:21.814619+0000","last_active":"2024-09-13T19:10:21.814541+0000","last_peered":"2024-09-13T19:10:21.814541+0000","last_clean":"2024-09-13T19:10:21.814541+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:10:21.814541+0000","last_undegraded":"2024-09-13T19:10:21.814541+0000","last_fullsized":"2024-09-13T19:10:21.814541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.814367+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:33.492669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":482,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.986750+0000","last_change":"2024-09-13T19:10:23.986876+0000","last_active":"2024-09-13T19:10:23.986750+0000","last_peered":"2024-09-13T19:10:23.986750+0000","last_clean":"2024-09-13T19:10:23.986750+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:23.986750+0000","last_undegraded":"2024-09-13T19:10:23.986750+0000","last_fullsized":"2024-09-13T19:10:23.986750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.986531+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:04.057824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.150372+0000","last_change":"2024-09-13T19:10:21.150372+0000","last_active":"2024-09-13T19:10:21.150372+0000","last_peered":"2024-09-13T19:10:21.150372+0000","last_clean":"2024-09-13T19:10:21.150372+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:10:21.150372+0000","last_undegraded":"2024-09-13T19:10:21.150372+0000","last_fullsized":"2024-09-13T19:10:21.150372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.150108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:27.355549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.474558+0000","last_change":"2024-09-13T19:06:21.261035+0000","last_active":"2024-09-13T19:09:38.474558+0000","last_peered":"2024-09-13T19:09:38.474558+0000","last_clean":"2024-09-13T19:09:38.474558+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:09:38.474558+0000","last_undegraded":"2024-09-13T19:09:38.474558+0000","last_fullsized":"2024-09-13T19:09:38.474558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373427+0000","last_change":"2024-09-13T19:06:19.292482+0000","last_active":"2024-09-13T19:10:08.373427+0000","last_peered":"2024-09-13T19:10:08.373427+0000","last_clean":"2024-09-13T19:10:08.373427+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:10:08.373427+0000","last_undegraded":"2024-09-13T19:10:08.373427+0000","last_fullsized":"2024-09-13T19:10:08.373427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.991513+0000","last_change":"2024-09-13T19:10:09.991613+0000","last_active":"2024-09-13T19:10:09.991513+0000","last_peered":"2024-09-13T19:10:09.991513+0000","last_clean":"2024-09-13T19:10:09.991513+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:10:09.991513+0000","last_undegraded":"2024-09-13T19:10:09.991513+0000","last_fullsized":"2024-09-13T19:10:09.991513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.991280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.624094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.862400+0000","last_change":"2024-09-13T19:10:12.862549+0000","last_active":"2024-09-13T19:10:12.862400+0000","last_peered":"2024-09-13T19:10:12.862400+0000","last_clean":"2024-09-13T19:10:12.862400+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:12.862400+0000","last_undegraded":"2024-09-13T19:10:12.862400+0000","last_fullsized":"2024-09-13T19:10:12.862400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.862157+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:03.704078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.251198+0000","last_change":"2024-09-13T19:10:10.251305+0000","last_active":"2024-09-13T19:10:10.251198+0000","last_peered":"2024-09-13T19:10:10.251198+0000","last_clean":"2024-09-13T19:10:10.251198+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:10:10.251198+0000","last_undegraded":"2024-09-13T19:10:10.251198+0000","last_fullsized":"2024-09-13T19:10:10.251198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.250951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:14.638874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.470968+0000","last_change":"2024-09-13T19:06:29.323735+0000","last_active":"2024-09-13T19:10:07.470968+0000","last_peered":"2024-09-13T19:10:07.470968+0000","last_clean":"2024-09-13T19:10:07.470968+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:10:07.470968+0000","last_undegraded":"2024-09-13T19:10:07.470968+0000","last_fullsized":"2024-09-13T19:10:07.470968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.788819+0000","last_change":"2024-09-13T19:10:22.788819+0000","last_active":"2024-09-13T19:10:22.788819+0000","last_peered":"2024-09-13T19:10:22.788819+0000","last_clean":"2024-09-13T19:10:22.788819+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:10:22.788819+0000","last_undegraded":"2024-09-13T19:10:22.788819+0000","last_fullsized":"2024-09-13T19:10:22.788819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.788534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:11.221320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":207,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469143+0000","last_change":"2024-09-13T19:06:06.688085+0000","last_active":"2024-09-13T19:10:07.469143+0000","last_peered":"2024-09-13T19:10:07.469143+0000","last_clean":"2024-09-13T19:10:07.469143+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:10:07.469143+0000","last_undegraded":"2024-09-13T19:10:07.469143+0000","last_fullsized":"2024-09-13T19:10:07.469143+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:05.016117+0000","last_clean_scrub_stamp":"2024-09-13T19:06:05.016117+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373046+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:10:08.373046+0000","last_peered":"2024-09-13T19:10:08.373046+0000","last_clean":"2024-09-13T19:10:08.373046+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:10:08.373046+0000","last_undegraded":"2024-09-13T19:10:08.373046+0000","last_fullsized":"2024-09-13T19:10:08.373046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373199+0000","last_change":"2024-09-13T19:06:19.294253+0000","last_active":"2024-09-13T19:10:08.373199+0000","last_peered":"2024-09-13T19:10:08.373199+0000","last_clean":"2024-09-13T19:10:08.373199+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:10:08.373199+0000","last_undegraded":"2024-09-13T19:10:08.373199+0000","last_fullsized":"2024-09-13T19:10:08.373199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.925770+0000","last_change":"2024-09-13T19:10:17.925770+0000","last_active":"2024-09-13T19:10:17.925770+0000","last_peered":"2024-09-13T19:10:17.925770+0000","last_clean":"2024-09-13T19:10:17.925770+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:10:17.925770+0000","last_undegraded":"2024-09-13T19:10:17.925770+0000","last_fullsized":"2024-09-13T19:10:17.925770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.925452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:48.521596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.929532+0000","last_change":"2024-09-13T19:10:13.929532+0000","last_active":"2024-09-13T19:10:13.929532+0000","last_peered":"2024-09-13T19:10:13.929532+0000","last_clean":"2024-09-13T19:10:13.929532+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:13.929532+0000","last_undegraded":"2024-09-13T19:10:13.929532+0000","last_fullsized":"2024-09-13T19:10:13.929532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.929281+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:35.787824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.567264+0000","last_change":"2024-09-13T19:10:12.567264+0000","last_active":"2024-09-13T19:10:12.567264+0000","last_peered":"2024-09-13T19:10:12.567264+0000","last_clean":"2024-09-13T19:10:12.567264+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:10:12.567264+0000","last_undegraded":"2024-09-13T19:10:12.567264+0000","last_fullsized":"2024-09-13T19:10:12.567264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.567011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:35.830195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.197379+0000","last_change":"2024-09-13T19:10:17.197379+0000","last_active":"2024-09-13T19:10:17.197379+0000","last_peered":"2024-09-13T19:10:17.197379+0000","last_clean":"2024-09-13T19:10:17.197379+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:10:17.197379+0000","last_undegraded":"2024-09-13T19:10:17.197379+0000","last_fullsized":"2024-09-13T19:10:17.197379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.197010+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:54.433206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374423+0000","last_change":"2024-09-13T19:06:21.248736+0000","last_active":"2024-09-13T19:10:08.374423+0000","last_peered":"2024-09-13T19:10:08.374423+0000","last_clean":"2024-09-13T19:10:08.374423+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:10:08.374423+0000","last_undegraded":"2024-09-13T19:10:08.374423+0000","last_fullsized":"2024-09-13T19:10:08.374423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373040+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:10:08.373040+0000","last_peered":"2024-09-13T19:10:08.373040+0000","last_clean":"2024-09-13T19:10:08.373040+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:10:08.373040+0000","last_undegraded":"2024-09-13T19:10:08.373040+0000","last_fullsized":"2024-09-13T19:10:08.373040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016586+0000","last_change":"2024-09-13T19:06:19.277325+0000","last_active":"2024-09-13T19:10:07.016586+0000","last_peered":"2024-09-13T19:10:07.016586+0000","last_clean":"2024-09-13T19:10:07.016586+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:10:07.016586+0000","last_undegraded":"2024-09-13T19:10:07.016586+0000","last_fullsized":"2024-09-13T19:10:07.016586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.969550+0000","last_change":"2024-09-13T19:10:10.969550+0000","last_active":"2024-09-13T19:10:10.969550+0000","last_peered":"2024-09-13T19:10:10.969550+0000","last_clean":"2024-09-13T19:10:10.969550+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:10.969550+0000","last_undegraded":"2024-09-13T19:10:10.969550+0000","last_fullsized":"2024-09-13T19:10:10.969550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.969289+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:28.059258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":518,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.847892+0000","last_change":"2024-09-13T19:10:08.847892+0000","last_active":"2024-09-13T19:10:08.847892+0000","last_peered":"2024-09-13T19:10:08.847892+0000","last_clean":"2024-09-13T19:10:08.847892+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:08.847892+0000","last_undegraded":"2024-09-13T19:10:08.847892+0000","last_fullsized":"2024-09-13T19:10:08.847892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'290","last_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_deep_scrub":"34'290","last_deep_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.847620+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:34.001690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.953784+0000","last_change":"2024-09-13T19:10:31.953784+0000","last_active":"2024-09-13T19:10:31.953784+0000","last_peered":"2024-09-13T19:10:31.953784+0000","last_clean":"2024-09-13T19:10:31.953784+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:10:31.953784+0000","last_undegraded":"2024-09-13T19:10:31.953784+0000","last_fullsized":"2024-09-13T19:10:31.953784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.953404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:26.886773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.995270+0000","last_change":"2024-09-13T19:10:35.995270+0000","last_active":"2024-09-13T19:10:35.995270+0000","last_peered":"2024-09-13T19:10:35.995270+0000","last_clean":"2024-09-13T19:10:35.995270+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:10:35.995270+0000","last_undegraded":"2024-09-13T19:10:35.995270+0000","last_fullsized":"2024-09-13T19:10:35.995270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.995027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.852689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.429059+0000","last_change":"2024-09-13T19:10:35.429059+0000","last_active":"2024-09-13T19:10:35.429059+0000","last_peered":"2024-09-13T19:10:35.429059+0000","last_clean":"2024-09-13T19:10:35.429059+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:10:35.429059+0000","last_undegraded":"2024-09-13T19:10:35.429059+0000","last_fullsized":"2024-09-13T19:10:35.429059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.428796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:58.222147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.088661+0000","last_change":"2024-09-13T19:10:47.088726+0000","last_active":"2024-09-13T19:10:47.088661+0000","last_peered":"2024-09-13T19:10:47.088661+0000","last_clean":"2024-09-13T19:10:47.088661+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:10:47.088661+0000","last_undegraded":"2024-09-13T19:10:47.088661+0000","last_fullsized":"2024-09-13T19:10:47.088661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.088396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:36.829110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016531+0000","last_change":"2024-09-13T19:06:19.277629+0000","last_active":"2024-09-13T19:10:07.016531+0000","last_peered":"2024-09-13T19:10:07.016531+0000","last_clean":"2024-09-13T19:10:07.016531+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:10:07.016531+0000","last_undegraded":"2024-09-13T19:10:07.016531+0000","last_fullsized":"2024-09-13T19:10:07.016531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.917640+0000","last_change":"2024-09-13T19:06:58.370121+0000","last_active":"2024-09-13T19:10:07.917640+0000","last_peered":"2024-09-13T19:10:07.917640+0000","last_clean":"2024-09-13T19:10:07.917640+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:10:07.917640+0000","last_undegraded":"2024-09-13T19:10:07.917640+0000","last_fullsized":"2024-09-13T19:10:07.917640+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.258425+0000","last_change":"2024-09-13T19:10:19.258425+0000","last_active":"2024-09-13T19:10:19.258425+0000","last_peered":"2024-09-13T19:10:19.258425+0000","last_clean":"2024-09-13T19:10:19.258425+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:10:19.258425+0000","last_undegraded":"2024-09-13T19:10:19.258425+0000","last_fullsized":"2024-09-13T19:10:19.258425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.258136+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:12.663138+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.475886+0000","last_change":"2024-09-13T19:10:20.475886+0000","last_active":"2024-09-13T19:10:20.475886+0000","last_peered":"2024-09-13T19:10:20.475886+0000","last_clean":"2024-09-13T19:10:20.475886+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:10:20.475886+0000","last_undegraded":"2024-09-13T19:10:20.475886+0000","last_fullsized":"2024-09-13T19:10:20.475886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.475636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:23.310735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004088+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:08:44.004088+0000","last_peered":"2024-09-13T19:08:44.004088+0000","last_clean":"2024-09-13T19:08:44.004088+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:08:44.004088+0000","last_undegraded":"2024-09-13T19:08:44.004088+0000","last_fullsized":"2024-09-13T19:08:44.004088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016842+0000","last_change":"2024-09-13T19:06:21.256085+0000","last_active":"2024-09-13T19:10:07.016842+0000","last_peered":"2024-09-13T19:10:07.016842+0000","last_clean":"2024-09-13T19:10:07.016842+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:10:07.016842+0000","last_undegraded":"2024-09-13T19:10:07.016842+0000","last_fullsized":"2024-09-13T19:10:07.016842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373053+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:10:08.373053+0000","last_peered":"2024-09-13T19:10:08.373053+0000","last_clean":"2024-09-13T19:10:08.373053+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:10:08.373053+0000","last_undegraded":"2024-09-13T19:10:08.373053+0000","last_fullsized":"2024-09-13T19:10:08.373053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916431+0000","last_change":"2024-09-13T19:06:19.264941+0000","last_active":"2024-09-13T19:10:07.916431+0000","last_peered":"2024-09-13T19:10:07.916431+0000","last_clean":"2024-09-13T19:10:07.916431+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:10:07.916431+0000","last_undegraded":"2024-09-13T19:10:07.916431+0000","last_fullsized":"2024-09-13T19:10:07.916431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.413883+0000","last_change":"2024-09-13T19:10:31.413883+0000","last_active":"2024-09-13T19:10:31.413883+0000","last_peered":"2024-09-13T19:10:31.413883+0000","last_clean":"2024-09-13T19:10:31.413883+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:10:31.413883+0000","last_undegraded":"2024-09-13T19:10:31.413883+0000","last_fullsized":"2024-09-13T19:10:31.413883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.413619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.384956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.988168+0000","last_change":"2024-09-13T19:10:11.988168+0000","last_active":"2024-09-13T19:10:11.988168+0000","last_peered":"2024-09-13T19:10:11.988168+0000","last_clean":"2024-09-13T19:10:11.988168+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:10:11.988168+0000","last_undegraded":"2024-09-13T19:10:11.988168+0000","last_fullsized":"2024-09-13T19:10:11.988168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.987853+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.357172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.896017+0000","last_change":"2024-09-13T19:10:29.896017+0000","last_active":"2024-09-13T19:10:29.896017+0000","last_peered":"2024-09-13T19:10:29.896017+0000","last_clean":"2024-09-13T19:10:29.896017+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:10:29.896017+0000","last_undegraded":"2024-09-13T19:10:29.896017+0000","last_fullsized":"2024-09-13T19:10:29.896017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.895758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:10.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.471179+0000","last_change":"2024-09-13T19:06:29.326404+0000","last_active":"2024-09-13T19:10:07.471179+0000","last_peered":"2024-09-13T19:10:07.471179+0000","last_clean":"2024-09-13T19:10:07.471179+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:10:07.471179+0000","last_undegraded":"2024-09-13T19:10:07.471179+0000","last_fullsized":"2024-09-13T19:10:07.471179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.925703+0000","last_change":"2024-09-13T19:10:28.925703+0000","last_active":"2024-09-13T19:10:28.925703+0000","last_peered":"2024-09-13T19:10:28.925703+0000","last_clean":"2024-09-13T19:10:28.925703+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:10:28.925703+0000","last_undegraded":"2024-09-13T19:10:28.925703+0000","last_fullsized":"2024-09-13T19:10:28.925703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.925441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:16.061636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916555+0000","last_change":"2024-09-13T19:06:19.267435+0000","last_active":"2024-09-13T19:10:07.916555+0000","last_peered":"2024-09-13T19:10:07.916555+0000","last_clean":"2024-09-13T19:10:07.916555+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:10:07.916555+0000","last_undegraded":"2024-09-13T19:10:07.916555+0000","last_fullsized":"2024-09-13T19:10:07.916555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016466+0000","last_change":"2024-09-13T19:06:11.226011+0000","last_active":"2024-09-13T19:10:07.016466+0000","last_peered":"2024-09-13T19:10:07.016466+0000","last_clean":"2024-09-13T19:10:07.016466+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:10:07.016466+0000","last_undegraded":"2024-09-13T19:10:07.016466+0000","last_fullsized":"2024-09-13T19:10:07.016466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.424395+0000","last_change":"2024-09-13T19:10:33.424395+0000","last_active":"2024-09-13T19:10:33.424395+0000","last_peered":"2024-09-13T19:10:33.424395+0000","last_clean":"2024-09-13T19:10:33.424395+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:10:33.424395+0000","last_undegraded":"2024-09-13T19:10:33.424395+0000","last_fullsized":"2024-09-13T19:10:33.424395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.424001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:59.281664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.564973+0000","last_change":"2024-09-13T19:10:18.564973+0000","last_active":"2024-09-13T19:10:18.564973+0000","last_peered":"2024-09-13T19:10:18.564973+0000","last_clean":"2024-09-13T19:10:18.564973+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:18.564973+0000","last_undegraded":"2024-09-13T19:10:18.564973+0000","last_fullsized":"2024-09-13T19:10:18.564973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.564713+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:02.178317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.287984+0000","last_change":"2024-09-13T19:10:09.287984+0000","last_active":"2024-09-13T19:10:09.287984+0000","last_peered":"2024-09-13T19:10:09.287984+0000","last_clean":"2024-09-13T19:10:09.287984+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:10:09.287984+0000","last_undegraded":"2024-09-13T19:10:09.287984+0000","last_fullsized":"2024-09-13T19:10:09.287984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.287642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:27.524091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:43.994238+0000","last_change":"2024-09-13T19:06:29.323835+0000","last_active":"2024-09-13T19:08:43.994238+0000","last_peered":"2024-09-13T19:08:43.994238+0000","last_clean":"2024-09-13T19:08:43.994238+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:08:43.994238+0000","last_undegraded":"2024-09-13T19:08:43.994238+0000","last_fullsized":"2024-09-13T19:08:43.994238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.065219+0000","last_change":"2024-09-13T19:10:40.065315+0000","last_active":"2024-09-13T19:10:40.065219+0000","last_peered":"2024-09-13T19:10:40.065219+0000","last_clean":"2024-09-13T19:10:40.065219+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:10:40.065219+0000","last_undegraded":"2024-09-13T19:10:40.065219+0000","last_fullsized":"2024-09-13T19:10:40.065219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.065006+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:29.805720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016625+0000","last_change":"2024-09-13T19:06:19.269338+0000","last_active":"2024-09-13T19:10:07.016625+0000","last_peered":"2024-09-13T19:10:07.016625+0000","last_clean":"2024-09-13T19:10:07.016625+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:10:07.016625+0000","last_undegraded":"2024-09-13T19:10:07.016625+0000","last_fullsized":"2024-09-13T19:10:07.016625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373117+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:10:08.373117+0000","last_peered":"2024-09-13T19:10:08.373117+0000","last_clean":"2024-09-13T19:10:08.373117+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:10:08.373117+0000","last_undegraded":"2024-09-13T19:10:08.373117+0000","last_fullsized":"2024-09-13T19:10:08.373117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.375130+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:10:08.375130+0000","last_peered":"2024-09-13T19:10:08.375130+0000","last_clean":"2024-09-13T19:10:08.375130+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:10:08.375130+0000","last_undegraded":"2024-09-13T19:10:08.375130+0000","last_fullsized":"2024-09-13T19:10:08.375130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.839664+0000","last_change":"2024-09-13T19:10:07.839664+0000","last_active":"2024-09-13T19:10:07.839664+0000","last_peered":"2024-09-13T19:10:07.839664+0000","last_clean":"2024-09-13T19:10:07.839664+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:10:07.839664+0000","last_undegraded":"2024-09-13T19:10:07.839664+0000","last_fullsized":"2024-09-13T19:10:07.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.839234+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.815476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":384,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.945197+0000","last_change":"2024-09-13T19:10:27.945197+0000","last_active":"2024-09-13T19:10:27.945197+0000","last_peered":"2024-09-13T19:10:27.945197+0000","last_clean":"2024-09-13T19:10:27.945197+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:27.945197+0000","last_undegraded":"2024-09-13T19:10:27.945197+0000","last_fullsized":"2024-09-13T19:10:27.945197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.944956+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.708373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004522+0000","last_change":"2024-09-13T19:06:29.311562+0000","last_active":"2024-09-13T19:08:44.004522+0000","last_peered":"2024-09-13T19:08:44.004522+0000","last_clean":"2024-09-13T19:08:44.004522+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:08:44.004522+0000","last_undegraded":"2024-09-13T19:08:44.004522+0000","last_fullsized":"2024-09-13T19:08:44.004522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.800379+0000","last_change":"2024-09-13T19:10:26.800432+0000","last_active":"2024-09-13T19:10:26.800379+0000","last_peered":"2024-09-13T19:10:26.800379+0000","last_clean":"2024-09-13T19:10:26.800379+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:10:26.800379+0000","last_undegraded":"2024-09-13T19:10:26.800379+0000","last_fullsized":"2024-09-13T19:10:26.800379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.800155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:20.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373408+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:10:08.373408+0000","last_peered":"2024-09-13T19:10:08.373408+0000","last_clean":"2024-09-13T19:10:08.373408+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:10:08.373408+0000","last_undegraded":"2024-09-13T19:10:08.373408+0000","last_fullsized":"2024-09-13T19:10:08.373408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016453+0000","last_change":"2024-09-13T19:06:11.226327+0000","last_active":"2024-09-13T19:10:07.016453+0000","last_peered":"2024-09-13T19:10:07.016453+0000","last_clean":"2024-09-13T19:10:07.016453+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:10:07.016453+0000","last_undegraded":"2024-09-13T19:10:07.016453+0000","last_fullsized":"2024-09-13T19:10:07.016453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.988381+0000","last_change":"2024-09-13T19:10:08.988381+0000","last_active":"2024-09-13T19:10:08.988381+0000","last_peered":"2024-09-13T19:10:08.988381+0000","last_clean":"2024-09-13T19:10:08.988381+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:10:08.988381+0000","last_undegraded":"2024-09-13T19:10:08.988381+0000","last_fullsized":"2024-09-13T19:10:08.988381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.988147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.969133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.913475+0000","last_change":"2024-09-13T19:10:34.913475+0000","last_active":"2024-09-13T19:10:34.913475+0000","last_peered":"2024-09-13T19:10:34.913475+0000","last_clean":"2024-09-13T19:10:34.913475+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:10:34.913475+0000","last_undegraded":"2024-09-13T19:10:34.913475+0000","last_fullsized":"2024-09-13T19:10:34.913475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.913181+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:57.790048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.531059+0000","last_change":"2024-09-13T19:10:14.531059+0000","last_active":"2024-09-13T19:10:14.531059+0000","last_peered":"2024-09-13T19:10:14.531059+0000","last_clean":"2024-09-13T19:10:14.531059+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:14.531059+0000","last_undegraded":"2024-09-13T19:10:14.531059+0000","last_fullsized":"2024-09-13T19:10:14.531059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.530810+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:54.291531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004109+0000","last_change":"2024-09-13T19:06:29.327636+0000","last_active":"2024-09-13T19:08:44.004109+0000","last_peered":"2024-09-13T19:08:44.004109+0000","last_clean":"2024-09-13T19:08:44.004109+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:08:44.004109+0000","last_undegraded":"2024-09-13T19:08:44.004109+0000","last_fullsized":"2024-09-13T19:08:44.004109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.916917+0000","last_change":"2024-09-13T19:06:21.260280+0000","last_active":"2024-09-13T19:10:07.916917+0000","last_peered":"2024-09-13T19:10:07.916917+0000","last_clean":"2024-09-13T19:10:07.916917+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:10:07.916917+0000","last_undegraded":"2024-09-13T19:10:07.916917+0000","last_fullsized":"2024-09-13T19:10:07.916917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469076+0000","last_change":"2024-09-13T19:06:19.274644+0000","last_active":"2024-09-13T19:10:07.469076+0000","last_peered":"2024-09-13T19:10:07.469076+0000","last_clean":"2024-09-13T19:10:07.469076+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:10:07.469076+0000","last_undegraded":"2024-09-13T19:10:07.469076+0000","last_fullsized":"2024-09-13T19:10:07.469076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373153+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:10:08.373153+0000","last_peered":"2024-09-13T19:10:08.373153+0000","last_clean":"2024-09-13T19:10:08.373153+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:10:08.373153+0000","last_undegraded":"2024-09-13T19:10:08.373153+0000","last_fullsized":"2024-09-13T19:10:08.373153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.832300+0000","last_change":"2024-09-13T19:10:18.832300+0000","last_active":"2024-09-13T19:10:18.832300+0000","last_peered":"2024-09-13T19:10:18.832300+0000","last_clean":"2024-09-13T19:10:18.832300+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:10:18.832300+0000","last_undegraded":"2024-09-13T19:10:18.832300+0000","last_fullsized":"2024-09-13T19:10:18.832300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.832064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:42.939752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.208010+0000","last_change":"2024-09-13T19:10:20.208010+0000","last_active":"2024-09-13T19:10:20.208010+0000","last_peered":"2024-09-13T19:10:20.208010+0000","last_clean":"2024-09-13T19:10:20.208010+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:20.208010+0000","last_undegraded":"2024-09-13T19:10:20.208010+0000","last_fullsized":"2024-09-13T19:10:20.208010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.207705+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:25.171811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.399306+0000","last_change":"2024-09-13T19:10:28.399306+0000","last_active":"2024-09-13T19:10:28.399306+0000","last_peered":"2024-09-13T19:10:28.399306+0000","last_clean":"2024-09-13T19:10:28.399306+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:10:28.399306+0000","last_undegraded":"2024-09-13T19:10:28.399306+0000","last_fullsized":"2024-09-13T19:10:28.399306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.399039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:50.175378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.121145+0000","last_change":"2024-09-13T19:10:25.121202+0000","last_active":"2024-09-13T19:10:25.121145+0000","last_peered":"2024-09-13T19:10:25.121145+0000","last_clean":"2024-09-13T19:10:25.121145+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:10:25.121145+0000","last_undegraded":"2024-09-13T19:10:25.121145+0000","last_fullsized":"2024-09-13T19:10:25.121145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.120954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.704432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.918305+0000","last_change":"2024-09-13T19:06:29.326153+0000","last_active":"2024-09-13T19:10:07.918305+0000","last_peered":"2024-09-13T19:10:07.918305+0000","last_clean":"2024-09-13T19:10:07.918305+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:10:07.918305+0000","last_undegraded":"2024-09-13T19:10:07.918305+0000","last_fullsized":"2024-09-13T19:10:07.918305+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.077505+0000","last_change":"2024-09-13T19:10:33.077566+0000","last_active":"2024-09-13T19:10:33.077505+0000","last_peered":"2024-09-13T19:10:33.077505+0000","last_clean":"2024-09-13T19:10:33.077505+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:10:33.077505+0000","last_undegraded":"2024-09-13T19:10:33.077505+0000","last_fullsized":"2024-09-13T19:10:33.077505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.077318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:02.423813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002452+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:08:39.002452+0000","last_peered":"2024-09-13T19:08:39.002452+0000","last_clean":"2024-09-13T19:08:39.002452+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:08:39.002452+0000","last_undegraded":"2024-09-13T19:08:39.002452+0000","last_fullsized":"2024-09-13T19:08:39.002452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.945275+0000","last_change":"2024-09-13T19:10:20.945400+0000","last_active":"2024-09-13T19:10:20.945275+0000","last_peered":"2024-09-13T19:10:20.945275+0000","last_clean":"2024-09-13T19:10:20.945275+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:10:20.945275+0000","last_undegraded":"2024-09-13T19:10:20.945275+0000","last_fullsized":"2024-09-13T19:10:20.945275+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.945028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:30.264384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.854536+0000","last_change":"2024-09-13T19:10:27.854611+0000","last_active":"2024-09-13T19:10:27.854536+0000","last_peered":"2024-09-13T19:10:27.854536+0000","last_clean":"2024-09-13T19:10:27.854536+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:27.854536+0000","last_undegraded":"2024-09-13T19:10:27.854536+0000","last_fullsized":"2024-09-13T19:10:27.854536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.854345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:28.517846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.951880+0000","last_change":"2024-09-13T19:10:43.951984+0000","last_active":"2024-09-13T19:10:43.951880+0000","last_peered":"2024-09-13T19:10:43.951880+0000","last_clean":"2024-09-13T19:10:43.951880+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:10:43.951880+0000","last_undegraded":"2024-09-13T19:10:43.951880+0000","last_fullsized":"2024-09-13T19:10:43.951880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.951573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:26.069111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.018294+0000","last_change":"2024-09-13T19:06:29.302445+0000","last_active":"2024-09-13T19:10:07.018294+0000","last_peered":"2024-09-13T19:10:07.018294+0000","last_clean":"2024-09-13T19:10:07.018294+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:10:07.018294+0000","last_undegraded":"2024-09-13T19:10:07.018294+0000","last_fullsized":"2024-09-13T19:10:07.018294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.081882+0000","last_change":"2024-09-13T19:10:42.081944+0000","last_active":"2024-09-13T19:10:42.081882+0000","last_peered":"2024-09-13T19:10:42.081882+0000","last_clean":"2024-09-13T19:10:42.081882+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:10:42.081882+0000","last_undegraded":"2024-09-13T19:10:42.081882+0000","last_fullsized":"2024-09-13T19:10:42.081882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.081677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:55.468803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:03.783993+0000","last_change":"2024-09-13T19:06:19.269029+0000","last_active":"2024-09-13T19:10:03.783993+0000","last_peered":"2024-09-13T19:10:03.783993+0000","last_clean":"2024-09-13T19:10:03.783993+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:10:03.783993+0000","last_undegraded":"2024-09-13T19:10:03.783993+0000","last_fullsized":"2024-09-13T19:10:03.783993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.867500+0000","last_change":"2024-09-13T19:10:17.867551+0000","last_active":"2024-09-13T19:10:17.867500+0000","last_peered":"2024-09-13T19:10:17.867500+0000","last_clean":"2024-09-13T19:10:17.867500+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:10:17.867500+0000","last_undegraded":"2024-09-13T19:10:17.867500+0000","last_fullsized":"2024-09-13T19:10:17.867500+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.867308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:43.159936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.561458+0000","last_change":"2024-09-13T19:10:17.561532+0000","last_active":"2024-09-13T19:10:17.561458+0000","last_peered":"2024-09-13T19:10:17.561458+0000","last_clean":"2024-09-13T19:10:17.561458+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:10:17.561458+0000","last_undegraded":"2024-09-13T19:10:17.561458+0000","last_fullsized":"2024-09-13T19:10:17.561458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.561274+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:36.904388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.291015+0000","last_change":"2024-09-13T19:10:11.291104+0000","last_active":"2024-09-13T19:10:11.291015+0000","last_peered":"2024-09-13T19:10:11.291015+0000","last_clean":"2024-09-13T19:10:11.291015+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:10:11.291015+0000","last_undegraded":"2024-09-13T19:10:11.291015+0000","last_fullsized":"2024-09-13T19:10:11.291015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.290797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.828167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:58.998281+0000","last_change":"2024-09-13T19:06:29.310925+0000","last_active":"2024-09-13T19:08:58.998281+0000","last_peered":"2024-09-13T19:08:58.998281+0000","last_clean":"2024-09-13T19:08:58.998281+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:08:58.998281+0000","last_undegraded":"2024-09-13T19:08:58.998281+0000","last_fullsized":"2024-09-13T19:08:58.998281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.350404+0000","last_change":"2024-09-13T19:10:40.350522+0000","last_active":"2024-09-13T19:10:40.350404+0000","last_peered":"2024-09-13T19:10:40.350404+0000","last_clean":"2024-09-13T19:10:40.350404+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:10:40.350404+0000","last_undegraded":"2024-09-13T19:10:40.350404+0000","last_fullsized":"2024-09-13T19:10:40.350404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.350179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:04.457866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.272208+0000","last_change":"2024-09-13T19:10:40.272268+0000","last_active":"2024-09-13T19:10:40.272208+0000","last_peered":"2024-09-13T19:10:40.272208+0000","last_clean":"2024-09-13T19:10:40.272208+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:10:40.272208+0000","last_undegraded":"2024-09-13T19:10:40.272208+0000","last_fullsized":"2024-09-13T19:10:40.272208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.271992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:13.748357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.162307+0000","last_change":"2024-09-13T19:10:24.162360+0000","last_active":"2024-09-13T19:10:24.162307+0000","last_peered":"2024-09-13T19:10:24.162307+0000","last_clean":"2024-09-13T19:10:24.162307+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:10:24.162307+0000","last_undegraded":"2024-09-13T19:10:24.162307+0000","last_fullsized":"2024-09-13T19:10:24.162307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.162112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:54.758256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":120,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.520870+0000","last_change":"2024-09-13T19:10:19.521044+0000","last_active":"2024-09-13T19:10:19.520870+0000","last_peered":"2024-09-13T19:10:19.520870+0000","last_clean":"2024-09-13T19:10:19.520870+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:19.520870+0000","last_undegraded":"2024-09-13T19:10:19.520870+0000","last_fullsized":"2024-09-13T19:10:19.520870+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.520627+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.918610+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.960282+0000","last_change":"2024-09-13T19:10:19.960335+0000","last_active":"2024-09-13T19:10:19.960282+0000","last_peered":"2024-09-13T19:10:19.960282+0000","last_clean":"2024-09-13T19:10:19.960282+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:10:19.960282+0000","last_undegraded":"2024-09-13T19:10:19.960282+0000","last_fullsized":"2024-09-13T19:10:19.960282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.960093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:12.950423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.897900+0000","last_change":"2024-09-13T19:06:29.310280+0000","last_active":"2024-09-13T19:09:37.897900+0000","last_peered":"2024-09-13T19:09:37.897900+0000","last_clean":"2024-09-13T19:09:37.897900+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:09:37.897900+0000","last_undegraded":"2024-09-13T19:09:37.897900+0000","last_fullsized":"2024-09-13T19:09:37.897900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.858054+0000","last_change":"2024-09-13T19:10:28.858131+0000","last_active":"2024-09-13T19:10:28.858054+0000","last_peered":"2024-09-13T19:10:28.858054+0000","last_clean":"2024-09-13T19:10:28.858054+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:10:28.858054+0000","last_undegraded":"2024-09-13T19:10:28.858054+0000","last_fullsized":"2024-09-13T19:10:28.858054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.857846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:49.466278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.004510+0000","last_change":"2024-09-13T19:06:19.276255+0000","last_active":"2024-09-13T19:08:44.004510+0000","last_peered":"2024-09-13T19:08:44.004510+0000","last_clean":"2024-09-13T19:08:44.004510+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:08:44.004510+0000","last_undegraded":"2024-09-13T19:08:44.004510+0000","last_fullsized":"2024-09-13T19:08:44.004510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.848802+0000","last_change":"2024-09-13T19:10:16.848901+0000","last_active":"2024-09-13T19:10:16.848802+0000","last_peered":"2024-09-13T19:10:16.848802+0000","last_clean":"2024-09-13T19:10:16.848802+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:10:16.848802+0000","last_undegraded":"2024-09-13T19:10:16.848802+0000","last_fullsized":"2024-09-13T19:10:16.848802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.848588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:18.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.179107+0000","last_change":"2024-09-13T19:10:16.179195+0000","last_active":"2024-09-13T19:10:16.179107+0000","last_peered":"2024-09-13T19:10:16.179107+0000","last_clean":"2024-09-13T19:10:16.179107+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:16.179107+0000","last_undegraded":"2024-09-13T19:10:16.179107+0000","last_fullsized":"2024-09-13T19:10:16.179107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.178926+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:09.694689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.208382+0000","last_change":"2024-09-13T19:10:14.208442+0000","last_active":"2024-09-13T19:10:14.208382+0000","last_peered":"2024-09-13T19:10:14.208382+0000","last_clean":"2024-09-13T19:10:14.208382+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:10:14.208382+0000","last_undegraded":"2024-09-13T19:10:14.208382+0000","last_fullsized":"2024-09-13T19:10:14.208382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.208183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:58.825796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374686+0000","last_change":"2024-09-13T19:06:21.255791+0000","last_active":"2024-09-13T19:10:08.374686+0000","last_peered":"2024-09-13T19:10:08.374686+0000","last_clean":"2024-09-13T19:10:08.374686+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:10:08.374686+0000","last_undegraded":"2024-09-13T19:10:08.374686+0000","last_fullsized":"2024-09-13T19:10:08.374686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003760+0000","last_change":"2024-09-13T19:06:19.292234+0000","last_active":"2024-09-13T19:08:44.003760+0000","last_peered":"2024-09-13T19:08:44.003760+0000","last_clean":"2024-09-13T19:08:44.003760+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:08:44.003760+0000","last_undegraded":"2024-09-13T19:08:44.003760+0000","last_fullsized":"2024-09-13T19:08:44.003760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.424270+0000","last_change":"2024-09-13T19:10:30.424323+0000","last_active":"2024-09-13T19:10:30.424270+0000","last_peered":"2024-09-13T19:10:30.424270+0000","last_clean":"2024-09-13T19:10:30.424270+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:10:30.424270+0000","last_undegraded":"2024-09-13T19:10:30.424270+0000","last_fullsized":"2024-09-13T19:10:30.424270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.424045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:59.405032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.538829+0000","last_change":"2024-09-13T19:10:15.538905+0000","last_active":"2024-09-13T19:10:15.538829+0000","last_peered":"2024-09-13T19:10:15.538829+0000","last_clean":"2024-09-13T19:10:15.538829+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:15.538829+0000","last_undegraded":"2024-09-13T19:10:15.538829+0000","last_fullsized":"2024-09-13T19:10:15.538829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.538629+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.122107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.250816+0000","last_change":"2024-09-13T19:10:12.250870+0000","last_active":"2024-09-13T19:10:12.250816+0000","last_peered":"2024-09-13T19:10:12.250816+0000","last_clean":"2024-09-13T19:10:12.250816+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:10:12.250816+0000","last_undegraded":"2024-09-13T19:10:12.250816+0000","last_fullsized":"2024-09-13T19:10:12.250816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:10.938731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:48.995376+0000","last_change":"2024-09-13T19:06:29.301409+0000","last_active":"2024-09-13T19:08:48.995376+0000","last_peered":"2024-09-13T19:08:48.995376+0000","last_clean":"2024-09-13T19:08:48.995376+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:08:48.995376+0000","last_undegraded":"2024-09-13T19:08:48.995376+0000","last_fullsized":"2024-09-13T19:08:48.995376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.017037+0000","last_change":"2024-09-13T19:06:21.258040+0000","last_active":"2024-09-13T19:10:07.017037+0000","last_peered":"2024-09-13T19:10:07.017037+0000","last_clean":"2024-09-13T19:10:07.017037+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:10:07.017037+0000","last_undegraded":"2024-09-13T19:10:07.017037+0000","last_fullsized":"2024-09-13T19:10:07.017037+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:44.003758+0000","last_change":"2024-09-13T19:06:19.272614+0000","last_active":"2024-09-13T19:08:44.003758+0000","last_peered":"2024-09-13T19:08:44.003758+0000","last_clean":"2024-09-13T19:08:44.003758+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:08:44.003758+0000","last_undegraded":"2024-09-13T19:08:44.003758+0000","last_fullsized":"2024-09-13T19:08:44.003758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.038792+0000","last_change":"2024-09-13T19:10:27.038792+0000","last_active":"2024-09-13T19:10:27.038792+0000","last_peered":"2024-09-13T19:10:27.038792+0000","last_clean":"2024-09-13T19:10:27.038792+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:10:27.038792+0000","last_undegraded":"2024-09-13T19:10:27.038792+0000","last_fullsized":"2024-09-13T19:10:27.038792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.038560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:46.381674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.966398+0000","last_change":"2024-09-13T19:10:37.966601+0000","last_active":"2024-09-13T19:10:37.966398+0000","last_peered":"2024-09-13T19:10:37.966398+0000","last_clean":"2024-09-13T19:10:37.966398+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:37.966398+0000","last_undegraded":"2024-09-13T19:10:37.966398+0000","last_fullsized":"2024-09-13T19:10:37.966398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.966152+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:38.978338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.871929+0000","last_change":"2024-09-13T19:10:11.872063+0000","last_active":"2024-09-13T19:10:11.871929+0000","last_peered":"2024-09-13T19:10:11.871929+0000","last_clean":"2024-09-13T19:10:11.871929+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:10:11.871929+0000","last_undegraded":"2024-09-13T19:10:11.871929+0000","last_fullsized":"2024-09-13T19:10:11.871929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.871702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.344253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006067+0000","last_change":"2024-09-13T19:06:29.311604+0000","last_active":"2024-09-13T19:08:49.006067+0000","last_peered":"2024-09-13T19:08:49.006067+0000","last_clean":"2024-09-13T19:08:49.006067+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:08:49.006067+0000","last_undegraded":"2024-09-13T19:08:49.006067+0000","last_fullsized":"2024-09-13T19:08:49.006067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:29.012056+0000","last_change":"2024-09-13T19:06:58.375331+0000","last_active":"2024-09-13T19:09:29.012056+0000","last_peered":"2024-09-13T19:09:29.012056+0000","last_clean":"2024-09-13T19:09:29.012056+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:09:29.012056+0000","last_undegraded":"2024-09-13T19:09:29.012056+0000","last_fullsized":"2024-09-13T19:09:29.012056+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005947+0000","last_change":"2024-09-13T19:06:19.281119+0000","last_active":"2024-09-13T19:08:49.005947+0000","last_peered":"2024-09-13T19:08:49.005947+0000","last_clean":"2024-09-13T19:08:49.005947+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:08:49.005947+0000","last_undegraded":"2024-09-13T19:08:49.005947+0000","last_fullsized":"2024-09-13T19:08:49.005947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.082445+0000","last_change":"2024-09-13T19:10:26.082518+0000","last_active":"2024-09-13T19:10:26.082445+0000","last_peered":"2024-09-13T19:10:26.082445+0000","last_clean":"2024-09-13T19:10:26.082445+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:26.082445+0000","last_undegraded":"2024-09-13T19:10:26.082445+0000","last_fullsized":"2024-09-13T19:10:26.082445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.082257+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.108750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.503964+0000","last_change":"2024-09-13T19:10:21.503964+0000","last_active":"2024-09-13T19:10:21.503964+0000","last_peered":"2024-09-13T19:10:21.503964+0000","last_clean":"2024-09-13T19:10:21.503964+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:21.503964+0000","last_undegraded":"2024-09-13T19:10:21.503964+0000","last_fullsized":"2024-09-13T19:10:21.503964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.503707+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:01.575001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.524503+0000","last_change":"2024-09-13T19:10:13.524503+0000","last_active":"2024-09-13T19:10:13.524503+0000","last_peered":"2024-09-13T19:10:13.524503+0000","last_clean":"2024-09-13T19:10:13.524503+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:10:13.524503+0000","last_undegraded":"2024-09-13T19:10:13.524503+0000","last_fullsized":"2024-09-13T19:10:13.524503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.524264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.550419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.266538+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:09:38.266538+0000","last_peered":"2024-09-13T19:09:38.266538+0000","last_clean":"2024-09-13T19:09:38.266538+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:09:38.266538+0000","last_undegraded":"2024-09-13T19:09:38.266538+0000","last_fullsized":"2024-09-13T19:09:38.266538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.479965+0000","last_change":"2024-09-13T19:10:46.480028+0000","last_active":"2024-09-13T19:10:46.479965+0000","last_peered":"2024-09-13T19:10:46.479965+0000","last_clean":"2024-09-13T19:10:46.479965+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:10:46.479965+0000","last_undegraded":"2024-09-13T19:10:46.479965+0000","last_fullsized":"2024-09-13T19:10:46.479965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.479775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:43.497505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:37.842133+0000","last_change":"2024-09-13T19:06:19.297044+0000","last_active":"2024-09-13T19:09:37.842133+0000","last_peered":"2024-09-13T19:09:37.842133+0000","last_clean":"2024-09-13T19:09:37.842133+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:09:37.842133+0000","last_undegraded":"2024-09-13T19:09:37.842133+0000","last_fullsized":"2024-09-13T19:09:37.842133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.982887+0000","last_change":"2024-09-13T19:10:21.982937+0000","last_active":"2024-09-13T19:10:21.982887+0000","last_peered":"2024-09-13T19:10:21.982887+0000","last_clean":"2024-09-13T19:10:21.982887+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:10:21.982887+0000","last_undegraded":"2024-09-13T19:10:21.982887+0000","last_fullsized":"2024-09-13T19:10:21.982887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.982700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:30.750394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.948762+0000","last_change":"2024-09-13T19:10:36.948838+0000","last_active":"2024-09-13T19:10:36.948762+0000","last_peered":"2024-09-13T19:10:36.948762+0000","last_clean":"2024-09-13T19:10:36.948762+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:10:36.948762+0000","last_undegraded":"2024-09-13T19:10:36.948762+0000","last_fullsized":"2024-09-13T19:10:36.948762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.948531+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:54.759393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.250351+0000","last_change":"2024-09-13T19:10:08.250351+0000","last_active":"2024-09-13T19:10:08.250351+0000","last_peered":"2024-09-13T19:10:08.250351+0000","last_clean":"2024-09-13T19:10:08.250351+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:08.250351+0000","last_undegraded":"2024-09-13T19:10:08.250351+0000","last_fullsized":"2024-09-13T19:10:08.250351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.249922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:42.550124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005700+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:08:49.005700+0000","last_peered":"2024-09-13T19:08:49.005700+0000","last_clean":"2024-09-13T19:08:49.005700+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:08:49.005700+0000","last_undegraded":"2024-09-13T19:08:49.005700+0000","last_fullsized":"2024-09-13T19:08:49.005700+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.125118+0000","last_change":"2024-09-13T19:10:35.125178+0000","last_active":"2024-09-13T19:10:35.125118+0000","last_peered":"2024-09-13T19:10:35.125118+0000","last_clean":"2024-09-13T19:10:35.125118+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:10:35.125118+0000","last_undegraded":"2024-09-13T19:10:35.125118+0000","last_fullsized":"2024-09-13T19:10:35.125118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.124924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:46.888340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.230536+0000","last_change":"2024-09-13T19:06:19.279361+0000","last_active":"2024-09-13T19:09:38.230536+0000","last_peered":"2024-09-13T19:09:38.230536+0000","last_clean":"2024-09-13T19:09:38.230536+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:09:38.230536+0000","last_undegraded":"2024-09-13T19:09:38.230536+0000","last_fullsized":"2024-09-13T19:09:38.230536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.937682+0000","last_change":"2024-09-13T19:10:18.937733+0000","last_active":"2024-09-13T19:10:18.937682+0000","last_peered":"2024-09-13T19:10:18.937682+0000","last_clean":"2024-09-13T19:10:18.937682+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:10:18.937682+0000","last_undegraded":"2024-09-13T19:10:18.937682+0000","last_fullsized":"2024-09-13T19:10:18.937682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.937494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:07.450855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.890149+0000","last_change":"2024-09-13T19:10:13.890226+0000","last_active":"2024-09-13T19:10:13.890149+0000","last_peered":"2024-09-13T19:10:13.890149+0000","last_clean":"2024-09-13T19:10:13.890149+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:13.890149+0000","last_undegraded":"2024-09-13T19:10:13.890149+0000","last_fullsized":"2024-09-13T19:10:13.890149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.889956+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:41.379481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.586378+0000","last_change":"2024-09-13T19:10:08.586502+0000","last_active":"2024-09-13T19:10:08.586378+0000","last_peered":"2024-09-13T19:10:08.586378+0000","last_clean":"2024-09-13T19:10:08.586378+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:10:08.586378+0000","last_undegraded":"2024-09-13T19:10:08.586378+0000","last_fullsized":"2024-09-13T19:10:08.586378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.586205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:31.058755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.007927+0000","last_change":"2024-09-13T19:06:29.320211+0000","last_active":"2024-09-13T19:08:54.007927+0000","last_peered":"2024-09-13T19:08:54.007927+0000","last_clean":"2024-09-13T19:08:54.007927+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:08:54.007927+0000","last_undegraded":"2024-09-13T19:08:54.007927+0000","last_fullsized":"2024-09-13T19:08:54.007927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.067777+0000","last_change":"2024-09-13T19:10:31.067914+0000","last_active":"2024-09-13T19:10:31.067777+0000","last_peered":"2024-09-13T19:10:31.067777+0000","last_clean":"2024-09-13T19:10:31.067777+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:10:31.067777+0000","last_undegraded":"2024-09-13T19:10:31.067777+0000","last_fullsized":"2024-09-13T19:10:31.067777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.067555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:11.138849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006472+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:49.006472+0000","last_peered":"2024-09-13T19:08:49.006472+0000","last_clean":"2024-09-13T19:08:49.006472+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:49.006472+0000","last_undegraded":"2024-09-13T19:08:49.006472+0000","last_fullsized":"2024-09-13T19:08:49.006472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.089342+0000","last_change":"2024-09-13T19:10:30.089399+0000","last_active":"2024-09-13T19:10:30.089342+0000","last_peered":"2024-09-13T19:10:30.089342+0000","last_clean":"2024-09-13T19:10:30.089342+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:10:30.089342+0000","last_undegraded":"2024-09-13T19:10:30.089342+0000","last_fullsized":"2024-09-13T19:10:30.089342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.089119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.043364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.454622+0000","last_change":"2024-09-13T19:10:22.454696+0000","last_active":"2024-09-13T19:10:22.454622+0000","last_peered":"2024-09-13T19:10:22.454622+0000","last_clean":"2024-09-13T19:10:22.454622+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:22.454622+0000","last_undegraded":"2024-09-13T19:10:22.454622+0000","last_fullsized":"2024-09-13T19:10:22.454622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.454429+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:00.959003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.898700+0000","last_change":"2024-09-13T19:10:35.898752+0000","last_active":"2024-09-13T19:10:35.898700+0000","last_peered":"2024-09-13T19:10:35.898700+0000","last_clean":"2024-09-13T19:10:35.898700+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:10:35.898700+0000","last_undegraded":"2024-09-13T19:10:35.898700+0000","last_fullsized":"2024-09-13T19:10:35.898700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.898496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.675915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.008313+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:08:54.008313+0000","last_peered":"2024-09-13T19:08:54.008313+0000","last_clean":"2024-09-13T19:08:54.008313+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:08:54.008313+0000","last_undegraded":"2024-09-13T19:08:54.008313+0000","last_fullsized":"2024-09-13T19:08:54.008313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:24.010907+0000","last_change":"2024-09-13T19:06:58.351633+0000","last_active":"2024-09-13T19:09:24.010907+0000","last_peered":"2024-09-13T19:09:24.010907+0000","last_clean":"2024-09-13T19:09:24.010907+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:09:24.010907+0000","last_undegraded":"2024-09-13T19:09:24.010907+0000","last_fullsized":"2024-09-13T19:09:24.010907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016536+0000","last_change":"2024-09-13T19:06:19.274736+0000","last_active":"2024-09-13T19:10:07.016536+0000","last_peered":"2024-09-13T19:10:07.016536+0000","last_clean":"2024-09-13T19:10:07.016536+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:10:07.016536+0000","last_undegraded":"2024-09-13T19:10:07.016536+0000","last_fullsized":"2024-09-13T19:10:07.016536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.987986+0000","last_change":"2024-09-13T19:10:24.988040+0000","last_active":"2024-09-13T19:10:24.987986+0000","last_peered":"2024-09-13T19:10:24.987986+0000","last_clean":"2024-09-13T19:10:24.987986+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:10:24.987986+0000","last_undegraded":"2024-09-13T19:10:24.987986+0000","last_fullsized":"2024-09-13T19:10:24.987986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.987790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.492363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.936225+0000","last_change":"2024-09-13T19:10:38.936353+0000","last_active":"2024-09-13T19:10:38.936225+0000","last_peered":"2024-09-13T19:10:38.936225+0000","last_clean":"2024-09-13T19:10:38.936225+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:38.936225+0000","last_undegraded":"2024-09-13T19:10:38.936225+0000","last_fullsized":"2024-09-13T19:10:38.936225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.935949+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:31.557189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.947911+0000","last_change":"2024-09-13T19:10:39.947969+0000","last_active":"2024-09-13T19:10:39.947911+0000","last_peered":"2024-09-13T19:10:39.947911+0000","last_clean":"2024-09-13T19:10:39.947911+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:10:39.947911+0000","last_undegraded":"2024-09-13T19:10:39.947911+0000","last_fullsized":"2024-09-13T19:10:39.947911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.947716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:39.389129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.061934+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.061934+0000","last_peered":"2024-09-13T19:09:38.061934+0000","last_clean":"2024-09-13T19:09:38.061934+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.061934+0000","last_undegraded":"2024-09-13T19:09:38.061934+0000","last_fullsized":"2024-09-13T19:09:38.061934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.071401+0000","last_change":"2024-09-13T19:10:32.071527+0000","last_active":"2024-09-13T19:10:32.071401+0000","last_peered":"2024-09-13T19:10:32.071401+0000","last_clean":"2024-09-13T19:10:32.071401+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:10:32.071401+0000","last_undegraded":"2024-09-13T19:10:32.071401+0000","last_fullsized":"2024-09-13T19:10:32.071401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.071163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:10.575736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469474+0000","last_change":"2024-09-13T19:06:19.280303+0000","last_active":"2024-09-13T19:10:07.469474+0000","last_peered":"2024-09-13T19:10:07.469474+0000","last_clean":"2024-09-13T19:10:07.469474+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:10:07.469474+0000","last_undegraded":"2024-09-13T19:10:07.469474+0000","last_fullsized":"2024-09-13T19:10:07.469474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.902984+0000","last_change":"2024-09-13T19:10:16.903047+0000","last_active":"2024-09-13T19:10:16.902984+0000","last_peered":"2024-09-13T19:10:16.902984+0000","last_clean":"2024-09-13T19:10:16.902984+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:10:16.902984+0000","last_undegraded":"2024-09-13T19:10:16.902984+0000","last_fullsized":"2024-09-13T19:10:16.902984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.902806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:19.703828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.918619+0000","last_change":"2024-09-13T19:10:33.918703+0000","last_active":"2024-09-13T19:10:33.918619+0000","last_peered":"2024-09-13T19:10:33.918619+0000","last_clean":"2024-09-13T19:10:33.918619+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:33.918619+0000","last_undegraded":"2024-09-13T19:10:33.918619+0000","last_fullsized":"2024-09-13T19:10:33.918619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.918433+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:50.289186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.519922+0000","last_change":"2024-09-13T19:10:16.520027+0000","last_active":"2024-09-13T19:10:16.519922+0000","last_peered":"2024-09-13T19:10:16.519922+0000","last_clean":"2024-09-13T19:10:16.519922+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:10:16.519922+0000","last_undegraded":"2024-09-13T19:10:16.519922+0000","last_fullsized":"2024-09-13T19:10:16.519922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.519636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:59.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.888191+0000","last_change":"2024-09-13T19:10:47.888253+0000","last_active":"2024-09-13T19:10:47.888191+0000","last_peered":"2024-09-13T19:10:47.888191+0000","last_clean":"2024-09-13T19:10:47.888191+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:10:47.888191+0000","last_undegraded":"2024-09-13T19:10:47.888191+0000","last_fullsized":"2024-09-13T19:10:47.888191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.887997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:30.869982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.028462+0000","last_change":"2024-09-13T19:10:46.028526+0000","last_active":"2024-09-13T19:10:46.028462+0000","last_peered":"2024-09-13T19:10:46.028462+0000","last_clean":"2024-09-13T19:10:46.028462+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:10:46.028462+0000","last_undegraded":"2024-09-13T19:10:46.028462+0000","last_fullsized":"2024-09-13T19:10:46.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.028259+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:47.928830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.107911+0000","last_change":"2024-09-13T19:10:46.107973+0000","last_active":"2024-09-13T19:10:46.107911+0000","last_peered":"2024-09-13T19:10:46.107911+0000","last_clean":"2024-09-13T19:10:46.107911+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:10:46.107911+0000","last_undegraded":"2024-09-13T19:10:46.107911+0000","last_fullsized":"2024-09-13T19:10:46.107911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.107689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:25.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.467731+0000","last_change":"2024-09-13T19:10:44.467791+0000","last_active":"2024-09-13T19:10:44.467731+0000","last_peered":"2024-09-13T19:10:44.467731+0000","last_clean":"2024-09-13T19:10:44.467731+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:10:44.467731+0000","last_undegraded":"2024-09-13T19:10:44.467731+0000","last_fullsized":"2024-09-13T19:10:44.467731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.467543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:25.126852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016684+0000","last_change":"2024-09-13T19:06:19.264754+0000","last_active":"2024-09-13T19:10:07.016684+0000","last_peered":"2024-09-13T19:10:07.016684+0000","last_clean":"2024-09-13T19:10:07.016684+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:10:07.016684+0000","last_undegraded":"2024-09-13T19:10:07.016684+0000","last_fullsized":"2024-09-13T19:10:07.016684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374819+0000","last_change":"2024-09-13T19:06:21.245715+0000","last_active":"2024-09-13T19:10:08.374819+0000","last_peered":"2024-09-13T19:10:08.374819+0000","last_clean":"2024-09-13T19:10:08.374819+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:10:08.374819+0000","last_undegraded":"2024-09-13T19:10:08.374819+0000","last_fullsized":"2024-09-13T19:10:08.374819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373888+0000","last_change":"2024-09-13T19:06:19.291400+0000","last_active":"2024-09-13T19:10:08.373888+0000","last_peered":"2024-09-13T19:10:08.373888+0000","last_clean":"2024-09-13T19:10:08.373888+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:10:08.373888+0000","last_undegraded":"2024-09-13T19:10:08.373888+0000","last_fullsized":"2024-09-13T19:10:08.373888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.482729+0000","last_change":"2024-09-13T19:10:48.482795+0000","last_active":"2024-09-13T19:10:48.482729+0000","last_peered":"2024-09-13T19:10:48.482729+0000","last_clean":"2024-09-13T19:10:48.482729+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:10:48.482729+0000","last_undegraded":"2024-09-13T19:10:48.482729+0000","last_fullsized":"2024-09-13T19:10:48.482729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.482535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:41.806005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016645+0000","last_change":"2024-09-13T19:06:19.263503+0000","last_active":"2024-09-13T19:10:07.016645+0000","last_peered":"2024-09-13T19:10:07.016645+0000","last_clean":"2024-09-13T19:10:07.016645+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:10:07.016645+0000","last_undegraded":"2024-09-13T19:10:07.016645+0000","last_fullsized":"2024-09-13T19:10:07.016645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016974+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:10:07.016974+0000","last_peered":"2024-09-13T19:10:07.016974+0000","last_clean":"2024-09-13T19:10:07.016974+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:10:07.016974+0000","last_undegraded":"2024-09-13T19:10:07.016974+0000","last_fullsized":"2024-09-13T19:10:07.016974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.391394+0000","last_change":"2024-09-13T19:10:41.391471+0000","last_active":"2024-09-13T19:10:41.391394+0000","last_peered":"2024-09-13T19:10:41.391394+0000","last_clean":"2024-09-13T19:10:41.391394+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:10:41.391394+0000","last_undegraded":"2024-09-13T19:10:41.391394+0000","last_fullsized":"2024-09-13T19:10:41.391394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.391199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:07.114988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.939056+0000","last_change":"2024-09-13T19:10:32.939056+0000","last_active":"2024-09-13T19:10:32.939056+0000","last_peered":"2024-09-13T19:10:32.939056+0000","last_clean":"2024-09-13T19:10:32.939056+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:10:32.939056+0000","last_undegraded":"2024-09-13T19:10:32.939056+0000","last_fullsized":"2024-09-13T19:10:32.939056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.938814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:06.415179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469261+0000","last_change":"2024-09-13T19:06:19.275129+0000","last_active":"2024-09-13T19:10:07.469261+0000","last_peered":"2024-09-13T19:10:07.469261+0000","last_clean":"2024-09-13T19:10:07.469261+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:10:07.469261+0000","last_undegraded":"2024-09-13T19:10:07.469261+0000","last_fullsized":"2024-09-13T19:10:07.469261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.017028+0000","last_change":"2024-09-13T19:06:21.258466+0000","last_active":"2024-09-13T19:10:07.017028+0000","last_peered":"2024-09-13T19:10:07.017028+0000","last_clean":"2024-09-13T19:10:07.017028+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:10:07.017028+0000","last_undegraded":"2024-09-13T19:10:07.017028+0000","last_fullsized":"2024-09-13T19:10:07.017028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.127862+0000","last_change":"2024-09-13T19:10:44.127991+0000","last_active":"2024-09-13T19:10:44.127862+0000","last_peered":"2024-09-13T19:10:44.127862+0000","last_clean":"2024-09-13T19:10:44.127862+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:10:44.127862+0000","last_undegraded":"2024-09-13T19:10:44.127862+0000","last_fullsized":"2024-09-13T19:10:44.127862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.127604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:58.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.994450+0000","last_change":"2024-09-13T19:10:34.994578+0000","last_active":"2024-09-13T19:10:34.994450+0000","last_peered":"2024-09-13T19:10:34.994450+0000","last_clean":"2024-09-13T19:10:34.994450+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:10:34.994450+0000","last_undegraded":"2024-09-13T19:10:34.994450+0000","last_fullsized":"2024-09-13T19:10:34.994450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.994220+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.946370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016687+0000","last_change":"2024-09-13T19:06:19.265147+0000","last_active":"2024-09-13T19:10:07.016687+0000","last_peered":"2024-09-13T19:10:07.016687+0000","last_clean":"2024-09-13T19:10:07.016687+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:10:07.016687+0000","last_undegraded":"2024-09-13T19:10:07.016687+0000","last_fullsized":"2024-09-13T19:10:07.016687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.046807+0000","last_change":"2024-09-13T19:10:48.046880+0000","last_active":"2024-09-13T19:10:48.046807+0000","last_peered":"2024-09-13T19:10:48.046807+0000","last_clean":"2024-09-13T19:10:48.046807+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:10:48.046807+0000","last_undegraded":"2024-09-13T19:10:48.046807+0000","last_fullsized":"2024-09-13T19:10:48.046807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.046612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:06.112193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373884+0000","last_change":"2024-09-13T19:06:19.292507+0000","last_active":"2024-09-13T19:10:08.373884+0000","last_peered":"2024-09-13T19:10:08.373884+0000","last_clean":"2024-09-13T19:10:08.373884+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:10:08.373884+0000","last_undegraded":"2024-09-13T19:10:08.373884+0000","last_fullsized":"2024-09-13T19:10:08.373884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.972376+0000","last_change":"2024-09-13T19:10:42.972524+0000","last_active":"2024-09-13T19:10:42.972376+0000","last_peered":"2024-09-13T19:10:42.972376+0000","last_clean":"2024-09-13T19:10:42.972376+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:10:42.972376+0000","last_undegraded":"2024-09-13T19:10:42.972376+0000","last_fullsized":"2024-09-13T19:10:42.972376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.972147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:14.740560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.526647+0000","last_change":"2024-09-13T19:10:47.526647+0000","last_active":"2024-09-13T19:10:47.526647+0000","last_peered":"2024-09-13T19:10:47.526647+0000","last_clean":"2024-09-13T19:10:47.526647+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:10:47.526647+0000","last_undegraded":"2024-09-13T19:10:47.526647+0000","last_fullsized":"2024-09-13T19:10:47.526647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.526271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.850818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.424041+0000","last_change":"2024-09-13T19:10:38.424112+0000","last_active":"2024-09-13T19:10:38.424041+0000","last_peered":"2024-09-13T19:10:38.424041+0000","last_clean":"2024-09-13T19:10:38.424041+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:10:38.424041+0000","last_undegraded":"2024-09-13T19:10:38.424041+0000","last_fullsized":"2024-09-13T19:10:38.424041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.423850+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:32.456343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.070971+0000","last_change":"2024-09-13T19:10:45.070971+0000","last_active":"2024-09-13T19:10:45.070971+0000","last_peered":"2024-09-13T19:10:45.070971+0000","last_clean":"2024-09-13T19:10:45.070971+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:10:45.070971+0000","last_undegraded":"2024-09-13T19:10:45.070971+0000","last_fullsized":"2024-09-13T19:10:45.070971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.070599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:23.213665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.612209+0000","last_change":"2024-09-13T19:06:21.262182+0000","last_active":"2024-09-13T19:09:38.612209+0000","last_peered":"2024-09-13T19:09:38.612209+0000","last_clean":"2024-09-13T19:09:38.612209+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:09:38.612209+0000","last_undegraded":"2024-09-13T19:09:38.612209+0000","last_fullsized":"2024-09-13T19:09:38.612209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.469432+0000","last_change":"2024-09-13T19:06:19.274745+0000","last_active":"2024-09-13T19:10:07.469432+0000","last_peered":"2024-09-13T19:10:07.469432+0000","last_clean":"2024-09-13T19:10:07.469432+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:10:07.469432+0000","last_undegraded":"2024-09-13T19:10:07.469432+0000","last_fullsized":"2024-09-13T19:10:07.469432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.042136+0000","last_change":"2024-09-13T19:10:38.042199+0000","last_active":"2024-09-13T19:10:38.042136+0000","last_peered":"2024-09-13T19:10:38.042136+0000","last_clean":"2024-09-13T19:10:38.042136+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:10:38.042136+0000","last_undegraded":"2024-09-13T19:10:38.042136+0000","last_fullsized":"2024-09-13T19:10:38.042136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.041895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:59.900437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373986+0000","last_change":"2024-09-13T19:06:19.290283+0000","last_active":"2024-09-13T19:10:08.373986+0000","last_peered":"2024-09-13T19:10:08.373986+0000","last_clean":"2024-09-13T19:10:08.373986+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:10:08.373986+0000","last_undegraded":"2024-09-13T19:10:08.373986+0000","last_fullsized":"2024-09-13T19:10:08.373986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.907418+0000","last_change":"2024-09-13T19:10:30.907486+0000","last_active":"2024-09-13T19:10:30.907418+0000","last_peered":"2024-09-13T19:10:30.907418+0000","last_clean":"2024-09-13T19:10:30.907418+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:10:30.907418+0000","last_undegraded":"2024-09-13T19:10:30.907418+0000","last_fullsized":"2024-09-13T19:10:30.907418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.907226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:52.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373987+0000","last_change":"2024-09-13T19:06:19.296375+0000","last_active":"2024-09-13T19:10:08.373987+0000","last_peered":"2024-09-13T19:10:08.373987+0000","last_clean":"2024-09-13T19:10:08.373987+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:10:08.373987+0000","last_undegraded":"2024-09-13T19:10:08.373987+0000","last_fullsized":"2024-09-13T19:10:08.373987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.753120+0000","last_change":"2024-09-13T19:10:25.753182+0000","last_active":"2024-09-13T19:10:25.753120+0000","last_peered":"2024-09-13T19:10:25.753120+0000","last_clean":"2024-09-13T19:10:25.753120+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:10:25.753120+0000","last_undegraded":"2024-09-13T19:10:25.753120+0000","last_fullsized":"2024-09-13T19:10:25.753120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.752912+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:44.077460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.105255+0000","last_change":"2024-09-13T19:10:34.105311+0000","last_active":"2024-09-13T19:10:34.105255+0000","last_peered":"2024-09-13T19:10:34.105255+0000","last_clean":"2024-09-13T19:10:34.105255+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:10:34.105255+0000","last_undegraded":"2024-09-13T19:10:34.105255+0000","last_fullsized":"2024-09-13T19:10:34.105255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.105056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:03.469390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.470220+0000","last_change":"2024-09-13T19:06:21.262095+0000","last_active":"2024-09-13T19:10:07.470220+0000","last_peered":"2024-09-13T19:10:07.470220+0000","last_clean":"2024-09-13T19:10:07.470220+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:10:07.470220+0000","last_undegraded":"2024-09-13T19:10:07.470220+0000","last_fullsized":"2024-09-13T19:10:07.470220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.239429+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:09:38.239429+0000","last_peered":"2024-09-13T19:09:38.239429+0000","last_clean":"2024-09-13T19:09:38.239429+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:09:38.239429+0000","last_undegraded":"2024-09-13T19:09:38.239429+0000","last_fullsized":"2024-09-13T19:09:38.239429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:39.002127+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:08:39.002127+0000","last_peered":"2024-09-13T19:08:39.002127+0000","last_clean":"2024-09-13T19:08:39.002127+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:08:39.002127+0000","last_undegraded":"2024-09-13T19:08:39.002127+0000","last_fullsized":"2024-09-13T19:08:39.002127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.413696+0000","last_change":"2024-09-13T19:10:34.413754+0000","last_active":"2024-09-13T19:10:34.413696+0000","last_peered":"2024-09-13T19:10:34.413696+0000","last_clean":"2024-09-13T19:10:34.413696+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:10:34.413696+0000","last_undegraded":"2024-09-13T19:10:34.413696+0000","last_fullsized":"2024-09-13T19:10:34.413696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.413506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:48.737050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.496495+0000","last_change":"2024-09-13T19:10:45.496556+0000","last_active":"2024-09-13T19:10:45.496495+0000","last_peered":"2024-09-13T19:10:45.496495+0000","last_clean":"2024-09-13T19:10:45.496495+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:10:45.496495+0000","last_undegraded":"2024-09-13T19:10:45.496495+0000","last_fullsized":"2024-09-13T19:10:45.496495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.496261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:03.561842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.018203+0000","last_change":"2024-09-13T19:10:39.018270+0000","last_active":"2024-09-13T19:10:39.018203+0000","last_peered":"2024-09-13T19:10:39.018203+0000","last_clean":"2024-09-13T19:10:39.018203+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:10:39.018203+0000","last_undegraded":"2024-09-13T19:10:39.018203+0000","last_fullsized":"2024-09-13T19:10:39.018203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.018018+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:18.277091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":741263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705725,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705725,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":152715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:10:49.590 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.590 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.590 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.590 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.591 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.592 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.593 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.594 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.595 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T19:06:05.016117+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.595 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.595 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.596 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.596 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.596 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.597 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.597 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.597 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.597 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.598 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.599 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.600 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.601 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.601 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.601 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.601 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.602 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.602 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.602 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.603 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.603 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.603 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.603 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.604 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.604 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.605 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.605 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.605 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.606 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.606 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.606 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.607 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.607 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.607 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.608 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.608 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.608 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.609 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.609 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.609 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.610 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.610 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.610 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.611 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.611 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.611 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.611 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.612 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.612 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.612 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:10:49.613 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:11:09.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:11:09.746 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fade5c66640 1 Processor -- start 2024-09-13T19:11:09.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fade5c66640 1 -- start start 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fade5c66640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fade012f390 0x7fade0133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fade5c66640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade00984f0 con 0x7fade012e760 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fade5c66640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fade0098dc0 con 0x7fade012f390 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7faddf7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fade012e760 0x7fade012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37158/0 (socket says 172.21.15.12:37158) 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7faddf7fe640 1 -- 172.21.15.12:0/1240207962 learned_addr learned my addr 172.21.15.12:0/1240207962 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7faddeffd640 1 --2- 172.21.15.12:0/1240207962 >> v2:172.21.15.12:3300/0 conn(0x7fade012f390 0x7fade0133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fadde7fc640 1 -- 172.21.15.12:0/1240207962 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072511453 0 0) 0x7fade00984f0 con 0x7fade012e760 2024-09-13T19:11:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.741+0000 7fadde7fc640 1 -- 172.21.15.12:0/1240207962 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadcc003530 con 0x7fade012e760 2024-09-13T19:11:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7faddeffd640 1 -- 172.21.15.12:0/1240207962 >> v1:172.21.15.12:6789/0 conn(0x7fade012e760 legacy=0x7fade012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7faddeffd640 1 -- 172.21.15.12:0/1240207962 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00981a0 con 0x7fade012f390 2024-09-13T19:11:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7faddeffd640 1 --2- 172.21.15.12:0/1240207962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012f390 0x7fade0133a80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba77c66a312aa6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:09.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fadde7fc640 1 -- 172.21.15.12:0/1240207962 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd00b2070 con 0x7fade012f390 2024-09-13T19:11:09.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fadde7fc640 1 -- 172.21.15.12:0/1240207962 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd00a57d0 con 0x7fade012f390 2024-09-13T19:11:09.750 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fadde7fc640 1 -- 172.21.15.12:0/1240207962 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadd00a5ab0 con 0x7fade012f390 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- 172.21.15.12:0/1240207962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012f390 msgr2=0x7fade0133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 --2- 172.21.15.12:0/1240207962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012f390 0x7fade0133a80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009d90 tx=0x7fadd001c950 comp rx=0 tx=0).stop 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- 172.21.15.12:0/1240207962 shutdown_connections 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 --2- 172.21.15.12:0/1240207962 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012f390 0x7fade0133a80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- 172.21.15.12:0/1240207962 >> 172.21.15.12:0/1240207962 conn(0x7fade00a10a0 msgr2=0x7fade00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- 172.21.15.12:0/1240207962 shutdown_connections 2024-09-13T19:11:09.751 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- 172.21.15.12:0/1240207962 wait complete. 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 Processor -- start 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.745+0000 7fade5c66640 1 -- start start 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fade5c66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fade5c66640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fade0136b70 con 0x7fade012e760 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34446/0 (socket says 172.21.15.12:34446) 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddf7fe640 1 -- 172.21.15.12:0/3295771336 learned_addr learned my addr 172.21.15.12:0/3295771336 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:11:09.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddf7fe640 1 -- 172.21.15.12:0/3295771336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade0131150 con 0x7fade012e760 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddf7fe640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c3d0 tx=0x7fadc800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc8017070 con 0x7fade012e760 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc8005ce0 con 0x7fade012e760 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadc80070d0 con 0x7fade012e760 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade0132e30 con 0x7fade012e760 2024-09-13T19:11:09.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade0097830 con 0x7fade012e760 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fadc801a070 con 0x7fade012e760 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade012ec80 con 0x7fade012e760 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 0x7fadc0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fadc80485a0 con 0x7fade012e760 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddeffd640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 0x7fadc0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:09.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.749+0000 7faddeffd640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 0x7fadc0038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fadd00af000 tx=0x7fadd00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.753+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fadc8019e10 con 0x7fade012e760 2024-09-13T19:11:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.913+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fade01321e0 con 0x7fadc0035db0 2024-09-13T19:11:09.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.957+0000 7fadd7fff640 1 -- 172.21.15.12:0/3295771336 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665505 (secure 0 0 0) 0x7fadd00a57a0 con 0x7fadc0035db0 2024-09-13T19:11:09.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:11:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 msgr2=0x7fadc0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 0x7fadc0038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fadd00af000 tx=0x7fadd00a7070 comp rx=0 tx=0).stop 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 msgr2=0x7fade00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c3d0 tx=0x7fadc800c890 comp rx=0 tx=0).stop 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 shutdown_connections 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fadc0035db0 0x7fadc0038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 --2- 172.21.15.12:0/3295771336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fade012e760 0x7fade00972f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 >> 172.21.15.12:0/3295771336 conn(0x7fade00a10a0 msgr2=0x7fade0128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 shutdown_connections 2024-09-13T19:11:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:09.969+0000 7fade5c66640 1 -- 172.21.15.12:0/3295771336 wait complete. 2024-09-13T19:11:09.989 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-13T19:11:09.048215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4792,"ondisk_log_size":4792,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165088,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322272,"statfs":{"total":386547056640,"available":386378006528,"internally_reserved":0,"allocated":2981888,"data_stored":1788524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005953"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.114644+0000","last_change":"2024-09-13T19:10:50.114706+0000","last_active":"2024-09-13T19:10:50.114644+0000","last_peered":"2024-09-13T19:10:50.114644+0000","last_clean":"2024-09-13T19:10:50.114644+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:10:50.114644+0000","last_undegraded":"2024-09-13T19:10:50.114644+0000","last_fullsized":"2024-09-13T19:10:50.114644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.114431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:14.222119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.965072+0000","last_change":"2024-09-13T19:10:25.965129+0000","last_active":"2024-09-13T19:10:25.965072+0000","last_peered":"2024-09-13T19:10:25.965072+0000","last_clean":"2024-09-13T19:10:25.965072+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:10:25.965072+0000","last_undegraded":"2024-09-13T19:10:25.965072+0000","last_fullsized":"2024-09-13T19:10:25.965072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.964881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:55.311376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.386765+0000","last_change":"2024-09-13T19:10:39.386834+0000","last_active":"2024-09-13T19:10:39.386765+0000","last_peered":"2024-09-13T19:10:39.386765+0000","last_clean":"2024-09-13T19:10:39.386765+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:10:39.386765+0000","last_undegraded":"2024-09-13T19:10:39.386765+0000","last_fullsized":"2024-09-13T19:10:39.386765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.386575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:52.773701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.885413+0000","last_change":"2024-09-13T19:10:46.885532+0000","last_active":"2024-09-13T19:10:46.885413+0000","last_peered":"2024-09-13T19:10:46.885413+0000","last_clean":"2024-09-13T19:10:46.885413+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:10:46.885413+0000","last_undegraded":"2024-09-13T19:10:46.885413+0000","last_fullsized":"2024-09-13T19:10:46.885413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.885150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:36.242321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374522+0000","last_change":"2024-09-13T19:06:19.296088+0000","last_active":"2024-09-13T19:10:08.374522+0000","last_peered":"2024-09-13T19:10:08.374522+0000","last_clean":"2024-09-13T19:10:08.374522+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:10:08.374522+0000","last_undegraded":"2024-09-13T19:10:08.374522+0000","last_fullsized":"2024-09-13T19:10:08.374522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.962210+0000","last_change":"2024-09-13T19:10:44.962280+0000","last_active":"2024-09-13T19:10:44.962210+0000","last_peered":"2024-09-13T19:10:44.962210+0000","last_clean":"2024-09-13T19:10:44.962210+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:10:44.962210+0000","last_undegraded":"2024-09-13T19:10:44.962210+0000","last_fullsized":"2024-09-13T19:10:44.962210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.961999+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:09.446134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.214987+0000","last_change":"2024-09-13T19:10:42.215120+0000","last_active":"2024-09-13T19:10:42.214987+0000","last_peered":"2024-09-13T19:10:42.214987+0000","last_clean":"2024-09-13T19:10:42.214987+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:10:42.214987+0000","last_undegraded":"2024-09-13T19:10:42.214987+0000","last_fullsized":"2024-09-13T19:10:42.214987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.214682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:21.166832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.929553+0000","last_change":"2024-09-13T19:10:52.929698+0000","last_active":"2024-09-13T19:10:52.929553+0000","last_peered":"2024-09-13T19:10:52.929553+0000","last_clean":"2024-09-13T19:10:52.929553+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:10:52.929553+0000","last_undegraded":"2024-09-13T19:10:52.929553+0000","last_fullsized":"2024-09-13T19:10:52.929553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.929326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:33.662146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006250+0000","last_change":"2024-09-13T19:06:19.289779+0000","last_active":"2024-09-13T19:08:49.006250+0000","last_peered":"2024-09-13T19:08:49.006250+0000","last_clean":"2024-09-13T19:08:49.006250+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:08:49.006250+0000","last_undegraded":"2024-09-13T19:08:49.006250+0000","last_fullsized":"2024-09-13T19:08:49.006250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.014802+0000","last_change":"2024-09-13T19:10:37.014859+0000","last_active":"2024-09-13T19:10:37.014802+0000","last_peered":"2024-09-13T19:10:37.014802+0000","last_clean":"2024-09-13T19:10:37.014802+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:10:37.014802+0000","last_undegraded":"2024-09-13T19:10:37.014802+0000","last_fullsized":"2024-09-13T19:10:37.014802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.014649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:51.338193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.024944+0000","last_change":"2024-09-13T19:10:53.025008+0000","last_active":"2024-09-13T19:10:53.024944+0000","last_peered":"2024-09-13T19:10:53.024944+0000","last_clean":"2024-09-13T19:10:53.024944+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:10:53.024944+0000","last_undegraded":"2024-09-13T19:10:53.024944+0000","last_fullsized":"2024-09-13T19:10:53.024944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.024751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:54.925323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.711657+0000","last_change":"2024-09-13T19:10:24.711657+0000","last_active":"2024-09-13T19:10:24.711657+0000","last_peered":"2024-09-13T19:10:24.711657+0000","last_clean":"2024-09-13T19:10:24.711657+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:10:24.711657+0000","last_undegraded":"2024-09-13T19:10:24.711657+0000","last_fullsized":"2024-09-13T19:10:24.711657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.711412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:17.178317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.005953+0000","last_change":"2024-09-13T19:06:19.284431+0000","last_active":"2024-09-13T19:08:49.005953+0000","last_peered":"2024-09-13T19:08:49.005953+0000","last_clean":"2024-09-13T19:08:49.005953+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:08:49.005953+0000","last_undegraded":"2024-09-13T19:08:49.005953+0000","last_fullsized":"2024-09-13T19:08:49.005953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.239676+0000","last_change":"2024-09-13T19:10:41.239708+0000","last_active":"2024-09-13T19:10:41.239676+0000","last_peered":"2024-09-13T19:10:41.239676+0000","last_clean":"2024-09-13T19:10:41.239676+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:10:41.239676+0000","last_undegraded":"2024-09-13T19:10:41.239676+0000","last_fullsized":"2024-09-13T19:10:41.239676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.239600+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:03.210937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.431486+0000","last_change":"2024-09-13T19:10:59.431549+0000","last_active":"2024-09-13T19:10:59.431486+0000","last_peered":"2024-09-13T19:10:59.431486+0000","last_clean":"2024-09-13T19:10:59.431486+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:10:59.431486+0000","last_undegraded":"2024-09-13T19:10:59.431486+0000","last_fullsized":"2024-09-13T19:10:59.431486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.431298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.872786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.114062+0000","last_change":"2024-09-13T19:10:45.114122+0000","last_active":"2024-09-13T19:10:45.114062+0000","last_peered":"2024-09-13T19:10:45.114062+0000","last_clean":"2024-09-13T19:10:45.114062+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:10:45.114062+0000","last_undegraded":"2024-09-13T19:10:45.114062+0000","last_fullsized":"2024-09-13T19:10:45.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.113869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.972412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.915985+0000","last_change":"2024-09-13T19:10:45.915985+0000","last_active":"2024-09-13T19:10:45.915985+0000","last_peered":"2024-09-13T19:10:45.915985+0000","last_clean":"2024-09-13T19:10:45.915985+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:10:45.915985+0000","last_undegraded":"2024-09-13T19:10:45.915985+0000","last_fullsized":"2024-09-13T19:10:45.915985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.915738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:39.816239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.072129+0000","last_change":"2024-09-13T19:10:43.072129+0000","last_active":"2024-09-13T19:10:43.072129+0000","last_peered":"2024-09-13T19:10:43.072129+0000","last_clean":"2024-09-13T19:10:43.072129+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:10:43.072129+0000","last_undegraded":"2024-09-13T19:10:43.072129+0000","last_fullsized":"2024-09-13T19:10:43.072129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.071868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:07.179556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.974650+0000","last_change":"2024-09-13T19:10:33.974650+0000","last_active":"2024-09-13T19:10:33.974650+0000","last_peered":"2024-09-13T19:10:33.974650+0000","last_clean":"2024-09-13T19:10:33.974650+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:10:33.974650+0000","last_undegraded":"2024-09-13T19:10:33.974650+0000","last_fullsized":"2024-09-13T19:10:33.974650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.974412+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:55.945748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.173537+0000","last_change":"2024-09-13T19:10:36.173537+0000","last_active":"2024-09-13T19:10:36.173537+0000","last_peered":"2024-09-13T19:10:36.173537+0000","last_clean":"2024-09-13T19:10:36.173537+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:10:36.173537+0000","last_undegraded":"2024-09-13T19:10:36.173537+0000","last_fullsized":"2024-09-13T19:10:36.173537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.173259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:23.309455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.919051+0000","last_change":"2024-09-13T19:10:26.919051+0000","last_active":"2024-09-13T19:10:26.919051+0000","last_peered":"2024-09-13T19:10:26.919051+0000","last_clean":"2024-09-13T19:10:26.919051+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:10:26.919051+0000","last_undegraded":"2024-09-13T19:10:26.919051+0000","last_fullsized":"2024-09-13T19:10:26.919051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.918796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:56.283130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.953812+0000","last_change":"2024-09-13T19:10:58.953812+0000","last_active":"2024-09-13T19:10:58.953812+0000","last_peered":"2024-09-13T19:10:58.953812+0000","last_clean":"2024-09-13T19:10:58.953812+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:10:58.953812+0000","last_undegraded":"2024-09-13T19:10:58.953812+0000","last_fullsized":"2024-09-13T19:10:58.953812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.953532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:41.900118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.426223+0000","last_change":"2024-09-13T19:10:42.426283+0000","last_active":"2024-09-13T19:10:42.426223+0000","last_peered":"2024-09-13T19:10:42.426223+0000","last_clean":"2024-09-13T19:10:42.426223+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:10:42.426223+0000","last_undegraded":"2024-09-13T19:10:42.426223+0000","last_fullsized":"2024-09-13T19:10:42.426223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.425992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:20.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.052015+0000","last_change":"2024-09-13T19:10:47.052015+0000","last_active":"2024-09-13T19:10:47.052015+0000","last_peered":"2024-09-13T19:10:47.052015+0000","last_clean":"2024-09-13T19:10:47.052015+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:10:47.052015+0000","last_undegraded":"2024-09-13T19:10:47.052015+0000","last_fullsized":"2024-09-13T19:10:47.052015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.051626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:27.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.250949+0000","last_change":"2024-09-13T19:10:39.251015+0000","last_active":"2024-09-13T19:10:39.250949+0000","last_peered":"2024-09-13T19:10:39.250949+0000","last_clean":"2024-09-13T19:10:39.250949+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:10:39.250949+0000","last_undegraded":"2024-09-13T19:10:39.250949+0000","last_fullsized":"2024-09-13T19:10:39.250949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.250731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:13.731105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.465752+0000","last_change":"2024-09-13T19:10:43.465752+0000","last_active":"2024-09-13T19:10:43.465752+0000","last_peered":"2024-09-13T19:10:43.465752+0000","last_clean":"2024-09-13T19:10:43.465752+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:10:43.465752+0000","last_undegraded":"2024-09-13T19:10:43.465752+0000","last_fullsized":"2024-09-13T19:10:43.465752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.465496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:45.366067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.911687+0000","last_change":"2024-09-13T19:10:29.911854+0000","last_active":"2024-09-13T19:10:29.911687+0000","last_peered":"2024-09-13T19:10:29.911687+0000","last_clean":"2024-09-13T19:10:29.911687+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:10:29.911687+0000","last_undegraded":"2024-09-13T19:10:29.911687+0000","last_fullsized":"2024-09-13T19:10:29.911687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.911432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:31.527553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374299+0000","last_change":"2024-09-13T19:06:19.281841+0000","last_active":"2024-09-13T19:10:08.374299+0000","last_peered":"2024-09-13T19:10:08.374299+0000","last_clean":"2024-09-13T19:10:08.374299+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:10:08.374299+0000","last_undegraded":"2024-09-13T19:10:08.374299+0000","last_fullsized":"2024-09-13T19:10:08.374299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.837421+0000","last_change":"2024-09-13T19:11:04.837486+0000","last_active":"2024-09-13T19:11:04.837421+0000","last_peered":"2024-09-13T19:11:04.837421+0000","last_clean":"2024-09-13T19:11:04.837421+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:11:04.837421+0000","last_undegraded":"2024-09-13T19:11:04.837421+0000","last_fullsized":"2024-09-13T19:11:04.837421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.837235+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:36.605647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.989392+0000","last_change":"2024-09-13T19:10:54.989392+0000","last_active":"2024-09-13T19:10:54.989392+0000","last_peered":"2024-09-13T19:10:54.989392+0000","last_clean":"2024-09-13T19:10:54.989392+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:10:54.989392+0000","last_undegraded":"2024-09-13T19:10:54.989392+0000","last_fullsized":"2024-09-13T19:10:54.989392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.989104+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:26.683655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373757+0000","last_change":"2024-09-13T19:06:19.294421+0000","last_active":"2024-09-13T19:10:08.373757+0000","last_peered":"2024-09-13T19:10:08.373757+0000","last_clean":"2024-09-13T19:10:08.373757+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:10:08.373757+0000","last_undegraded":"2024-09-13T19:10:08.373757+0000","last_fullsized":"2024-09-13T19:10:08.373757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.972877+0000","last_change":"2024-09-13T19:10:12.972934+0000","last_active":"2024-09-13T19:10:12.972877+0000","last_peered":"2024-09-13T19:10:12.972877+0000","last_clean":"2024-09-13T19:10:12.972877+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:10:12.972877+0000","last_undegraded":"2024-09-13T19:10:12.972877+0000","last_fullsized":"2024-09-13T19:10:12.972877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.972679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:27.296223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.842913+0000","last_change":"2024-09-13T19:10:19.843011+0000","last_active":"2024-09-13T19:10:19.842913+0000","last_peered":"2024-09-13T19:10:19.842913+0000","last_clean":"2024-09-13T19:10:19.842913+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:19.842913+0000","last_undegraded":"2024-09-13T19:10:19.842913+0000","last_fullsized":"2024-09-13T19:10:19.842913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.842729+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:36.209477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.887782+0000","last_change":"2024-09-13T19:10:15.887880+0000","last_active":"2024-09-13T19:10:15.887782+0000","last_peered":"2024-09-13T19:10:15.887782+0000","last_clean":"2024-09-13T19:10:15.887782+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:10:15.887782+0000","last_undegraded":"2024-09-13T19:10:15.887782+0000","last_fullsized":"2024-09-13T19:10:15.887782+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.887546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:39.150730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.810878+0000","last_change":"2024-09-13T19:11:06.810986+0000","last_active":"2024-09-13T19:11:06.810878+0000","last_peered":"2024-09-13T19:11:06.810878+0000","last_clean":"2024-09-13T19:11:06.810878+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:11:06.810878+0000","last_undegraded":"2024-09-13T19:11:06.810878+0000","last_fullsized":"2024-09-13T19:11:06.810878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.810674+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:31.294809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.975078+0000","last_change":"2024-09-13T19:10:49.975142+0000","last_active":"2024-09-13T19:10:49.975078+0000","last_peered":"2024-09-13T19:10:49.975078+0000","last_clean":"2024-09-13T19:10:49.975078+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:10:49.975078+0000","last_undegraded":"2024-09-13T19:10:49.975078+0000","last_fullsized":"2024-09-13T19:10:49.975078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.974877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:08.294215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.035800+0000","last_change":"2024-09-13T19:10:54.035800+0000","last_active":"2024-09-13T19:10:54.035800+0000","last_peered":"2024-09-13T19:10:54.035800+0000","last_clean":"2024-09-13T19:10:54.035800+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:10:54.035800+0000","last_undegraded":"2024-09-13T19:10:54.035800+0000","last_fullsized":"2024-09-13T19:10:54.035800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:34.694748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.432482+0000","last_change":"2024-09-13T19:10:27.432482+0000","last_active":"2024-09-13T19:10:27.432482+0000","last_peered":"2024-09-13T19:10:27.432482+0000","last_clean":"2024-09-13T19:10:27.432482+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:10:27.432482+0000","last_undegraded":"2024-09-13T19:10:27.432482+0000","last_fullsized":"2024-09-13T19:10:27.432482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.432228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:29.048350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.866941+0000","last_change":"2024-09-13T19:10:10.867013+0000","last_active":"2024-09-13T19:10:10.866941+0000","last_peered":"2024-09-13T19:10:10.866941+0000","last_clean":"2024-09-13T19:10:10.866941+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:10:10.866941+0000","last_undegraded":"2024-09-13T19:10:10.866941+0000","last_fullsized":"2024-09-13T19:10:10.866941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.866745+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:48.102941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.912524+0000","last_change":"2024-09-13T19:10:31.912578+0000","last_active":"2024-09-13T19:10:31.912524+0000","last_peered":"2024-09-13T19:10:31.912524+0000","last_clean":"2024-09-13T19:10:31.912524+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:10:31.912524+0000","last_undegraded":"2024-09-13T19:10:31.912524+0000","last_fullsized":"2024-09-13T19:10:31.912524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:06.392672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.430859+0000","last_change":"2024-09-13T19:10:36.430935+0000","last_active":"2024-09-13T19:10:36.430859+0000","last_peered":"2024-09-13T19:10:36.430859+0000","last_clean":"2024-09-13T19:10:36.430859+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:10:36.430859+0000","last_undegraded":"2024-09-13T19:10:36.430859+0000","last_fullsized":"2024-09-13T19:10:36.430859+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.430640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.689712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.931091+0000","last_change":"2024-09-13T19:10:48.931258+0000","last_active":"2024-09-13T19:10:48.931091+0000","last_peered":"2024-09-13T19:10:48.931091+0000","last_clean":"2024-09-13T19:10:48.931091+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:10:48.931091+0000","last_undegraded":"2024-09-13T19:10:48.931091+0000","last_fullsized":"2024-09-13T19:10:48.931091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.930858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:24.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373687+0000","last_change":"2024-09-13T19:06:19.284119+0000","last_active":"2024-09-13T19:10:08.373687+0000","last_peered":"2024-09-13T19:10:08.373687+0000","last_clean":"2024-09-13T19:10:08.373687+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:10:08.373687+0000","last_undegraded":"2024-09-13T19:10:08.373687+0000","last_fullsized":"2024-09-13T19:10:08.373687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.425940+0000","last_change":"2024-09-13T19:10:25.425993+0000","last_active":"2024-09-13T19:10:25.425940+0000","last_peered":"2024-09-13T19:10:25.425940+0000","last_clean":"2024-09-13T19:10:25.425940+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:10:25.425940+0000","last_undegraded":"2024-09-13T19:10:25.425940+0000","last_fullsized":"2024-09-13T19:10:25.425940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.425753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:37.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.253379+0000","last_change":"2024-09-13T19:10:18.253379+0000","last_active":"2024-09-13T19:10:18.253379+0000","last_peered":"2024-09-13T19:10:18.253379+0000","last_clean":"2024-09-13T19:10:18.253379+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:10:18.253379+0000","last_undegraded":"2024-09-13T19:10:18.253379+0000","last_fullsized":"2024-09-13T19:10:18.253379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.252941+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:40.725492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":395,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.956351+0000","last_change":"2024-09-13T19:10:32.956410+0000","last_active":"2024-09-13T19:10:32.956351+0000","last_peered":"2024-09-13T19:10:32.956351+0000","last_clean":"2024-09-13T19:10:32.956351+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:32.956351+0000","last_undegraded":"2024-09-13T19:10:32.956351+0000","last_fullsized":"2024-09-13T19:10:32.956351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.956155+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:32.705617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.040421+0000","last_change":"2024-09-13T19:10:57.040480+0000","last_active":"2024-09-13T19:10:57.040421+0000","last_peered":"2024-09-13T19:10:57.040421+0000","last_clean":"2024-09-13T19:10:57.040421+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:10:57.040421+0000","last_undegraded":"2024-09-13T19:10:57.040421+0000","last_fullsized":"2024-09-13T19:10:57.040421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.040234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:15.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.435476+0000","last_change":"2024-09-13T19:10:37.435604+0000","last_active":"2024-09-13T19:10:37.435476+0000","last_peered":"2024-09-13T19:10:37.435476+0000","last_clean":"2024-09-13T19:10:37.435476+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:10:37.435476+0000","last_undegraded":"2024-09-13T19:10:37.435476+0000","last_fullsized":"2024-09-13T19:10:37.435476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.435250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:27.175964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.038490+0000","last_change":"2024-09-13T19:10:55.038490+0000","last_active":"2024-09-13T19:10:55.038490+0000","last_peered":"2024-09-13T19:10:55.038490+0000","last_clean":"2024-09-13T19:10:55.038490+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:10:55.038490+0000","last_undegraded":"2024-09-13T19:10:55.038490+0000","last_fullsized":"2024-09-13T19:10:55.038490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.038216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.971585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.881704+0000","last_change":"2024-09-13T19:10:14.881765+0000","last_active":"2024-09-13T19:10:14.881704+0000","last_peered":"2024-09-13T19:10:14.881704+0000","last_clean":"2024-09-13T19:10:14.881704+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:10:14.881704+0000","last_undegraded":"2024-09-13T19:10:14.881704+0000","last_fullsized":"2024-09-13T19:10:14.881704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.881511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:35.275730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.131235+0000","last_change":"2024-09-13T19:10:22.131313+0000","last_active":"2024-09-13T19:10:22.131235+0000","last_peered":"2024-09-13T19:10:22.131235+0000","last_clean":"2024-09-13T19:10:22.131235+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:22.131235+0000","last_undegraded":"2024-09-13T19:10:22.131235+0000","last_fullsized":"2024-09-13T19:10:22.131235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.131038+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:23.920744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.561428+0000","last_change":"2024-09-13T19:10:11.561428+0000","last_active":"2024-09-13T19:10:11.561428+0000","last_peered":"2024-09-13T19:10:11.561428+0000","last_clean":"2024-09-13T19:10:11.561428+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:11.561428+0000","last_undegraded":"2024-09-13T19:10:11.561428+0000","last_fullsized":"2024-09-13T19:10:11.561428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.561170+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:17.766610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.929670+0000","last_change":"2024-09-13T19:10:41.929670+0000","last_active":"2024-09-13T19:10:41.929670+0000","last_peered":"2024-09-13T19:10:41.929670+0000","last_clean":"2024-09-13T19:10:41.929670+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:10:41.929670+0000","last_undegraded":"2024-09-13T19:10:41.929670+0000","last_fullsized":"2024-09-13T19:10:41.929670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.929268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.427604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.054552+0000","last_change":"2024-09-13T19:10:48.054552+0000","last_active":"2024-09-13T19:10:48.054552+0000","last_peered":"2024-09-13T19:10:48.054552+0000","last_clean":"2024-09-13T19:10:48.054552+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:10:48.054552+0000","last_undegraded":"2024-09-13T19:10:48.054552+0000","last_fullsized":"2024-09-13T19:10:48.054552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.054273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:42.086766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.843983+0000","last_change":"2024-09-13T19:10:14.843983+0000","last_active":"2024-09-13T19:10:14.843983+0000","last_peered":"2024-09-13T19:10:14.843983+0000","last_clean":"2024-09-13T19:10:14.843983+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:10:14.843983+0000","last_undegraded":"2024-09-13T19:10:14.843983+0000","last_fullsized":"2024-09-13T19:10:14.843983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.843733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.242513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.232478+0000","last_change":"2024-09-13T19:10:15.232478+0000","last_active":"2024-09-13T19:10:15.232478+0000","last_peered":"2024-09-13T19:10:15.232478+0000","last_clean":"2024-09-13T19:10:15.232478+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:15.232478+0000","last_undegraded":"2024-09-13T19:10:15.232478+0000","last_fullsized":"2024-09-13T19:10:15.232478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.232187+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:36.639820+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.573027+0000","last_change":"2024-09-13T19:10:10.573027+0000","last_active":"2024-09-13T19:10:10.573027+0000","last_peered":"2024-09-13T19:10:10.573027+0000","last_clean":"2024-09-13T19:10:10.573027+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:10:10.573027+0000","last_undegraded":"2024-09-13T19:10:10.573027+0000","last_fullsized":"2024-09-13T19:10:10.573027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.572736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:15.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.062803+0000","last_change":"2024-09-13T19:10:29.062803+0000","last_active":"2024-09-13T19:10:29.062803+0000","last_peered":"2024-09-13T19:10:29.062803+0000","last_clean":"2024-09-13T19:10:29.062803+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:10:29.062803+0000","last_undegraded":"2024-09-13T19:10:29.062803+0000","last_fullsized":"2024-09-13T19:10:29.062803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.062532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:37.830227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.057410+0000","last_change":"2024-09-13T19:10:44.057477+0000","last_active":"2024-09-13T19:10:44.057410+0000","last_peered":"2024-09-13T19:10:44.057410+0000","last_clean":"2024-09-13T19:10:44.057410+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:10:44.057410+0000","last_undegraded":"2024-09-13T19:10:44.057410+0000","last_fullsized":"2024-09-13T19:10:44.057410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.057221+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:09.781010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.232296+0000","last_change":"2024-09-13T19:10:38.232296+0000","last_active":"2024-09-13T19:10:38.232296+0000","last_peered":"2024-09-13T19:10:38.232296+0000","last_clean":"2024-09-13T19:10:38.232296+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:10:38.232296+0000","last_undegraded":"2024-09-13T19:10:38.232296+0000","last_fullsized":"2024-09-13T19:10:38.232296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.232043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:00.008382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.047465+0000","last_change":"2024-09-13T19:11:00.047517+0000","last_active":"2024-09-13T19:11:00.047465+0000","last_peered":"2024-09-13T19:11:00.047465+0000","last_clean":"2024-09-13T19:11:00.047465+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:11:00.047465+0000","last_undegraded":"2024-09-13T19:11:00.047465+0000","last_fullsized":"2024-09-13T19:11:00.047465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.047252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:20.655684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.869718+0000","last_change":"2024-09-13T19:10:15.869718+0000","last_active":"2024-09-13T19:10:15.869718+0000","last_peered":"2024-09-13T19:10:15.869718+0000","last_clean":"2024-09-13T19:10:15.869718+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:15.869718+0000","last_undegraded":"2024-09-13T19:10:15.869718+0000","last_fullsized":"2024-09-13T19:10:15.869718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.869314+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.537473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.581959+0000","last_change":"2024-09-13T19:10:09.581959+0000","last_active":"2024-09-13T19:10:09.581959+0000","last_peered":"2024-09-13T19:10:09.581959+0000","last_clean":"2024-09-13T19:10:09.581959+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:10:09.581959+0000","last_undegraded":"2024-09-13T19:10:09.581959+0000","last_fullsized":"2024-09-13T19:10:09.581959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.581716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:02.986719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.803237+0000","last_change":"2024-09-13T19:11:05.803312+0000","last_active":"2024-09-13T19:11:05.803237+0000","last_peered":"2024-09-13T19:11:05.803237+0000","last_clean":"2024-09-13T19:11:05.803237+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:11:05.803237+0000","last_undegraded":"2024-09-13T19:11:05.803237+0000","last_fullsized":"2024-09-13T19:11:05.803237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.803047+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:47.920585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.029472+0000","last_change":"2024-09-13T19:10:58.029544+0000","last_active":"2024-09-13T19:10:58.029472+0000","last_peered":"2024-09-13T19:10:58.029472+0000","last_clean":"2024-09-13T19:10:58.029472+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:10:58.029472+0000","last_undegraded":"2024-09-13T19:10:58.029472+0000","last_fullsized":"2024-09-13T19:10:58.029472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.029287+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:51.352757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.961540+0000","last_change":"2024-09-13T19:10:58.961603+0000","last_active":"2024-09-13T19:10:58.961540+0000","last_peered":"2024-09-13T19:10:58.961540+0000","last_clean":"2024-09-13T19:10:58.961540+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:10:58.961540+0000","last_undegraded":"2024-09-13T19:10:58.961540+0000","last_fullsized":"2024-09-13T19:10:58.961540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.961359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:40.944452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.463320+0000","last_change":"2024-09-13T19:10:26.463320+0000","last_active":"2024-09-13T19:10:26.463320+0000","last_peered":"2024-09-13T19:10:26.463320+0000","last_clean":"2024-09-13T19:10:26.463320+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:10:26.463320+0000","last_undegraded":"2024-09-13T19:10:26.463320+0000","last_fullsized":"2024-09-13T19:10:26.463320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.463075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:13.599270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.935492+0000","last_change":"2024-09-13T19:10:40.935492+0000","last_active":"2024-09-13T19:10:40.935492+0000","last_peered":"2024-09-13T19:10:40.935492+0000","last_clean":"2024-09-13T19:10:40.935492+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:40.935492+0000","last_undegraded":"2024-09-13T19:10:40.935492+0000","last_fullsized":"2024-09-13T19:10:40.935492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.935209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.770064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.631641+0000","last_change":"2024-09-13T19:10:07.631641+0000","last_active":"2024-09-13T19:10:07.631641+0000","last_peered":"2024-09-13T19:10:07.631641+0000","last_clean":"2024-09-13T19:10:07.631641+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:07.631641+0000","last_undegraded":"2024-09-13T19:10:07.631641+0000","last_fullsized":"2024-09-13T19:10:07.631641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.631538+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:44.867733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.571156+0000","last_change":"2024-09-13T19:11:07.571223+0000","last_active":"2024-09-13T19:11:07.571156+0000","last_peered":"2024-09-13T19:11:07.571156+0000","last_clean":"2024-09-13T19:11:07.571156+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:11:07.571156+0000","last_undegraded":"2024-09-13T19:11:07.571156+0000","last_fullsized":"2024-09-13T19:11:07.571156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.570954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:56.928125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.213822+0000","last_change":"2024-09-13T19:10:37.213822+0000","last_active":"2024-09-13T19:10:37.213822+0000","last_peered":"2024-09-13T19:10:37.213822+0000","last_clean":"2024-09-13T19:10:37.213822+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:10:37.213822+0000","last_undegraded":"2024-09-13T19:10:37.213822+0000","last_fullsized":"2024-09-13T19:10:37.213822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.213576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:38.829697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.894229+0000","last_change":"2024-09-13T19:11:06.894290+0000","last_active":"2024-09-13T19:11:06.894229+0000","last_peered":"2024-09-13T19:11:06.894229+0000","last_clean":"2024-09-13T19:11:06.894229+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:11:06.894229+0000","last_undegraded":"2024-09-13T19:11:06.894229+0000","last_fullsized":"2024-09-13T19:11:06.894229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.894042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:15.165505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.381653+0000","last_change":"2024-09-13T19:10:29.381653+0000","last_active":"2024-09-13T19:10:29.381653+0000","last_peered":"2024-09-13T19:10:29.381653+0000","last_clean":"2024-09-13T19:10:29.381653+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:10:29.381653+0000","last_undegraded":"2024-09-13T19:10:29.381653+0000","last_fullsized":"2024-09-13T19:10:29.381653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.381399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:03.861773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.751268+0000","last_change":"2024-09-13T19:10:23.751268+0000","last_active":"2024-09-13T19:10:23.751268+0000","last_peered":"2024-09-13T19:10:23.751268+0000","last_clean":"2024-09-13T19:10:23.751268+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:23.751268+0000","last_undegraded":"2024-09-13T19:10:23.751268+0000","last_fullsized":"2024-09-13T19:10:23.751268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'64","last_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_deep_scrub":"34'64","last_deep_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.750999+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:41.816580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.394449+0000","last_change":"2024-09-13T19:10:24.394449+0000","last_active":"2024-09-13T19:10:24.394449+0000","last_peered":"2024-09-13T19:10:24.394449+0000","last_clean":"2024-09-13T19:10:24.394449+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:10:24.394449+0000","last_undegraded":"2024-09-13T19:10:24.394449+0000","last_fullsized":"2024-09-13T19:10:24.394449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.394197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:46.758833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.516024+0000","last_change":"2024-09-13T19:11:04.516098+0000","last_active":"2024-09-13T19:11:04.516024+0000","last_peered":"2024-09-13T19:11:04.516024+0000","last_clean":"2024-09-13T19:11:04.516024+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:11:04.516024+0000","last_undegraded":"2024-09-13T19:11:04.516024+0000","last_fullsized":"2024-09-13T19:11:04.516024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.515837+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:03.482989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.044112+0000","last_change":"2024-09-13T19:10:41.044112+0000","last_active":"2024-09-13T19:10:41.044112+0000","last_peered":"2024-09-13T19:10:41.044112+0000","last_clean":"2024-09-13T19:10:41.044112+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:10:41.044112+0000","last_undegraded":"2024-09-13T19:10:41.044112+0000","last_fullsized":"2024-09-13T19:10:41.044112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.043868+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:35.076360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.514736+0000","last_change":"2024-09-13T19:10:53.514797+0000","last_active":"2024-09-13T19:10:53.514736+0000","last_peered":"2024-09-13T19:10:53.514736+0000","last_clean":"2024-09-13T19:10:53.514736+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:10:53.514736+0000","last_undegraded":"2024-09-13T19:10:53.514736+0000","last_fullsized":"2024-09-13T19:10:53.514736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.514542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:53.518567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.036506+0000","last_change":"2024-09-13T19:10:28.036506+0000","last_active":"2024-09-13T19:10:28.036506+0000","last_peered":"2024-09-13T19:10:28.036506+0000","last_clean":"2024-09-13T19:10:28.036506+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:10:28.036506+0000","last_undegraded":"2024-09-13T19:10:28.036506+0000","last_fullsized":"2024-09-13T19:10:28.036506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.036142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:37.355498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.832750+0000","last_change":"2024-09-13T19:10:09.832750+0000","last_active":"2024-09-13T19:10:09.832750+0000","last_peered":"2024-09-13T19:10:09.832750+0000","last_clean":"2024-09-13T19:10:09.832750+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:09.832750+0000","last_undegraded":"2024-09-13T19:10:09.832750+0000","last_fullsized":"2024-09-13T19:10:09.832750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.832440+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:33.388702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.941102+0000","last_change":"2024-09-13T19:10:30.941102+0000","last_active":"2024-09-13T19:10:30.941102+0000","last_peered":"2024-09-13T19:10:30.941102+0000","last_clean":"2024-09-13T19:10:30.941102+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:10:30.941102+0000","last_undegraded":"2024-09-13T19:10:30.941102+0000","last_fullsized":"2024-09-13T19:10:30.941102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:05.758351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376155+0000","last_change":"2024-09-13T19:06:29.323661+0000","last_active":"2024-09-13T19:10:08.376155+0000","last_peered":"2024-09-13T19:10:08.376155+0000","last_clean":"2024-09-13T19:10:08.376155+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:10:08.376155+0000","last_undegraded":"2024-09-13T19:10:08.376155+0000","last_fullsized":"2024-09-13T19:10:08.376155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.793652+0000","last_change":"2024-09-13T19:10:20.793652+0000","last_active":"2024-09-13T19:10:20.793652+0000","last_peered":"2024-09-13T19:10:20.793652+0000","last_clean":"2024-09-13T19:10:20.793652+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:10:20.793652+0000","last_undegraded":"2024-09-13T19:10:20.793652+0000","last_fullsized":"2024-09-13T19:10:20.793652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.793393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:48.213611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.922009+0000","last_change":"2024-09-13T19:11:02.922064+0000","last_active":"2024-09-13T19:11:02.922009+0000","last_peered":"2024-09-13T19:11:02.922009+0000","last_clean":"2024-09-13T19:11:02.922009+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:11:02.922009+0000","last_undegraded":"2024-09-13T19:11:02.922009+0000","last_fullsized":"2024-09-13T19:11:02.922009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.921808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:23.507567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.412680+0000","last_change":"2024-09-13T19:10:23.412680+0000","last_active":"2024-09-13T19:10:23.412680+0000","last_peered":"2024-09-13T19:10:23.412680+0000","last_clean":"2024-09-13T19:10:23.412680+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:10:23.412680+0000","last_undegraded":"2024-09-13T19:10:23.412680+0000","last_fullsized":"2024-09-13T19:10:23.412680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.412440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.127417+0000","last_change":"2024-09-13T19:10:23.127417+0000","last_active":"2024-09-13T19:10:23.127417+0000","last_peered":"2024-09-13T19:10:23.127417+0000","last_clean":"2024-09-13T19:10:23.127417+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:23.127417+0000","last_undegraded":"2024-09-13T19:10:23.127417+0000","last_fullsized":"2024-09-13T19:10:23.127417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.127136+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:43.153291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":446,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.210977+0000","last_change":"2024-09-13T19:10:13.210977+0000","last_active":"2024-09-13T19:10:13.210977+0000","last_peered":"2024-09-13T19:10:13.210977+0000","last_clean":"2024-09-13T19:10:13.210977+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:13.210977+0000","last_undegraded":"2024-09-13T19:10:13.210977+0000","last_fullsized":"2024-09-13T19:10:13.210977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.210704+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:44.040477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.438358+0000","last_change":"2024-09-13T19:10:32.438358+0000","last_active":"2024-09-13T19:10:32.438358+0000","last_peered":"2024-09-13T19:10:32.438358+0000","last_clean":"2024-09-13T19:10:32.438358+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:10:32.438358+0000","last_undegraded":"2024-09-13T19:10:32.438358+0000","last_fullsized":"2024-09-13T19:10:32.438358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.438073+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:11.390223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.167545+0000","last_change":"2024-09-13T19:10:43.167545+0000","last_active":"2024-09-13T19:10:43.167545+0000","last_peered":"2024-09-13T19:10:43.167545+0000","last_clean":"2024-09-13T19:10:43.167545+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:10:43.167545+0000","last_undegraded":"2024-09-13T19:10:43.167545+0000","last_fullsized":"2024-09-13T19:10:43.167545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.167114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:09.024776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373513+0000","last_change":"2024-09-13T19:06:19.285415+0000","last_active":"2024-09-13T19:10:08.373513+0000","last_peered":"2024-09-13T19:10:08.373513+0000","last_clean":"2024-09-13T19:10:08.373513+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:10:08.373513+0000","last_undegraded":"2024-09-13T19:10:08.373513+0000","last_fullsized":"2024-09-13T19:10:08.373513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.959117+0000","last_change":"2024-09-13T19:10:22.959117+0000","last_active":"2024-09-13T19:10:22.959117+0000","last_peered":"2024-09-13T19:10:22.959117+0000","last_clean":"2024-09-13T19:10:22.959117+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:22.959117+0000","last_undegraded":"2024-09-13T19:10:22.959117+0000","last_fullsized":"2024-09-13T19:10:22.959117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.958854+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.913099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.814619+0000","last_change":"2024-09-13T19:10:21.814619+0000","last_active":"2024-09-13T19:10:21.814619+0000","last_peered":"2024-09-13T19:10:21.814619+0000","last_clean":"2024-09-13T19:10:21.814619+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:10:21.814619+0000","last_undegraded":"2024-09-13T19:10:21.814619+0000","last_fullsized":"2024-09-13T19:10:21.814619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.814367+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:33.492669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":483,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.986876+0000","last_change":"2024-09-13T19:10:23.986876+0000","last_active":"2024-09-13T19:10:23.986876+0000","last_peered":"2024-09-13T19:10:23.986876+0000","last_clean":"2024-09-13T19:10:23.986876+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:23.986876+0000","last_undegraded":"2024-09-13T19:10:23.986876+0000","last_fullsized":"2024-09-13T19:10:23.986876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.986531+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:04.057824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.150372+0000","last_change":"2024-09-13T19:10:21.150372+0000","last_active":"2024-09-13T19:10:21.150372+0000","last_peered":"2024-09-13T19:10:21.150372+0000","last_clean":"2024-09-13T19:10:21.150372+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:10:21.150372+0000","last_undegraded":"2024-09-13T19:10:21.150372+0000","last_fullsized":"2024-09-13T19:10:21.150372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.150108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:27.355549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.127264+0000","last_change":"2024-09-13T19:10:50.127264+0000","last_active":"2024-09-13T19:10:50.127264+0000","last_peered":"2024-09-13T19:10:50.127264+0000","last_clean":"2024-09-13T19:10:50.127264+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:10:50.127264+0000","last_undegraded":"2024-09-13T19:10:50.127264+0000","last_fullsized":"2024-09-13T19:10:50.127264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.127013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.451561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.876607+0000","last_change":"2024-09-13T19:11:03.876751+0000","last_active":"2024-09-13T19:11:03.876607+0000","last_peered":"2024-09-13T19:11:03.876607+0000","last_clean":"2024-09-13T19:11:03.876607+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:11:03.876607+0000","last_undegraded":"2024-09-13T19:11:03.876607+0000","last_fullsized":"2024-09-13T19:11:03.876607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.876376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:25.983099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.991613+0000","last_change":"2024-09-13T19:10:09.991613+0000","last_active":"2024-09-13T19:10:09.991613+0000","last_peered":"2024-09-13T19:10:09.991613+0000","last_clean":"2024-09-13T19:10:09.991613+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:10:09.991613+0000","last_undegraded":"2024-09-13T19:10:09.991613+0000","last_fullsized":"2024-09-13T19:10:09.991613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.991280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.624094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.862549+0000","last_change":"2024-09-13T19:10:12.862549+0000","last_active":"2024-09-13T19:10:12.862549+0000","last_peered":"2024-09-13T19:10:12.862549+0000","last_clean":"2024-09-13T19:10:12.862549+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:12.862549+0000","last_undegraded":"2024-09-13T19:10:12.862549+0000","last_fullsized":"2024-09-13T19:10:12.862549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.862157+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:03.704078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.251305+0000","last_change":"2024-09-13T19:10:10.251305+0000","last_active":"2024-09-13T19:10:10.251305+0000","last_peered":"2024-09-13T19:10:10.251305+0000","last_clean":"2024-09-13T19:10:10.251305+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:10:10.251305+0000","last_undegraded":"2024-09-13T19:10:10.251305+0000","last_fullsized":"2024-09-13T19:10:10.251305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.250951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:14.638874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.857657+0000","last_change":"2024-09-13T19:11:03.857726+0000","last_active":"2024-09-13T19:11:03.857657+0000","last_peered":"2024-09-13T19:11:03.857657+0000","last_clean":"2024-09-13T19:11:03.857657+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:11:03.857657+0000","last_undegraded":"2024-09-13T19:11:03.857657+0000","last_fullsized":"2024-09-13T19:11:03.857657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.857461+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:41.355797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.788819+0000","last_change":"2024-09-13T19:10:22.788819+0000","last_active":"2024-09-13T19:10:22.788819+0000","last_peered":"2024-09-13T19:10:22.788819+0000","last_clean":"2024-09-13T19:10:22.788819+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:10:22.788819+0000","last_undegraded":"2024-09-13T19:10:22.788819+0000","last_fullsized":"2024-09-13T19:10:22.788819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.788534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:11.221320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":217,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.047563+0000","last_change":"2024-09-13T19:10:54.047637+0000","last_active":"2024-09-13T19:10:54.047563+0000","last_peered":"2024-09-13T19:10:54.047563+0000","last_clean":"2024-09-13T19:10:54.047563+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:10:54.047563+0000","last_undegraded":"2024-09-13T19:10:54.047563+0000","last_fullsized":"2024-09-13T19:10:54.047563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.047370+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:04.396516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373046+0000","last_change":"2024-09-13T19:06:11.228761+0000","last_active":"2024-09-13T19:10:08.373046+0000","last_peered":"2024-09-13T19:10:08.373046+0000","last_clean":"2024-09-13T19:10:08.373046+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:10:08.373046+0000","last_undegraded":"2024-09-13T19:10:08.373046+0000","last_fullsized":"2024-09-13T19:10:08.373046+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.927200+0000","last_change":"2024-09-13T19:11:07.927265+0000","last_active":"2024-09-13T19:11:07.927200+0000","last_peered":"2024-09-13T19:11:07.927200+0000","last_clean":"2024-09-13T19:11:07.927200+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:11:07.927200+0000","last_undegraded":"2024-09-13T19:11:07.927200+0000","last_fullsized":"2024-09-13T19:11:07.927200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.926993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:16.838950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.925770+0000","last_change":"2024-09-13T19:10:17.925770+0000","last_active":"2024-09-13T19:10:17.925770+0000","last_peered":"2024-09-13T19:10:17.925770+0000","last_clean":"2024-09-13T19:10:17.925770+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:10:17.925770+0000","last_undegraded":"2024-09-13T19:10:17.925770+0000","last_fullsized":"2024-09-13T19:10:17.925770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.925452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:48.521596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.929532+0000","last_change":"2024-09-13T19:10:13.929532+0000","last_active":"2024-09-13T19:10:13.929532+0000","last_peered":"2024-09-13T19:10:13.929532+0000","last_clean":"2024-09-13T19:10:13.929532+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:13.929532+0000","last_undegraded":"2024-09-13T19:10:13.929532+0000","last_fullsized":"2024-09-13T19:10:13.929532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.929281+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:35.787824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.567264+0000","last_change":"2024-09-13T19:10:12.567264+0000","last_active":"2024-09-13T19:10:12.567264+0000","last_peered":"2024-09-13T19:10:12.567264+0000","last_clean":"2024-09-13T19:10:12.567264+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:10:12.567264+0000","last_undegraded":"2024-09-13T19:10:12.567264+0000","last_fullsized":"2024-09-13T19:10:12.567264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.567011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:35.830195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.197379+0000","last_change":"2024-09-13T19:10:17.197379+0000","last_active":"2024-09-13T19:10:17.197379+0000","last_peered":"2024-09-13T19:10:17.197379+0000","last_clean":"2024-09-13T19:10:17.197379+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:10:17.197379+0000","last_undegraded":"2024-09-13T19:10:17.197379+0000","last_fullsized":"2024-09-13T19:10:17.197379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.197010+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:54.433206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.949414+0000","last_change":"2024-09-13T19:10:53.949476+0000","last_active":"2024-09-13T19:10:53.949414+0000","last_peered":"2024-09-13T19:10:53.949414+0000","last_clean":"2024-09-13T19:10:53.949414+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:10:53.949414+0000","last_undegraded":"2024-09-13T19:10:53.949414+0000","last_fullsized":"2024-09-13T19:10:53.949414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.949220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:44.541345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373040+0000","last_change":"2024-09-13T19:06:11.226735+0000","last_active":"2024-09-13T19:10:08.373040+0000","last_peered":"2024-09-13T19:10:08.373040+0000","last_clean":"2024-09-13T19:10:08.373040+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:10:08.373040+0000","last_undegraded":"2024-09-13T19:10:08.373040+0000","last_fullsized":"2024-09-13T19:10:08.373040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.495700+0000","last_change":"2024-09-13T19:10:51.495761+0000","last_active":"2024-09-13T19:10:51.495700+0000","last_peered":"2024-09-13T19:10:51.495700+0000","last_clean":"2024-09-13T19:10:51.495700+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:10:51.495700+0000","last_undegraded":"2024-09-13T19:10:51.495700+0000","last_fullsized":"2024-09-13T19:10:51.495700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.495502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:01.844647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.969550+0000","last_change":"2024-09-13T19:10:10.969550+0000","last_active":"2024-09-13T19:10:10.969550+0000","last_peered":"2024-09-13T19:10:10.969550+0000","last_clean":"2024-09-13T19:10:10.969550+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:10.969550+0000","last_undegraded":"2024-09-13T19:10:10.969550+0000","last_fullsized":"2024-09-13T19:10:10.969550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.969289+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:28.059258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":518,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.847892+0000","last_change":"2024-09-13T19:10:08.847892+0000","last_active":"2024-09-13T19:10:08.847892+0000","last_peered":"2024-09-13T19:10:08.847892+0000","last_clean":"2024-09-13T19:10:08.847892+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:08.847892+0000","last_undegraded":"2024-09-13T19:10:08.847892+0000","last_fullsized":"2024-09-13T19:10:08.847892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'290","last_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_deep_scrub":"34'290","last_deep_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.847620+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:34.001690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.953784+0000","last_change":"2024-09-13T19:10:31.953784+0000","last_active":"2024-09-13T19:10:31.953784+0000","last_peered":"2024-09-13T19:10:31.953784+0000","last_clean":"2024-09-13T19:10:31.953784+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:10:31.953784+0000","last_undegraded":"2024-09-13T19:10:31.953784+0000","last_fullsized":"2024-09-13T19:10:31.953784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.953404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:26.886773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.995270+0000","last_change":"2024-09-13T19:10:35.995270+0000","last_active":"2024-09-13T19:10:35.995270+0000","last_peered":"2024-09-13T19:10:35.995270+0000","last_clean":"2024-09-13T19:10:35.995270+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:10:35.995270+0000","last_undegraded":"2024-09-13T19:10:35.995270+0000","last_fullsized":"2024-09-13T19:10:35.995270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.995027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.852689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.429059+0000","last_change":"2024-09-13T19:10:35.429059+0000","last_active":"2024-09-13T19:10:35.429059+0000","last_peered":"2024-09-13T19:10:35.429059+0000","last_clean":"2024-09-13T19:10:35.429059+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:10:35.429059+0000","last_undegraded":"2024-09-13T19:10:35.429059+0000","last_fullsized":"2024-09-13T19:10:35.429059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.428796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:58.222147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.088661+0000","last_change":"2024-09-13T19:10:47.088726+0000","last_active":"2024-09-13T19:10:47.088661+0000","last_peered":"2024-09-13T19:10:47.088661+0000","last_clean":"2024-09-13T19:10:47.088661+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:10:47.088661+0000","last_undegraded":"2024-09-13T19:10:47.088661+0000","last_fullsized":"2024-09-13T19:10:47.088661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.088396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:36.829110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.497142+0000","last_change":"2024-09-13T19:10:49.497201+0000","last_active":"2024-09-13T19:10:49.497142+0000","last_peered":"2024-09-13T19:10:49.497142+0000","last_clean":"2024-09-13T19:10:49.497142+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:10:49.497142+0000","last_undegraded":"2024-09-13T19:10:49.497142+0000","last_fullsized":"2024-09-13T19:10:49.497142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.496931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:05.613751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.077141+0000","last_change":"2024-09-13T19:11:01.077169+0000","last_active":"2024-09-13T19:11:01.077141+0000","last_peered":"2024-09-13T19:11:01.077141+0000","last_clean":"2024-09-13T19:11:01.077141+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:11:01.077141+0000","last_undegraded":"2024-09-13T19:11:01.077141+0000","last_fullsized":"2024-09-13T19:11:01.077141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.077063+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:41.862042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.258425+0000","last_change":"2024-09-13T19:10:19.258425+0000","last_active":"2024-09-13T19:10:19.258425+0000","last_peered":"2024-09-13T19:10:19.258425+0000","last_clean":"2024-09-13T19:10:19.258425+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:10:19.258425+0000","last_undegraded":"2024-09-13T19:10:19.258425+0000","last_fullsized":"2024-09-13T19:10:19.258425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.258136+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:12.663138+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.475886+0000","last_change":"2024-09-13T19:10:20.475886+0000","last_active":"2024-09-13T19:10:20.475886+0000","last_peered":"2024-09-13T19:10:20.475886+0000","last_clean":"2024-09-13T19:10:20.475886+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:10:20.475886+0000","last_undegraded":"2024-09-13T19:10:20.475886+0000","last_fullsized":"2024-09-13T19:10:20.475886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.475636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:23.310735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376201+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:10:08.376201+0000","last_peered":"2024-09-13T19:10:08.376201+0000","last_clean":"2024-09-13T19:10:08.376201+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:10:08.376201+0000","last_undegraded":"2024-09-13T19:10:08.376201+0000","last_fullsized":"2024-09-13T19:10:08.376201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.535919+0000","last_change":"2024-09-13T19:10:50.535980+0000","last_active":"2024-09-13T19:10:50.535919+0000","last_peered":"2024-09-13T19:10:50.535919+0000","last_clean":"2024-09-13T19:10:50.535919+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:10:50.535919+0000","last_undegraded":"2024-09-13T19:10:50.535919+0000","last_fullsized":"2024-09-13T19:10:50.535919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.535729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:30.458282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373053+0000","last_change":"2024-09-13T19:06:11.227983+0000","last_active":"2024-09-13T19:10:08.373053+0000","last_peered":"2024-09-13T19:10:08.373053+0000","last_clean":"2024-09-13T19:10:08.373053+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:10:08.373053+0000","last_undegraded":"2024-09-13T19:10:08.373053+0000","last_fullsized":"2024-09-13T19:10:08.373053+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.086466+0000","last_change":"2024-09-13T19:10:49.086566+0000","last_active":"2024-09-13T19:10:49.086466+0000","last_peered":"2024-09-13T19:10:49.086466+0000","last_clean":"2024-09-13T19:10:49.086466+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:10:49.086466+0000","last_undegraded":"2024-09-13T19:10:49.086466+0000","last_fullsized":"2024-09-13T19:10:49.086466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.086290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:02.473416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.413883+0000","last_change":"2024-09-13T19:10:31.413883+0000","last_active":"2024-09-13T19:10:31.413883+0000","last_peered":"2024-09-13T19:10:31.413883+0000","last_clean":"2024-09-13T19:10:31.413883+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:10:31.413883+0000","last_undegraded":"2024-09-13T19:10:31.413883+0000","last_fullsized":"2024-09-13T19:10:31.413883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.413619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.384956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.988168+0000","last_change":"2024-09-13T19:10:11.988168+0000","last_active":"2024-09-13T19:10:11.988168+0000","last_peered":"2024-09-13T19:10:11.988168+0000","last_clean":"2024-09-13T19:10:11.988168+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:10:11.988168+0000","last_undegraded":"2024-09-13T19:10:11.988168+0000","last_fullsized":"2024-09-13T19:10:11.988168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.987853+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.357172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.896017+0000","last_change":"2024-09-13T19:10:29.896017+0000","last_active":"2024-09-13T19:10:29.896017+0000","last_peered":"2024-09-13T19:10:29.896017+0000","last_clean":"2024-09-13T19:10:29.896017+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:10:29.896017+0000","last_undegraded":"2024-09-13T19:10:29.896017+0000","last_fullsized":"2024-09-13T19:10:29.896017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.895758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:10.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.809087+0000","last_change":"2024-09-13T19:11:07.809149+0000","last_active":"2024-09-13T19:11:07.809087+0000","last_peered":"2024-09-13T19:11:07.809087+0000","last_clean":"2024-09-13T19:11:07.809087+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:11:07.809087+0000","last_undegraded":"2024-09-13T19:11:07.809087+0000","last_fullsized":"2024-09-13T19:11:07.809087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.808901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:01.709401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.925703+0000","last_change":"2024-09-13T19:10:28.925703+0000","last_active":"2024-09-13T19:10:28.925703+0000","last_peered":"2024-09-13T19:10:28.925703+0000","last_clean":"2024-09-13T19:10:28.925703+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:10:28.925703+0000","last_undegraded":"2024-09-13T19:10:28.925703+0000","last_fullsized":"2024-09-13T19:10:28.925703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.925441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:16.061636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.066417+0000","last_change":"2024-09-13T19:10:51.066476+0000","last_active":"2024-09-13T19:10:51.066417+0000","last_peered":"2024-09-13T19:10:51.066417+0000","last_clean":"2024-09-13T19:10:51.066417+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:10:51.066417+0000","last_undegraded":"2024-09-13T19:10:51.066417+0000","last_fullsized":"2024-09-13T19:10:51.066417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.066198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:16.789987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.479112+0000","last_change":"2024-09-13T19:10:54.479173+0000","last_active":"2024-09-13T19:10:54.479112+0000","last_peered":"2024-09-13T19:10:54.479112+0000","last_clean":"2024-09-13T19:10:54.479112+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:10:54.479112+0000","last_undegraded":"2024-09-13T19:10:54.479112+0000","last_fullsized":"2024-09-13T19:10:54.479112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.478927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:49.935597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.424395+0000","last_change":"2024-09-13T19:10:33.424395+0000","last_active":"2024-09-13T19:10:33.424395+0000","last_peered":"2024-09-13T19:10:33.424395+0000","last_clean":"2024-09-13T19:10:33.424395+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:10:33.424395+0000","last_undegraded":"2024-09-13T19:10:33.424395+0000","last_fullsized":"2024-09-13T19:10:33.424395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.424001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:59.281664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.564973+0000","last_change":"2024-09-13T19:10:18.564973+0000","last_active":"2024-09-13T19:10:18.564973+0000","last_peered":"2024-09-13T19:10:18.564973+0000","last_clean":"2024-09-13T19:10:18.564973+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:18.564973+0000","last_undegraded":"2024-09-13T19:10:18.564973+0000","last_fullsized":"2024-09-13T19:10:18.564973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.564713+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:02.178317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.287984+0000","last_change":"2024-09-13T19:10:09.287984+0000","last_active":"2024-09-13T19:10:09.287984+0000","last_peered":"2024-09-13T19:10:09.287984+0000","last_clean":"2024-09-13T19:10:09.287984+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:10:09.287984+0000","last_undegraded":"2024-09-13T19:10:09.287984+0000","last_fullsized":"2024-09-13T19:10:09.287984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.287642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:27.524091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.573467+0000","last_change":"2024-09-13T19:11:08.573530+0000","last_active":"2024-09-13T19:11:08.573467+0000","last_peered":"2024-09-13T19:11:08.573467+0000","last_clean":"2024-09-13T19:11:08.573467+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:11:08.573467+0000","last_undegraded":"2024-09-13T19:11:08.573467+0000","last_fullsized":"2024-09-13T19:11:08.573467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.573284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:51.555269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.065219+0000","last_change":"2024-09-13T19:10:40.065315+0000","last_active":"2024-09-13T19:10:40.065219+0000","last_peered":"2024-09-13T19:10:40.065219+0000","last_clean":"2024-09-13T19:10:40.065219+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:10:40.065219+0000","last_undegraded":"2024-09-13T19:10:40.065219+0000","last_fullsized":"2024-09-13T19:10:40.065219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.065006+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:29.805720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.432436+0000","last_change":"2024-09-13T19:11:00.432501+0000","last_active":"2024-09-13T19:11:00.432436+0000","last_peered":"2024-09-13T19:11:00.432436+0000","last_clean":"2024-09-13T19:11:00.432436+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:11:00.432436+0000","last_undegraded":"2024-09-13T19:11:00.432436+0000","last_fullsized":"2024-09-13T19:11:00.432436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.432247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.873661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373117+0000","last_change":"2024-09-13T19:06:11.228167+0000","last_active":"2024-09-13T19:10:08.373117+0000","last_peered":"2024-09-13T19:10:08.373117+0000","last_clean":"2024-09-13T19:10:08.373117+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:10:08.373117+0000","last_undegraded":"2024-09-13T19:10:08.373117+0000","last_fullsized":"2024-09-13T19:10:08.373117+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.375130+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:10:08.375130+0000","last_peered":"2024-09-13T19:10:08.375130+0000","last_clean":"2024-09-13T19:10:08.375130+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:10:08.375130+0000","last_undegraded":"2024-09-13T19:10:08.375130+0000","last_fullsized":"2024-09-13T19:10:08.375130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.839664+0000","last_change":"2024-09-13T19:10:07.839664+0000","last_active":"2024-09-13T19:10:07.839664+0000","last_peered":"2024-09-13T19:10:07.839664+0000","last_clean":"2024-09-13T19:10:07.839664+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:10:07.839664+0000","last_undegraded":"2024-09-13T19:10:07.839664+0000","last_fullsized":"2024-09-13T19:10:07.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.839234+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.815476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":384,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.945197+0000","last_change":"2024-09-13T19:10:27.945197+0000","last_active":"2024-09-13T19:10:27.945197+0000","last_peered":"2024-09-13T19:10:27.945197+0000","last_clean":"2024-09-13T19:10:27.945197+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:27.945197+0000","last_undegraded":"2024-09-13T19:10:27.945197+0000","last_fullsized":"2024-09-13T19:10:27.945197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.944956+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.708373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.994412+0000","last_change":"2024-09-13T19:10:55.994412+0000","last_active":"2024-09-13T19:10:55.994412+0000","last_peered":"2024-09-13T19:10:55.994412+0000","last_clean":"2024-09-13T19:10:55.994412+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:10:55.994412+0000","last_undegraded":"2024-09-13T19:10:55.994412+0000","last_fullsized":"2024-09-13T19:10:55.994412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.994119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:19.655333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.800379+0000","last_change":"2024-09-13T19:10:26.800432+0000","last_active":"2024-09-13T19:10:26.800379+0000","last_peered":"2024-09-13T19:10:26.800379+0000","last_clean":"2024-09-13T19:10:26.800379+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:10:26.800379+0000","last_undegraded":"2024-09-13T19:10:26.800379+0000","last_fullsized":"2024-09-13T19:10:26.800379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.800155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:20.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373408+0000","last_change":"2024-09-13T19:06:19.294807+0000","last_active":"2024-09-13T19:10:08.373408+0000","last_peered":"2024-09-13T19:10:08.373408+0000","last_clean":"2024-09-13T19:10:08.373408+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:10:08.373408+0000","last_undegraded":"2024-09-13T19:10:08.373408+0000","last_fullsized":"2024-09-13T19:10:08.373408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.499876+0000","last_change":"2024-09-13T19:10:55.499929+0000","last_active":"2024-09-13T19:10:55.499876+0000","last_peered":"2024-09-13T19:10:55.499876+0000","last_clean":"2024-09-13T19:10:55.499876+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:10:55.499876+0000","last_undegraded":"2024-09-13T19:10:55.499876+0000","last_fullsized":"2024-09-13T19:10:55.499876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.499652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:20.972903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.988381+0000","last_change":"2024-09-13T19:10:08.988381+0000","last_active":"2024-09-13T19:10:08.988381+0000","last_peered":"2024-09-13T19:10:08.988381+0000","last_clean":"2024-09-13T19:10:08.988381+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:10:08.988381+0000","last_undegraded":"2024-09-13T19:10:08.988381+0000","last_fullsized":"2024-09-13T19:10:08.988381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.988147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.969133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.913475+0000","last_change":"2024-09-13T19:10:34.913475+0000","last_active":"2024-09-13T19:10:34.913475+0000","last_peered":"2024-09-13T19:10:34.913475+0000","last_clean":"2024-09-13T19:10:34.913475+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:10:34.913475+0000","last_undegraded":"2024-09-13T19:10:34.913475+0000","last_fullsized":"2024-09-13T19:10:34.913475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.913181+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:57.790048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.531059+0000","last_change":"2024-09-13T19:10:14.531059+0000","last_active":"2024-09-13T19:10:14.531059+0000","last_peered":"2024-09-13T19:10:14.531059+0000","last_clean":"2024-09-13T19:10:14.531059+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:14.531059+0000","last_undegraded":"2024-09-13T19:10:14.531059+0000","last_fullsized":"2024-09-13T19:10:14.531059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.530810+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:54.291531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.845668+0000","last_change":"2024-09-13T19:11:08.845731+0000","last_active":"2024-09-13T19:11:08.845668+0000","last_peered":"2024-09-13T19:11:08.845668+0000","last_clean":"2024-09-13T19:11:08.845668+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:11:08.845668+0000","last_undegraded":"2024-09-13T19:11:08.845668+0000","last_fullsized":"2024-09-13T19:11:08.845668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.845463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.202633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.085344+0000","last_change":"2024-09-13T19:10:55.085508+0000","last_active":"2024-09-13T19:10:55.085344+0000","last_peered":"2024-09-13T19:10:55.085344+0000","last_clean":"2024-09-13T19:10:55.085344+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:10:55.085344+0000","last_undegraded":"2024-09-13T19:10:55.085344+0000","last_fullsized":"2024-09-13T19:10:55.085344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.085114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.150695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.957696+0000","last_change":"2024-09-13T19:10:56.957756+0000","last_active":"2024-09-13T19:10:56.957696+0000","last_peered":"2024-09-13T19:10:56.957696+0000","last_clean":"2024-09-13T19:10:56.957696+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:10:56.957696+0000","last_undegraded":"2024-09-13T19:10:56.957696+0000","last_fullsized":"2024-09-13T19:10:56.957696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.957496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:22.430747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.373153+0000","last_change":"2024-09-13T19:06:11.228549+0000","last_active":"2024-09-13T19:10:08.373153+0000","last_peered":"2024-09-13T19:10:08.373153+0000","last_clean":"2024-09-13T19:10:08.373153+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:10:08.373153+0000","last_undegraded":"2024-09-13T19:10:08.373153+0000","last_fullsized":"2024-09-13T19:10:08.373153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:08.200935+0000","last_clean_scrub_stamp":"2024-09-13T19:06:08.200935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.832300+0000","last_change":"2024-09-13T19:10:18.832300+0000","last_active":"2024-09-13T19:10:18.832300+0000","last_peered":"2024-09-13T19:10:18.832300+0000","last_clean":"2024-09-13T19:10:18.832300+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:10:18.832300+0000","last_undegraded":"2024-09-13T19:10:18.832300+0000","last_fullsized":"2024-09-13T19:10:18.832300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.832064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:42.939752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.208010+0000","last_change":"2024-09-13T19:10:20.208010+0000","last_active":"2024-09-13T19:10:20.208010+0000","last_peered":"2024-09-13T19:10:20.208010+0000","last_clean":"2024-09-13T19:10:20.208010+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:20.208010+0000","last_undegraded":"2024-09-13T19:10:20.208010+0000","last_fullsized":"2024-09-13T19:10:20.208010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.207705+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:25.171811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.399306+0000","last_change":"2024-09-13T19:10:28.399306+0000","last_active":"2024-09-13T19:10:28.399306+0000","last_peered":"2024-09-13T19:10:28.399306+0000","last_clean":"2024-09-13T19:10:28.399306+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:10:28.399306+0000","last_undegraded":"2024-09-13T19:10:28.399306+0000","last_fullsized":"2024-09-13T19:10:28.399306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.399039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:50.175378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.121202+0000","last_change":"2024-09-13T19:10:25.121202+0000","last_active":"2024-09-13T19:10:25.121202+0000","last_peered":"2024-09-13T19:10:25.121202+0000","last_clean":"2024-09-13T19:10:25.121202+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:10:25.121202+0000","last_undegraded":"2024-09-13T19:10:25.121202+0000","last_fullsized":"2024-09-13T19:10:25.121202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.120954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.704432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.073645+0000","last_change":"2024-09-13T19:10:56.073718+0000","last_active":"2024-09-13T19:10:56.073645+0000","last_peered":"2024-09-13T19:10:56.073645+0000","last_clean":"2024-09-13T19:10:56.073645+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:10:56.073645+0000","last_undegraded":"2024-09-13T19:10:56.073645+0000","last_fullsized":"2024-09-13T19:10:56.073645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.073454+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:48.540359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.077566+0000","last_change":"2024-09-13T19:10:33.077566+0000","last_active":"2024-09-13T19:10:33.077566+0000","last_peered":"2024-09-13T19:10:33.077566+0000","last_clean":"2024-09-13T19:10:33.077566+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:10:33.077566+0000","last_undegraded":"2024-09-13T19:10:33.077566+0000","last_fullsized":"2024-09-13T19:10:33.077566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.077318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:02.423813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374037+0000","last_change":"2024-09-13T19:06:19.289738+0000","last_active":"2024-09-13T19:10:08.374037+0000","last_peered":"2024-09-13T19:10:08.374037+0000","last_clean":"2024-09-13T19:10:08.374037+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:10:08.374037+0000","last_undegraded":"2024-09-13T19:10:08.374037+0000","last_fullsized":"2024-09-13T19:10:08.374037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.945400+0000","last_change":"2024-09-13T19:10:20.945400+0000","last_active":"2024-09-13T19:10:20.945400+0000","last_peered":"2024-09-13T19:10:20.945400+0000","last_clean":"2024-09-13T19:10:20.945400+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:10:20.945400+0000","last_undegraded":"2024-09-13T19:10:20.945400+0000","last_fullsized":"2024-09-13T19:10:20.945400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.945028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:30.264384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.854611+0000","last_change":"2024-09-13T19:10:27.854611+0000","last_active":"2024-09-13T19:10:27.854611+0000","last_peered":"2024-09-13T19:10:27.854611+0000","last_clean":"2024-09-13T19:10:27.854611+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:27.854611+0000","last_undegraded":"2024-09-13T19:10:27.854611+0000","last_fullsized":"2024-09-13T19:10:27.854611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.854345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:28.517846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.951984+0000","last_change":"2024-09-13T19:10:43.951984+0000","last_active":"2024-09-13T19:10:43.951984+0000","last_peered":"2024-09-13T19:10:43.951984+0000","last_clean":"2024-09-13T19:10:43.951984+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:10:43.951984+0000","last_undegraded":"2024-09-13T19:10:43.951984+0000","last_fullsized":"2024-09-13T19:10:43.951984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.951573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:26.069111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.546488+0000","last_change":"2024-09-13T19:11:05.546551+0000","last_active":"2024-09-13T19:11:05.546488+0000","last_peered":"2024-09-13T19:11:05.546488+0000","last_clean":"2024-09-13T19:11:05.546488+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:11:05.546488+0000","last_undegraded":"2024-09-13T19:11:05.546488+0000","last_fullsized":"2024-09-13T19:11:05.546488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.546296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:23.305608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.081944+0000","last_change":"2024-09-13T19:10:42.081944+0000","last_active":"2024-09-13T19:10:42.081944+0000","last_peered":"2024-09-13T19:10:42.081944+0000","last_clean":"2024-09-13T19:10:42.081944+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:10:42.081944+0000","last_undegraded":"2024-09-13T19:10:42.081944+0000","last_fullsized":"2024-09-13T19:10:42.081944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.081677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:55.468803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.030305+0000","last_change":"2024-09-13T19:10:52.030305+0000","last_active":"2024-09-13T19:10:52.030305+0000","last_peered":"2024-09-13T19:10:52.030305+0000","last_clean":"2024-09-13T19:10:52.030305+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:10:52.030305+0000","last_undegraded":"2024-09-13T19:10:52.030305+0000","last_fullsized":"2024-09-13T19:10:52.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.030011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:30.173078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.867551+0000","last_change":"2024-09-13T19:10:17.867551+0000","last_active":"2024-09-13T19:10:17.867551+0000","last_peered":"2024-09-13T19:10:17.867551+0000","last_clean":"2024-09-13T19:10:17.867551+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:10:17.867551+0000","last_undegraded":"2024-09-13T19:10:17.867551+0000","last_fullsized":"2024-09-13T19:10:17.867551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.867308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:43.159936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.561532+0000","last_change":"2024-09-13T19:10:17.561532+0000","last_active":"2024-09-13T19:10:17.561532+0000","last_peered":"2024-09-13T19:10:17.561532+0000","last_clean":"2024-09-13T19:10:17.561532+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:10:17.561532+0000","last_undegraded":"2024-09-13T19:10:17.561532+0000","last_fullsized":"2024-09-13T19:10:17.561532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.561274+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:36.904388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.291104+0000","last_change":"2024-09-13T19:10:11.291104+0000","last_active":"2024-09-13T19:10:11.291104+0000","last_peered":"2024-09-13T19:10:11.291104+0000","last_clean":"2024-09-13T19:10:11.291104+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:10:11.291104+0000","last_undegraded":"2024-09-13T19:10:11.291104+0000","last_fullsized":"2024-09-13T19:10:11.291104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.290797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.828167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.545484+0000","last_change":"2024-09-13T19:11:06.545599+0000","last_active":"2024-09-13T19:11:06.545484+0000","last_peered":"2024-09-13T19:11:06.545484+0000","last_clean":"2024-09-13T19:11:06.545484+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:11:06.545484+0000","last_undegraded":"2024-09-13T19:11:06.545484+0000","last_fullsized":"2024-09-13T19:11:06.545484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.545207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:31.033367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.350522+0000","last_change":"2024-09-13T19:10:40.350522+0000","last_active":"2024-09-13T19:10:40.350522+0000","last_peered":"2024-09-13T19:10:40.350522+0000","last_clean":"2024-09-13T19:10:40.350522+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:10:40.350522+0000","last_undegraded":"2024-09-13T19:10:40.350522+0000","last_fullsized":"2024-09-13T19:10:40.350522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.350179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:04.457866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.272268+0000","last_change":"2024-09-13T19:10:40.272268+0000","last_active":"2024-09-13T19:10:40.272268+0000","last_peered":"2024-09-13T19:10:40.272268+0000","last_clean":"2024-09-13T19:10:40.272268+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:10:40.272268+0000","last_undegraded":"2024-09-13T19:10:40.272268+0000","last_fullsized":"2024-09-13T19:10:40.272268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.271992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:13.748357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.162360+0000","last_change":"2024-09-13T19:10:24.162360+0000","last_active":"2024-09-13T19:10:24.162360+0000","last_peered":"2024-09-13T19:10:24.162360+0000","last_clean":"2024-09-13T19:10:24.162360+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:10:24.162360+0000","last_undegraded":"2024-09-13T19:10:24.162360+0000","last_fullsized":"2024-09-13T19:10:24.162360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.162112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:54.758256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.521044+0000","last_change":"2024-09-13T19:10:19.521044+0000","last_active":"2024-09-13T19:10:19.521044+0000","last_peered":"2024-09-13T19:10:19.521044+0000","last_clean":"2024-09-13T19:10:19.521044+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:19.521044+0000","last_undegraded":"2024-09-13T19:10:19.521044+0000","last_fullsized":"2024-09-13T19:10:19.521044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.520627+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.918610+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.960335+0000","last_change":"2024-09-13T19:10:19.960335+0000","last_active":"2024-09-13T19:10:19.960335+0000","last_peered":"2024-09-13T19:10:19.960335+0000","last_clean":"2024-09-13T19:10:19.960335+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:10:19.960335+0000","last_undegraded":"2024-09-13T19:10:19.960335+0000","last_fullsized":"2024-09-13T19:10:19.960335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.960093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:12.950423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.895210+0000","last_change":"2024-09-13T19:10:51.895273+0000","last_active":"2024-09-13T19:10:51.895210+0000","last_peered":"2024-09-13T19:10:51.895210+0000","last_clean":"2024-09-13T19:10:51.895210+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:10:51.895210+0000","last_undegraded":"2024-09-13T19:10:51.895210+0000","last_fullsized":"2024-09-13T19:10:51.895210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.895017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:21.682090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.858131+0000","last_change":"2024-09-13T19:10:28.858131+0000","last_active":"2024-09-13T19:10:28.858131+0000","last_peered":"2024-09-13T19:10:28.858131+0000","last_clean":"2024-09-13T19:10:28.858131+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:10:28.858131+0000","last_undegraded":"2024-09-13T19:10:28.858131+0000","last_fullsized":"2024-09-13T19:10:28.858131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.857846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:49.466278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.907072+0000","last_change":"2024-09-13T19:11:00.907072+0000","last_active":"2024-09-13T19:11:00.907072+0000","last_peered":"2024-09-13T19:11:00.907072+0000","last_clean":"2024-09-13T19:11:00.907072+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:11:00.907072+0000","last_undegraded":"2024-09-13T19:11:00.907072+0000","last_fullsized":"2024-09-13T19:11:00.907072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.906816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:21.348304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.848901+0000","last_change":"2024-09-13T19:10:16.848901+0000","last_active":"2024-09-13T19:10:16.848901+0000","last_peered":"2024-09-13T19:10:16.848901+0000","last_clean":"2024-09-13T19:10:16.848901+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:10:16.848901+0000","last_undegraded":"2024-09-13T19:10:16.848901+0000","last_fullsized":"2024-09-13T19:10:16.848901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.848588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:18.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.179195+0000","last_change":"2024-09-13T19:10:16.179195+0000","last_active":"2024-09-13T19:10:16.179195+0000","last_peered":"2024-09-13T19:10:16.179195+0000","last_clean":"2024-09-13T19:10:16.179195+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:16.179195+0000","last_undegraded":"2024-09-13T19:10:16.179195+0000","last_fullsized":"2024-09-13T19:10:16.179195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.178926+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:09.694689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.208442+0000","last_change":"2024-09-13T19:10:14.208442+0000","last_active":"2024-09-13T19:10:14.208442+0000","last_peered":"2024-09-13T19:10:14.208442+0000","last_clean":"2024-09-13T19:10:14.208442+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:10:14.208442+0000","last_undegraded":"2024-09-13T19:10:14.208442+0000","last_fullsized":"2024-09-13T19:10:14.208442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.208183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:58.825796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.929476+0000","last_change":"2024-09-13T19:10:50.929555+0000","last_active":"2024-09-13T19:10:50.929476+0000","last_peered":"2024-09-13T19:10:50.929476+0000","last_clean":"2024-09-13T19:10:50.929476+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:10:50.929476+0000","last_undegraded":"2024-09-13T19:10:50.929476+0000","last_fullsized":"2024-09-13T19:10:50.929476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.929270+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.095083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.925896+0000","last_change":"2024-09-13T19:11:01.925896+0000","last_active":"2024-09-13T19:11:01.925896+0000","last_peered":"2024-09-13T19:11:01.925896+0000","last_clean":"2024-09-13T19:11:01.925896+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:11:01.925896+0000","last_undegraded":"2024-09-13T19:11:01.925896+0000","last_fullsized":"2024-09-13T19:11:01.925896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.925650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.270080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.424270+0000","last_change":"2024-09-13T19:10:30.424323+0000","last_active":"2024-09-13T19:10:30.424270+0000","last_peered":"2024-09-13T19:10:30.424270+0000","last_clean":"2024-09-13T19:10:30.424270+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:10:30.424270+0000","last_undegraded":"2024-09-13T19:10:30.424270+0000","last_fullsized":"2024-09-13T19:10:30.424270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.424045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:59.405032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.538829+0000","last_change":"2024-09-13T19:10:15.538905+0000","last_active":"2024-09-13T19:10:15.538829+0000","last_peered":"2024-09-13T19:10:15.538829+0000","last_clean":"2024-09-13T19:10:15.538829+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:15.538829+0000","last_undegraded":"2024-09-13T19:10:15.538829+0000","last_fullsized":"2024-09-13T19:10:15.538829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.538629+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.122107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.250816+0000","last_change":"2024-09-13T19:10:12.250870+0000","last_active":"2024-09-13T19:10:12.250816+0000","last_peered":"2024-09-13T19:10:12.250816+0000","last_clean":"2024-09-13T19:10:12.250816+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:10:12.250816+0000","last_undegraded":"2024-09-13T19:10:12.250816+0000","last_fullsized":"2024-09-13T19:10:12.250816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:10.938731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.505486+0000","last_change":"2024-09-13T19:11:03.505486+0000","last_active":"2024-09-13T19:11:03.505486+0000","last_peered":"2024-09-13T19:11:03.505486+0000","last_clean":"2024-09-13T19:11:03.505486+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:11:03.505486+0000","last_undegraded":"2024-09-13T19:11:03.505486+0000","last_fullsized":"2024-09-13T19:11:03.505486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.505228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:53.171890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.467256+0000","last_change":"2024-09-13T19:10:52.467319+0000","last_active":"2024-09-13T19:10:52.467256+0000","last_peered":"2024-09-13T19:10:52.467256+0000","last_clean":"2024-09-13T19:10:52.467256+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:10:52.467256+0000","last_undegraded":"2024-09-13T19:10:52.467256+0000","last_fullsized":"2024-09-13T19:10:52.467256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.467064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.284557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.992274+0000","last_change":"2024-09-13T19:10:55.992274+0000","last_active":"2024-09-13T19:10:55.992274+0000","last_peered":"2024-09-13T19:10:55.992274+0000","last_clean":"2024-09-13T19:10:55.992274+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:10:55.992274+0000","last_undegraded":"2024-09-13T19:10:55.992274+0000","last_fullsized":"2024-09-13T19:10:55.992274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.991902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:55.741364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.038792+0000","last_change":"2024-09-13T19:10:27.038792+0000","last_active":"2024-09-13T19:10:27.038792+0000","last_peered":"2024-09-13T19:10:27.038792+0000","last_clean":"2024-09-13T19:10:27.038792+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:10:27.038792+0000","last_undegraded":"2024-09-13T19:10:27.038792+0000","last_fullsized":"2024-09-13T19:10:27.038792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.038560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:46.381674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.966398+0000","last_change":"2024-09-13T19:10:37.966601+0000","last_active":"2024-09-13T19:10:37.966398+0000","last_peered":"2024-09-13T19:10:37.966398+0000","last_clean":"2024-09-13T19:10:37.966398+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:37.966398+0000","last_undegraded":"2024-09-13T19:10:37.966398+0000","last_fullsized":"2024-09-13T19:10:37.966398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.966152+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:38.978338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.871929+0000","last_change":"2024-09-13T19:10:11.872063+0000","last_active":"2024-09-13T19:10:11.871929+0000","last_peered":"2024-09-13T19:10:11.871929+0000","last_clean":"2024-09-13T19:10:11.871929+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:10:11.871929+0000","last_undegraded":"2024-09-13T19:10:11.871929+0000","last_fullsized":"2024-09-13T19:10:11.871929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.871702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.344253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.920624+0000","last_change":"2024-09-13T19:10:59.920624+0000","last_active":"2024-09-13T19:10:59.920624+0000","last_peered":"2024-09-13T19:10:59.920624+0000","last_clean":"2024-09-13T19:10:59.920624+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:10:59.920624+0000","last_undegraded":"2024-09-13T19:10:59.920624+0000","last_fullsized":"2024-09-13T19:10:59.920624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.920373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:40.967193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.061617+0000","last_change":"2024-09-13T19:11:02.061682+0000","last_active":"2024-09-13T19:11:02.061617+0000","last_peered":"2024-09-13T19:11:02.061617+0000","last_clean":"2024-09-13T19:11:02.061617+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:11:02.061617+0000","last_undegraded":"2024-09-13T19:11:02.061617+0000","last_fullsized":"2024-09-13T19:11:02.061617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.061439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:36.878931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.088209+0000","last_change":"2024-09-13T19:10:49.088366+0000","last_active":"2024-09-13T19:10:49.088209+0000","last_peered":"2024-09-13T19:10:49.088209+0000","last_clean":"2024-09-13T19:10:49.088209+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:10:49.088209+0000","last_undegraded":"2024-09-13T19:10:49.088209+0000","last_fullsized":"2024-09-13T19:10:49.088209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.087937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:41.554842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.082445+0000","last_change":"2024-09-13T19:10:26.082518+0000","last_active":"2024-09-13T19:10:26.082445+0000","last_peered":"2024-09-13T19:10:26.082445+0000","last_clean":"2024-09-13T19:10:26.082445+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:26.082445+0000","last_undegraded":"2024-09-13T19:10:26.082445+0000","last_fullsized":"2024-09-13T19:10:26.082445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.082257+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.108750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.503964+0000","last_change":"2024-09-13T19:10:21.503964+0000","last_active":"2024-09-13T19:10:21.503964+0000","last_peered":"2024-09-13T19:10:21.503964+0000","last_clean":"2024-09-13T19:10:21.503964+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:21.503964+0000","last_undegraded":"2024-09-13T19:10:21.503964+0000","last_fullsized":"2024-09-13T19:10:21.503964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.503707+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:01.575001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.524503+0000","last_change":"2024-09-13T19:10:13.524503+0000","last_active":"2024-09-13T19:10:13.524503+0000","last_peered":"2024-09-13T19:10:13.524503+0000","last_clean":"2024-09-13T19:10:13.524503+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:10:13.524503+0000","last_undegraded":"2024-09-13T19:10:13.524503+0000","last_fullsized":"2024-09-13T19:10:13.524503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.524264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.550419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376390+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:10:08.376390+0000","last_peered":"2024-09-13T19:10:08.376390+0000","last_clean":"2024-09-13T19:10:08.376390+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:10:08.376390+0000","last_undegraded":"2024-09-13T19:10:08.376390+0000","last_fullsized":"2024-09-13T19:10:08.376390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.479965+0000","last_change":"2024-09-13T19:10:46.480028+0000","last_active":"2024-09-13T19:10:46.479965+0000","last_peered":"2024-09-13T19:10:46.479965+0000","last_clean":"2024-09-13T19:10:46.479965+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:10:46.479965+0000","last_undegraded":"2024-09-13T19:10:46.479965+0000","last_fullsized":"2024-09-13T19:10:46.479965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.479775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:43.497505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.991984+0000","last_change":"2024-09-13T19:10:57.992077+0000","last_active":"2024-09-13T19:10:57.991984+0000","last_peered":"2024-09-13T19:10:57.991984+0000","last_clean":"2024-09-13T19:10:57.991984+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:10:57.991984+0000","last_undegraded":"2024-09-13T19:10:57.991984+0000","last_fullsized":"2024-09-13T19:10:57.991984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.991795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:11.616420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.982887+0000","last_change":"2024-09-13T19:10:21.982937+0000","last_active":"2024-09-13T19:10:21.982887+0000","last_peered":"2024-09-13T19:10:21.982887+0000","last_clean":"2024-09-13T19:10:21.982887+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:10:21.982887+0000","last_undegraded":"2024-09-13T19:10:21.982887+0000","last_fullsized":"2024-09-13T19:10:21.982887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.982700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:30.750394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.948762+0000","last_change":"2024-09-13T19:10:36.948838+0000","last_active":"2024-09-13T19:10:36.948762+0000","last_peered":"2024-09-13T19:10:36.948762+0000","last_clean":"2024-09-13T19:10:36.948762+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:10:36.948762+0000","last_undegraded":"2024-09-13T19:10:36.948762+0000","last_fullsized":"2024-09-13T19:10:36.948762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.948531+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:54.759393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.250351+0000","last_change":"2024-09-13T19:10:08.250351+0000","last_active":"2024-09-13T19:10:08.250351+0000","last_peered":"2024-09-13T19:10:08.250351+0000","last_clean":"2024-09-13T19:10:08.250351+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:08.250351+0000","last_undegraded":"2024-09-13T19:10:08.250351+0000","last_fullsized":"2024-09-13T19:10:08.250351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.249922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:42.550124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376210+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:10:08.376210+0000","last_peered":"2024-09-13T19:10:08.376210+0000","last_clean":"2024-09-13T19:10:08.376210+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:10:08.376210+0000","last_undegraded":"2024-09-13T19:10:08.376210+0000","last_fullsized":"2024-09-13T19:10:08.376210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.125118+0000","last_change":"2024-09-13T19:10:35.125178+0000","last_active":"2024-09-13T19:10:35.125118+0000","last_peered":"2024-09-13T19:10:35.125118+0000","last_clean":"2024-09-13T19:10:35.125118+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:10:35.125118+0000","last_undegraded":"2024-09-13T19:10:35.125118+0000","last_fullsized":"2024-09-13T19:10:35.125118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.124924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:46.888340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.070017+0000","last_change":"2024-09-13T19:10:53.070082+0000","last_active":"2024-09-13T19:10:53.070017+0000","last_peered":"2024-09-13T19:10:53.070017+0000","last_clean":"2024-09-13T19:10:53.070017+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:10:53.070017+0000","last_undegraded":"2024-09-13T19:10:53.070017+0000","last_fullsized":"2024-09-13T19:10:53.070017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.069807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:13.678239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.937682+0000","last_change":"2024-09-13T19:10:18.937733+0000","last_active":"2024-09-13T19:10:18.937682+0000","last_peered":"2024-09-13T19:10:18.937682+0000","last_clean":"2024-09-13T19:10:18.937682+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:10:18.937682+0000","last_undegraded":"2024-09-13T19:10:18.937682+0000","last_fullsized":"2024-09-13T19:10:18.937682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.937494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:07.450855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.890149+0000","last_change":"2024-09-13T19:10:13.890226+0000","last_active":"2024-09-13T19:10:13.890149+0000","last_peered":"2024-09-13T19:10:13.890149+0000","last_clean":"2024-09-13T19:10:13.890149+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:13.890149+0000","last_undegraded":"2024-09-13T19:10:13.890149+0000","last_fullsized":"2024-09-13T19:10:13.890149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.889956+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:41.379481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.586378+0000","last_change":"2024-09-13T19:10:08.586502+0000","last_active":"2024-09-13T19:10:08.586378+0000","last_peered":"2024-09-13T19:10:08.586378+0000","last_clean":"2024-09-13T19:10:08.586378+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:10:08.586378+0000","last_undegraded":"2024-09-13T19:10:08.586378+0000","last_fullsized":"2024-09-13T19:10:08.586378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.586205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:31.058755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.888624+0000","last_change":"2024-09-13T19:11:02.888701+0000","last_active":"2024-09-13T19:11:02.888624+0000","last_peered":"2024-09-13T19:11:02.888624+0000","last_clean":"2024-09-13T19:11:02.888624+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:11:02.888624+0000","last_undegraded":"2024-09-13T19:11:02.888624+0000","last_fullsized":"2024-09-13T19:11:02.888624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.888433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:39.723288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.067777+0000","last_change":"2024-09-13T19:10:31.067914+0000","last_active":"2024-09-13T19:10:31.067777+0000","last_peered":"2024-09-13T19:10:31.067777+0000","last_clean":"2024-09-13T19:10:31.067777+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:10:31.067777+0000","last_undegraded":"2024-09-13T19:10:31.067777+0000","last_fullsized":"2024-09-13T19:10:31.067777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.067555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:11.138849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:49.006472+0000","last_change":"2024-09-13T19:06:19.296145+0000","last_active":"2024-09-13T19:08:49.006472+0000","last_peered":"2024-09-13T19:08:49.006472+0000","last_clean":"2024-09-13T19:08:49.006472+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:08:49.006472+0000","last_undegraded":"2024-09-13T19:08:49.006472+0000","last_fullsized":"2024-09-13T19:08:49.006472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.089342+0000","last_change":"2024-09-13T19:10:30.089399+0000","last_active":"2024-09-13T19:10:30.089342+0000","last_peered":"2024-09-13T19:10:30.089342+0000","last_clean":"2024-09-13T19:10:30.089342+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:10:30.089342+0000","last_undegraded":"2024-09-13T19:10:30.089342+0000","last_fullsized":"2024-09-13T19:10:30.089342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.089119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.043364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.454622+0000","last_change":"2024-09-13T19:10:22.454696+0000","last_active":"2024-09-13T19:10:22.454622+0000","last_peered":"2024-09-13T19:10:22.454622+0000","last_clean":"2024-09-13T19:10:22.454622+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:22.454622+0000","last_undegraded":"2024-09-13T19:10:22.454622+0000","last_fullsized":"2024-09-13T19:10:22.454622+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.454429+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:00.959003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.898700+0000","last_change":"2024-09-13T19:10:35.898752+0000","last_active":"2024-09-13T19:10:35.898700+0000","last_peered":"2024-09-13T19:10:35.898700+0000","last_clean":"2024-09-13T19:10:35.898700+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:10:35.898700+0000","last_undegraded":"2024-09-13T19:10:35.898700+0000","last_fullsized":"2024-09-13T19:10:35.898700+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.898496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.675915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:08:54.008313+0000","last_change":"2024-09-13T19:06:29.317758+0000","last_active":"2024-09-13T19:08:54.008313+0000","last_peered":"2024-09-13T19:08:54.008313+0000","last_clean":"2024-09-13T19:08:54.008313+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:08:54.008313+0000","last_undegraded":"2024-09-13T19:08:54.008313+0000","last_fullsized":"2024-09-13T19:08:54.008313+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.041465+0000","last_change":"2024-09-13T19:10:59.041600+0000","last_active":"2024-09-13T19:10:59.041465+0000","last_peered":"2024-09-13T19:10:59.041465+0000","last_clean":"2024-09-13T19:10:59.041465+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:10:59.041465+0000","last_undegraded":"2024-09-13T19:10:59.041465+0000","last_fullsized":"2024-09-13T19:10:59.041465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.041190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:59.704690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.456459+0000","last_change":"2024-09-13T19:11:01.456519+0000","last_active":"2024-09-13T19:11:01.456459+0000","last_peered":"2024-09-13T19:11:01.456459+0000","last_clean":"2024-09-13T19:11:01.456459+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:11:01.456459+0000","last_undegraded":"2024-09-13T19:11:01.456459+0000","last_fullsized":"2024-09-13T19:11:01.456459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.456156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:12.616137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.987986+0000","last_change":"2024-09-13T19:10:24.988040+0000","last_active":"2024-09-13T19:10:24.987986+0000","last_peered":"2024-09-13T19:10:24.987986+0000","last_clean":"2024-09-13T19:10:24.987986+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:10:24.987986+0000","last_undegraded":"2024-09-13T19:10:24.987986+0000","last_fullsized":"2024-09-13T19:10:24.987986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.987790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.492363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.936225+0000","last_change":"2024-09-13T19:10:38.936353+0000","last_active":"2024-09-13T19:10:38.936225+0000","last_peered":"2024-09-13T19:10:38.936225+0000","last_clean":"2024-09-13T19:10:38.936225+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:38.936225+0000","last_undegraded":"2024-09-13T19:10:38.936225+0000","last_fullsized":"2024-09-13T19:10:38.936225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.935949+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:31.557189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.947911+0000","last_change":"2024-09-13T19:10:39.947969+0000","last_active":"2024-09-13T19:10:39.947911+0000","last_peered":"2024-09-13T19:10:39.947911+0000","last_clean":"2024-09-13T19:10:39.947911+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:10:39.947911+0000","last_undegraded":"2024-09-13T19:10:39.947911+0000","last_fullsized":"2024-09-13T19:10:39.947911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.947716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:39.389129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:09:38.061934+0000","last_change":"2024-09-13T19:06:29.315679+0000","last_active":"2024-09-13T19:09:38.061934+0000","last_peered":"2024-09-13T19:09:38.061934+0000","last_clean":"2024-09-13T19:09:38.061934+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:09:38.061934+0000","last_undegraded":"2024-09-13T19:09:38.061934+0000","last_fullsized":"2024-09-13T19:09:38.061934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.071401+0000","last_change":"2024-09-13T19:10:32.071527+0000","last_active":"2024-09-13T19:10:32.071401+0000","last_peered":"2024-09-13T19:10:32.071401+0000","last_clean":"2024-09-13T19:10:32.071401+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:10:32.071401+0000","last_undegraded":"2024-09-13T19:10:32.071401+0000","last_fullsized":"2024-09-13T19:10:32.071401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.071163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:10.575736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.125394+0000","last_change":"2024-09-13T19:10:51.125453+0000","last_active":"2024-09-13T19:10:51.125394+0000","last_peered":"2024-09-13T19:10:51.125394+0000","last_clean":"2024-09-13T19:10:51.125394+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:10:51.125394+0000","last_undegraded":"2024-09-13T19:10:51.125394+0000","last_fullsized":"2024-09-13T19:10:51.125394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.125199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.448668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.902984+0000","last_change":"2024-09-13T19:10:16.903047+0000","last_active":"2024-09-13T19:10:16.902984+0000","last_peered":"2024-09-13T19:10:16.902984+0000","last_clean":"2024-09-13T19:10:16.902984+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:10:16.902984+0000","last_undegraded":"2024-09-13T19:10:16.902984+0000","last_fullsized":"2024-09-13T19:10:16.902984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.902806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:19.703828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.918619+0000","last_change":"2024-09-13T19:10:33.918703+0000","last_active":"2024-09-13T19:10:33.918619+0000","last_peered":"2024-09-13T19:10:33.918619+0000","last_clean":"2024-09-13T19:10:33.918619+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:33.918619+0000","last_undegraded":"2024-09-13T19:10:33.918619+0000","last_fullsized":"2024-09-13T19:10:33.918619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.918433+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:50.289186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.519922+0000","last_change":"2024-09-13T19:10:16.520027+0000","last_active":"2024-09-13T19:10:16.519922+0000","last_peered":"2024-09-13T19:10:16.519922+0000","last_clean":"2024-09-13T19:10:16.519922+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:10:16.519922+0000","last_undegraded":"2024-09-13T19:10:16.519922+0000","last_fullsized":"2024-09-13T19:10:16.519922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.519636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:59.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.888253+0000","last_change":"2024-09-13T19:10:47.888253+0000","last_active":"2024-09-13T19:10:47.888253+0000","last_peered":"2024-09-13T19:10:47.888253+0000","last_clean":"2024-09-13T19:10:47.888253+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:10:47.888253+0000","last_undegraded":"2024-09-13T19:10:47.888253+0000","last_fullsized":"2024-09-13T19:10:47.888253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.887997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:30.869982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.028462+0000","last_change":"2024-09-13T19:10:46.028526+0000","last_active":"2024-09-13T19:10:46.028462+0000","last_peered":"2024-09-13T19:10:46.028462+0000","last_clean":"2024-09-13T19:10:46.028462+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:10:46.028462+0000","last_undegraded":"2024-09-13T19:10:46.028462+0000","last_fullsized":"2024-09-13T19:10:46.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.028259+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:47.928830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.107911+0000","last_change":"2024-09-13T19:10:46.107973+0000","last_active":"2024-09-13T19:10:46.107911+0000","last_peered":"2024-09-13T19:10:46.107911+0000","last_clean":"2024-09-13T19:10:46.107911+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:10:46.107911+0000","last_undegraded":"2024-09-13T19:10:46.107911+0000","last_fullsized":"2024-09-13T19:10:46.107911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.107689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:25.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.467731+0000","last_change":"2024-09-13T19:10:44.467791+0000","last_active":"2024-09-13T19:10:44.467731+0000","last_peered":"2024-09-13T19:10:44.467731+0000","last_clean":"2024-09-13T19:10:44.467731+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:10:44.467731+0000","last_undegraded":"2024-09-13T19:10:44.467731+0000","last_fullsized":"2024-09-13T19:10:44.467731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.467543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:25.126852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.461029+0000","last_change":"2024-09-13T19:10:57.461105+0000","last_active":"2024-09-13T19:10:57.461029+0000","last_peered":"2024-09-13T19:10:57.461029+0000","last_clean":"2024-09-13T19:10:57.461029+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:10:57.461029+0000","last_undegraded":"2024-09-13T19:10:57.461029+0000","last_fullsized":"2024-09-13T19:10:57.461029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.460837+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:40.407423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.983112+0000","last_change":"2024-09-13T19:10:56.983262+0000","last_active":"2024-09-13T19:10:56.983112+0000","last_peered":"2024-09-13T19:10:56.983112+0000","last_clean":"2024-09-13T19:10:56.983112+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:10:56.983112+0000","last_undegraded":"2024-09-13T19:10:56.983112+0000","last_fullsized":"2024-09-13T19:10:56.983112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.982857+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:46.123347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.828235+0000","last_change":"2024-09-13T19:11:04.828305+0000","last_active":"2024-09-13T19:11:04.828235+0000","last_peered":"2024-09-13T19:11:04.828235+0000","last_clean":"2024-09-13T19:11:04.828235+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:11:04.828235+0000","last_undegraded":"2024-09-13T19:11:04.828235+0000","last_fullsized":"2024-09-13T19:11:04.828235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.828016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:25.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.482729+0000","last_change":"2024-09-13T19:10:48.482795+0000","last_active":"2024-09-13T19:10:48.482729+0000","last_peered":"2024-09-13T19:10:48.482729+0000","last_clean":"2024-09-13T19:10:48.482729+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:10:48.482729+0000","last_undegraded":"2024-09-13T19:10:48.482729+0000","last_fullsized":"2024-09-13T19:10:48.482729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.482535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:41.806005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.473063+0000","last_change":"2024-09-13T19:10:56.473134+0000","last_active":"2024-09-13T19:10:56.473063+0000","last_peered":"2024-09-13T19:10:56.473063+0000","last_clean":"2024-09-13T19:10:56.473063+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:10:56.473063+0000","last_undegraded":"2024-09-13T19:10:56.473063+0000","last_fullsized":"2024-09-13T19:10:56.473063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.472869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:50.986688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.016974+0000","last_change":"2024-09-13T19:06:58.350700+0000","last_active":"2024-09-13T19:10:07.016974+0000","last_peered":"2024-09-13T19:10:07.016974+0000","last_clean":"2024-09-13T19:10:07.016974+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:10:07.016974+0000","last_undegraded":"2024-09-13T19:10:07.016974+0000","last_fullsized":"2024-09-13T19:10:07.016974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:20.219089+0000","last_clean_scrub_stamp":"2024-09-13T19:06:20.219089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.391394+0000","last_change":"2024-09-13T19:10:41.391471+0000","last_active":"2024-09-13T19:10:41.391394+0000","last_peered":"2024-09-13T19:10:41.391394+0000","last_clean":"2024-09-13T19:10:41.391394+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:10:41.391394+0000","last_undegraded":"2024-09-13T19:10:41.391394+0000","last_fullsized":"2024-09-13T19:10:41.391394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.391199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:07.114988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.939056+0000","last_change":"2024-09-13T19:10:32.939056+0000","last_active":"2024-09-13T19:10:32.939056+0000","last_peered":"2024-09-13T19:10:32.939056+0000","last_clean":"2024-09-13T19:10:32.939056+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:10:32.939056+0000","last_undegraded":"2024-09-13T19:10:32.939056+0000","last_fullsized":"2024-09-13T19:10:32.939056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.938814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:06.415179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.917014+0000","last_change":"2024-09-13T19:10:59.917125+0000","last_active":"2024-09-13T19:10:59.917014+0000","last_peered":"2024-09-13T19:10:59.917014+0000","last_clean":"2024-09-13T19:10:59.917014+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:10:59.917014+0000","last_undegraded":"2024-09-13T19:10:59.917014+0000","last_fullsized":"2024-09-13T19:10:59.917014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.916701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:00.071057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.492292+0000","last_change":"2024-09-13T19:11:02.492359+0000","last_active":"2024-09-13T19:11:02.492292+0000","last_peered":"2024-09-13T19:11:02.492292+0000","last_clean":"2024-09-13T19:11:02.492292+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:11:02.492292+0000","last_undegraded":"2024-09-13T19:11:02.492292+0000","last_fullsized":"2024-09-13T19:11:02.492292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.492090+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:11.373794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.127862+0000","last_change":"2024-09-13T19:10:44.127991+0000","last_active":"2024-09-13T19:10:44.127862+0000","last_peered":"2024-09-13T19:10:44.127862+0000","last_clean":"2024-09-13T19:10:44.127862+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:10:44.127862+0000","last_undegraded":"2024-09-13T19:10:44.127862+0000","last_fullsized":"2024-09-13T19:10:44.127862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.127604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:58.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.994450+0000","last_change":"2024-09-13T19:10:34.994578+0000","last_active":"2024-09-13T19:10:34.994450+0000","last_peered":"2024-09-13T19:10:34.994450+0000","last_clean":"2024-09-13T19:10:34.994450+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:10:34.994450+0000","last_undegraded":"2024-09-13T19:10:34.994450+0000","last_fullsized":"2024-09-13T19:10:34.994450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.994220+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.946370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.454678+0000","last_change":"2024-09-13T19:10:58.454739+0000","last_active":"2024-09-13T19:10:58.454678+0000","last_peered":"2024-09-13T19:10:58.454678+0000","last_clean":"2024-09-13T19:10:58.454678+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:10:58.454678+0000","last_undegraded":"2024-09-13T19:10:58.454678+0000","last_fullsized":"2024-09-13T19:10:58.454678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.454475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:58.608830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.046880+0000","last_change":"2024-09-13T19:10:48.046880+0000","last_active":"2024-09-13T19:10:48.046880+0000","last_peered":"2024-09-13T19:10:48.046880+0000","last_clean":"2024-09-13T19:10:48.046880+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:10:48.046880+0000","last_undegraded":"2024-09-13T19:10:48.046880+0000","last_fullsized":"2024-09-13T19:10:48.046880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.046612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:06.112193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.858499+0000","last_change":"2024-09-13T19:11:05.858555+0000","last_active":"2024-09-13T19:11:05.858499+0000","last_peered":"2024-09-13T19:11:05.858499+0000","last_clean":"2024-09-13T19:11:05.858499+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:11:05.858499+0000","last_undegraded":"2024-09-13T19:11:05.858499+0000","last_fullsized":"2024-09-13T19:11:05.858499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.858284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:55.214937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.972524+0000","last_change":"2024-09-13T19:10:42.972524+0000","last_active":"2024-09-13T19:10:42.972524+0000","last_peered":"2024-09-13T19:10:42.972524+0000","last_clean":"2024-09-13T19:10:42.972524+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:10:42.972524+0000","last_undegraded":"2024-09-13T19:10:42.972524+0000","last_fullsized":"2024-09-13T19:10:42.972524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.972147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:14.740560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.526647+0000","last_change":"2024-09-13T19:10:47.526647+0000","last_active":"2024-09-13T19:10:47.526647+0000","last_peered":"2024-09-13T19:10:47.526647+0000","last_clean":"2024-09-13T19:10:47.526647+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:10:47.526647+0000","last_undegraded":"2024-09-13T19:10:47.526647+0000","last_fullsized":"2024-09-13T19:10:47.526647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.526271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.850818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.424112+0000","last_change":"2024-09-13T19:10:38.424112+0000","last_active":"2024-09-13T19:10:38.424112+0000","last_peered":"2024-09-13T19:10:38.424112+0000","last_clean":"2024-09-13T19:10:38.424112+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:10:38.424112+0000","last_undegraded":"2024-09-13T19:10:38.424112+0000","last_fullsized":"2024-09-13T19:10:38.424112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.423850+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:32.456343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.070971+0000","last_change":"2024-09-13T19:10:45.070971+0000","last_active":"2024-09-13T19:10:45.070971+0000","last_peered":"2024-09-13T19:10:45.070971+0000","last_clean":"2024-09-13T19:10:45.070971+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:10:45.070971+0000","last_undegraded":"2024-09-13T19:10:45.070971+0000","last_fullsized":"2024-09-13T19:10:45.070971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.070599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:23.213665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.907546+0000","last_change":"2024-09-13T19:11:01.907590+0000","last_active":"2024-09-13T19:11:01.907546+0000","last_peered":"2024-09-13T19:11:01.907546+0000","last_clean":"2024-09-13T19:11:01.907546+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:11:01.907546+0000","last_undegraded":"2024-09-13T19:11:01.907546+0000","last_fullsized":"2024-09-13T19:11:01.907546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.907431+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:01.348844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.943573+0000","last_change":"2024-09-13T19:10:57.943633+0000","last_active":"2024-09-13T19:10:57.943573+0000","last_peered":"2024-09-13T19:10:57.943573+0000","last_clean":"2024-09-13T19:10:57.943573+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:10:57.943573+0000","last_undegraded":"2024-09-13T19:10:57.943573+0000","last_fullsized":"2024-09-13T19:10:57.943573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.943383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:35.094936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.042199+0000","last_change":"2024-09-13T19:10:38.042199+0000","last_active":"2024-09-13T19:10:38.042199+0000","last_peered":"2024-09-13T19:10:38.042199+0000","last_clean":"2024-09-13T19:10:38.042199+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:10:38.042199+0000","last_undegraded":"2024-09-13T19:10:38.042199+0000","last_fullsized":"2024-09-13T19:10:38.042199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.041895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:59.900437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.944353+0000","last_change":"2024-09-13T19:11:08.944495+0000","last_active":"2024-09-13T19:11:08.944353+0000","last_peered":"2024-09-13T19:11:08.944353+0000","last_clean":"2024-09-13T19:11:08.944353+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:11:08.944353+0000","last_undegraded":"2024-09-13T19:11:08.944353+0000","last_fullsized":"2024-09-13T19:11:08.944353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.944070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:24.191489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.907486+0000","last_change":"2024-09-13T19:10:30.907486+0000","last_active":"2024-09-13T19:10:30.907486+0000","last_peered":"2024-09-13T19:10:30.907486+0000","last_clean":"2024-09-13T19:10:30.907486+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:10:30.907486+0000","last_undegraded":"2024-09-13T19:10:30.907486+0000","last_fullsized":"2024-09-13T19:10:30.907486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.907226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:52.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.891559+0000","last_change":"2024-09-13T19:11:00.891617+0000","last_active":"2024-09-13T19:11:00.891559+0000","last_peered":"2024-09-13T19:11:00.891559+0000","last_clean":"2024-09-13T19:11:00.891559+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:11:00.891559+0000","last_undegraded":"2024-09-13T19:11:00.891559+0000","last_fullsized":"2024-09-13T19:11:00.891559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.891365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:24.920169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.753182+0000","last_change":"2024-09-13T19:10:25.753182+0000","last_active":"2024-09-13T19:10:25.753182+0000","last_peered":"2024-09-13T19:10:25.753182+0000","last_clean":"2024-09-13T19:10:25.753182+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:10:25.753182+0000","last_undegraded":"2024-09-13T19:10:25.753182+0000","last_fullsized":"2024-09-13T19:10:25.753182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.752912+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:44.077460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.105311+0000","last_change":"2024-09-13T19:10:34.105311+0000","last_active":"2024-09-13T19:10:34.105311+0000","last_peered":"2024-09-13T19:10:34.105311+0000","last_clean":"2024-09-13T19:10:34.105311+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:10:34.105311+0000","last_undegraded":"2024-09-13T19:10:34.105311+0000","last_fullsized":"2024-09-13T19:10:34.105311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.105056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:03.469390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.088306+0000","last_change":"2024-09-13T19:10:52.088373+0000","last_active":"2024-09-13T19:10:52.088306+0000","last_peered":"2024-09-13T19:10:52.088306+0000","last_clean":"2024-09-13T19:10:52.088306+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:10:52.088306+0000","last_undegraded":"2024-09-13T19:10:52.088306+0000","last_fullsized":"2024-09-13T19:10:52.088306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.088124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:52.751625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374056+0000","last_change":"2024-09-13T19:06:19.294750+0000","last_active":"2024-09-13T19:10:08.374056+0000","last_peered":"2024-09-13T19:10:08.374056+0000","last_clean":"2024-09-13T19:10:08.374056+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:10:08.374056+0000","last_undegraded":"2024-09-13T19:10:08.374056+0000","last_fullsized":"2024-09-13T19:10:08.374056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.374258+0000","last_change":"2024-09-13T19:06:19.279415+0000","last_active":"2024-09-13T19:10:08.374258+0000","last_peered":"2024-09-13T19:10:08.374258+0000","last_clean":"2024-09-13T19:10:08.374258+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:10:08.374258+0000","last_undegraded":"2024-09-13T19:10:08.374258+0000","last_fullsized":"2024-09-13T19:10:08.374258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:18.214388+0000","last_clean_scrub_stamp":"2024-09-13T19:06:18.214388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.413696+0000","last_change":"2024-09-13T19:10:34.413754+0000","last_active":"2024-09-13T19:10:34.413696+0000","last_peered":"2024-09-13T19:10:34.413696+0000","last_clean":"2024-09-13T19:10:34.413696+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:10:34.413696+0000","last_undegraded":"2024-09-13T19:10:34.413696+0000","last_fullsized":"2024-09-13T19:10:34.413696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.413506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:48.737050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.496556+0000","last_change":"2024-09-13T19:10:45.496556+0000","last_active":"2024-09-13T19:10:45.496556+0000","last_peered":"2024-09-13T19:10:45.496556+0000","last_clean":"2024-09-13T19:10:45.496556+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:10:45.496556+0000","last_undegraded":"2024-09-13T19:10:45.496556+0000","last_fullsized":"2024-09-13T19:10:45.496556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.496261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:03.561842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.018203+0000","last_change":"2024-09-13T19:10:39.018270+0000","last_active":"2024-09-13T19:10:39.018203+0000","last_peered":"2024-09-13T19:10:39.018203+0000","last_clean":"2024-09-13T19:10:39.018203+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:10:39.018203+0000","last_undegraded":"2024-09-13T19:10:39.018203+0000","last_fullsized":"2024-09-13T19:10:39.018203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.018018+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:18.277091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705728,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":741263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705729,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":450560,"data_stored":152715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:11:10.000 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.000 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.001 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.001 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.002 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.002 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.002 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.003 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.003 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.003 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.003 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.004 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.004 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.004 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.004 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.004 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T19:06:08.200935+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=8, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.005 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.005 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.006 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.006 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.006 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.006 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.007 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-13T19:06:20.219089+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=20, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.007 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.007 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T19:06:18.214388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=18, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:10.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:11:30.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:11:30.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec61d66640 1 Processor -- start 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec61d66640 1 -- start start 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec61d66640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec5c06dbd0 0x7fec5c131e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec61d66640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec5c071c10 con 0x7fec5c06d0e0 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec61d66640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fec5c072230 con 0x7fec5c06dbd0 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec5c06dbd0 0x7fec5c131e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec5c06d0e0 0x7fec5c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35242/0 (socket says 172.21.15.12:35242) 2024-09-13T19:11:30.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5b7fe640 1 -- 172.21.15.12:0/556798196 learned_addr learned my addr 172.21.15.12:0/556798196 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:11:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5affd640 1 -- 172.21.15.12:0/556798196 >> v1:172.21.15.12:6789/0 conn(0x7fec5c06d0e0 legacy=0x7fec5c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:30.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5affd640 1 -- 172.21.15.12:0/556798196 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c0709e0 con 0x7fec5c06dbd0 2024-09-13T19:11:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.136+0000 7fec5affd640 1 --2- 172.21.15.12:0/556798196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06dbd0 0x7fec5c131e60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fec50009740 tx=0x7fec5001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6177bb32746033 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:30.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5a7fc640 1 -- 172.21.15.12:0/556798196 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec500b0070 con 0x7fec5c06dbd0 2024-09-13T19:11:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5a7fc640 1 -- 172.21.15.12:0/556798196 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec500ab530 con 0x7fec5c06dbd0 2024-09-13T19:11:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5a7fc640 1 -- 172.21.15.12:0/556798196 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec500ab830 con 0x7fec5c06dbd0 2024-09-13T19:11:30.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/556798196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06dbd0 msgr2=0x7fec5c131e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 --2- 172.21.15.12:0/556798196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06dbd0 0x7fec5c131e60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fec50009740 tx=0x7fec5001c370 comp rx=0 tx=0).stop 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/556798196 shutdown_connections 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 --2- 172.21.15.12:0/556798196 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06dbd0 0x7fec5c131e60 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/556798196 >> 172.21.15.12:0/556798196 conn(0x7fec5c099a50 msgr2=0x7fec5c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/556798196 shutdown_connections 2024-09-13T19:11:30.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/556798196 wait complete. 2024-09-13T19:11:30.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 Processor -- start 2024-09-13T19:11:30.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- start start 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fec5c134d40 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40642/0 (socket says 172.21.15.12:40642) 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5b7fe640 1 -- 172.21.15.12:0/3667298093 learned_addr learned my addr 172.21.15.12:0/3667298093 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5b7fe640 1 -- 172.21.15.12:0/3667298093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5c12a770 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec5b7fe640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ca90 tx=0x7fec5400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec54018070 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec54004ca0 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec5c1291c0 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5400aa50 con 0x7fec5c06d0e0 2024-09-13T19:11:30.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec5c129c70 con 0x7fec5c06d0e0 2024-09-13T19:11:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fec5401b070 con 0x7fec5c06d0e0 2024-09-13T19:11:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.140+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec5c06d4c0 con 0x7fec5c06d0e0 2024-09-13T19:11:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.144+0000 7fec43fff640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 0x7fec48038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:30.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.144+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fec54048ef0 con 0x7fec5c06d0e0 2024-09-13T19:11:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.144+0000 7fec5affd640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 0x7fec48038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:30.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.144+0000 7fec5affd640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 0x7fec48038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec500ad000 tx=0x7fec500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:30.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.148+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fec5401c3b0 con 0x7fec5c06d0e0 2024-09-13T19:11:30.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.304+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fec5c126d30 con 0x7fec48035db0 2024-09-13T19:11:30.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.352+0000 7fec43fff640 1 -- 172.21.15.12:0/3667298093 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666306 (secure 0 0 0) 0x7fec5c126d30 con 0x7fec48035db0 2024-09-13T19:11:30.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:11:30.368 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 msgr2=0x7fec48038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 0x7fec48038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fec500ad000 tx=0x7fec500a6000 comp rx=0 tx=0).stop 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 msgr2=0x7fec5c129730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fec5400ca90 tx=0x7fec5400cf50 comp rx=0 tx=0).stop 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 shutdown_connections 2024-09-13T19:11:30.370 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7fec48035db0 0x7fec48038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 --2- 172.21.15.12:0/3667298093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec5c06d0e0 0x7fec5c129730 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 >> 172.21.15.12:0/3667298093 conn(0x7fec5c099a50 msgr2=0x7fec5c09b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 shutdown_connections 2024-09-13T19:11:30.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:30.356+0000 7fec61d66640 1 -- 172.21.15.12:0/3667298093 wait complete. 2024-09-13T19:11:30.377 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-13T19:11:29.058321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4795,"ondisk_log_size":4795,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1788524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005634"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.114644+0000","last_change":"2024-09-13T19:10:50.114706+0000","last_active":"2024-09-13T19:10:50.114644+0000","last_peered":"2024-09-13T19:10:50.114644+0000","last_clean":"2024-09-13T19:10:50.114644+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:10:50.114644+0000","last_undegraded":"2024-09-13T19:10:50.114644+0000","last_fullsized":"2024-09-13T19:10:50.114644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.114431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:14.222119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.965129+0000","last_change":"2024-09-13T19:10:25.965129+0000","last_active":"2024-09-13T19:10:25.965129+0000","last_peered":"2024-09-13T19:10:25.965129+0000","last_clean":"2024-09-13T19:10:25.965129+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:10:25.965129+0000","last_undegraded":"2024-09-13T19:10:25.965129+0000","last_fullsized":"2024-09-13T19:10:25.965129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.964881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:55.311376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.386765+0000","last_change":"2024-09-13T19:10:39.386834+0000","last_active":"2024-09-13T19:10:39.386765+0000","last_peered":"2024-09-13T19:10:39.386765+0000","last_clean":"2024-09-13T19:10:39.386765+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:10:39.386765+0000","last_undegraded":"2024-09-13T19:10:39.386765+0000","last_fullsized":"2024-09-13T19:10:39.386765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.386575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:52.773701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.885532+0000","last_change":"2024-09-13T19:10:46.885532+0000","last_active":"2024-09-13T19:10:46.885532+0000","last_peered":"2024-09-13T19:10:46.885532+0000","last_clean":"2024-09-13T19:10:46.885532+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:10:46.885532+0000","last_undegraded":"2024-09-13T19:10:46.885532+0000","last_fullsized":"2024-09-13T19:10:46.885532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.885150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:36.242321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:15.825230+0000","last_change":"2024-09-13T19:11:15.825340+0000","last_active":"2024-09-13T19:11:15.825230+0000","last_peered":"2024-09-13T19:11:15.825230+0000","last_clean":"2024-09-13T19:11:15.825230+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:11:15.825230+0000","last_undegraded":"2024-09-13T19:11:15.825230+0000","last_fullsized":"2024-09-13T19:11:15.825230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:15.824904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:15.824904+0000","last_clean_scrub_stamp":"2024-09-13T19:11:15.824904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.205165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.962280+0000","last_change":"2024-09-13T19:10:44.962280+0000","last_active":"2024-09-13T19:10:44.962280+0000","last_peered":"2024-09-13T19:10:44.962280+0000","last_clean":"2024-09-13T19:10:44.962280+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:10:44.962280+0000","last_undegraded":"2024-09-13T19:10:44.962280+0000","last_fullsized":"2024-09-13T19:10:44.962280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.961999+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:09.446134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.214987+0000","last_change":"2024-09-13T19:10:42.215120+0000","last_active":"2024-09-13T19:10:42.214987+0000","last_peered":"2024-09-13T19:10:42.214987+0000","last_clean":"2024-09-13T19:10:42.214987+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:10:42.214987+0000","last_undegraded":"2024-09-13T19:10:42.214987+0000","last_fullsized":"2024-09-13T19:10:42.214987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.214682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:21.166832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.929698+0000","last_change":"2024-09-13T19:10:52.929698+0000","last_active":"2024-09-13T19:10:52.929698+0000","last_peered":"2024-09-13T19:10:52.929698+0000","last_clean":"2024-09-13T19:10:52.929698+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:10:52.929698+0000","last_undegraded":"2024-09-13T19:10:52.929698+0000","last_fullsized":"2024-09-13T19:10:52.929698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.929326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:33.662146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:10.895840+0000","last_change":"2024-09-13T19:11:10.895840+0000","last_active":"2024-09-13T19:11:10.895840+0000","last_peered":"2024-09-13T19:11:10.895840+0000","last_clean":"2024-09-13T19:11:10.895840+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:11:10.895840+0000","last_undegraded":"2024-09-13T19:11:10.895840+0000","last_fullsized":"2024-09-13T19:11:10.895840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:10.895414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:10.895414+0000","last_clean_scrub_stamp":"2024-09-13T19:11:10.895414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:03.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.014802+0000","last_change":"2024-09-13T19:10:37.014859+0000","last_active":"2024-09-13T19:10:37.014802+0000","last_peered":"2024-09-13T19:10:37.014802+0000","last_clean":"2024-09-13T19:10:37.014802+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:10:37.014802+0000","last_undegraded":"2024-09-13T19:10:37.014802+0000","last_fullsized":"2024-09-13T19:10:37.014802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.014649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:51.338193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.025008+0000","last_change":"2024-09-13T19:10:53.025008+0000","last_active":"2024-09-13T19:10:53.025008+0000","last_peered":"2024-09-13T19:10:53.025008+0000","last_clean":"2024-09-13T19:10:53.025008+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:10:53.025008+0000","last_undegraded":"2024-09-13T19:10:53.025008+0000","last_fullsized":"2024-09-13T19:10:53.025008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.024751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:54.925323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.711657+0000","last_change":"2024-09-13T19:10:24.711657+0000","last_active":"2024-09-13T19:10:24.711657+0000","last_peered":"2024-09-13T19:10:24.711657+0000","last_clean":"2024-09-13T19:10:24.711657+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:10:24.711657+0000","last_undegraded":"2024-09-13T19:10:24.711657+0000","last_fullsized":"2024-09-13T19:10:24.711657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.711412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:17.178317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:16.804795+0000","last_change":"2024-09-13T19:11:16.804795+0000","last_active":"2024-09-13T19:11:16.804795+0000","last_peered":"2024-09-13T19:11:16.804795+0000","last_clean":"2024-09-13T19:11:16.804795+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:11:16.804795+0000","last_undegraded":"2024-09-13T19:11:16.804795+0000","last_fullsized":"2024-09-13T19:11:16.804795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:16.804506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:16.804506+0000","last_clean_scrub_stamp":"2024-09-13T19:11:16.804506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:32.048066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.239676+0000","last_change":"2024-09-13T19:10:41.239708+0000","last_active":"2024-09-13T19:10:41.239676+0000","last_peered":"2024-09-13T19:10:41.239676+0000","last_clean":"2024-09-13T19:10:41.239676+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:10:41.239676+0000","last_undegraded":"2024-09-13T19:10:41.239676+0000","last_fullsized":"2024-09-13T19:10:41.239676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.239600+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:03.210937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.431549+0000","last_change":"2024-09-13T19:10:59.431549+0000","last_active":"2024-09-13T19:10:59.431549+0000","last_peered":"2024-09-13T19:10:59.431549+0000","last_clean":"2024-09-13T19:10:59.431549+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:10:59.431549+0000","last_undegraded":"2024-09-13T19:10:59.431549+0000","last_fullsized":"2024-09-13T19:10:59.431549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.431298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.872786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.114062+0000","last_change":"2024-09-13T19:10:45.114122+0000","last_active":"2024-09-13T19:10:45.114062+0000","last_peered":"2024-09-13T19:10:45.114062+0000","last_clean":"2024-09-13T19:10:45.114062+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:10:45.114062+0000","last_undegraded":"2024-09-13T19:10:45.114062+0000","last_fullsized":"2024-09-13T19:10:45.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.113869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.972412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.915985+0000","last_change":"2024-09-13T19:10:45.915985+0000","last_active":"2024-09-13T19:10:45.915985+0000","last_peered":"2024-09-13T19:10:45.915985+0000","last_clean":"2024-09-13T19:10:45.915985+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:10:45.915985+0000","last_undegraded":"2024-09-13T19:10:45.915985+0000","last_fullsized":"2024-09-13T19:10:45.915985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.915738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:39.816239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.072129+0000","last_change":"2024-09-13T19:10:43.072129+0000","last_active":"2024-09-13T19:10:43.072129+0000","last_peered":"2024-09-13T19:10:43.072129+0000","last_clean":"2024-09-13T19:10:43.072129+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:10:43.072129+0000","last_undegraded":"2024-09-13T19:10:43.072129+0000","last_fullsized":"2024-09-13T19:10:43.072129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.071868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:07.179556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.974650+0000","last_change":"2024-09-13T19:10:33.974650+0000","last_active":"2024-09-13T19:10:33.974650+0000","last_peered":"2024-09-13T19:10:33.974650+0000","last_clean":"2024-09-13T19:10:33.974650+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:10:33.974650+0000","last_undegraded":"2024-09-13T19:10:33.974650+0000","last_fullsized":"2024-09-13T19:10:33.974650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.974412+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:55.945748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.173537+0000","last_change":"2024-09-13T19:10:36.173537+0000","last_active":"2024-09-13T19:10:36.173537+0000","last_peered":"2024-09-13T19:10:36.173537+0000","last_clean":"2024-09-13T19:10:36.173537+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:10:36.173537+0000","last_undegraded":"2024-09-13T19:10:36.173537+0000","last_fullsized":"2024-09-13T19:10:36.173537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.173259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:23.309455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.919051+0000","last_change":"2024-09-13T19:10:26.919051+0000","last_active":"2024-09-13T19:10:26.919051+0000","last_peered":"2024-09-13T19:10:26.919051+0000","last_clean":"2024-09-13T19:10:26.919051+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:10:26.919051+0000","last_undegraded":"2024-09-13T19:10:26.919051+0000","last_fullsized":"2024-09-13T19:10:26.919051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.918796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:56.283130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.953812+0000","last_change":"2024-09-13T19:10:58.953812+0000","last_active":"2024-09-13T19:10:58.953812+0000","last_peered":"2024-09-13T19:10:58.953812+0000","last_clean":"2024-09-13T19:10:58.953812+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:10:58.953812+0000","last_undegraded":"2024-09-13T19:10:58.953812+0000","last_fullsized":"2024-09-13T19:10:58.953812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.953532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:41.900118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.426283+0000","last_change":"2024-09-13T19:10:42.426283+0000","last_active":"2024-09-13T19:10:42.426283+0000","last_peered":"2024-09-13T19:10:42.426283+0000","last_clean":"2024-09-13T19:10:42.426283+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:10:42.426283+0000","last_undegraded":"2024-09-13T19:10:42.426283+0000","last_fullsized":"2024-09-13T19:10:42.426283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.425992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:20.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.052015+0000","last_change":"2024-09-13T19:10:47.052015+0000","last_active":"2024-09-13T19:10:47.052015+0000","last_peered":"2024-09-13T19:10:47.052015+0000","last_clean":"2024-09-13T19:10:47.052015+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:10:47.052015+0000","last_undegraded":"2024-09-13T19:10:47.052015+0000","last_fullsized":"2024-09-13T19:10:47.052015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.051626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:27.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.251015+0000","last_change":"2024-09-13T19:10:39.251015+0000","last_active":"2024-09-13T19:10:39.251015+0000","last_peered":"2024-09-13T19:10:39.251015+0000","last_clean":"2024-09-13T19:10:39.251015+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:10:39.251015+0000","last_undegraded":"2024-09-13T19:10:39.251015+0000","last_fullsized":"2024-09-13T19:10:39.251015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.250731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:13.731105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.465752+0000","last_change":"2024-09-13T19:10:43.465752+0000","last_active":"2024-09-13T19:10:43.465752+0000","last_peered":"2024-09-13T19:10:43.465752+0000","last_clean":"2024-09-13T19:10:43.465752+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:10:43.465752+0000","last_undegraded":"2024-09-13T19:10:43.465752+0000","last_fullsized":"2024-09-13T19:10:43.465752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.465496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:45.366067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.911854+0000","last_change":"2024-09-13T19:10:29.911854+0000","last_active":"2024-09-13T19:10:29.911854+0000","last_peered":"2024-09-13T19:10:29.911854+0000","last_clean":"2024-09-13T19:10:29.911854+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:10:29.911854+0000","last_undegraded":"2024-09-13T19:10:29.911854+0000","last_fullsized":"2024-09-13T19:10:29.911854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.911432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:31.527553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:23.741846+0000","last_change":"2024-09-13T19:11:23.741903+0000","last_active":"2024-09-13T19:11:23.741846+0000","last_peered":"2024-09-13T19:11:23.741846+0000","last_clean":"2024-09-13T19:11:23.741846+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:11:23.741846+0000","last_undegraded":"2024-09-13T19:11:23.741846+0000","last_fullsized":"2024-09-13T19:11:23.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:23.741637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:23.741637+0000","last_clean_scrub_stamp":"2024-09-13T19:11:23.741637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.826194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.837486+0000","last_change":"2024-09-13T19:11:04.837486+0000","last_active":"2024-09-13T19:11:04.837486+0000","last_peered":"2024-09-13T19:11:04.837486+0000","last_clean":"2024-09-13T19:11:04.837486+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:11:04.837486+0000","last_undegraded":"2024-09-13T19:11:04.837486+0000","last_fullsized":"2024-09-13T19:11:04.837486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.837235+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:36.605647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.989392+0000","last_change":"2024-09-13T19:10:54.989392+0000","last_active":"2024-09-13T19:10:54.989392+0000","last_peered":"2024-09-13T19:10:54.989392+0000","last_clean":"2024-09-13T19:10:54.989392+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:10:54.989392+0000","last_undegraded":"2024-09-13T19:10:54.989392+0000","last_fullsized":"2024-09-13T19:10:54.989392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.989104+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:26.683655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:09.908071+0000","last_change":"2024-09-13T19:11:09.908212+0000","last_active":"2024-09-13T19:11:09.908071+0000","last_peered":"2024-09-13T19:11:09.908071+0000","last_clean":"2024-09-13T19:11:09.908071+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:11:09.908071+0000","last_undegraded":"2024-09-13T19:11:09.908071+0000","last_fullsized":"2024-09-13T19:11:09.908071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:09.907831+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:09.907831+0000","last_clean_scrub_stamp":"2024-09-13T19:11:09.907831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:14.270691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.972934+0000","last_change":"2024-09-13T19:10:12.972934+0000","last_active":"2024-09-13T19:10:12.972934+0000","last_peered":"2024-09-13T19:10:12.972934+0000","last_clean":"2024-09-13T19:10:12.972934+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:10:12.972934+0000","last_undegraded":"2024-09-13T19:10:12.972934+0000","last_fullsized":"2024-09-13T19:10:12.972934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.972679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:27.296223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.843011+0000","last_change":"2024-09-13T19:10:19.843011+0000","last_active":"2024-09-13T19:10:19.843011+0000","last_peered":"2024-09-13T19:10:19.843011+0000","last_clean":"2024-09-13T19:10:19.843011+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:19.843011+0000","last_undegraded":"2024-09-13T19:10:19.843011+0000","last_fullsized":"2024-09-13T19:10:19.843011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.842729+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:36.209477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.887880+0000","last_change":"2024-09-13T19:10:15.887880+0000","last_active":"2024-09-13T19:10:15.887880+0000","last_peered":"2024-09-13T19:10:15.887880+0000","last_clean":"2024-09-13T19:10:15.887880+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:10:15.887880+0000","last_undegraded":"2024-09-13T19:10:15.887880+0000","last_fullsized":"2024-09-13T19:10:15.887880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.887546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:39.150730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.810986+0000","last_change":"2024-09-13T19:11:06.810986+0000","last_active":"2024-09-13T19:11:06.810986+0000","last_peered":"2024-09-13T19:11:06.810986+0000","last_clean":"2024-09-13T19:11:06.810986+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:11:06.810986+0000","last_undegraded":"2024-09-13T19:11:06.810986+0000","last_fullsized":"2024-09-13T19:11:06.810986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.810674+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:31.294809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.975142+0000","last_change":"2024-09-13T19:10:49.975142+0000","last_active":"2024-09-13T19:10:49.975142+0000","last_peered":"2024-09-13T19:10:49.975142+0000","last_clean":"2024-09-13T19:10:49.975142+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:10:49.975142+0000","last_undegraded":"2024-09-13T19:10:49.975142+0000","last_fullsized":"2024-09-13T19:10:49.975142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.974877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:08.294215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.035800+0000","last_change":"2024-09-13T19:10:54.035800+0000","last_active":"2024-09-13T19:10:54.035800+0000","last_peered":"2024-09-13T19:10:54.035800+0000","last_clean":"2024-09-13T19:10:54.035800+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:10:54.035800+0000","last_undegraded":"2024-09-13T19:10:54.035800+0000","last_fullsized":"2024-09-13T19:10:54.035800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:34.694748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.432482+0000","last_change":"2024-09-13T19:10:27.432482+0000","last_active":"2024-09-13T19:10:27.432482+0000","last_peered":"2024-09-13T19:10:27.432482+0000","last_clean":"2024-09-13T19:10:27.432482+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:10:27.432482+0000","last_undegraded":"2024-09-13T19:10:27.432482+0000","last_fullsized":"2024-09-13T19:10:27.432482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.432228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:29.048350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.867013+0000","last_change":"2024-09-13T19:10:10.867013+0000","last_active":"2024-09-13T19:10:10.867013+0000","last_peered":"2024-09-13T19:10:10.867013+0000","last_clean":"2024-09-13T19:10:10.867013+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:10:10.867013+0000","last_undegraded":"2024-09-13T19:10:10.867013+0000","last_fullsized":"2024-09-13T19:10:10.867013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.866745+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:48.102941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.912578+0000","last_change":"2024-09-13T19:10:31.912578+0000","last_active":"2024-09-13T19:10:31.912578+0000","last_peered":"2024-09-13T19:10:31.912578+0000","last_clean":"2024-09-13T19:10:31.912578+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:10:31.912578+0000","last_undegraded":"2024-09-13T19:10:31.912578+0000","last_fullsized":"2024-09-13T19:10:31.912578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:06.392672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.430935+0000","last_change":"2024-09-13T19:10:36.430935+0000","last_active":"2024-09-13T19:10:36.430935+0000","last_peered":"2024-09-13T19:10:36.430935+0000","last_clean":"2024-09-13T19:10:36.430935+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:10:36.430935+0000","last_undegraded":"2024-09-13T19:10:36.430935+0000","last_fullsized":"2024-09-13T19:10:36.430935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.430640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.689712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.931258+0000","last_change":"2024-09-13T19:10:48.931258+0000","last_active":"2024-09-13T19:10:48.931258+0000","last_peered":"2024-09-13T19:10:48.931258+0000","last_clean":"2024-09-13T19:10:48.931258+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:10:48.931258+0000","last_undegraded":"2024-09-13T19:10:48.931258+0000","last_fullsized":"2024-09-13T19:10:48.931258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.930858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:24.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:24.790374+0000","last_change":"2024-09-13T19:11:24.790430+0000","last_active":"2024-09-13T19:11:24.790374+0000","last_peered":"2024-09-13T19:11:24.790374+0000","last_clean":"2024-09-13T19:11:24.790374+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:11:24.790374+0000","last_undegraded":"2024-09-13T19:11:24.790374+0000","last_fullsized":"2024-09-13T19:11:24.790374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:24.790172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:24.790172+0000","last_clean_scrub_stamp":"2024-09-13T19:11:24.790172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:34.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.425993+0000","last_change":"2024-09-13T19:10:25.425993+0000","last_active":"2024-09-13T19:10:25.425993+0000","last_peered":"2024-09-13T19:10:25.425993+0000","last_clean":"2024-09-13T19:10:25.425993+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:10:25.425993+0000","last_undegraded":"2024-09-13T19:10:25.425993+0000","last_fullsized":"2024-09-13T19:10:25.425993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.425753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:37.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.253379+0000","last_change":"2024-09-13T19:10:18.253379+0000","last_active":"2024-09-13T19:10:18.253379+0000","last_peered":"2024-09-13T19:10:18.253379+0000","last_clean":"2024-09-13T19:10:18.253379+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:10:18.253379+0000","last_undegraded":"2024-09-13T19:10:18.253379+0000","last_fullsized":"2024-09-13T19:10:18.253379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.252941+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:40.725492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.956410+0000","last_change":"2024-09-13T19:10:32.956410+0000","last_active":"2024-09-13T19:10:32.956410+0000","last_peered":"2024-09-13T19:10:32.956410+0000","last_clean":"2024-09-13T19:10:32.956410+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:32.956410+0000","last_undegraded":"2024-09-13T19:10:32.956410+0000","last_fullsized":"2024-09-13T19:10:32.956410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.956155+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:32.705617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.040480+0000","last_change":"2024-09-13T19:10:57.040480+0000","last_active":"2024-09-13T19:10:57.040480+0000","last_peered":"2024-09-13T19:10:57.040480+0000","last_clean":"2024-09-13T19:10:57.040480+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:10:57.040480+0000","last_undegraded":"2024-09-13T19:10:57.040480+0000","last_fullsized":"2024-09-13T19:10:57.040480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.040234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:15.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.435604+0000","last_change":"2024-09-13T19:10:37.435604+0000","last_active":"2024-09-13T19:10:37.435604+0000","last_peered":"2024-09-13T19:10:37.435604+0000","last_clean":"2024-09-13T19:10:37.435604+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:10:37.435604+0000","last_undegraded":"2024-09-13T19:10:37.435604+0000","last_fullsized":"2024-09-13T19:10:37.435604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.435250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:27.175964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.038490+0000","last_change":"2024-09-13T19:10:55.038490+0000","last_active":"2024-09-13T19:10:55.038490+0000","last_peered":"2024-09-13T19:10:55.038490+0000","last_clean":"2024-09-13T19:10:55.038490+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:10:55.038490+0000","last_undegraded":"2024-09-13T19:10:55.038490+0000","last_fullsized":"2024-09-13T19:10:55.038490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.038216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.971585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.881765+0000","last_change":"2024-09-13T19:10:14.881765+0000","last_active":"2024-09-13T19:10:14.881765+0000","last_peered":"2024-09-13T19:10:14.881765+0000","last_clean":"2024-09-13T19:10:14.881765+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:10:14.881765+0000","last_undegraded":"2024-09-13T19:10:14.881765+0000","last_fullsized":"2024-09-13T19:10:14.881765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.881511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:35.275730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.131313+0000","last_change":"2024-09-13T19:10:22.131313+0000","last_active":"2024-09-13T19:10:22.131313+0000","last_peered":"2024-09-13T19:10:22.131313+0000","last_clean":"2024-09-13T19:10:22.131313+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:22.131313+0000","last_undegraded":"2024-09-13T19:10:22.131313+0000","last_fullsized":"2024-09-13T19:10:22.131313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.131038+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:23.920744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.561428+0000","last_change":"2024-09-13T19:10:11.561428+0000","last_active":"2024-09-13T19:10:11.561428+0000","last_peered":"2024-09-13T19:10:11.561428+0000","last_clean":"2024-09-13T19:10:11.561428+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:11.561428+0000","last_undegraded":"2024-09-13T19:10:11.561428+0000","last_fullsized":"2024-09-13T19:10:11.561428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.561170+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:17.766610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.929670+0000","last_change":"2024-09-13T19:10:41.929670+0000","last_active":"2024-09-13T19:10:41.929670+0000","last_peered":"2024-09-13T19:10:41.929670+0000","last_clean":"2024-09-13T19:10:41.929670+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:10:41.929670+0000","last_undegraded":"2024-09-13T19:10:41.929670+0000","last_fullsized":"2024-09-13T19:10:41.929670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.929268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.427604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.054552+0000","last_change":"2024-09-13T19:10:48.054552+0000","last_active":"2024-09-13T19:10:48.054552+0000","last_peered":"2024-09-13T19:10:48.054552+0000","last_clean":"2024-09-13T19:10:48.054552+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:10:48.054552+0000","last_undegraded":"2024-09-13T19:10:48.054552+0000","last_fullsized":"2024-09-13T19:10:48.054552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.054273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:42.086766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.843983+0000","last_change":"2024-09-13T19:10:14.843983+0000","last_active":"2024-09-13T19:10:14.843983+0000","last_peered":"2024-09-13T19:10:14.843983+0000","last_clean":"2024-09-13T19:10:14.843983+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:10:14.843983+0000","last_undegraded":"2024-09-13T19:10:14.843983+0000","last_fullsized":"2024-09-13T19:10:14.843983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.843733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.242513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.232478+0000","last_change":"2024-09-13T19:10:15.232478+0000","last_active":"2024-09-13T19:10:15.232478+0000","last_peered":"2024-09-13T19:10:15.232478+0000","last_clean":"2024-09-13T19:10:15.232478+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:15.232478+0000","last_undegraded":"2024-09-13T19:10:15.232478+0000","last_fullsized":"2024-09-13T19:10:15.232478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.232187+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:36.639820+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.573027+0000","last_change":"2024-09-13T19:10:10.573027+0000","last_active":"2024-09-13T19:10:10.573027+0000","last_peered":"2024-09-13T19:10:10.573027+0000","last_clean":"2024-09-13T19:10:10.573027+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:10:10.573027+0000","last_undegraded":"2024-09-13T19:10:10.573027+0000","last_fullsized":"2024-09-13T19:10:10.573027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.572736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:15.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.062803+0000","last_change":"2024-09-13T19:10:29.062803+0000","last_active":"2024-09-13T19:10:29.062803+0000","last_peered":"2024-09-13T19:10:29.062803+0000","last_clean":"2024-09-13T19:10:29.062803+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:10:29.062803+0000","last_undegraded":"2024-09-13T19:10:29.062803+0000","last_fullsized":"2024-09-13T19:10:29.062803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.062532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:37.830227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.057410+0000","last_change":"2024-09-13T19:10:44.057477+0000","last_active":"2024-09-13T19:10:44.057410+0000","last_peered":"2024-09-13T19:10:44.057410+0000","last_clean":"2024-09-13T19:10:44.057410+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:10:44.057410+0000","last_undegraded":"2024-09-13T19:10:44.057410+0000","last_fullsized":"2024-09-13T19:10:44.057410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.057221+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:09.781010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.232296+0000","last_change":"2024-09-13T19:10:38.232296+0000","last_active":"2024-09-13T19:10:38.232296+0000","last_peered":"2024-09-13T19:10:38.232296+0000","last_clean":"2024-09-13T19:10:38.232296+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:10:38.232296+0000","last_undegraded":"2024-09-13T19:10:38.232296+0000","last_fullsized":"2024-09-13T19:10:38.232296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.232043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:00.008382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.047517+0000","last_change":"2024-09-13T19:11:00.047517+0000","last_active":"2024-09-13T19:11:00.047517+0000","last_peered":"2024-09-13T19:11:00.047517+0000","last_clean":"2024-09-13T19:11:00.047517+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:11:00.047517+0000","last_undegraded":"2024-09-13T19:11:00.047517+0000","last_fullsized":"2024-09-13T19:11:00.047517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.047252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:20.655684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.869718+0000","last_change":"2024-09-13T19:10:15.869718+0000","last_active":"2024-09-13T19:10:15.869718+0000","last_peered":"2024-09-13T19:10:15.869718+0000","last_clean":"2024-09-13T19:10:15.869718+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:15.869718+0000","last_undegraded":"2024-09-13T19:10:15.869718+0000","last_fullsized":"2024-09-13T19:10:15.869718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.869314+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.537473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.581959+0000","last_change":"2024-09-13T19:10:09.581959+0000","last_active":"2024-09-13T19:10:09.581959+0000","last_peered":"2024-09-13T19:10:09.581959+0000","last_clean":"2024-09-13T19:10:09.581959+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:10:09.581959+0000","last_undegraded":"2024-09-13T19:10:09.581959+0000","last_fullsized":"2024-09-13T19:10:09.581959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.581716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:02.986719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.803237+0000","last_change":"2024-09-13T19:11:05.803312+0000","last_active":"2024-09-13T19:11:05.803237+0000","last_peered":"2024-09-13T19:11:05.803237+0000","last_clean":"2024-09-13T19:11:05.803237+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:11:05.803237+0000","last_undegraded":"2024-09-13T19:11:05.803237+0000","last_fullsized":"2024-09-13T19:11:05.803237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.803047+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:47.920585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.029472+0000","last_change":"2024-09-13T19:10:58.029544+0000","last_active":"2024-09-13T19:10:58.029472+0000","last_peered":"2024-09-13T19:10:58.029472+0000","last_clean":"2024-09-13T19:10:58.029472+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:10:58.029472+0000","last_undegraded":"2024-09-13T19:10:58.029472+0000","last_fullsized":"2024-09-13T19:10:58.029472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.029287+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:51.352757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.961540+0000","last_change":"2024-09-13T19:10:58.961603+0000","last_active":"2024-09-13T19:10:58.961540+0000","last_peered":"2024-09-13T19:10:58.961540+0000","last_clean":"2024-09-13T19:10:58.961540+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:10:58.961540+0000","last_undegraded":"2024-09-13T19:10:58.961540+0000","last_fullsized":"2024-09-13T19:10:58.961540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.961359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:40.944452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.463320+0000","last_change":"2024-09-13T19:10:26.463320+0000","last_active":"2024-09-13T19:10:26.463320+0000","last_peered":"2024-09-13T19:10:26.463320+0000","last_clean":"2024-09-13T19:10:26.463320+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:10:26.463320+0000","last_undegraded":"2024-09-13T19:10:26.463320+0000","last_fullsized":"2024-09-13T19:10:26.463320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.463075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:13.599270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.935492+0000","last_change":"2024-09-13T19:10:40.935492+0000","last_active":"2024-09-13T19:10:40.935492+0000","last_peered":"2024-09-13T19:10:40.935492+0000","last_clean":"2024-09-13T19:10:40.935492+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:40.935492+0000","last_undegraded":"2024-09-13T19:10:40.935492+0000","last_fullsized":"2024-09-13T19:10:40.935492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.935209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.770064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.631641+0000","last_change":"2024-09-13T19:10:07.631641+0000","last_active":"2024-09-13T19:10:07.631641+0000","last_peered":"2024-09-13T19:10:07.631641+0000","last_clean":"2024-09-13T19:10:07.631641+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:07.631641+0000","last_undegraded":"2024-09-13T19:10:07.631641+0000","last_fullsized":"2024-09-13T19:10:07.631641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.631538+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:44.867733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.571156+0000","last_change":"2024-09-13T19:11:07.571223+0000","last_active":"2024-09-13T19:11:07.571156+0000","last_peered":"2024-09-13T19:11:07.571156+0000","last_clean":"2024-09-13T19:11:07.571156+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:11:07.571156+0000","last_undegraded":"2024-09-13T19:11:07.571156+0000","last_fullsized":"2024-09-13T19:11:07.571156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.570954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:56.928125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.213822+0000","last_change":"2024-09-13T19:10:37.213822+0000","last_active":"2024-09-13T19:10:37.213822+0000","last_peered":"2024-09-13T19:10:37.213822+0000","last_clean":"2024-09-13T19:10:37.213822+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:10:37.213822+0000","last_undegraded":"2024-09-13T19:10:37.213822+0000","last_fullsized":"2024-09-13T19:10:37.213822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.213576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:38.829697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.894229+0000","last_change":"2024-09-13T19:11:06.894290+0000","last_active":"2024-09-13T19:11:06.894229+0000","last_peered":"2024-09-13T19:11:06.894229+0000","last_clean":"2024-09-13T19:11:06.894229+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:11:06.894229+0000","last_undegraded":"2024-09-13T19:11:06.894229+0000","last_fullsized":"2024-09-13T19:11:06.894229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.894042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:15.165505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.381653+0000","last_change":"2024-09-13T19:10:29.381653+0000","last_active":"2024-09-13T19:10:29.381653+0000","last_peered":"2024-09-13T19:10:29.381653+0000","last_clean":"2024-09-13T19:10:29.381653+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:10:29.381653+0000","last_undegraded":"2024-09-13T19:10:29.381653+0000","last_fullsized":"2024-09-13T19:10:29.381653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.381399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:03.861773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.751268+0000","last_change":"2024-09-13T19:10:23.751268+0000","last_active":"2024-09-13T19:10:23.751268+0000","last_peered":"2024-09-13T19:10:23.751268+0000","last_clean":"2024-09-13T19:10:23.751268+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:23.751268+0000","last_undegraded":"2024-09-13T19:10:23.751268+0000","last_fullsized":"2024-09-13T19:10:23.751268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'64","last_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_deep_scrub":"34'64","last_deep_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.750999+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:41.816580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.394449+0000","last_change":"2024-09-13T19:10:24.394449+0000","last_active":"2024-09-13T19:10:24.394449+0000","last_peered":"2024-09-13T19:10:24.394449+0000","last_clean":"2024-09-13T19:10:24.394449+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:10:24.394449+0000","last_undegraded":"2024-09-13T19:10:24.394449+0000","last_fullsized":"2024-09-13T19:10:24.394449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.394197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:46.758833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.516024+0000","last_change":"2024-09-13T19:11:04.516098+0000","last_active":"2024-09-13T19:11:04.516024+0000","last_peered":"2024-09-13T19:11:04.516024+0000","last_clean":"2024-09-13T19:11:04.516024+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:11:04.516024+0000","last_undegraded":"2024-09-13T19:11:04.516024+0000","last_fullsized":"2024-09-13T19:11:04.516024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.515837+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:03.482989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.044112+0000","last_change":"2024-09-13T19:10:41.044112+0000","last_active":"2024-09-13T19:10:41.044112+0000","last_peered":"2024-09-13T19:10:41.044112+0000","last_clean":"2024-09-13T19:10:41.044112+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:10:41.044112+0000","last_undegraded":"2024-09-13T19:10:41.044112+0000","last_fullsized":"2024-09-13T19:10:41.044112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.043868+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:35.076360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.514736+0000","last_change":"2024-09-13T19:10:53.514797+0000","last_active":"2024-09-13T19:10:53.514736+0000","last_peered":"2024-09-13T19:10:53.514736+0000","last_clean":"2024-09-13T19:10:53.514736+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:10:53.514736+0000","last_undegraded":"2024-09-13T19:10:53.514736+0000","last_fullsized":"2024-09-13T19:10:53.514736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.514542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:53.518567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.036506+0000","last_change":"2024-09-13T19:10:28.036506+0000","last_active":"2024-09-13T19:10:28.036506+0000","last_peered":"2024-09-13T19:10:28.036506+0000","last_clean":"2024-09-13T19:10:28.036506+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:10:28.036506+0000","last_undegraded":"2024-09-13T19:10:28.036506+0000","last_fullsized":"2024-09-13T19:10:28.036506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.036142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:37.355498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.832750+0000","last_change":"2024-09-13T19:10:09.832750+0000","last_active":"2024-09-13T19:10:09.832750+0000","last_peered":"2024-09-13T19:10:09.832750+0000","last_clean":"2024-09-13T19:10:09.832750+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:09.832750+0000","last_undegraded":"2024-09-13T19:10:09.832750+0000","last_fullsized":"2024-09-13T19:10:09.832750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.832440+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:33.388702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.941102+0000","last_change":"2024-09-13T19:10:30.941102+0000","last_active":"2024-09-13T19:10:30.941102+0000","last_peered":"2024-09-13T19:10:30.941102+0000","last_clean":"2024-09-13T19:10:30.941102+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:10:30.941102+0000","last_undegraded":"2024-09-13T19:10:30.941102+0000","last_fullsized":"2024-09-13T19:10:30.941102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:05.758351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:28.816736+0000","last_change":"2024-09-13T19:11:28.816810+0000","last_active":"2024-09-13T19:11:28.816736+0000","last_peered":"2024-09-13T19:11:28.816736+0000","last_clean":"2024-09-13T19:11:28.816736+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:11:28.816736+0000","last_undegraded":"2024-09-13T19:11:28.816736+0000","last_fullsized":"2024-09-13T19:11:28.816736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:28.816510+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:28.816510+0000","last_clean_scrub_stamp":"2024-09-13T19:11:28.816510+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:38.169590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.793652+0000","last_change":"2024-09-13T19:10:20.793652+0000","last_active":"2024-09-13T19:10:20.793652+0000","last_peered":"2024-09-13T19:10:20.793652+0000","last_clean":"2024-09-13T19:10:20.793652+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:10:20.793652+0000","last_undegraded":"2024-09-13T19:10:20.793652+0000","last_fullsized":"2024-09-13T19:10:20.793652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.793393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:48.213611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.922009+0000","last_change":"2024-09-13T19:11:02.922064+0000","last_active":"2024-09-13T19:11:02.922009+0000","last_peered":"2024-09-13T19:11:02.922009+0000","last_clean":"2024-09-13T19:11:02.922009+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:11:02.922009+0000","last_undegraded":"2024-09-13T19:11:02.922009+0000","last_fullsized":"2024-09-13T19:11:02.922009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.921808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:23.507567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.412680+0000","last_change":"2024-09-13T19:10:23.412680+0000","last_active":"2024-09-13T19:10:23.412680+0000","last_peered":"2024-09-13T19:10:23.412680+0000","last_clean":"2024-09-13T19:10:23.412680+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:10:23.412680+0000","last_undegraded":"2024-09-13T19:10:23.412680+0000","last_fullsized":"2024-09-13T19:10:23.412680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.412440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.127417+0000","last_change":"2024-09-13T19:10:23.127417+0000","last_active":"2024-09-13T19:10:23.127417+0000","last_peered":"2024-09-13T19:10:23.127417+0000","last_clean":"2024-09-13T19:10:23.127417+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:23.127417+0000","last_undegraded":"2024-09-13T19:10:23.127417+0000","last_fullsized":"2024-09-13T19:10:23.127417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.127136+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:43.153291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":446,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.210977+0000","last_change":"2024-09-13T19:10:13.210977+0000","last_active":"2024-09-13T19:10:13.210977+0000","last_peered":"2024-09-13T19:10:13.210977+0000","last_clean":"2024-09-13T19:10:13.210977+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:13.210977+0000","last_undegraded":"2024-09-13T19:10:13.210977+0000","last_fullsized":"2024-09-13T19:10:13.210977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.210704+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:44.040477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.438358+0000","last_change":"2024-09-13T19:10:32.438358+0000","last_active":"2024-09-13T19:10:32.438358+0000","last_peered":"2024-09-13T19:10:32.438358+0000","last_clean":"2024-09-13T19:10:32.438358+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:10:32.438358+0000","last_undegraded":"2024-09-13T19:10:32.438358+0000","last_fullsized":"2024-09-13T19:10:32.438358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.438073+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:11.390223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.167545+0000","last_change":"2024-09-13T19:10:43.167545+0000","last_active":"2024-09-13T19:10:43.167545+0000","last_peered":"2024-09-13T19:10:43.167545+0000","last_clean":"2024-09-13T19:10:43.167545+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:10:43.167545+0000","last_undegraded":"2024-09-13T19:10:43.167545+0000","last_fullsized":"2024-09-13T19:10:43.167545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.167114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:09.024776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:14.823006+0000","last_change":"2024-09-13T19:11:14.823070+0000","last_active":"2024-09-13T19:11:14.823006+0000","last_peered":"2024-09-13T19:11:14.823006+0000","last_clean":"2024-09-13T19:11:14.823006+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:11:14.823006+0000","last_undegraded":"2024-09-13T19:11:14.823006+0000","last_fullsized":"2024-09-13T19:11:14.823006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:14.822802+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:14.822802+0000","last_clean_scrub_stamp":"2024-09-13T19:11:14.822802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:04.165891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.959117+0000","last_change":"2024-09-13T19:10:22.959117+0000","last_active":"2024-09-13T19:10:22.959117+0000","last_peered":"2024-09-13T19:10:22.959117+0000","last_clean":"2024-09-13T19:10:22.959117+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:22.959117+0000","last_undegraded":"2024-09-13T19:10:22.959117+0000","last_fullsized":"2024-09-13T19:10:22.959117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.958854+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.913099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.814619+0000","last_change":"2024-09-13T19:10:21.814619+0000","last_active":"2024-09-13T19:10:21.814619+0000","last_peered":"2024-09-13T19:10:21.814619+0000","last_clean":"2024-09-13T19:10:21.814619+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:10:21.814619+0000","last_undegraded":"2024-09-13T19:10:21.814619+0000","last_fullsized":"2024-09-13T19:10:21.814619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.814367+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:33.492669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":483,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.986876+0000","last_change":"2024-09-13T19:10:23.986876+0000","last_active":"2024-09-13T19:10:23.986876+0000","last_peered":"2024-09-13T19:10:23.986876+0000","last_clean":"2024-09-13T19:10:23.986876+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:23.986876+0000","last_undegraded":"2024-09-13T19:10:23.986876+0000","last_fullsized":"2024-09-13T19:10:23.986876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.986531+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:04.057824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.150372+0000","last_change":"2024-09-13T19:10:21.150372+0000","last_active":"2024-09-13T19:10:21.150372+0000","last_peered":"2024-09-13T19:10:21.150372+0000","last_clean":"2024-09-13T19:10:21.150372+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:10:21.150372+0000","last_undegraded":"2024-09-13T19:10:21.150372+0000","last_fullsized":"2024-09-13T19:10:21.150372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.150108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:27.355549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.127264+0000","last_change":"2024-09-13T19:10:50.127264+0000","last_active":"2024-09-13T19:10:50.127264+0000","last_peered":"2024-09-13T19:10:50.127264+0000","last_clean":"2024-09-13T19:10:50.127264+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:10:50.127264+0000","last_undegraded":"2024-09-13T19:10:50.127264+0000","last_fullsized":"2024-09-13T19:10:50.127264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.127013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.451561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.876607+0000","last_change":"2024-09-13T19:11:03.876751+0000","last_active":"2024-09-13T19:11:03.876607+0000","last_peered":"2024-09-13T19:11:03.876607+0000","last_clean":"2024-09-13T19:11:03.876607+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:11:03.876607+0000","last_undegraded":"2024-09-13T19:11:03.876607+0000","last_fullsized":"2024-09-13T19:11:03.876607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.876376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:25.983099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.991613+0000","last_change":"2024-09-13T19:10:09.991613+0000","last_active":"2024-09-13T19:10:09.991613+0000","last_peered":"2024-09-13T19:10:09.991613+0000","last_clean":"2024-09-13T19:10:09.991613+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:10:09.991613+0000","last_undegraded":"2024-09-13T19:10:09.991613+0000","last_fullsized":"2024-09-13T19:10:09.991613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.991280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.624094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.862549+0000","last_change":"2024-09-13T19:10:12.862549+0000","last_active":"2024-09-13T19:10:12.862549+0000","last_peered":"2024-09-13T19:10:12.862549+0000","last_clean":"2024-09-13T19:10:12.862549+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:12.862549+0000","last_undegraded":"2024-09-13T19:10:12.862549+0000","last_fullsized":"2024-09-13T19:10:12.862549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.862157+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:03.704078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.251305+0000","last_change":"2024-09-13T19:10:10.251305+0000","last_active":"2024-09-13T19:10:10.251305+0000","last_peered":"2024-09-13T19:10:10.251305+0000","last_clean":"2024-09-13T19:10:10.251305+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:10:10.251305+0000","last_undegraded":"2024-09-13T19:10:10.251305+0000","last_fullsized":"2024-09-13T19:10:10.251305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.250951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:14.638874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.857657+0000","last_change":"2024-09-13T19:11:03.857726+0000","last_active":"2024-09-13T19:11:03.857657+0000","last_peered":"2024-09-13T19:11:03.857657+0000","last_clean":"2024-09-13T19:11:03.857657+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:11:03.857657+0000","last_undegraded":"2024-09-13T19:11:03.857657+0000","last_fullsized":"2024-09-13T19:11:03.857657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.857461+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:41.355797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.788819+0000","last_change":"2024-09-13T19:10:22.788819+0000","last_active":"2024-09-13T19:10:22.788819+0000","last_peered":"2024-09-13T19:10:22.788819+0000","last_clean":"2024-09-13T19:10:22.788819+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:10:22.788819+0000","last_undegraded":"2024-09-13T19:10:22.788819+0000","last_fullsized":"2024-09-13T19:10:22.788819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.788534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:11.221320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":217,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.047563+0000","last_change":"2024-09-13T19:10:54.047637+0000","last_active":"2024-09-13T19:10:54.047563+0000","last_peered":"2024-09-13T19:10:54.047563+0000","last_clean":"2024-09-13T19:10:54.047563+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:10:54.047563+0000","last_undegraded":"2024-09-13T19:10:54.047563+0000","last_fullsized":"2024-09-13T19:10:54.047563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.047370+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:04.396516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:18.811825+0000","last_change":"2024-09-13T19:11:18.812003+0000","last_active":"2024-09-13T19:11:18.811825+0000","last_peered":"2024-09-13T19:11:18.811825+0000","last_clean":"2024-09-13T19:11:18.811825+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:11:18.811825+0000","last_undegraded":"2024-09-13T19:11:18.811825+0000","last_fullsized":"2024-09-13T19:11:18.811825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:18.811593+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:18.811593+0000","last_clean_scrub_stamp":"2024-09-13T19:11:18.811593+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:54.030654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.927200+0000","last_change":"2024-09-13T19:11:07.927265+0000","last_active":"2024-09-13T19:11:07.927200+0000","last_peered":"2024-09-13T19:11:07.927200+0000","last_clean":"2024-09-13T19:11:07.927200+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:11:07.927200+0000","last_undegraded":"2024-09-13T19:11:07.927200+0000","last_fullsized":"2024-09-13T19:11:07.927200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.926993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:16.838950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.925770+0000","last_change":"2024-09-13T19:10:17.925770+0000","last_active":"2024-09-13T19:10:17.925770+0000","last_peered":"2024-09-13T19:10:17.925770+0000","last_clean":"2024-09-13T19:10:17.925770+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:10:17.925770+0000","last_undegraded":"2024-09-13T19:10:17.925770+0000","last_fullsized":"2024-09-13T19:10:17.925770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.925452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:48.521596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.929532+0000","last_change":"2024-09-13T19:10:13.929532+0000","last_active":"2024-09-13T19:10:13.929532+0000","last_peered":"2024-09-13T19:10:13.929532+0000","last_clean":"2024-09-13T19:10:13.929532+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:13.929532+0000","last_undegraded":"2024-09-13T19:10:13.929532+0000","last_fullsized":"2024-09-13T19:10:13.929532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.929281+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:35.787824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.567264+0000","last_change":"2024-09-13T19:10:12.567264+0000","last_active":"2024-09-13T19:10:12.567264+0000","last_peered":"2024-09-13T19:10:12.567264+0000","last_clean":"2024-09-13T19:10:12.567264+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:10:12.567264+0000","last_undegraded":"2024-09-13T19:10:12.567264+0000","last_fullsized":"2024-09-13T19:10:12.567264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.567011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:35.830195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.197379+0000","last_change":"2024-09-13T19:10:17.197379+0000","last_active":"2024-09-13T19:10:17.197379+0000","last_peered":"2024-09-13T19:10:17.197379+0000","last_clean":"2024-09-13T19:10:17.197379+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:10:17.197379+0000","last_undegraded":"2024-09-13T19:10:17.197379+0000","last_fullsized":"2024-09-13T19:10:17.197379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.197010+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:54.433206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.949414+0000","last_change":"2024-09-13T19:10:53.949476+0000","last_active":"2024-09-13T19:10:53.949414+0000","last_peered":"2024-09-13T19:10:53.949414+0000","last_clean":"2024-09-13T19:10:53.949414+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:10:53.949414+0000","last_undegraded":"2024-09-13T19:10:53.949414+0000","last_fullsized":"2024-09-13T19:10:53.949414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.949220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:44.541345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:19.790405+0000","last_change":"2024-09-13T19:11:19.790459+0000","last_active":"2024-09-13T19:11:19.790405+0000","last_peered":"2024-09-13T19:11:19.790405+0000","last_clean":"2024-09-13T19:11:19.790405+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:11:19.790405+0000","last_undegraded":"2024-09-13T19:11:19.790405+0000","last_fullsized":"2024-09-13T19:11:19.790405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:19.790208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:19.790208+0000","last_clean_scrub_stamp":"2024-09-13T19:11:19.790208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:03.089596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.495700+0000","last_change":"2024-09-13T19:10:51.495761+0000","last_active":"2024-09-13T19:10:51.495700+0000","last_peered":"2024-09-13T19:10:51.495700+0000","last_clean":"2024-09-13T19:10:51.495700+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:10:51.495700+0000","last_undegraded":"2024-09-13T19:10:51.495700+0000","last_fullsized":"2024-09-13T19:10:51.495700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.495502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:01.844647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.969550+0000","last_change":"2024-09-13T19:10:10.969550+0000","last_active":"2024-09-13T19:10:10.969550+0000","last_peered":"2024-09-13T19:10:10.969550+0000","last_clean":"2024-09-13T19:10:10.969550+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:10.969550+0000","last_undegraded":"2024-09-13T19:10:10.969550+0000","last_fullsized":"2024-09-13T19:10:10.969550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.969289+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:28.059258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":518,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.847892+0000","last_change":"2024-09-13T19:10:08.847892+0000","last_active":"2024-09-13T19:10:08.847892+0000","last_peered":"2024-09-13T19:10:08.847892+0000","last_clean":"2024-09-13T19:10:08.847892+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:08.847892+0000","last_undegraded":"2024-09-13T19:10:08.847892+0000","last_fullsized":"2024-09-13T19:10:08.847892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'290","last_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_deep_scrub":"34'290","last_deep_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.847620+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:34.001690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.953784+0000","last_change":"2024-09-13T19:10:31.953784+0000","last_active":"2024-09-13T19:10:31.953784+0000","last_peered":"2024-09-13T19:10:31.953784+0000","last_clean":"2024-09-13T19:10:31.953784+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:10:31.953784+0000","last_undegraded":"2024-09-13T19:10:31.953784+0000","last_fullsized":"2024-09-13T19:10:31.953784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.953404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:26.886773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.995270+0000","last_change":"2024-09-13T19:10:35.995270+0000","last_active":"2024-09-13T19:10:35.995270+0000","last_peered":"2024-09-13T19:10:35.995270+0000","last_clean":"2024-09-13T19:10:35.995270+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:10:35.995270+0000","last_undegraded":"2024-09-13T19:10:35.995270+0000","last_fullsized":"2024-09-13T19:10:35.995270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.995027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.852689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.429059+0000","last_change":"2024-09-13T19:10:35.429059+0000","last_active":"2024-09-13T19:10:35.429059+0000","last_peered":"2024-09-13T19:10:35.429059+0000","last_clean":"2024-09-13T19:10:35.429059+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:10:35.429059+0000","last_undegraded":"2024-09-13T19:10:35.429059+0000","last_fullsized":"2024-09-13T19:10:35.429059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.428796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:58.222147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.088661+0000","last_change":"2024-09-13T19:10:47.088726+0000","last_active":"2024-09-13T19:10:47.088661+0000","last_peered":"2024-09-13T19:10:47.088661+0000","last_clean":"2024-09-13T19:10:47.088661+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:10:47.088661+0000","last_undegraded":"2024-09-13T19:10:47.088661+0000","last_fullsized":"2024-09-13T19:10:47.088661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.088396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:36.829110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.497142+0000","last_change":"2024-09-13T19:10:49.497201+0000","last_active":"2024-09-13T19:10:49.497142+0000","last_peered":"2024-09-13T19:10:49.497142+0000","last_clean":"2024-09-13T19:10:49.497142+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:10:49.497142+0000","last_undegraded":"2024-09-13T19:10:49.497142+0000","last_fullsized":"2024-09-13T19:10:49.497142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.496931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:05.613751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.077141+0000","last_change":"2024-09-13T19:11:01.077169+0000","last_active":"2024-09-13T19:11:01.077141+0000","last_peered":"2024-09-13T19:11:01.077141+0000","last_clean":"2024-09-13T19:11:01.077141+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:11:01.077141+0000","last_undegraded":"2024-09-13T19:11:01.077141+0000","last_fullsized":"2024-09-13T19:11:01.077141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.077063+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:41.862042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.258425+0000","last_change":"2024-09-13T19:10:19.258425+0000","last_active":"2024-09-13T19:10:19.258425+0000","last_peered":"2024-09-13T19:10:19.258425+0000","last_clean":"2024-09-13T19:10:19.258425+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:10:19.258425+0000","last_undegraded":"2024-09-13T19:10:19.258425+0000","last_fullsized":"2024-09-13T19:10:19.258425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.258136+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:12.663138+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.475886+0000","last_change":"2024-09-13T19:10:20.475886+0000","last_active":"2024-09-13T19:10:20.475886+0000","last_peered":"2024-09-13T19:10:20.475886+0000","last_clean":"2024-09-13T19:10:20.475886+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:10:20.475886+0000","last_undegraded":"2024-09-13T19:10:20.475886+0000","last_fullsized":"2024-09-13T19:10:20.475886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.475636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:23.310735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376201+0000","last_change":"2024-09-13T19:06:29.329853+0000","last_active":"2024-09-13T19:10:08.376201+0000","last_peered":"2024-09-13T19:10:08.376201+0000","last_clean":"2024-09-13T19:10:08.376201+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:10:08.376201+0000","last_undegraded":"2024-09-13T19:10:08.376201+0000","last_fullsized":"2024-09-13T19:10:08.376201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.535919+0000","last_change":"2024-09-13T19:10:50.535980+0000","last_active":"2024-09-13T19:10:50.535919+0000","last_peered":"2024-09-13T19:10:50.535919+0000","last_clean":"2024-09-13T19:10:50.535919+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:10:50.535919+0000","last_undegraded":"2024-09-13T19:10:50.535919+0000","last_fullsized":"2024-09-13T19:10:50.535919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.535729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:30.458282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:17.829057+0000","last_change":"2024-09-13T19:11:17.829118+0000","last_active":"2024-09-13T19:11:17.829057+0000","last_peered":"2024-09-13T19:11:17.829057+0000","last_clean":"2024-09-13T19:11:17.829057+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:11:17.829057+0000","last_undegraded":"2024-09-13T19:11:17.829057+0000","last_fullsized":"2024-09-13T19:11:17.829057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:11:17.828861+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:11:17.828861+0000","last_clean_scrub_stamp":"2024-09-13T19:11:17.828861+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:05.067674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.086466+0000","last_change":"2024-09-13T19:10:49.086566+0000","last_active":"2024-09-13T19:10:49.086466+0000","last_peered":"2024-09-13T19:10:49.086466+0000","last_clean":"2024-09-13T19:10:49.086466+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:10:49.086466+0000","last_undegraded":"2024-09-13T19:10:49.086466+0000","last_fullsized":"2024-09-13T19:10:49.086466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.086290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:02.473416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.413883+0000","last_change":"2024-09-13T19:10:31.413883+0000","last_active":"2024-09-13T19:10:31.413883+0000","last_peered":"2024-09-13T19:10:31.413883+0000","last_clean":"2024-09-13T19:10:31.413883+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:10:31.413883+0000","last_undegraded":"2024-09-13T19:10:31.413883+0000","last_fullsized":"2024-09-13T19:10:31.413883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.413619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.384956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.988168+0000","last_change":"2024-09-13T19:10:11.988168+0000","last_active":"2024-09-13T19:10:11.988168+0000","last_peered":"2024-09-13T19:10:11.988168+0000","last_clean":"2024-09-13T19:10:11.988168+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:10:11.988168+0000","last_undegraded":"2024-09-13T19:10:11.988168+0000","last_fullsized":"2024-09-13T19:10:11.988168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.987853+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.357172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.896017+0000","last_change":"2024-09-13T19:10:29.896017+0000","last_active":"2024-09-13T19:10:29.896017+0000","last_peered":"2024-09-13T19:10:29.896017+0000","last_clean":"2024-09-13T19:10:29.896017+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:10:29.896017+0000","last_undegraded":"2024-09-13T19:10:29.896017+0000","last_fullsized":"2024-09-13T19:10:29.896017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.895758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:10.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.809087+0000","last_change":"2024-09-13T19:11:07.809149+0000","last_active":"2024-09-13T19:11:07.809087+0000","last_peered":"2024-09-13T19:11:07.809087+0000","last_clean":"2024-09-13T19:11:07.809087+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:11:07.809087+0000","last_undegraded":"2024-09-13T19:11:07.809087+0000","last_fullsized":"2024-09-13T19:11:07.809087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.808901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:01.709401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.925703+0000","last_change":"2024-09-13T19:10:28.925703+0000","last_active":"2024-09-13T19:10:28.925703+0000","last_peered":"2024-09-13T19:10:28.925703+0000","last_clean":"2024-09-13T19:10:28.925703+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:10:28.925703+0000","last_undegraded":"2024-09-13T19:10:28.925703+0000","last_fullsized":"2024-09-13T19:10:28.925703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.925441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:16.061636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.066417+0000","last_change":"2024-09-13T19:10:51.066476+0000","last_active":"2024-09-13T19:10:51.066417+0000","last_peered":"2024-09-13T19:10:51.066417+0000","last_clean":"2024-09-13T19:10:51.066417+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:10:51.066417+0000","last_undegraded":"2024-09-13T19:10:51.066417+0000","last_fullsized":"2024-09-13T19:10:51.066417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.066198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:16.789987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.479112+0000","last_change":"2024-09-13T19:10:54.479173+0000","last_active":"2024-09-13T19:10:54.479112+0000","last_peered":"2024-09-13T19:10:54.479112+0000","last_clean":"2024-09-13T19:10:54.479112+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:10:54.479112+0000","last_undegraded":"2024-09-13T19:10:54.479112+0000","last_fullsized":"2024-09-13T19:10:54.479112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.478927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:49.935597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.424395+0000","last_change":"2024-09-13T19:10:33.424395+0000","last_active":"2024-09-13T19:10:33.424395+0000","last_peered":"2024-09-13T19:10:33.424395+0000","last_clean":"2024-09-13T19:10:33.424395+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:10:33.424395+0000","last_undegraded":"2024-09-13T19:10:33.424395+0000","last_fullsized":"2024-09-13T19:10:33.424395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.424001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:59.281664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.564973+0000","last_change":"2024-09-13T19:10:18.564973+0000","last_active":"2024-09-13T19:10:18.564973+0000","last_peered":"2024-09-13T19:10:18.564973+0000","last_clean":"2024-09-13T19:10:18.564973+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:18.564973+0000","last_undegraded":"2024-09-13T19:10:18.564973+0000","last_fullsized":"2024-09-13T19:10:18.564973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.564713+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:02.178317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.287984+0000","last_change":"2024-09-13T19:10:09.287984+0000","last_active":"2024-09-13T19:10:09.287984+0000","last_peered":"2024-09-13T19:10:09.287984+0000","last_clean":"2024-09-13T19:10:09.287984+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:10:09.287984+0000","last_undegraded":"2024-09-13T19:10:09.287984+0000","last_fullsized":"2024-09-13T19:10:09.287984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.287642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:27.524091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.573467+0000","last_change":"2024-09-13T19:11:08.573530+0000","last_active":"2024-09-13T19:11:08.573467+0000","last_peered":"2024-09-13T19:11:08.573467+0000","last_clean":"2024-09-13T19:11:08.573467+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:11:08.573467+0000","last_undegraded":"2024-09-13T19:11:08.573467+0000","last_fullsized":"2024-09-13T19:11:08.573467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.573284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:51.555269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.065219+0000","last_change":"2024-09-13T19:10:40.065315+0000","last_active":"2024-09-13T19:10:40.065219+0000","last_peered":"2024-09-13T19:10:40.065219+0000","last_clean":"2024-09-13T19:10:40.065219+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:10:40.065219+0000","last_undegraded":"2024-09-13T19:10:40.065219+0000","last_fullsized":"2024-09-13T19:10:40.065219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.065006+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:29.805720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.432436+0000","last_change":"2024-09-13T19:11:00.432501+0000","last_active":"2024-09-13T19:11:00.432436+0000","last_peered":"2024-09-13T19:11:00.432436+0000","last_clean":"2024-09-13T19:11:00.432436+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:11:00.432436+0000","last_undegraded":"2024-09-13T19:11:00.432436+0000","last_fullsized":"2024-09-13T19:11:00.432436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.432247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.873661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:20.775677+0000","last_change":"2024-09-13T19:11:20.775733+0000","last_active":"2024-09-13T19:11:20.775677+0000","last_peered":"2024-09-13T19:11:20.775677+0000","last_clean":"2024-09-13T19:11:20.775677+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:11:20.775677+0000","last_undegraded":"2024-09-13T19:11:20.775677+0000","last_fullsized":"2024-09-13T19:11:20.775677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:20.775469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:20.775469+0000","last_clean_scrub_stamp":"2024-09-13T19:11:20.775469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:40.923782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.375130+0000","last_change":"2024-09-13T19:06:58.356420+0000","last_active":"2024-09-13T19:10:08.375130+0000","last_peered":"2024-09-13T19:10:08.375130+0000","last_clean":"2024-09-13T19:10:08.375130+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:10:08.375130+0000","last_undegraded":"2024-09-13T19:10:08.375130+0000","last_fullsized":"2024-09-13T19:10:08.375130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:22.223299+0000","last_clean_scrub_stamp":"2024-09-13T19:06:22.223299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.839664+0000","last_change":"2024-09-13T19:10:07.839664+0000","last_active":"2024-09-13T19:10:07.839664+0000","last_peered":"2024-09-13T19:10:07.839664+0000","last_clean":"2024-09-13T19:10:07.839664+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:10:07.839664+0000","last_undegraded":"2024-09-13T19:10:07.839664+0000","last_fullsized":"2024-09-13T19:10:07.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.839234+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.815476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":384,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.945197+0000","last_change":"2024-09-13T19:10:27.945197+0000","last_active":"2024-09-13T19:10:27.945197+0000","last_peered":"2024-09-13T19:10:27.945197+0000","last_clean":"2024-09-13T19:10:27.945197+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:27.945197+0000","last_undegraded":"2024-09-13T19:10:27.945197+0000","last_fullsized":"2024-09-13T19:10:27.945197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.944956+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.708373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.994412+0000","last_change":"2024-09-13T19:10:55.994412+0000","last_active":"2024-09-13T19:10:55.994412+0000","last_peered":"2024-09-13T19:10:55.994412+0000","last_clean":"2024-09-13T19:10:55.994412+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:10:55.994412+0000","last_undegraded":"2024-09-13T19:10:55.994412+0000","last_fullsized":"2024-09-13T19:10:55.994412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.994119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:19.655333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.800379+0000","last_change":"2024-09-13T19:10:26.800432+0000","last_active":"2024-09-13T19:10:26.800379+0000","last_peered":"2024-09-13T19:10:26.800379+0000","last_clean":"2024-09-13T19:10:26.800379+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:10:26.800379+0000","last_undegraded":"2024-09-13T19:10:26.800379+0000","last_fullsized":"2024-09-13T19:10:26.800379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.800155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:20.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:13.867987+0000","last_change":"2024-09-13T19:11:13.868044+0000","last_active":"2024-09-13T19:11:13.867987+0000","last_peered":"2024-09-13T19:11:13.867987+0000","last_clean":"2024-09-13T19:11:13.867987+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:11:13.867987+0000","last_undegraded":"2024-09-13T19:11:13.867987+0000","last_fullsized":"2024-09-13T19:11:13.867987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:13.867760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:13.867760+0000","last_clean_scrub_stamp":"2024-09-13T19:11:13.867760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:19.636547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.499876+0000","last_change":"2024-09-13T19:10:55.499929+0000","last_active":"2024-09-13T19:10:55.499876+0000","last_peered":"2024-09-13T19:10:55.499876+0000","last_clean":"2024-09-13T19:10:55.499876+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:10:55.499876+0000","last_undegraded":"2024-09-13T19:10:55.499876+0000","last_fullsized":"2024-09-13T19:10:55.499876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.499652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:20.972903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.988381+0000","last_change":"2024-09-13T19:10:08.988381+0000","last_active":"2024-09-13T19:10:08.988381+0000","last_peered":"2024-09-13T19:10:08.988381+0000","last_clean":"2024-09-13T19:10:08.988381+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:10:08.988381+0000","last_undegraded":"2024-09-13T19:10:08.988381+0000","last_fullsized":"2024-09-13T19:10:08.988381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.988147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.969133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.913475+0000","last_change":"2024-09-13T19:10:34.913475+0000","last_active":"2024-09-13T19:10:34.913475+0000","last_peered":"2024-09-13T19:10:34.913475+0000","last_clean":"2024-09-13T19:10:34.913475+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:10:34.913475+0000","last_undegraded":"2024-09-13T19:10:34.913475+0000","last_fullsized":"2024-09-13T19:10:34.913475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.913181+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:57.790048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.531059+0000","last_change":"2024-09-13T19:10:14.531059+0000","last_active":"2024-09-13T19:10:14.531059+0000","last_peered":"2024-09-13T19:10:14.531059+0000","last_clean":"2024-09-13T19:10:14.531059+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:14.531059+0000","last_undegraded":"2024-09-13T19:10:14.531059+0000","last_fullsized":"2024-09-13T19:10:14.531059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.530810+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:54.291531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.845668+0000","last_change":"2024-09-13T19:11:08.845731+0000","last_active":"2024-09-13T19:11:08.845668+0000","last_peered":"2024-09-13T19:11:08.845668+0000","last_clean":"2024-09-13T19:11:08.845668+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:11:08.845668+0000","last_undegraded":"2024-09-13T19:11:08.845668+0000","last_fullsized":"2024-09-13T19:11:08.845668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.845463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.202633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.085344+0000","last_change":"2024-09-13T19:10:55.085508+0000","last_active":"2024-09-13T19:10:55.085344+0000","last_peered":"2024-09-13T19:10:55.085344+0000","last_clean":"2024-09-13T19:10:55.085344+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:10:55.085344+0000","last_undegraded":"2024-09-13T19:10:55.085344+0000","last_fullsized":"2024-09-13T19:10:55.085344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.085114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.150695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.957696+0000","last_change":"2024-09-13T19:10:56.957756+0000","last_active":"2024-09-13T19:10:56.957696+0000","last_peered":"2024-09-13T19:10:56.957696+0000","last_clean":"2024-09-13T19:10:56.957696+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:10:56.957696+0000","last_undegraded":"2024-09-13T19:10:56.957696+0000","last_fullsized":"2024-09-13T19:10:56.957696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.957496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:22.430747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:21.730261+0000","last_change":"2024-09-13T19:11:21.730313+0000","last_active":"2024-09-13T19:11:21.730261+0000","last_peered":"2024-09-13T19:11:21.730261+0000","last_clean":"2024-09-13T19:11:21.730261+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:11:21.730261+0000","last_undegraded":"2024-09-13T19:11:21.730261+0000","last_fullsized":"2024-09-13T19:11:21.730261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:21.730064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:21.730064+0000","last_clean_scrub_stamp":"2024-09-13T19:11:21.730064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:57.125796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.832300+0000","last_change":"2024-09-13T19:10:18.832300+0000","last_active":"2024-09-13T19:10:18.832300+0000","last_peered":"2024-09-13T19:10:18.832300+0000","last_clean":"2024-09-13T19:10:18.832300+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:10:18.832300+0000","last_undegraded":"2024-09-13T19:10:18.832300+0000","last_fullsized":"2024-09-13T19:10:18.832300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.832064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:42.939752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.208010+0000","last_change":"2024-09-13T19:10:20.208010+0000","last_active":"2024-09-13T19:10:20.208010+0000","last_peered":"2024-09-13T19:10:20.208010+0000","last_clean":"2024-09-13T19:10:20.208010+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:20.208010+0000","last_undegraded":"2024-09-13T19:10:20.208010+0000","last_fullsized":"2024-09-13T19:10:20.208010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.207705+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:25.171811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.399306+0000","last_change":"2024-09-13T19:10:28.399306+0000","last_active":"2024-09-13T19:10:28.399306+0000","last_peered":"2024-09-13T19:10:28.399306+0000","last_clean":"2024-09-13T19:10:28.399306+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:10:28.399306+0000","last_undegraded":"2024-09-13T19:10:28.399306+0000","last_fullsized":"2024-09-13T19:10:28.399306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.399039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:50.175378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.121202+0000","last_change":"2024-09-13T19:10:25.121202+0000","last_active":"2024-09-13T19:10:25.121202+0000","last_peered":"2024-09-13T19:10:25.121202+0000","last_clean":"2024-09-13T19:10:25.121202+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:10:25.121202+0000","last_undegraded":"2024-09-13T19:10:25.121202+0000","last_fullsized":"2024-09-13T19:10:25.121202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.120954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.704432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.073645+0000","last_change":"2024-09-13T19:10:56.073718+0000","last_active":"2024-09-13T19:10:56.073645+0000","last_peered":"2024-09-13T19:10:56.073645+0000","last_clean":"2024-09-13T19:10:56.073645+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:10:56.073645+0000","last_undegraded":"2024-09-13T19:10:56.073645+0000","last_fullsized":"2024-09-13T19:10:56.073645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.073454+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:48.540359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.077566+0000","last_change":"2024-09-13T19:10:33.077566+0000","last_active":"2024-09-13T19:10:33.077566+0000","last_peered":"2024-09-13T19:10:33.077566+0000","last_clean":"2024-09-13T19:10:33.077566+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:10:33.077566+0000","last_undegraded":"2024-09-13T19:10:33.077566+0000","last_fullsized":"2024-09-13T19:10:33.077566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.077318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:02.423813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:12.905338+0000","last_change":"2024-09-13T19:11:12.905393+0000","last_active":"2024-09-13T19:11:12.905338+0000","last_peered":"2024-09-13T19:11:12.905338+0000","last_clean":"2024-09-13T19:11:12.905338+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:11:12.905338+0000","last_undegraded":"2024-09-13T19:11:12.905338+0000","last_fullsized":"2024-09-13T19:11:12.905338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:12.905140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:12.905140+0000","last_clean_scrub_stamp":"2024-09-13T19:11:12.905140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:02.168824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.945400+0000","last_change":"2024-09-13T19:10:20.945400+0000","last_active":"2024-09-13T19:10:20.945400+0000","last_peered":"2024-09-13T19:10:20.945400+0000","last_clean":"2024-09-13T19:10:20.945400+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:10:20.945400+0000","last_undegraded":"2024-09-13T19:10:20.945400+0000","last_fullsized":"2024-09-13T19:10:20.945400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.945028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:30.264384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.854611+0000","last_change":"2024-09-13T19:10:27.854611+0000","last_active":"2024-09-13T19:10:27.854611+0000","last_peered":"2024-09-13T19:10:27.854611+0000","last_clean":"2024-09-13T19:10:27.854611+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:27.854611+0000","last_undegraded":"2024-09-13T19:10:27.854611+0000","last_fullsized":"2024-09-13T19:10:27.854611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.854345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:28.517846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.951984+0000","last_change":"2024-09-13T19:10:43.951984+0000","last_active":"2024-09-13T19:10:43.951984+0000","last_peered":"2024-09-13T19:10:43.951984+0000","last_clean":"2024-09-13T19:10:43.951984+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:10:43.951984+0000","last_undegraded":"2024-09-13T19:10:43.951984+0000","last_fullsized":"2024-09-13T19:10:43.951984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.951573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:26.069111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.546488+0000","last_change":"2024-09-13T19:11:05.546551+0000","last_active":"2024-09-13T19:11:05.546488+0000","last_peered":"2024-09-13T19:11:05.546488+0000","last_clean":"2024-09-13T19:11:05.546488+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:11:05.546488+0000","last_undegraded":"2024-09-13T19:11:05.546488+0000","last_fullsized":"2024-09-13T19:11:05.546488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.546296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:23.305608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.081944+0000","last_change":"2024-09-13T19:10:42.081944+0000","last_active":"2024-09-13T19:10:42.081944+0000","last_peered":"2024-09-13T19:10:42.081944+0000","last_clean":"2024-09-13T19:10:42.081944+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:10:42.081944+0000","last_undegraded":"2024-09-13T19:10:42.081944+0000","last_fullsized":"2024-09-13T19:10:42.081944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.081677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:55.468803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.030305+0000","last_change":"2024-09-13T19:10:52.030305+0000","last_active":"2024-09-13T19:10:52.030305+0000","last_peered":"2024-09-13T19:10:52.030305+0000","last_clean":"2024-09-13T19:10:52.030305+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:10:52.030305+0000","last_undegraded":"2024-09-13T19:10:52.030305+0000","last_fullsized":"2024-09-13T19:10:52.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.030011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:30.173078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.867551+0000","last_change":"2024-09-13T19:10:17.867551+0000","last_active":"2024-09-13T19:10:17.867551+0000","last_peered":"2024-09-13T19:10:17.867551+0000","last_clean":"2024-09-13T19:10:17.867551+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:10:17.867551+0000","last_undegraded":"2024-09-13T19:10:17.867551+0000","last_fullsized":"2024-09-13T19:10:17.867551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.867308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:43.159936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.561532+0000","last_change":"2024-09-13T19:10:17.561532+0000","last_active":"2024-09-13T19:10:17.561532+0000","last_peered":"2024-09-13T19:10:17.561532+0000","last_clean":"2024-09-13T19:10:17.561532+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:10:17.561532+0000","last_undegraded":"2024-09-13T19:10:17.561532+0000","last_fullsized":"2024-09-13T19:10:17.561532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.561274+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:36.904388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.291104+0000","last_change":"2024-09-13T19:10:11.291104+0000","last_active":"2024-09-13T19:10:11.291104+0000","last_peered":"2024-09-13T19:10:11.291104+0000","last_clean":"2024-09-13T19:10:11.291104+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:10:11.291104+0000","last_undegraded":"2024-09-13T19:10:11.291104+0000","last_fullsized":"2024-09-13T19:10:11.291104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.290797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.828167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.545599+0000","last_change":"2024-09-13T19:11:06.545599+0000","last_active":"2024-09-13T19:11:06.545599+0000","last_peered":"2024-09-13T19:11:06.545599+0000","last_clean":"2024-09-13T19:11:06.545599+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:11:06.545599+0000","last_undegraded":"2024-09-13T19:11:06.545599+0000","last_fullsized":"2024-09-13T19:11:06.545599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.545207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:31.033367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.350522+0000","last_change":"2024-09-13T19:10:40.350522+0000","last_active":"2024-09-13T19:10:40.350522+0000","last_peered":"2024-09-13T19:10:40.350522+0000","last_clean":"2024-09-13T19:10:40.350522+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:10:40.350522+0000","last_undegraded":"2024-09-13T19:10:40.350522+0000","last_fullsized":"2024-09-13T19:10:40.350522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.350179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:04.457866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.272268+0000","last_change":"2024-09-13T19:10:40.272268+0000","last_active":"2024-09-13T19:10:40.272268+0000","last_peered":"2024-09-13T19:10:40.272268+0000","last_clean":"2024-09-13T19:10:40.272268+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:10:40.272268+0000","last_undegraded":"2024-09-13T19:10:40.272268+0000","last_fullsized":"2024-09-13T19:10:40.272268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.271992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:13.748357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.162360+0000","last_change":"2024-09-13T19:10:24.162360+0000","last_active":"2024-09-13T19:10:24.162360+0000","last_peered":"2024-09-13T19:10:24.162360+0000","last_clean":"2024-09-13T19:10:24.162360+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:10:24.162360+0000","last_undegraded":"2024-09-13T19:10:24.162360+0000","last_fullsized":"2024-09-13T19:10:24.162360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.162112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:54.758256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.521044+0000","last_change":"2024-09-13T19:10:19.521044+0000","last_active":"2024-09-13T19:10:19.521044+0000","last_peered":"2024-09-13T19:10:19.521044+0000","last_clean":"2024-09-13T19:10:19.521044+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:19.521044+0000","last_undegraded":"2024-09-13T19:10:19.521044+0000","last_fullsized":"2024-09-13T19:10:19.521044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.520627+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.918610+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.960335+0000","last_change":"2024-09-13T19:10:19.960335+0000","last_active":"2024-09-13T19:10:19.960335+0000","last_peered":"2024-09-13T19:10:19.960335+0000","last_clean":"2024-09-13T19:10:19.960335+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:10:19.960335+0000","last_undegraded":"2024-09-13T19:10:19.960335+0000","last_fullsized":"2024-09-13T19:10:19.960335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.960093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:12.950423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.895273+0000","last_change":"2024-09-13T19:10:51.895273+0000","last_active":"2024-09-13T19:10:51.895273+0000","last_peered":"2024-09-13T19:10:51.895273+0000","last_clean":"2024-09-13T19:10:51.895273+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:10:51.895273+0000","last_undegraded":"2024-09-13T19:10:51.895273+0000","last_fullsized":"2024-09-13T19:10:51.895273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.895017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:21.682090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.858131+0000","last_change":"2024-09-13T19:10:28.858131+0000","last_active":"2024-09-13T19:10:28.858131+0000","last_peered":"2024-09-13T19:10:28.858131+0000","last_clean":"2024-09-13T19:10:28.858131+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:10:28.858131+0000","last_undegraded":"2024-09-13T19:10:28.858131+0000","last_fullsized":"2024-09-13T19:10:28.858131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.857846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:49.466278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.907072+0000","last_change":"2024-09-13T19:11:00.907072+0000","last_active":"2024-09-13T19:11:00.907072+0000","last_peered":"2024-09-13T19:11:00.907072+0000","last_clean":"2024-09-13T19:11:00.907072+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:11:00.907072+0000","last_undegraded":"2024-09-13T19:11:00.907072+0000","last_fullsized":"2024-09-13T19:11:00.907072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.906816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:21.348304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.848901+0000","last_change":"2024-09-13T19:10:16.848901+0000","last_active":"2024-09-13T19:10:16.848901+0000","last_peered":"2024-09-13T19:10:16.848901+0000","last_clean":"2024-09-13T19:10:16.848901+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:10:16.848901+0000","last_undegraded":"2024-09-13T19:10:16.848901+0000","last_fullsized":"2024-09-13T19:10:16.848901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.848588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:18.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.179195+0000","last_change":"2024-09-13T19:10:16.179195+0000","last_active":"2024-09-13T19:10:16.179195+0000","last_peered":"2024-09-13T19:10:16.179195+0000","last_clean":"2024-09-13T19:10:16.179195+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:16.179195+0000","last_undegraded":"2024-09-13T19:10:16.179195+0000","last_fullsized":"2024-09-13T19:10:16.179195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.178926+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:09.694689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.208442+0000","last_change":"2024-09-13T19:10:14.208442+0000","last_active":"2024-09-13T19:10:14.208442+0000","last_peered":"2024-09-13T19:10:14.208442+0000","last_clean":"2024-09-13T19:10:14.208442+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:10:14.208442+0000","last_undegraded":"2024-09-13T19:10:14.208442+0000","last_fullsized":"2024-09-13T19:10:14.208442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.208183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:58.825796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.929476+0000","last_change":"2024-09-13T19:10:50.929555+0000","last_active":"2024-09-13T19:10:50.929476+0000","last_peered":"2024-09-13T19:10:50.929476+0000","last_clean":"2024-09-13T19:10:50.929476+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:10:50.929476+0000","last_undegraded":"2024-09-13T19:10:50.929476+0000","last_fullsized":"2024-09-13T19:10:50.929476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.929270+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.095083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.925896+0000","last_change":"2024-09-13T19:11:01.925896+0000","last_active":"2024-09-13T19:11:01.925896+0000","last_peered":"2024-09-13T19:11:01.925896+0000","last_clean":"2024-09-13T19:11:01.925896+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:11:01.925896+0000","last_undegraded":"2024-09-13T19:11:01.925896+0000","last_fullsized":"2024-09-13T19:11:01.925896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.925650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.270080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.424270+0000","last_change":"2024-09-13T19:10:30.424323+0000","last_active":"2024-09-13T19:10:30.424270+0000","last_peered":"2024-09-13T19:10:30.424270+0000","last_clean":"2024-09-13T19:10:30.424270+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:10:30.424270+0000","last_undegraded":"2024-09-13T19:10:30.424270+0000","last_fullsized":"2024-09-13T19:10:30.424270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.424045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:59.405032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.538905+0000","last_change":"2024-09-13T19:10:15.538905+0000","last_active":"2024-09-13T19:10:15.538905+0000","last_peered":"2024-09-13T19:10:15.538905+0000","last_clean":"2024-09-13T19:10:15.538905+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:15.538905+0000","last_undegraded":"2024-09-13T19:10:15.538905+0000","last_fullsized":"2024-09-13T19:10:15.538905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.538629+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.122107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.250870+0000","last_change":"2024-09-13T19:10:12.250870+0000","last_active":"2024-09-13T19:10:12.250870+0000","last_peered":"2024-09-13T19:10:12.250870+0000","last_clean":"2024-09-13T19:10:12.250870+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:10:12.250870+0000","last_undegraded":"2024-09-13T19:10:12.250870+0000","last_fullsized":"2024-09-13T19:10:12.250870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:10.938731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.505486+0000","last_change":"2024-09-13T19:11:03.505486+0000","last_active":"2024-09-13T19:11:03.505486+0000","last_peered":"2024-09-13T19:11:03.505486+0000","last_clean":"2024-09-13T19:11:03.505486+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:11:03.505486+0000","last_undegraded":"2024-09-13T19:11:03.505486+0000","last_fullsized":"2024-09-13T19:11:03.505486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.505228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:53.171890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.467256+0000","last_change":"2024-09-13T19:10:52.467319+0000","last_active":"2024-09-13T19:10:52.467256+0000","last_peered":"2024-09-13T19:10:52.467256+0000","last_clean":"2024-09-13T19:10:52.467256+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:10:52.467256+0000","last_undegraded":"2024-09-13T19:10:52.467256+0000","last_fullsized":"2024-09-13T19:10:52.467256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.467064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.284557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.992274+0000","last_change":"2024-09-13T19:10:55.992274+0000","last_active":"2024-09-13T19:10:55.992274+0000","last_peered":"2024-09-13T19:10:55.992274+0000","last_clean":"2024-09-13T19:10:55.992274+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:10:55.992274+0000","last_undegraded":"2024-09-13T19:10:55.992274+0000","last_fullsized":"2024-09-13T19:10:55.992274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.991902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:55.741364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.038792+0000","last_change":"2024-09-13T19:10:27.038792+0000","last_active":"2024-09-13T19:10:27.038792+0000","last_peered":"2024-09-13T19:10:27.038792+0000","last_clean":"2024-09-13T19:10:27.038792+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:10:27.038792+0000","last_undegraded":"2024-09-13T19:10:27.038792+0000","last_fullsized":"2024-09-13T19:10:27.038792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.038560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:46.381674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.966601+0000","last_change":"2024-09-13T19:10:37.966601+0000","last_active":"2024-09-13T19:10:37.966601+0000","last_peered":"2024-09-13T19:10:37.966601+0000","last_clean":"2024-09-13T19:10:37.966601+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:37.966601+0000","last_undegraded":"2024-09-13T19:10:37.966601+0000","last_fullsized":"2024-09-13T19:10:37.966601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.966152+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:38.978338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.872063+0000","last_change":"2024-09-13T19:10:11.872063+0000","last_active":"2024-09-13T19:10:11.872063+0000","last_peered":"2024-09-13T19:10:11.872063+0000","last_clean":"2024-09-13T19:10:11.872063+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:10:11.872063+0000","last_undegraded":"2024-09-13T19:10:11.872063+0000","last_fullsized":"2024-09-13T19:10:11.872063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.871702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.344253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.920624+0000","last_change":"2024-09-13T19:10:59.920624+0000","last_active":"2024-09-13T19:10:59.920624+0000","last_peered":"2024-09-13T19:10:59.920624+0000","last_clean":"2024-09-13T19:10:59.920624+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:10:59.920624+0000","last_undegraded":"2024-09-13T19:10:59.920624+0000","last_fullsized":"2024-09-13T19:10:59.920624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.920373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:40.967193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.061617+0000","last_change":"2024-09-13T19:11:02.061682+0000","last_active":"2024-09-13T19:11:02.061617+0000","last_peered":"2024-09-13T19:11:02.061617+0000","last_clean":"2024-09-13T19:11:02.061617+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:11:02.061617+0000","last_undegraded":"2024-09-13T19:11:02.061617+0000","last_fullsized":"2024-09-13T19:11:02.061617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.061439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:36.878931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.088366+0000","last_change":"2024-09-13T19:10:49.088366+0000","last_active":"2024-09-13T19:10:49.088366+0000","last_peered":"2024-09-13T19:10:49.088366+0000","last_clean":"2024-09-13T19:10:49.088366+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:10:49.088366+0000","last_undegraded":"2024-09-13T19:10:49.088366+0000","last_fullsized":"2024-09-13T19:10:49.088366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.087937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:41.554842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.082518+0000","last_change":"2024-09-13T19:10:26.082518+0000","last_active":"2024-09-13T19:10:26.082518+0000","last_peered":"2024-09-13T19:10:26.082518+0000","last_clean":"2024-09-13T19:10:26.082518+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:26.082518+0000","last_undegraded":"2024-09-13T19:10:26.082518+0000","last_fullsized":"2024-09-13T19:10:26.082518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.082257+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.108750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.503964+0000","last_change":"2024-09-13T19:10:21.503964+0000","last_active":"2024-09-13T19:10:21.503964+0000","last_peered":"2024-09-13T19:10:21.503964+0000","last_clean":"2024-09-13T19:10:21.503964+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:21.503964+0000","last_undegraded":"2024-09-13T19:10:21.503964+0000","last_fullsized":"2024-09-13T19:10:21.503964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.503707+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:01.575001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.524503+0000","last_change":"2024-09-13T19:10:13.524503+0000","last_active":"2024-09-13T19:10:13.524503+0000","last_peered":"2024-09-13T19:10:13.524503+0000","last_clean":"2024-09-13T19:10:13.524503+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:10:13.524503+0000","last_undegraded":"2024-09-13T19:10:13.524503+0000","last_fullsized":"2024-09-13T19:10:13.524503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.524264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.550419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376390+0000","last_change":"2024-09-13T19:06:29.324926+0000","last_active":"2024-09-13T19:10:08.376390+0000","last_peered":"2024-09-13T19:10:08.376390+0000","last_clean":"2024-09-13T19:10:08.376390+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:10:08.376390+0000","last_undegraded":"2024-09-13T19:10:08.376390+0000","last_fullsized":"2024-09-13T19:10:08.376390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.480028+0000","last_change":"2024-09-13T19:10:46.480028+0000","last_active":"2024-09-13T19:10:46.480028+0000","last_peered":"2024-09-13T19:10:46.480028+0000","last_clean":"2024-09-13T19:10:46.480028+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:10:46.480028+0000","last_undegraded":"2024-09-13T19:10:46.480028+0000","last_fullsized":"2024-09-13T19:10:46.480028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.479775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:43.497505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.992077+0000","last_change":"2024-09-13T19:10:57.992077+0000","last_active":"2024-09-13T19:10:57.992077+0000","last_peered":"2024-09-13T19:10:57.992077+0000","last_clean":"2024-09-13T19:10:57.992077+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:10:57.992077+0000","last_undegraded":"2024-09-13T19:10:57.992077+0000","last_fullsized":"2024-09-13T19:10:57.992077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.991795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:11.616420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.982937+0000","last_change":"2024-09-13T19:10:21.982937+0000","last_active":"2024-09-13T19:10:21.982937+0000","last_peered":"2024-09-13T19:10:21.982937+0000","last_clean":"2024-09-13T19:10:21.982937+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:10:21.982937+0000","last_undegraded":"2024-09-13T19:10:21.982937+0000","last_fullsized":"2024-09-13T19:10:21.982937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.982700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:30.750394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.948762+0000","last_change":"2024-09-13T19:10:36.948838+0000","last_active":"2024-09-13T19:10:36.948762+0000","last_peered":"2024-09-13T19:10:36.948762+0000","last_clean":"2024-09-13T19:10:36.948762+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:10:36.948762+0000","last_undegraded":"2024-09-13T19:10:36.948762+0000","last_fullsized":"2024-09-13T19:10:36.948762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.948531+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:54.759393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.250351+0000","last_change":"2024-09-13T19:10:08.250351+0000","last_active":"2024-09-13T19:10:08.250351+0000","last_peered":"2024-09-13T19:10:08.250351+0000","last_clean":"2024-09-13T19:10:08.250351+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:08.250351+0000","last_undegraded":"2024-09-13T19:10:08.250351+0000","last_fullsized":"2024-09-13T19:10:08.250351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.249922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:42.550124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.376210+0000","last_change":"2024-09-13T19:06:29.324237+0000","last_active":"2024-09-13T19:10:08.376210+0000","last_peered":"2024-09-13T19:10:08.376210+0000","last_clean":"2024-09-13T19:10:08.376210+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:10:08.376210+0000","last_undegraded":"2024-09-13T19:10:08.376210+0000","last_fullsized":"2024-09-13T19:10:08.376210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:06:28.255347+0000","last_clean_scrub_stamp":"2024-09-13T19:06:28.255347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.125178+0000","last_change":"2024-09-13T19:10:35.125178+0000","last_active":"2024-09-13T19:10:35.125178+0000","last_peered":"2024-09-13T19:10:35.125178+0000","last_clean":"2024-09-13T19:10:35.125178+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:10:35.125178+0000","last_undegraded":"2024-09-13T19:10:35.125178+0000","last_fullsized":"2024-09-13T19:10:35.125178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.124924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:46.888340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.070082+0000","last_change":"2024-09-13T19:10:53.070082+0000","last_active":"2024-09-13T19:10:53.070082+0000","last_peered":"2024-09-13T19:10:53.070082+0000","last_clean":"2024-09-13T19:10:53.070082+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:10:53.070082+0000","last_undegraded":"2024-09-13T19:10:53.070082+0000","last_fullsized":"2024-09-13T19:10:53.070082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.069807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:13.678239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.937733+0000","last_change":"2024-09-13T19:10:18.937733+0000","last_active":"2024-09-13T19:10:18.937733+0000","last_peered":"2024-09-13T19:10:18.937733+0000","last_clean":"2024-09-13T19:10:18.937733+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:10:18.937733+0000","last_undegraded":"2024-09-13T19:10:18.937733+0000","last_fullsized":"2024-09-13T19:10:18.937733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.937494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:07.450855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.890226+0000","last_change":"2024-09-13T19:10:13.890226+0000","last_active":"2024-09-13T19:10:13.890226+0000","last_peered":"2024-09-13T19:10:13.890226+0000","last_clean":"2024-09-13T19:10:13.890226+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:13.890226+0000","last_undegraded":"2024-09-13T19:10:13.890226+0000","last_fullsized":"2024-09-13T19:10:13.890226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.889956+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:41.379481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.586502+0000","last_change":"2024-09-13T19:10:08.586502+0000","last_active":"2024-09-13T19:10:08.586502+0000","last_peered":"2024-09-13T19:10:08.586502+0000","last_clean":"2024-09-13T19:10:08.586502+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:10:08.586502+0000","last_undegraded":"2024-09-13T19:10:08.586502+0000","last_fullsized":"2024-09-13T19:10:08.586502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.586205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:31.058755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.888701+0000","last_change":"2024-09-13T19:11:02.888701+0000","last_active":"2024-09-13T19:11:02.888701+0000","last_peered":"2024-09-13T19:11:02.888701+0000","last_clean":"2024-09-13T19:11:02.888701+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:11:02.888701+0000","last_undegraded":"2024-09-13T19:11:02.888701+0000","last_fullsized":"2024-09-13T19:11:02.888701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.888433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:39.723288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.067914+0000","last_change":"2024-09-13T19:10:31.067914+0000","last_active":"2024-09-13T19:10:31.067914+0000","last_peered":"2024-09-13T19:10:31.067914+0000","last_clean":"2024-09-13T19:10:31.067914+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:10:31.067914+0000","last_undegraded":"2024-09-13T19:10:31.067914+0000","last_fullsized":"2024-09-13T19:10:31.067914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.067555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:11.138849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:25.830492+0000","last_change":"2024-09-13T19:11:25.830654+0000","last_active":"2024-09-13T19:11:25.830492+0000","last_peered":"2024-09-13T19:11:25.830492+0000","last_clean":"2024-09-13T19:11:25.830492+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:11:25.830492+0000","last_undegraded":"2024-09-13T19:11:25.830492+0000","last_fullsized":"2024-09-13T19:11:25.830492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:25.830176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:25.830176+0000","last_clean_scrub_stamp":"2024-09-13T19:11:25.830176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:24.368121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.089399+0000","last_change":"2024-09-13T19:10:30.089399+0000","last_active":"2024-09-13T19:10:30.089399+0000","last_peered":"2024-09-13T19:10:30.089399+0000","last_clean":"2024-09-13T19:10:30.089399+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:10:30.089399+0000","last_undegraded":"2024-09-13T19:10:30.089399+0000","last_fullsized":"2024-09-13T19:10:30.089399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.089119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.043364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.454696+0000","last_change":"2024-09-13T19:10:22.454696+0000","last_active":"2024-09-13T19:10:22.454696+0000","last_peered":"2024-09-13T19:10:22.454696+0000","last_clean":"2024-09-13T19:10:22.454696+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:22.454696+0000","last_undegraded":"2024-09-13T19:10:22.454696+0000","last_fullsized":"2024-09-13T19:10:22.454696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.454429+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:00.959003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.898752+0000","last_change":"2024-09-13T19:10:35.898752+0000","last_active":"2024-09-13T19:10:35.898752+0000","last_peered":"2024-09-13T19:10:35.898752+0000","last_clean":"2024-09-13T19:10:35.898752+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:10:35.898752+0000","last_undegraded":"2024-09-13T19:10:35.898752+0000","last_fullsized":"2024-09-13T19:10:35.898752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.898496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.675915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:27.852384+0000","last_change":"2024-09-13T19:11:27.852450+0000","last_active":"2024-09-13T19:11:27.852384+0000","last_peered":"2024-09-13T19:11:27.852384+0000","last_clean":"2024-09-13T19:11:27.852384+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:11:27.852384+0000","last_undegraded":"2024-09-13T19:11:27.852384+0000","last_fullsized":"2024-09-13T19:11:27.852384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:11:27.852202+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:11:27.852202+0000","last_clean_scrub_stamp":"2024-09-13T19:11:27.852202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:30.486125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.041465+0000","last_change":"2024-09-13T19:10:59.041600+0000","last_active":"2024-09-13T19:10:59.041465+0000","last_peered":"2024-09-13T19:10:59.041465+0000","last_clean":"2024-09-13T19:10:59.041465+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:10:59.041465+0000","last_undegraded":"2024-09-13T19:10:59.041465+0000","last_fullsized":"2024-09-13T19:10:59.041465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.041190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:59.704690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.456459+0000","last_change":"2024-09-13T19:11:01.456519+0000","last_active":"2024-09-13T19:11:01.456459+0000","last_peered":"2024-09-13T19:11:01.456459+0000","last_clean":"2024-09-13T19:11:01.456459+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:11:01.456459+0000","last_undegraded":"2024-09-13T19:11:01.456459+0000","last_fullsized":"2024-09-13T19:11:01.456459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.456156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:12.616137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.988040+0000","last_change":"2024-09-13T19:10:24.988040+0000","last_active":"2024-09-13T19:10:24.988040+0000","last_peered":"2024-09-13T19:10:24.988040+0000","last_clean":"2024-09-13T19:10:24.988040+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:10:24.988040+0000","last_undegraded":"2024-09-13T19:10:24.988040+0000","last_fullsized":"2024-09-13T19:10:24.988040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.987790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.492363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.936353+0000","last_change":"2024-09-13T19:10:38.936353+0000","last_active":"2024-09-13T19:10:38.936353+0000","last_peered":"2024-09-13T19:10:38.936353+0000","last_clean":"2024-09-13T19:10:38.936353+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:38.936353+0000","last_undegraded":"2024-09-13T19:10:38.936353+0000","last_fullsized":"2024-09-13T19:10:38.936353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.935949+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:31.557189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.947969+0000","last_change":"2024-09-13T19:10:39.947969+0000","last_active":"2024-09-13T19:10:39.947969+0000","last_peered":"2024-09-13T19:10:39.947969+0000","last_clean":"2024-09-13T19:10:39.947969+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:10:39.947969+0000","last_undegraded":"2024-09-13T19:10:39.947969+0000","last_fullsized":"2024-09-13T19:10:39.947969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.947716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:39.389129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:26.818725+0000","last_change":"2024-09-13T19:11:26.818786+0000","last_active":"2024-09-13T19:11:26.818725+0000","last_peered":"2024-09-13T19:11:26.818725+0000","last_clean":"2024-09-13T19:11:26.818725+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:11:26.818725+0000","last_undegraded":"2024-09-13T19:11:26.818725+0000","last_fullsized":"2024-09-13T19:11:26.818725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:26.818543+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:26.818543+0000","last_clean_scrub_stamp":"2024-09-13T19:11:26.818543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:39.219857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.071527+0000","last_change":"2024-09-13T19:10:32.071527+0000","last_active":"2024-09-13T19:10:32.071527+0000","last_peered":"2024-09-13T19:10:32.071527+0000","last_clean":"2024-09-13T19:10:32.071527+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:10:32.071527+0000","last_undegraded":"2024-09-13T19:10:32.071527+0000","last_fullsized":"2024-09-13T19:10:32.071527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.071163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:10.575736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.125394+0000","last_change":"2024-09-13T19:10:51.125453+0000","last_active":"2024-09-13T19:10:51.125394+0000","last_peered":"2024-09-13T19:10:51.125394+0000","last_clean":"2024-09-13T19:10:51.125394+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:10:51.125394+0000","last_undegraded":"2024-09-13T19:10:51.125394+0000","last_fullsized":"2024-09-13T19:10:51.125394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.125199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.448668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.903047+0000","last_change":"2024-09-13T19:10:16.903047+0000","last_active":"2024-09-13T19:10:16.903047+0000","last_peered":"2024-09-13T19:10:16.903047+0000","last_clean":"2024-09-13T19:10:16.903047+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:10:16.903047+0000","last_undegraded":"2024-09-13T19:10:16.903047+0000","last_fullsized":"2024-09-13T19:10:16.903047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.902806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:19.703828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.918703+0000","last_change":"2024-09-13T19:10:33.918703+0000","last_active":"2024-09-13T19:10:33.918703+0000","last_peered":"2024-09-13T19:10:33.918703+0000","last_clean":"2024-09-13T19:10:33.918703+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:33.918703+0000","last_undegraded":"2024-09-13T19:10:33.918703+0000","last_fullsized":"2024-09-13T19:10:33.918703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.918433+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:50.289186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.520027+0000","last_change":"2024-09-13T19:10:16.520027+0000","last_active":"2024-09-13T19:10:16.520027+0000","last_peered":"2024-09-13T19:10:16.520027+0000","last_clean":"2024-09-13T19:10:16.520027+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:10:16.520027+0000","last_undegraded":"2024-09-13T19:10:16.520027+0000","last_fullsized":"2024-09-13T19:10:16.520027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.519636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:59.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.888253+0000","last_change":"2024-09-13T19:10:47.888253+0000","last_active":"2024-09-13T19:10:47.888253+0000","last_peered":"2024-09-13T19:10:47.888253+0000","last_clean":"2024-09-13T19:10:47.888253+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:10:47.888253+0000","last_undegraded":"2024-09-13T19:10:47.888253+0000","last_fullsized":"2024-09-13T19:10:47.888253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.887997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:30.869982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.028462+0000","last_change":"2024-09-13T19:10:46.028526+0000","last_active":"2024-09-13T19:10:46.028462+0000","last_peered":"2024-09-13T19:10:46.028462+0000","last_clean":"2024-09-13T19:10:46.028462+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:10:46.028462+0000","last_undegraded":"2024-09-13T19:10:46.028462+0000","last_fullsized":"2024-09-13T19:10:46.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.028259+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:47.928830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.107911+0000","last_change":"2024-09-13T19:10:46.107973+0000","last_active":"2024-09-13T19:10:46.107911+0000","last_peered":"2024-09-13T19:10:46.107911+0000","last_clean":"2024-09-13T19:10:46.107911+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:10:46.107911+0000","last_undegraded":"2024-09-13T19:10:46.107911+0000","last_fullsized":"2024-09-13T19:10:46.107911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.107689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:25.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.467731+0000","last_change":"2024-09-13T19:10:44.467791+0000","last_active":"2024-09-13T19:10:44.467731+0000","last_peered":"2024-09-13T19:10:44.467731+0000","last_clean":"2024-09-13T19:10:44.467731+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:10:44.467731+0000","last_undegraded":"2024-09-13T19:10:44.467731+0000","last_fullsized":"2024-09-13T19:10:44.467731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.467543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:25.126852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.461029+0000","last_change":"2024-09-13T19:10:57.461105+0000","last_active":"2024-09-13T19:10:57.461029+0000","last_peered":"2024-09-13T19:10:57.461029+0000","last_clean":"2024-09-13T19:10:57.461029+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:10:57.461029+0000","last_undegraded":"2024-09-13T19:10:57.461029+0000","last_fullsized":"2024-09-13T19:10:57.461029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.460837+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:40.407423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.983112+0000","last_change":"2024-09-13T19:10:56.983262+0000","last_active":"2024-09-13T19:10:56.983112+0000","last_peered":"2024-09-13T19:10:56.983112+0000","last_clean":"2024-09-13T19:10:56.983112+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:10:56.983112+0000","last_undegraded":"2024-09-13T19:10:56.983112+0000","last_fullsized":"2024-09-13T19:10:56.983112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.982857+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:46.123347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.828235+0000","last_change":"2024-09-13T19:11:04.828305+0000","last_active":"2024-09-13T19:11:04.828235+0000","last_peered":"2024-09-13T19:11:04.828235+0000","last_clean":"2024-09-13T19:11:04.828235+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:11:04.828235+0000","last_undegraded":"2024-09-13T19:11:04.828235+0000","last_fullsized":"2024-09-13T19:11:04.828235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.828016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:25.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.482729+0000","last_change":"2024-09-13T19:10:48.482795+0000","last_active":"2024-09-13T19:10:48.482729+0000","last_peered":"2024-09-13T19:10:48.482729+0000","last_clean":"2024-09-13T19:10:48.482729+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:10:48.482729+0000","last_undegraded":"2024-09-13T19:10:48.482729+0000","last_fullsized":"2024-09-13T19:10:48.482729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.482535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:41.806005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.473063+0000","last_change":"2024-09-13T19:10:56.473134+0000","last_active":"2024-09-13T19:10:56.473063+0000","last_peered":"2024-09-13T19:10:56.473063+0000","last_clean":"2024-09-13T19:10:56.473063+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:10:56.473063+0000","last_undegraded":"2024-09-13T19:10:56.473063+0000","last_fullsized":"2024-09-13T19:10:56.473063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.472869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:50.986688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:09.551600+0000","last_change":"2024-09-13T19:11:09.551746+0000","last_active":"2024-09-13T19:11:09.551600+0000","last_peered":"2024-09-13T19:11:09.551600+0000","last_clean":"2024-09-13T19:11:09.551600+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:11:09.551600+0000","last_undegraded":"2024-09-13T19:11:09.551600+0000","last_fullsized":"2024-09-13T19:11:09.551600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:09.551367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:09.551367+0000","last_clean_scrub_stamp":"2024-09-13T19:11:09.551367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:29.684905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.391394+0000","last_change":"2024-09-13T19:10:41.391471+0000","last_active":"2024-09-13T19:10:41.391394+0000","last_peered":"2024-09-13T19:10:41.391394+0000","last_clean":"2024-09-13T19:10:41.391394+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:10:41.391394+0000","last_undegraded":"2024-09-13T19:10:41.391394+0000","last_fullsized":"2024-09-13T19:10:41.391394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.391199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:07.114988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.939056+0000","last_change":"2024-09-13T19:10:32.939056+0000","last_active":"2024-09-13T19:10:32.939056+0000","last_peered":"2024-09-13T19:10:32.939056+0000","last_clean":"2024-09-13T19:10:32.939056+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:10:32.939056+0000","last_undegraded":"2024-09-13T19:10:32.939056+0000","last_fullsized":"2024-09-13T19:10:32.939056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.938814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:06.415179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.917014+0000","last_change":"2024-09-13T19:10:59.917125+0000","last_active":"2024-09-13T19:10:59.917014+0000","last_peered":"2024-09-13T19:10:59.917014+0000","last_clean":"2024-09-13T19:10:59.917014+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:10:59.917014+0000","last_undegraded":"2024-09-13T19:10:59.917014+0000","last_fullsized":"2024-09-13T19:10:59.917014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.916701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:00.071057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.492292+0000","last_change":"2024-09-13T19:11:02.492359+0000","last_active":"2024-09-13T19:11:02.492292+0000","last_peered":"2024-09-13T19:11:02.492292+0000","last_clean":"2024-09-13T19:11:02.492292+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:11:02.492292+0000","last_undegraded":"2024-09-13T19:11:02.492292+0000","last_fullsized":"2024-09-13T19:11:02.492292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.492090+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:11.373794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.127862+0000","last_change":"2024-09-13T19:10:44.127991+0000","last_active":"2024-09-13T19:10:44.127862+0000","last_peered":"2024-09-13T19:10:44.127862+0000","last_clean":"2024-09-13T19:10:44.127862+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:10:44.127862+0000","last_undegraded":"2024-09-13T19:10:44.127862+0000","last_fullsized":"2024-09-13T19:10:44.127862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.127604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:58.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.994450+0000","last_change":"2024-09-13T19:10:34.994578+0000","last_active":"2024-09-13T19:10:34.994450+0000","last_peered":"2024-09-13T19:10:34.994450+0000","last_clean":"2024-09-13T19:10:34.994450+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:10:34.994450+0000","last_undegraded":"2024-09-13T19:10:34.994450+0000","last_fullsized":"2024-09-13T19:10:34.994450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.994220+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.946370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.454678+0000","last_change":"2024-09-13T19:10:58.454739+0000","last_active":"2024-09-13T19:10:58.454678+0000","last_peered":"2024-09-13T19:10:58.454678+0000","last_clean":"2024-09-13T19:10:58.454678+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:10:58.454678+0000","last_undegraded":"2024-09-13T19:10:58.454678+0000","last_fullsized":"2024-09-13T19:10:58.454678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.454475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:58.608830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.046880+0000","last_change":"2024-09-13T19:10:48.046880+0000","last_active":"2024-09-13T19:10:48.046880+0000","last_peered":"2024-09-13T19:10:48.046880+0000","last_clean":"2024-09-13T19:10:48.046880+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:10:48.046880+0000","last_undegraded":"2024-09-13T19:10:48.046880+0000","last_fullsized":"2024-09-13T19:10:48.046880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.046612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:06.112193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.858499+0000","last_change":"2024-09-13T19:11:05.858555+0000","last_active":"2024-09-13T19:11:05.858499+0000","last_peered":"2024-09-13T19:11:05.858499+0000","last_clean":"2024-09-13T19:11:05.858499+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:11:05.858499+0000","last_undegraded":"2024-09-13T19:11:05.858499+0000","last_fullsized":"2024-09-13T19:11:05.858499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.858284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:55.214937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.972524+0000","last_change":"2024-09-13T19:10:42.972524+0000","last_active":"2024-09-13T19:10:42.972524+0000","last_peered":"2024-09-13T19:10:42.972524+0000","last_clean":"2024-09-13T19:10:42.972524+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:10:42.972524+0000","last_undegraded":"2024-09-13T19:10:42.972524+0000","last_fullsized":"2024-09-13T19:10:42.972524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.972147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:14.740560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.526647+0000","last_change":"2024-09-13T19:10:47.526647+0000","last_active":"2024-09-13T19:10:47.526647+0000","last_peered":"2024-09-13T19:10:47.526647+0000","last_clean":"2024-09-13T19:10:47.526647+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:10:47.526647+0000","last_undegraded":"2024-09-13T19:10:47.526647+0000","last_fullsized":"2024-09-13T19:10:47.526647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.526271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.850818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.424112+0000","last_change":"2024-09-13T19:10:38.424112+0000","last_active":"2024-09-13T19:10:38.424112+0000","last_peered":"2024-09-13T19:10:38.424112+0000","last_clean":"2024-09-13T19:10:38.424112+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:10:38.424112+0000","last_undegraded":"2024-09-13T19:10:38.424112+0000","last_fullsized":"2024-09-13T19:10:38.424112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.423850+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:32.456343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.070971+0000","last_change":"2024-09-13T19:10:45.070971+0000","last_active":"2024-09-13T19:10:45.070971+0000","last_peered":"2024-09-13T19:10:45.070971+0000","last_clean":"2024-09-13T19:10:45.070971+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:10:45.070971+0000","last_undegraded":"2024-09-13T19:10:45.070971+0000","last_fullsized":"2024-09-13T19:10:45.070971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.070599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:23.213665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.907546+0000","last_change":"2024-09-13T19:11:01.907590+0000","last_active":"2024-09-13T19:11:01.907546+0000","last_peered":"2024-09-13T19:11:01.907546+0000","last_clean":"2024-09-13T19:11:01.907546+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:11:01.907546+0000","last_undegraded":"2024-09-13T19:11:01.907546+0000","last_fullsized":"2024-09-13T19:11:01.907546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.907431+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:01.348844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.943573+0000","last_change":"2024-09-13T19:10:57.943633+0000","last_active":"2024-09-13T19:10:57.943573+0000","last_peered":"2024-09-13T19:10:57.943573+0000","last_clean":"2024-09-13T19:10:57.943573+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:10:57.943573+0000","last_undegraded":"2024-09-13T19:10:57.943573+0000","last_fullsized":"2024-09-13T19:10:57.943573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.943383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:35.094936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.042199+0000","last_change":"2024-09-13T19:10:38.042199+0000","last_active":"2024-09-13T19:10:38.042199+0000","last_peered":"2024-09-13T19:10:38.042199+0000","last_clean":"2024-09-13T19:10:38.042199+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:10:38.042199+0000","last_undegraded":"2024-09-13T19:10:38.042199+0000","last_fullsized":"2024-09-13T19:10:38.042199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.041895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:59.900437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.944353+0000","last_change":"2024-09-13T19:11:08.944495+0000","last_active":"2024-09-13T19:11:08.944353+0000","last_peered":"2024-09-13T19:11:08.944353+0000","last_clean":"2024-09-13T19:11:08.944353+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:11:08.944353+0000","last_undegraded":"2024-09-13T19:11:08.944353+0000","last_fullsized":"2024-09-13T19:11:08.944353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.944070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:24.191489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.907486+0000","last_change":"2024-09-13T19:10:30.907486+0000","last_active":"2024-09-13T19:10:30.907486+0000","last_peered":"2024-09-13T19:10:30.907486+0000","last_clean":"2024-09-13T19:10:30.907486+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:10:30.907486+0000","last_undegraded":"2024-09-13T19:10:30.907486+0000","last_fullsized":"2024-09-13T19:10:30.907486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.907226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:52.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.891559+0000","last_change":"2024-09-13T19:11:00.891617+0000","last_active":"2024-09-13T19:11:00.891559+0000","last_peered":"2024-09-13T19:11:00.891559+0000","last_clean":"2024-09-13T19:11:00.891559+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:11:00.891559+0000","last_undegraded":"2024-09-13T19:11:00.891559+0000","last_fullsized":"2024-09-13T19:11:00.891559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.891365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:24.920169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.753182+0000","last_change":"2024-09-13T19:10:25.753182+0000","last_active":"2024-09-13T19:10:25.753182+0000","last_peered":"2024-09-13T19:10:25.753182+0000","last_clean":"2024-09-13T19:10:25.753182+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:10:25.753182+0000","last_undegraded":"2024-09-13T19:10:25.753182+0000","last_fullsized":"2024-09-13T19:10:25.753182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.752912+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:44.077460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.105311+0000","last_change":"2024-09-13T19:10:34.105311+0000","last_active":"2024-09-13T19:10:34.105311+0000","last_peered":"2024-09-13T19:10:34.105311+0000","last_clean":"2024-09-13T19:10:34.105311+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:10:34.105311+0000","last_undegraded":"2024-09-13T19:10:34.105311+0000","last_fullsized":"2024-09-13T19:10:34.105311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.105056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:03.469390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.088306+0000","last_change":"2024-09-13T19:10:52.088373+0000","last_active":"2024-09-13T19:10:52.088306+0000","last_peered":"2024-09-13T19:10:52.088306+0000","last_clean":"2024-09-13T19:10:52.088306+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:10:52.088306+0000","last_undegraded":"2024-09-13T19:10:52.088306+0000","last_fullsized":"2024-09-13T19:10:52.088306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.088124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:52.751625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:11.880924+0000","last_change":"2024-09-13T19:11:11.880989+0000","last_active":"2024-09-13T19:11:11.880924+0000","last_peered":"2024-09-13T19:11:11.880924+0000","last_clean":"2024-09-13T19:11:11.880924+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:11:11.880924+0000","last_undegraded":"2024-09-13T19:11:11.880924+0000","last_fullsized":"2024-09-13T19:11:11.880924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:11.880732+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:11.880732+0000","last_clean_scrub_stamp":"2024-09-13T19:11:11.880732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:05.023046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:22.696995+0000","last_change":"2024-09-13T19:11:22.697055+0000","last_active":"2024-09-13T19:11:22.696995+0000","last_peered":"2024-09-13T19:11:22.696995+0000","last_clean":"2024-09-13T19:11:22.696995+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:11:22.696995+0000","last_undegraded":"2024-09-13T19:11:22.696995+0000","last_fullsized":"2024-09-13T19:11:22.696995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:22.696804+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:22.696804+0000","last_clean_scrub_stamp":"2024-09-13T19:11:22.696804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.177091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.413754+0000","last_change":"2024-09-13T19:10:34.413754+0000","last_active":"2024-09-13T19:10:34.413754+0000","last_peered":"2024-09-13T19:10:34.413754+0000","last_clean":"2024-09-13T19:10:34.413754+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:10:34.413754+0000","last_undegraded":"2024-09-13T19:10:34.413754+0000","last_fullsized":"2024-09-13T19:10:34.413754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.413506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:48.737050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.496556+0000","last_change":"2024-09-13T19:10:45.496556+0000","last_active":"2024-09-13T19:10:45.496556+0000","last_peered":"2024-09-13T19:10:45.496556+0000","last_clean":"2024-09-13T19:10:45.496556+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:10:45.496556+0000","last_undegraded":"2024-09-13T19:10:45.496556+0000","last_fullsized":"2024-09-13T19:10:45.496556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.496261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:03.561842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.018270+0000","last_change":"2024-09-13T19:10:39.018270+0000","last_active":"2024-09-13T19:10:39.018270+0000","last_peered":"2024-09-13T19:10:39.018270+0000","last_clean":"2024-09-13T19:10:39.018270+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:10:39.018270+0000","last_undegraded":"2024-09-13T19:10:39.018270+0000","last_fullsized":"2024-09-13T19:10:39.018270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.018018+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:18.277091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705732,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":741263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705733,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":152715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:11:30.389 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:30.389 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-13T19:06:22.223299+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=22, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:30.390 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:30.390 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-13T19:06:28.255347+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=6, tm_sec=28, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=19, tm_min=10, tm_sec=5, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T19:11:30.391 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T19:11:50.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T19:11:50.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe7e01d640 1 Processor -- start 2024-09-13T19:11:50.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe7e01d640 1 -- start start 2024-09-13T19:11:50.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe7e01d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe7812ea90 0x7efe78130e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe7e01d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7809a9c0 con 0x7efe7812bd10 2024-09-13T19:11:50.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe7e01d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efe7812b820 con 0x7efe7812ea90 2024-09-13T19:11:50.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe6ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe7812ea90 0x7efe78130e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe777fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efe7812bd10 0x7efe7812c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60958/0 (socket says 172.21.15.12:60958) 2024-09-13T19:11:50.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe777fe640 1 -- 172.21.15.12:0/3731751439 learned_addr learned my addr 172.21.15.12:0/3731751439 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:11:50.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe6ffff640 1 -- 172.21.15.12:0/3731751439 >> v1:172.21.15.12:6789/0 conn(0x7efe7812bd10 legacy=0x7efe7812c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe6ffff640 1 -- 172.21.15.12:0/3731751439 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe78074f80 con 0x7efe7812ea90 2024-09-13T19:11:50.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe6ffff640 1 --2- 172.21.15.12:0/3731751439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812ea90 0x7efe78130e80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b9e0 tx=0x7efe6001ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f13726c8f2d4c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe76ffd640 1 -- 172.21.15.12:0/3731751439 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe600b4070 con 0x7efe7812ea90 2024-09-13T19:11:50.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe76ffd640 1 -- 172.21.15.12:0/3731751439 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe600a77f0 con 0x7efe7812ea90 2024-09-13T19:11:50.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.524+0000 7efe76ffd640 1 -- 172.21.15.12:0/3731751439 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe600a7af0 con 0x7efe7812ea90 2024-09-13T19:11:50.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/3731751439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812ea90 msgr2=0x7efe78130e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 --2- 172.21.15.12:0/3731751439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812ea90 0x7efe78130e80 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b9e0 tx=0x7efe6001ea40 comp rx=0 tx=0).stop 2024-09-13T19:11:50.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/3731751439 shutdown_connections 2024-09-13T19:11:50.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 --2- 172.21.15.12:0/3731751439 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812ea90 0x7efe78130e80 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:50.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/3731751439 >> 172.21.15.12:0/3731751439 conn(0x7efe7809d6f0 msgr2=0x7efe78099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:50.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/3731751439 shutdown_connections 2024-09-13T19:11:50.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/3731751439 wait complete. 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 Processor -- start 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- start start 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efe780961a0 con 0x7efe7812bd10 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe777fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe777fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57782/0 (socket says 172.21.15.12:57782) 2024-09-13T19:11:50.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe777fe640 1 -- 172.21.15.12:0/2326356262 learned_addr learned my addr 172.21.15.12:0/2326356262 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe777fe640 1 -- 172.21.15.12:0/2326356262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe781247a0 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe777fe640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efe6800c480 tx=0x7efe6800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68017070 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe68005c20 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe780721b0 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe68007070 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.528+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe78123c80 con 0x7efe7812bd10 2024-09-13T19:11:50.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7efe6801a070 con 0x7efe7812bd10 2024-09-13T19:11:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe78123a90 con 0x7efe7812bd10 2024-09-13T19:11:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe74ff9640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 0x7efe58038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efe68048490 con 0x7efe7812bd10 2024-09-13T19:11:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe6ffff640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 0x7efe58038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.532+0000 7efe6ffff640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 0x7efe58038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b9e0 tx=0x7efe600a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.536+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe781247a0 con 0x7efe7812bd10 2024-09-13T19:11:50.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.696+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 --> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe7812c0f0 con 0x7efe58035db0 2024-09-13T19:11:50.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.744+0000 7efe74ff9640 1 -- 172.21.15.12:0/2326356262 <== mgr.4100 v2:172.21.15.151:6824/3943350610 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666456 (secure 0 0 0) 0x7efe7812c0f0 con 0x7efe58035db0 2024-09-13T19:11:50.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-09-13T19:11:50.760 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-09-13T19:11:50.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 msgr2=0x7efe58038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 0x7efe58038270 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b9e0 tx=0x7efe600a9070 comp rx=0 tx=0).stop 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 msgr2=0x7efe781221b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efe6800c480 tx=0x7efe6800c940 comp rx=0 tx=0).stop 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 shutdown_connections 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7efe58035db0 0x7efe58038270 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 --2- 172.21.15.12:0/2326356262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe7812bd10 0x7efe781221b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 >> 172.21.15.12:0/2326356262 conn(0x7efe7809d6f0 msgr2=0x7efe78097b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 shutdown_connections 2024-09-13T19:11:50.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.748+0000 7efe7e01d640 1 -- 172.21.15.12:0/2326356262 wait complete. 2024-09-13T19:11:50.771 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-13T19:11:49.068351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5091,"num_read_kb":4672,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4795,"ondisk_log_size":4795,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148448,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338912,"statfs":{"total":386547056640,"available":386395045888,"internally_reserved":0,"allocated":2981888,"data_stored":1788524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005597"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.114644+0000","last_change":"2024-09-13T19:10:50.114706+0000","last_active":"2024-09-13T19:10:50.114644+0000","last_peered":"2024-09-13T19:10:50.114644+0000","last_clean":"2024-09-13T19:10:50.114644+0000","last_became_active":"2024-09-13T19:06:19.265933+0000","last_became_peered":"2024-09-13T19:06:19.265933+0000","last_unstale":"2024-09-13T19:10:50.114644+0000","last_undegraded":"2024-09-13T19:10:50.114644+0000","last_fullsized":"2024-09-13T19:10:50.114644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:50.114431+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.114431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:14.222119+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'16","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.965129+0000","last_change":"2024-09-13T19:10:25.965129+0000","last_active":"2024-09-13T19:10:25.965129+0000","last_peered":"2024-09-13T19:10:25.965129+0000","last_clean":"2024-09-13T19:10:25.965129+0000","last_became_active":"2024-09-13T19:06:21.264031+0000","last_became_peered":"2024-09-13T19:06:21.264031+0000","last_unstale":"2024-09-13T19:10:25.965129+0000","last_undegraded":"2024-09-13T19:10:25.965129+0000","last_fullsized":"2024-09-13T19:10:25.965129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.964881+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.964881+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:55.311376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":70,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.386765+0000","last_change":"2024-09-13T19:10:39.386834+0000","last_active":"2024-09-13T19:10:39.386765+0000","last_peered":"2024-09-13T19:10:39.386765+0000","last_clean":"2024-09-13T19:10:39.386765+0000","last_became_active":"2024-09-13T19:06:19.275511+0000","last_became_peered":"2024-09-13T19:06:19.275511+0000","last_unstale":"2024-09-13T19:10:39.386765+0000","last_undegraded":"2024-09-13T19:10:39.386765+0000","last_fullsized":"2024-09-13T19:10:39.386765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:39.386575+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.386575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:52.773701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.885532+0000","last_change":"2024-09-13T19:10:46.885532+0000","last_active":"2024-09-13T19:10:46.885532+0000","last_peered":"2024-09-13T19:10:46.885532+0000","last_clean":"2024-09-13T19:10:46.885532+0000","last_became_active":"2024-09-13T19:06:21.256854+0000","last_became_peered":"2024-09-13T19:06:21.256854+0000","last_unstale":"2024-09-13T19:10:46.885532+0000","last_undegraded":"2024-09-13T19:10:46.885532+0000","last_fullsized":"2024-09-13T19:10:46.885532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:46.885150+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.885150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:36.242321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:15.825230+0000","last_change":"2024-09-13T19:11:15.825340+0000","last_active":"2024-09-13T19:11:15.825230+0000","last_peered":"2024-09-13T19:11:15.825230+0000","last_clean":"2024-09-13T19:11:15.825230+0000","last_became_active":"2024-09-13T19:06:19.293180+0000","last_became_peered":"2024-09-13T19:06:19.293180+0000","last_unstale":"2024-09-13T19:11:15.825230+0000","last_undegraded":"2024-09-13T19:11:15.825230+0000","last_fullsized":"2024-09-13T19:11:15.825230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:15.824904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:15.824904+0000","last_clean_scrub_stamp":"2024-09-13T19:11:15.824904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.205165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.962280+0000","last_change":"2024-09-13T19:10:44.962280+0000","last_active":"2024-09-13T19:10:44.962280+0000","last_peered":"2024-09-13T19:10:44.962280+0000","last_clean":"2024-09-13T19:10:44.962280+0000","last_became_active":"2024-09-13T19:06:21.256781+0000","last_became_peered":"2024-09-13T19:06:21.256781+0000","last_unstale":"2024-09-13T19:10:44.962280+0000","last_undegraded":"2024-09-13T19:10:44.962280+0000","last_fullsized":"2024-09-13T19:10:44.962280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:44.961999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.961999+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:09.446134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.214987+0000","last_change":"2024-09-13T19:10:42.215120+0000","last_active":"2024-09-13T19:10:42.214987+0000","last_peered":"2024-09-13T19:10:42.214987+0000","last_clean":"2024-09-13T19:10:42.214987+0000","last_became_active":"2024-09-13T19:06:19.271652+0000","last_became_peered":"2024-09-13T19:06:19.271652+0000","last_unstale":"2024-09-13T19:10:42.214987+0000","last_undegraded":"2024-09-13T19:10:42.214987+0000","last_fullsized":"2024-09-13T19:10:42.214987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.214682+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.214682+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:21.166832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.929698+0000","last_change":"2024-09-13T19:10:52.929698+0000","last_active":"2024-09-13T19:10:52.929698+0000","last_peered":"2024-09-13T19:10:52.929698+0000","last_clean":"2024-09-13T19:10:52.929698+0000","last_became_active":"2024-09-13T19:06:21.255174+0000","last_became_peered":"2024-09-13T19:06:21.255174+0000","last_unstale":"2024-09-13T19:10:52.929698+0000","last_undegraded":"2024-09-13T19:10:52.929698+0000","last_fullsized":"2024-09-13T19:10:52.929698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:52.929326+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.929326+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:33.662146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:10.895840+0000","last_change":"2024-09-13T19:11:10.895840+0000","last_active":"2024-09-13T19:11:10.895840+0000","last_peered":"2024-09-13T19:11:10.895840+0000","last_clean":"2024-09-13T19:11:10.895840+0000","last_became_active":"2024-09-13T19:06:19.289383+0000","last_became_peered":"2024-09-13T19:06:19.289383+0000","last_unstale":"2024-09-13T19:11:10.895840+0000","last_undegraded":"2024-09-13T19:11:10.895840+0000","last_fullsized":"2024-09-13T19:11:10.895840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:10.895414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:10.895414+0000","last_clean_scrub_stamp":"2024-09-13T19:11:10.895414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:52:03.340866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.014802+0000","last_change":"2024-09-13T19:10:37.014859+0000","last_active":"2024-09-13T19:10:37.014802+0000","last_peered":"2024-09-13T19:10:37.014802+0000","last_clean":"2024-09-13T19:10:37.014802+0000","last_became_active":"2024-09-13T19:06:21.261653+0000","last_became_peered":"2024-09-13T19:06:21.261653+0000","last_unstale":"2024-09-13T19:10:37.014802+0000","last_undegraded":"2024-09-13T19:10:37.014802+0000","last_fullsized":"2024-09-13T19:10:37.014802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:37.014649+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.014649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:51.338193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.025008+0000","last_change":"2024-09-13T19:10:53.025008+0000","last_active":"2024-09-13T19:10:53.025008+0000","last_peered":"2024-09-13T19:10:53.025008+0000","last_clean":"2024-09-13T19:10:53.025008+0000","last_became_active":"2024-09-13T19:06:19.268742+0000","last_became_peered":"2024-09-13T19:06:19.268742+0000","last_unstale":"2024-09-13T19:10:53.025008+0000","last_undegraded":"2024-09-13T19:10:53.025008+0000","last_fullsized":"2024-09-13T19:10:53.025008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.024751+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.024751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:54.925323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.711657+0000","last_change":"2024-09-13T19:10:24.711657+0000","last_active":"2024-09-13T19:10:24.711657+0000","last_peered":"2024-09-13T19:10:24.711657+0000","last_clean":"2024-09-13T19:10:24.711657+0000","last_became_active":"2024-09-13T19:06:21.265131+0000","last_became_peered":"2024-09-13T19:06:21.265131+0000","last_unstale":"2024-09-13T19:10:24.711657+0000","last_undegraded":"2024-09-13T19:10:24.711657+0000","last_fullsized":"2024-09-13T19:10:24.711657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:24.711412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.711412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:17.178317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:16.804795+0000","last_change":"2024-09-13T19:11:16.804795+0000","last_active":"2024-09-13T19:11:16.804795+0000","last_peered":"2024-09-13T19:11:16.804795+0000","last_clean":"2024-09-13T19:11:16.804795+0000","last_became_active":"2024-09-13T19:06:19.282753+0000","last_became_peered":"2024-09-13T19:06:19.282753+0000","last_unstale":"2024-09-13T19:11:16.804795+0000","last_undegraded":"2024-09-13T19:11:16.804795+0000","last_fullsized":"2024-09-13T19:11:16.804795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:16.804506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:16.804506+0000","last_clean_scrub_stamp":"2024-09-13T19:11:16.804506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:32.048066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":48,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.239676+0000","last_change":"2024-09-13T19:10:41.239708+0000","last_active":"2024-09-13T19:10:41.239676+0000","last_peered":"2024-09-13T19:10:41.239676+0000","last_clean":"2024-09-13T19:10:41.239676+0000","last_became_active":"2024-09-13T19:06:21.255234+0000","last_became_peered":"2024-09-13T19:06:21.255234+0000","last_unstale":"2024-09-13T19:10:41.239676+0000","last_undegraded":"2024-09-13T19:10:41.239676+0000","last_fullsized":"2024-09-13T19:10:41.239676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:41.239600+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.239600+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:03.210937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.431549+0000","last_change":"2024-09-13T19:10:59.431549+0000","last_active":"2024-09-13T19:10:59.431549+0000","last_peered":"2024-09-13T19:10:59.431549+0000","last_clean":"2024-09-13T19:10:59.431549+0000","last_became_active":"2024-09-13T19:06:19.265361+0000","last_became_peered":"2024-09-13T19:06:19.265361+0000","last_unstale":"2024-09-13T19:10:59.431549+0000","last_undegraded":"2024-09-13T19:10:59.431549+0000","last_fullsized":"2024-09-13T19:10:59.431549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.431298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.431298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.872786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'10","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.114062+0000","last_change":"2024-09-13T19:10:45.114122+0000","last_active":"2024-09-13T19:10:45.114062+0000","last_peered":"2024-09-13T19:10:45.114062+0000","last_clean":"2024-09-13T19:10:45.114062+0000","last_became_active":"2024-09-13T19:06:21.259140+0000","last_became_peered":"2024-09-13T19:06:21.259140+0000","last_unstale":"2024-09-13T19:10:45.114062+0000","last_undegraded":"2024-09-13T19:10:45.114062+0000","last_fullsized":"2024-09-13T19:10:45.114062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:45.113869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.113869+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:06.972412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":56,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.915985+0000","last_change":"2024-09-13T19:10:45.915985+0000","last_active":"2024-09-13T19:10:45.915985+0000","last_peered":"2024-09-13T19:10:45.915985+0000","last_clean":"2024-09-13T19:10:45.915985+0000","last_became_active":"2024-09-13T19:06:21.256937+0000","last_became_peered":"2024-09-13T19:06:21.256937+0000","last_unstale":"2024-09-13T19:10:45.915985+0000","last_undegraded":"2024-09-13T19:10:45.915985+0000","last_fullsized":"2024-09-13T19:10:45.915985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:45.915738+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.915738+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:39.816239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.072129+0000","last_change":"2024-09-13T19:10:43.072129+0000","last_active":"2024-09-13T19:10:43.072129+0000","last_peered":"2024-09-13T19:10:43.072129+0000","last_clean":"2024-09-13T19:10:43.072129+0000","last_became_active":"2024-09-13T19:06:19.287451+0000","last_became_peered":"2024-09-13T19:06:19.287451+0000","last_unstale":"2024-09-13T19:10:43.072129+0000","last_undegraded":"2024-09-13T19:10:43.072129+0000","last_fullsized":"2024-09-13T19:10:43.072129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.071868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.071868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:07.179556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'14","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.974650+0000","last_change":"2024-09-13T19:10:33.974650+0000","last_active":"2024-09-13T19:10:33.974650+0000","last_peered":"2024-09-13T19:10:33.974650+0000","last_clean":"2024-09-13T19:10:33.974650+0000","last_became_active":"2024-09-13T19:06:21.262865+0000","last_became_peered":"2024-09-13T19:06:21.262865+0000","last_unstale":"2024-09-13T19:10:33.974650+0000","last_undegraded":"2024-09-13T19:10:33.974650+0000","last_fullsized":"2024-09-13T19:10:33.974650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:33.974412+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.974412+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:55.945748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.173537+0000","last_change":"2024-09-13T19:10:36.173537+0000","last_active":"2024-09-13T19:10:36.173537+0000","last_peered":"2024-09-13T19:10:36.173537+0000","last_clean":"2024-09-13T19:10:36.173537+0000","last_became_active":"2024-09-13T19:06:19.271815+0000","last_became_peered":"2024-09-13T19:06:19.271815+0000","last_unstale":"2024-09-13T19:10:36.173537+0000","last_undegraded":"2024-09-13T19:10:36.173537+0000","last_fullsized":"2024-09-13T19:10:36.173537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:36.173259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.173259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:23.309455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.919051+0000","last_change":"2024-09-13T19:10:26.919051+0000","last_active":"2024-09-13T19:10:26.919051+0000","last_peered":"2024-09-13T19:10:26.919051+0000","last_clean":"2024-09-13T19:10:26.919051+0000","last_became_active":"2024-09-13T19:06:21.264096+0000","last_became_peered":"2024-09-13T19:06:21.264096+0000","last_unstale":"2024-09-13T19:10:26.919051+0000","last_undegraded":"2024-09-13T19:10:26.919051+0000","last_fullsized":"2024-09-13T19:10:26.919051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:26.918796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.918796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:56.283130+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.953812+0000","last_change":"2024-09-13T19:10:58.953812+0000","last_active":"2024-09-13T19:10:58.953812+0000","last_peered":"2024-09-13T19:10:58.953812+0000","last_clean":"2024-09-13T19:10:58.953812+0000","last_became_active":"2024-09-13T19:06:19.274066+0000","last_became_peered":"2024-09-13T19:06:19.274066+0000","last_unstale":"2024-09-13T19:10:58.953812+0000","last_undegraded":"2024-09-13T19:10:58.953812+0000","last_fullsized":"2024-09-13T19:10:58.953812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.953532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.953532+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:41.900118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'10","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.426283+0000","last_change":"2024-09-13T19:10:42.426283+0000","last_active":"2024-09-13T19:10:42.426283+0000","last_peered":"2024-09-13T19:10:42.426283+0000","last_clean":"2024-09-13T19:10:42.426283+0000","last_became_active":"2024-09-13T19:06:21.252626+0000","last_became_peered":"2024-09-13T19:06:21.252626+0000","last_unstale":"2024-09-13T19:10:42.426283+0000","last_undegraded":"2024-09-13T19:10:42.426283+0000","last_fullsized":"2024-09-13T19:10:42.426283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:42.425992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.425992+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:20.569059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.052015+0000","last_change":"2024-09-13T19:10:47.052015+0000","last_active":"2024-09-13T19:10:47.052015+0000","last_peered":"2024-09-13T19:10:47.052015+0000","last_clean":"2024-09-13T19:10:47.052015+0000","last_became_active":"2024-09-13T19:06:19.281354+0000","last_became_peered":"2024-09-13T19:06:19.281354+0000","last_unstale":"2024-09-13T19:10:47.052015+0000","last_undegraded":"2024-09-13T19:10:47.052015+0000","last_fullsized":"2024-09-13T19:10:47.052015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.051626+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.051626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:27.710935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.251015+0000","last_change":"2024-09-13T19:10:39.251015+0000","last_active":"2024-09-13T19:10:39.251015+0000","last_peered":"2024-09-13T19:10:39.251015+0000","last_clean":"2024-09-13T19:10:39.251015+0000","last_became_active":"2024-09-13T19:06:21.254272+0000","last_became_peered":"2024-09-13T19:06:21.254272+0000","last_unstale":"2024-09-13T19:10:39.251015+0000","last_undegraded":"2024-09-13T19:10:39.251015+0000","last_fullsized":"2024-09-13T19:10:39.251015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:39.250731+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.250731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:13.731105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.465752+0000","last_change":"2024-09-13T19:10:43.465752+0000","last_active":"2024-09-13T19:10:43.465752+0000","last_peered":"2024-09-13T19:10:43.465752+0000","last_clean":"2024-09-13T19:10:43.465752+0000","last_became_active":"2024-09-13T19:06:19.277516+0000","last_became_peered":"2024-09-13T19:06:19.277516+0000","last_unstale":"2024-09-13T19:10:43.465752+0000","last_undegraded":"2024-09-13T19:10:43.465752+0000","last_fullsized":"2024-09-13T19:10:43.465752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:43.465496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.465496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:45.366067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.911854+0000","last_change":"2024-09-13T19:10:29.911854+0000","last_active":"2024-09-13T19:10:29.911854+0000","last_peered":"2024-09-13T19:10:29.911854+0000","last_clean":"2024-09-13T19:10:29.911854+0000","last_became_active":"2024-09-13T19:06:21.262497+0000","last_became_peered":"2024-09-13T19:06:21.262497+0000","last_unstale":"2024-09-13T19:10:29.911854+0000","last_undegraded":"2024-09-13T19:10:29.911854+0000","last_fullsized":"2024-09-13T19:10:29.911854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:29.911432+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.911432+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:31.527553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:23.741846+0000","last_change":"2024-09-13T19:11:23.741903+0000","last_active":"2024-09-13T19:11:23.741846+0000","last_peered":"2024-09-13T19:11:23.741846+0000","last_clean":"2024-09-13T19:11:23.741846+0000","last_became_active":"2024-09-13T19:06:19.281479+0000","last_became_peered":"2024-09-13T19:06:19.281479+0000","last_unstale":"2024-09-13T19:11:23.741846+0000","last_undegraded":"2024-09-13T19:11:23.741846+0000","last_fullsized":"2024-09-13T19:11:23.741846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:23.741637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:23.741637+0000","last_clean_scrub_stamp":"2024-09-13T19:11:23.741637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:00.826194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'38","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.837486+0000","last_change":"2024-09-13T19:11:04.837486+0000","last_active":"2024-09-13T19:11:04.837486+0000","last_peered":"2024-09-13T19:11:04.837486+0000","last_clean":"2024-09-13T19:11:04.837486+0000","last_became_active":"2024-09-13T19:06:29.323461+0000","last_became_peered":"2024-09-13T19:06:29.323461+0000","last_unstale":"2024-09-13T19:11:04.837486+0000","last_undegraded":"2024-09-13T19:11:04.837486+0000","last_fullsized":"2024-09-13T19:11:04.837486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-09-13T19:11:04.837235+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.837235+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:36.605647+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":172,"num_read_kb":172,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.989392+0000","last_change":"2024-09-13T19:10:54.989392+0000","last_active":"2024-09-13T19:10:54.989392+0000","last_peered":"2024-09-13T19:10:54.989392+0000","last_clean":"2024-09-13T19:10:54.989392+0000","last_became_active":"2024-09-13T19:06:21.248236+0000","last_became_peered":"2024-09-13T19:06:21.248236+0000","last_unstale":"2024-09-13T19:10:54.989392+0000","last_undegraded":"2024-09-13T19:10:54.989392+0000","last_fullsized":"2024-09-13T19:10:54.989392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:54.989104+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.989104+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:26.683655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:09.908071+0000","last_change":"2024-09-13T19:11:09.908212+0000","last_active":"2024-09-13T19:11:09.908071+0000","last_peered":"2024-09-13T19:11:09.908071+0000","last_clean":"2024-09-13T19:11:09.908071+0000","last_became_active":"2024-09-13T19:06:19.294010+0000","last_became_peered":"2024-09-13T19:06:19.294010+0000","last_unstale":"2024-09-13T19:11:09.908071+0000","last_undegraded":"2024-09-13T19:11:09.908071+0000","last_fullsized":"2024-09-13T19:11:09.908071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:09.907831+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:09.907831+0000","last_clean_scrub_stamp":"2024-09-13T19:11:09.907831+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:14.270691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.972934+0000","last_change":"2024-09-13T19:10:12.972934+0000","last_active":"2024-09-13T19:10:12.972934+0000","last_peered":"2024-09-13T19:10:12.972934+0000","last_clean":"2024-09-13T19:10:12.972934+0000","last_became_active":"2024-09-13T19:06:23.275890+0000","last_became_peered":"2024-09-13T19:06:23.275890+0000","last_unstale":"2024-09-13T19:10:12.972934+0000","last_undegraded":"2024-09-13T19:10:12.972934+0000","last_fullsized":"2024-09-13T19:10:12.972934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.972679+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.972679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:27.296223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.843011+0000","last_change":"2024-09-13T19:10:19.843011+0000","last_active":"2024-09-13T19:10:19.843011+0000","last_peered":"2024-09-13T19:10:19.843011+0000","last_clean":"2024-09-13T19:10:19.843011+0000","last_became_active":"2024-09-13T19:06:25.280860+0000","last_became_peered":"2024-09-13T19:06:25.280860+0000","last_unstale":"2024-09-13T19:10:19.843011+0000","last_undegraded":"2024-09-13T19:10:19.843011+0000","last_fullsized":"2024-09-13T19:10:19.843011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:19.842729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.842729+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:36.209477+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.887880+0000","last_change":"2024-09-13T19:10:15.887880+0000","last_active":"2024-09-13T19:10:15.887880+0000","last_peered":"2024-09-13T19:10:15.887880+0000","last_clean":"2024-09-13T19:10:15.887880+0000","last_became_active":"2024-09-13T19:06:27.317725+0000","last_became_peered":"2024-09-13T19:06:27.317725+0000","last_unstale":"2024-09-13T19:10:15.887880+0000","last_undegraded":"2024-09-13T19:10:15.887880+0000","last_fullsized":"2024-09-13T19:10:15.887880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:15.887546+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.887546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:39.150730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.810986+0000","last_change":"2024-09-13T19:11:06.810986+0000","last_active":"2024-09-13T19:11:06.810986+0000","last_peered":"2024-09-13T19:11:06.810986+0000","last_clean":"2024-09-13T19:11:06.810986+0000","last_became_active":"2024-09-13T19:06:29.324961+0000","last_became_peered":"2024-09-13T19:06:29.324961+0000","last_unstale":"2024-09-13T19:11:06.810986+0000","last_undegraded":"2024-09-13T19:11:06.810986+0000","last_fullsized":"2024-09-13T19:11:06.810986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:11:06.810674+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.810674+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:31.294809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.975142+0000","last_change":"2024-09-13T19:10:49.975142+0000","last_active":"2024-09-13T19:10:49.975142+0000","last_peered":"2024-09-13T19:10:49.975142+0000","last_clean":"2024-09-13T19:10:49.975142+0000","last_became_active":"2024-09-13T19:06:21.255550+0000","last_became_peered":"2024-09-13T19:06:21.255550+0000","last_unstale":"2024-09-13T19:10:49.975142+0000","last_undegraded":"2024-09-13T19:10:49.975142+0000","last_fullsized":"2024-09-13T19:10:49.975142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:49.974877+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.974877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:56:08.294215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.035800+0000","last_change":"2024-09-13T19:10:54.035800+0000","last_active":"2024-09-13T19:10:54.035800+0000","last_peered":"2024-09-13T19:10:54.035800+0000","last_clean":"2024-09-13T19:10:54.035800+0000","last_became_active":"2024-09-13T19:06:19.269270+0000","last_became_peered":"2024-09-13T19:06:19.269270+0000","last_unstale":"2024-09-13T19:10:54.035800+0000","last_undegraded":"2024-09-13T19:10:54.035800+0000","last_fullsized":"2024-09-13T19:10:54.035800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.035439+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.035439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:34.694748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.432482+0000","last_change":"2024-09-13T19:10:27.432482+0000","last_active":"2024-09-13T19:10:27.432482+0000","last_peered":"2024-09-13T19:10:27.432482+0000","last_clean":"2024-09-13T19:10:27.432482+0000","last_became_active":"2024-09-13T19:06:23.251718+0000","last_became_peered":"2024-09-13T19:06:23.251718+0000","last_unstale":"2024-09-13T19:10:27.432482+0000","last_undegraded":"2024-09-13T19:10:27.432482+0000","last_fullsized":"2024-09-13T19:10:27.432482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.432228+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.432228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:29.048350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'9","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.867013+0000","last_change":"2024-09-13T19:10:10.867013+0000","last_active":"2024-09-13T19:10:10.867013+0000","last_peered":"2024-09-13T19:10:10.867013+0000","last_clean":"2024-09-13T19:10:10.867013+0000","last_became_active":"2024-09-13T19:06:25.280492+0000","last_became_peered":"2024-09-13T19:06:25.280492+0000","last_unstale":"2024-09-13T19:10:10.867013+0000","last_undegraded":"2024-09-13T19:10:10.867013+0000","last_fullsized":"2024-09-13T19:10:10.867013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:10.866745+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.866745+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:48.102941+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.912578+0000","last_change":"2024-09-13T19:10:31.912578+0000","last_active":"2024-09-13T19:10:31.912578+0000","last_peered":"2024-09-13T19:10:31.912578+0000","last_clean":"2024-09-13T19:10:31.912578+0000","last_became_active":"2024-09-13T19:06:27.324229+0000","last_became_peered":"2024-09-13T19:06:27.324229+0000","last_unstale":"2024-09-13T19:10:31.912578+0000","last_undegraded":"2024-09-13T19:10:31.912578+0000","last_fullsized":"2024-09-13T19:10:31.912578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.912298+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.912298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:06.392672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.430935+0000","last_change":"2024-09-13T19:10:36.430935+0000","last_active":"2024-09-13T19:10:36.430935+0000","last_peered":"2024-09-13T19:10:36.430935+0000","last_clean":"2024-09-13T19:10:36.430935+0000","last_became_active":"2024-09-13T19:06:29.300116+0000","last_became_peered":"2024-09-13T19:06:29.300116+0000","last_unstale":"2024-09-13T19:10:36.430935+0000","last_undegraded":"2024-09-13T19:10:36.430935+0000","last_fullsized":"2024-09-13T19:10:36.430935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-09-13T19:10:36.430640+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.430640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.689712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.931258+0000","last_change":"2024-09-13T19:10:48.931258+0000","last_active":"2024-09-13T19:10:48.931258+0000","last_peered":"2024-09-13T19:10:48.931258+0000","last_clean":"2024-09-13T19:10:48.931258+0000","last_became_active":"2024-09-13T19:06:21.256021+0000","last_became_peered":"2024-09-13T19:06:21.256021+0000","last_unstale":"2024-09-13T19:10:48.931258+0000","last_undegraded":"2024-09-13T19:10:48.931258+0000","last_fullsized":"2024-09-13T19:10:48.931258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:48.930858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.930858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:06:24.303610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:24.790374+0000","last_change":"2024-09-13T19:11:24.790430+0000","last_active":"2024-09-13T19:11:24.790374+0000","last_peered":"2024-09-13T19:11:24.790374+0000","last_clean":"2024-09-13T19:11:24.790374+0000","last_became_active":"2024-09-13T19:06:19.282168+0000","last_became_peered":"2024-09-13T19:06:19.282168+0000","last_unstale":"2024-09-13T19:11:24.790374+0000","last_undegraded":"2024-09-13T19:11:24.790374+0000","last_fullsized":"2024-09-13T19:11:24.790374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:24.790172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:24.790172+0000","last_clean_scrub_stamp":"2024-09-13T19:11:24.790172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:34.064433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.425993+0000","last_change":"2024-09-13T19:10:25.425993+0000","last_active":"2024-09-13T19:10:25.425993+0000","last_peered":"2024-09-13T19:10:25.425993+0000","last_clean":"2024-09-13T19:10:25.425993+0000","last_became_active":"2024-09-13T19:06:23.257196+0000","last_became_peered":"2024-09-13T19:06:23.257196+0000","last_unstale":"2024-09-13T19:10:25.425993+0000","last_undegraded":"2024-09-13T19:10:25.425993+0000","last_fullsized":"2024-09-13T19:10:25.425993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.425753+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.425753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:37.189169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.253379+0000","last_change":"2024-09-13T19:10:18.253379+0000","last_active":"2024-09-13T19:10:18.253379+0000","last_peered":"2024-09-13T19:10:18.253379+0000","last_clean":"2024-09-13T19:10:18.253379+0000","last_became_active":"2024-09-13T19:06:25.296937+0000","last_became_peered":"2024-09-13T19:06:25.296937+0000","last_unstale":"2024-09-13T19:10:18.253379+0000","last_undegraded":"2024-09-13T19:10:18.253379+0000","last_fullsized":"2024-09-13T19:10:18.253379+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:18.252941+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.252941+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:40.725492+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.956410+0000","last_change":"2024-09-13T19:10:32.956410+0000","last_active":"2024-09-13T19:10:32.956410+0000","last_peered":"2024-09-13T19:10:32.956410+0000","last_clean":"2024-09-13T19:10:32.956410+0000","last_became_active":"2024-09-13T19:06:27.300786+0000","last_became_peered":"2024-09-13T19:06:27.300786+0000","last_unstale":"2024-09-13T19:10:32.956410+0000","last_undegraded":"2024-09-13T19:10:32.956410+0000","last_fullsized":"2024-09-13T19:10:32.956410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:32.956155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.956155+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:32.705617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.040480+0000","last_change":"2024-09-13T19:10:57.040480+0000","last_active":"2024-09-13T19:10:57.040480+0000","last_peered":"2024-09-13T19:10:57.040480+0000","last_clean":"2024-09-13T19:10:57.040480+0000","last_became_active":"2024-09-13T19:06:29.330247+0000","last_became_peered":"2024-09-13T19:06:29.330247+0000","last_unstale":"2024-09-13T19:10:57.040480+0000","last_undegraded":"2024-09-13T19:10:57.040480+0000","last_fullsized":"2024-09-13T19:10:57.040480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.040234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.040234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:15.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.435604+0000","last_change":"2024-09-13T19:10:37.435604+0000","last_active":"2024-09-13T19:10:37.435604+0000","last_peered":"2024-09-13T19:10:37.435604+0000","last_clean":"2024-09-13T19:10:37.435604+0000","last_became_active":"2024-09-13T19:06:21.258113+0000","last_became_peered":"2024-09-13T19:06:21.258113+0000","last_unstale":"2024-09-13T19:10:37.435604+0000","last_undegraded":"2024-09-13T19:10:37.435604+0000","last_fullsized":"2024-09-13T19:10:37.435604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:37.435250+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.435250+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:27.175964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.038490+0000","last_change":"2024-09-13T19:10:55.038490+0000","last_active":"2024-09-13T19:10:55.038490+0000","last_peered":"2024-09-13T19:10:55.038490+0000","last_clean":"2024-09-13T19:10:55.038490+0000","last_became_active":"2024-09-13T19:06:19.271904+0000","last_became_peered":"2024-09-13T19:06:19.271904+0000","last_unstale":"2024-09-13T19:10:55.038490+0000","last_undegraded":"2024-09-13T19:10:55.038490+0000","last_fullsized":"2024-09-13T19:10:55.038490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.038216+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.038216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:49.971585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.881765+0000","last_change":"2024-09-13T19:10:14.881765+0000","last_active":"2024-09-13T19:10:14.881765+0000","last_peered":"2024-09-13T19:10:14.881765+0000","last_clean":"2024-09-13T19:10:14.881765+0000","last_became_active":"2024-09-13T19:06:23.275895+0000","last_became_peered":"2024-09-13T19:06:23.275895+0000","last_unstale":"2024-09-13T19:10:14.881765+0000","last_undegraded":"2024-09-13T19:10:14.881765+0000","last_fullsized":"2024-09-13T19:10:14.881765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.881511+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.881511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:35.275730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.131313+0000","last_change":"2024-09-13T19:10:22.131313+0000","last_active":"2024-09-13T19:10:22.131313+0000","last_peered":"2024-09-13T19:10:22.131313+0000","last_clean":"2024-09-13T19:10:22.131313+0000","last_became_active":"2024-09-13T19:06:25.296194+0000","last_became_peered":"2024-09-13T19:06:25.296194+0000","last_unstale":"2024-09-13T19:10:22.131313+0000","last_undegraded":"2024-09-13T19:10:22.131313+0000","last_fullsized":"2024-09-13T19:10:22.131313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:22.131038+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.131038+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:50:23.920744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":456,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.561428+0000","last_change":"2024-09-13T19:10:11.561428+0000","last_active":"2024-09-13T19:10:11.561428+0000","last_peered":"2024-09-13T19:10:11.561428+0000","last_clean":"2024-09-13T19:10:11.561428+0000","last_became_active":"2024-09-13T19:06:27.282875+0000","last_became_peered":"2024-09-13T19:06:27.282875+0000","last_unstale":"2024-09-13T19:10:11.561428+0000","last_undegraded":"2024-09-13T19:10:11.561428+0000","last_fullsized":"2024-09-13T19:10:11.561428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:11.561170+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.561170+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:17.766610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.929670+0000","last_change":"2024-09-13T19:10:41.929670+0000","last_active":"2024-09-13T19:10:41.929670+0000","last_peered":"2024-09-13T19:10:41.929670+0000","last_clean":"2024-09-13T19:10:41.929670+0000","last_became_active":"2024-09-13T19:06:21.258847+0000","last_became_peered":"2024-09-13T19:06:21.258847+0000","last_unstale":"2024-09-13T19:10:41.929670+0000","last_undegraded":"2024-09-13T19:10:41.929670+0000","last_fullsized":"2024-09-13T19:10:41.929670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:41.929268+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.929268+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:19.427604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.054552+0000","last_change":"2024-09-13T19:10:48.054552+0000","last_active":"2024-09-13T19:10:48.054552+0000","last_peered":"2024-09-13T19:10:48.054552+0000","last_clean":"2024-09-13T19:10:48.054552+0000","last_became_active":"2024-09-13T19:06:19.263968+0000","last_became_peered":"2024-09-13T19:06:19.263968+0000","last_unstale":"2024-09-13T19:10:48.054552+0000","last_undegraded":"2024-09-13T19:10:48.054552+0000","last_fullsized":"2024-09-13T19:10:48.054552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.054273+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.054273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:42.086766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.843983+0000","last_change":"2024-09-13T19:10:14.843983+0000","last_active":"2024-09-13T19:10:14.843983+0000","last_peered":"2024-09-13T19:10:14.843983+0000","last_clean":"2024-09-13T19:10:14.843983+0000","last_became_active":"2024-09-13T19:06:23.273476+0000","last_became_peered":"2024-09-13T19:06:23.273476+0000","last_unstale":"2024-09-13T19:10:14.843983+0000","last_undegraded":"2024-09-13T19:10:14.843983+0000","last_fullsized":"2024-09-13T19:10:14.843983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.843733+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.843733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.242513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'52","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.232478+0000","last_change":"2024-09-13T19:10:15.232478+0000","last_active":"2024-09-13T19:10:15.232478+0000","last_peered":"2024-09-13T19:10:15.232478+0000","last_clean":"2024-09-13T19:10:15.232478+0000","last_became_active":"2024-09-13T19:06:25.301401+0000","last_became_peered":"2024-09-13T19:06:25.301401+0000","last_unstale":"2024-09-13T19:10:15.232478+0000","last_undegraded":"2024-09-13T19:10:15.232478+0000","last_fullsized":"2024-09-13T19:10:15.232478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'52","last_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_deep_scrub":"34'52","last_deep_scrub_stamp":"2024-09-13T19:10:15.232187+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.232187+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:36.639820+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.573027+0000","last_change":"2024-09-13T19:10:10.573027+0000","last_active":"2024-09-13T19:10:10.573027+0000","last_peered":"2024-09-13T19:10:10.573027+0000","last_clean":"2024-09-13T19:10:10.573027+0000","last_became_active":"2024-09-13T19:06:27.296091+0000","last_became_peered":"2024-09-13T19:06:27.296091+0000","last_unstale":"2024-09-13T19:10:10.573027+0000","last_undegraded":"2024-09-13T19:10:10.573027+0000","last_fullsized":"2024-09-13T19:10:10.573027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.572736+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.572736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:15.536842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.062803+0000","last_change":"2024-09-13T19:10:29.062803+0000","last_active":"2024-09-13T19:10:29.062803+0000","last_peered":"2024-09-13T19:10:29.062803+0000","last_clean":"2024-09-13T19:10:29.062803+0000","last_became_active":"2024-09-13T19:06:29.312951+0000","last_became_peered":"2024-09-13T19:06:29.312951+0000","last_unstale":"2024-09-13T19:10:29.062803+0000","last_undegraded":"2024-09-13T19:10:29.062803+0000","last_fullsized":"2024-09-13T19:10:29.062803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:29.062532+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.062532+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:37.830227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.057410+0000","last_change":"2024-09-13T19:10:44.057477+0000","last_active":"2024-09-13T19:10:44.057410+0000","last_peered":"2024-09-13T19:10:44.057410+0000","last_clean":"2024-09-13T19:10:44.057410+0000","last_became_active":"2024-09-13T19:06:21.258337+0000","last_became_peered":"2024-09-13T19:06:21.258337+0000","last_unstale":"2024-09-13T19:10:44.057410+0000","last_undegraded":"2024-09-13T19:10:44.057410+0000","last_fullsized":"2024-09-13T19:10:44.057410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:44.057221+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.057221+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:09.781010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.232296+0000","last_change":"2024-09-13T19:10:38.232296+0000","last_active":"2024-09-13T19:10:38.232296+0000","last_peered":"2024-09-13T19:10:38.232296+0000","last_clean":"2024-09-13T19:10:38.232296+0000","last_became_active":"2024-09-13T19:06:19.273152+0000","last_became_peered":"2024-09-13T19:06:19.273152+0000","last_unstale":"2024-09-13T19:10:38.232296+0000","last_undegraded":"2024-09-13T19:10:38.232296+0000","last_fullsized":"2024-09-13T19:10:38.232296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:38.232043+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.232043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:00.008382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.047517+0000","last_change":"2024-09-13T19:11:00.047517+0000","last_active":"2024-09-13T19:11:00.047517+0000","last_peered":"2024-09-13T19:11:00.047517+0000","last_clean":"2024-09-13T19:11:00.047517+0000","last_became_active":"2024-09-13T19:06:58.360996+0000","last_became_peered":"2024-09-13T19:06:58.360996+0000","last_unstale":"2024-09-13T19:11:00.047517+0000","last_undegraded":"2024-09-13T19:11:00.047517+0000","last_fullsized":"2024-09-13T19:11:00.047517+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.047252+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.047252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:20.655684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.869718+0000","last_change":"2024-09-13T19:10:15.869718+0000","last_active":"2024-09-13T19:10:15.869718+0000","last_peered":"2024-09-13T19:10:15.869718+0000","last_clean":"2024-09-13T19:10:15.869718+0000","last_became_active":"2024-09-13T19:06:25.279800+0000","last_became_peered":"2024-09-13T19:06:25.279800+0000","last_unstale":"2024-09-13T19:10:15.869718+0000","last_undegraded":"2024-09-13T19:10:15.869718+0000","last_fullsized":"2024-09-13T19:10:15.869718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-09-13T19:10:15.869314+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.869314+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:40.537473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.581959+0000","last_change":"2024-09-13T19:10:09.581959+0000","last_active":"2024-09-13T19:10:09.581959+0000","last_peered":"2024-09-13T19:10:09.581959+0000","last_clean":"2024-09-13T19:10:09.581959+0000","last_became_active":"2024-09-13T19:06:27.297168+0000","last_became_peered":"2024-09-13T19:06:27.297168+0000","last_unstale":"2024-09-13T19:10:09.581959+0000","last_undegraded":"2024-09-13T19:10:09.581959+0000","last_fullsized":"2024-09-13T19:10:09.581959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.581716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.581716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:02.986719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.803237+0000","last_change":"2024-09-13T19:11:05.803312+0000","last_active":"2024-09-13T19:11:05.803237+0000","last_peered":"2024-09-13T19:11:05.803237+0000","last_clean":"2024-09-13T19:11:05.803237+0000","last_became_active":"2024-09-13T19:06:29.325079+0000","last_became_peered":"2024-09-13T19:06:29.325079+0000","last_unstale":"2024-09-13T19:11:05.803237+0000","last_undegraded":"2024-09-13T19:11:05.803237+0000","last_fullsized":"2024-09-13T19:11:05.803237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:05.803047+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.803047+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:47.920585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.029472+0000","last_change":"2024-09-13T19:10:58.029544+0000","last_active":"2024-09-13T19:10:58.029472+0000","last_peered":"2024-09-13T19:10:58.029472+0000","last_clean":"2024-09-13T19:10:58.029472+0000","last_became_active":"2024-09-13T19:06:58.345678+0000","last_became_peered":"2024-09-13T19:06:58.345678+0000","last_unstale":"2024-09-13T19:10:58.029472+0000","last_undegraded":"2024-09-13T19:10:58.029472+0000","last_fullsized":"2024-09-13T19:10:58.029472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:58.029287+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.029287+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:51.352757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.961540+0000","last_change":"2024-09-13T19:10:58.961603+0000","last_active":"2024-09-13T19:10:58.961540+0000","last_peered":"2024-09-13T19:10:58.961540+0000","last_clean":"2024-09-13T19:10:58.961540+0000","last_became_active":"2024-09-13T19:06:19.295821+0000","last_became_peered":"2024-09-13T19:06:19.295821+0000","last_unstale":"2024-09-13T19:10:58.961540+0000","last_undegraded":"2024-09-13T19:10:58.961540+0000","last_fullsized":"2024-09-13T19:10:58.961540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:58.961359+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.961359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:40.944452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.463320+0000","last_change":"2024-09-13T19:10:26.463320+0000","last_active":"2024-09-13T19:10:26.463320+0000","last_peered":"2024-09-13T19:10:26.463320+0000","last_clean":"2024-09-13T19:10:26.463320+0000","last_became_active":"2024-09-13T19:06:23.256961+0000","last_became_peered":"2024-09-13T19:06:23.256961+0000","last_unstale":"2024-09-13T19:10:26.463320+0000","last_undegraded":"2024-09-13T19:10:26.463320+0000","last_fullsized":"2024-09-13T19:10:26.463320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.463075+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.463075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:13.599270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.935492+0000","last_change":"2024-09-13T19:10:40.935492+0000","last_active":"2024-09-13T19:10:40.935492+0000","last_peered":"2024-09-13T19:10:40.935492+0000","last_clean":"2024-09-13T19:10:40.935492+0000","last_became_active":"2024-09-13T19:06:25.289066+0000","last_became_peered":"2024-09-13T19:06:25.289066+0000","last_unstale":"2024-09-13T19:10:40.935492+0000","last_undegraded":"2024-09-13T19:10:40.935492+0000","last_fullsized":"2024-09-13T19:10:40.935492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:40.935209+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.935209+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.770064+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.631641+0000","last_change":"2024-09-13T19:10:07.631641+0000","last_active":"2024-09-13T19:10:07.631641+0000","last_peered":"2024-09-13T19:10:07.631641+0000","last_clean":"2024-09-13T19:10:07.631641+0000","last_became_active":"2024-09-13T19:06:27.297373+0000","last_became_peered":"2024-09-13T19:06:27.297373+0000","last_unstale":"2024-09-13T19:10:07.631641+0000","last_undegraded":"2024-09-13T19:10:07.631641+0000","last_fullsized":"2024-09-13T19:10:07.631641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:07.631538+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.631538+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:44.867733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.571156+0000","last_change":"2024-09-13T19:11:07.571223+0000","last_active":"2024-09-13T19:11:07.571156+0000","last_peered":"2024-09-13T19:11:07.571156+0000","last_clean":"2024-09-13T19:11:07.571156+0000","last_became_active":"2024-09-13T19:06:29.310542+0000","last_became_peered":"2024-09-13T19:06:29.310542+0000","last_unstale":"2024-09-13T19:11:07.571156+0000","last_undegraded":"2024-09-13T19:11:07.571156+0000","last_fullsized":"2024-09-13T19:11:07.571156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:07.570954+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.570954+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:56.928125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.213822+0000","last_change":"2024-09-13T19:10:37.213822+0000","last_active":"2024-09-13T19:10:37.213822+0000","last_peered":"2024-09-13T19:10:37.213822+0000","last_clean":"2024-09-13T19:10:37.213822+0000","last_became_active":"2024-09-13T19:06:21.253678+0000","last_became_peered":"2024-09-13T19:06:21.253678+0000","last_unstale":"2024-09-13T19:10:37.213822+0000","last_undegraded":"2024-09-13T19:10:37.213822+0000","last_fullsized":"2024-09-13T19:10:37.213822+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:37.213576+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.213576+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:38.829697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.894229+0000","last_change":"2024-09-13T19:11:06.894290+0000","last_active":"2024-09-13T19:11:06.894229+0000","last_peered":"2024-09-13T19:11:06.894229+0000","last_clean":"2024-09-13T19:11:06.894229+0000","last_became_active":"2024-09-13T19:06:19.290278+0000","last_became_peered":"2024-09-13T19:06:19.290278+0000","last_unstale":"2024-09-13T19:11:06.894229+0000","last_undegraded":"2024-09-13T19:11:06.894229+0000","last_fullsized":"2024-09-13T19:11:06.894229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:06.894042+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.894042+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:10:15.165505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.381653+0000","last_change":"2024-09-13T19:10:29.381653+0000","last_active":"2024-09-13T19:10:29.381653+0000","last_peered":"2024-09-13T19:10:29.381653+0000","last_clean":"2024-09-13T19:10:29.381653+0000","last_became_active":"2024-09-13T19:06:23.248404+0000","last_became_peered":"2024-09-13T19:06:23.248404+0000","last_unstale":"2024-09-13T19:10:29.381653+0000","last_undegraded":"2024-09-13T19:10:29.381653+0000","last_fullsized":"2024-09-13T19:10:29.381653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.381399+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.381399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:50:03.861773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'64","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.751268+0000","last_change":"2024-09-13T19:10:23.751268+0000","last_active":"2024-09-13T19:10:23.751268+0000","last_peered":"2024-09-13T19:10:23.751268+0000","last_clean":"2024-09-13T19:10:23.751268+0000","last_became_active":"2024-09-13T19:06:25.281875+0000","last_became_peered":"2024-09-13T19:06:25.281875+0000","last_unstale":"2024-09-13T19:10:23.751268+0000","last_undegraded":"2024-09-13T19:10:23.751268+0000","last_fullsized":"2024-09-13T19:10:23.751268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'64","last_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_deep_scrub":"34'64","last_deep_scrub_stamp":"2024-09-13T19:10:23.750999+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.750999+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:41.816580+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.394449+0000","last_change":"2024-09-13T19:10:24.394449+0000","last_active":"2024-09-13T19:10:24.394449+0000","last_peered":"2024-09-13T19:10:24.394449+0000","last_clean":"2024-09-13T19:10:24.394449+0000","last_became_active":"2024-09-13T19:06:27.312824+0000","last_became_peered":"2024-09-13T19:06:27.312824+0000","last_unstale":"2024-09-13T19:10:24.394449+0000","last_undegraded":"2024-09-13T19:10:24.394449+0000","last_fullsized":"2024-09-13T19:10:24.394449+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.394197+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.394197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:46.758833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.516024+0000","last_change":"2024-09-13T19:11:04.516098+0000","last_active":"2024-09-13T19:11:04.516024+0000","last_peered":"2024-09-13T19:11:04.516024+0000","last_clean":"2024-09-13T19:11:04.516024+0000","last_became_active":"2024-09-13T19:06:29.301629+0000","last_became_peered":"2024-09-13T19:06:29.301629+0000","last_unstale":"2024-09-13T19:11:04.516024+0000","last_undegraded":"2024-09-13T19:11:04.516024+0000","last_fullsized":"2024-09-13T19:11:04.516024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-13T19:11:04.515837+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.515837+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:03.482989+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'16","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.044112+0000","last_change":"2024-09-13T19:10:41.044112+0000","last_active":"2024-09-13T19:10:41.044112+0000","last_peered":"2024-09-13T19:10:41.044112+0000","last_clean":"2024-09-13T19:10:41.044112+0000","last_became_active":"2024-09-13T19:06:21.254537+0000","last_became_peered":"2024-09-13T19:06:21.254537+0000","last_unstale":"2024-09-13T19:10:41.044112+0000","last_undegraded":"2024-09-13T19:10:41.044112+0000","last_fullsized":"2024-09-13T19:10:41.044112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:41.043868+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.043868+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:35.076360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.514736+0000","last_change":"2024-09-13T19:10:53.514797+0000","last_active":"2024-09-13T19:10:53.514736+0000","last_peered":"2024-09-13T19:10:53.514736+0000","last_clean":"2024-09-13T19:10:53.514736+0000","last_became_active":"2024-09-13T19:06:19.274665+0000","last_became_peered":"2024-09-13T19:06:19.274665+0000","last_unstale":"2024-09-13T19:10:53.514736+0000","last_undegraded":"2024-09-13T19:10:53.514736+0000","last_fullsized":"2024-09-13T19:10:53.514736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:53.514542+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.514542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:53.518567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.036506+0000","last_change":"2024-09-13T19:10:28.036506+0000","last_active":"2024-09-13T19:10:28.036506+0000","last_peered":"2024-09-13T19:10:28.036506+0000","last_clean":"2024-09-13T19:10:28.036506+0000","last_became_active":"2024-09-13T19:06:23.252167+0000","last_became_peered":"2024-09-13T19:06:23.252167+0000","last_unstale":"2024-09-13T19:10:28.036506+0000","last_undegraded":"2024-09-13T19:10:28.036506+0000","last_fullsized":"2024-09-13T19:10:28.036506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.036142+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.036142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:37.355498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.832750+0000","last_change":"2024-09-13T19:10:09.832750+0000","last_active":"2024-09-13T19:10:09.832750+0000","last_peered":"2024-09-13T19:10:09.832750+0000","last_clean":"2024-09-13T19:10:09.832750+0000","last_became_active":"2024-09-13T19:06:25.280859+0000","last_became_peered":"2024-09-13T19:06:25.280859+0000","last_unstale":"2024-09-13T19:10:09.832750+0000","last_undegraded":"2024-09-13T19:10:09.832750+0000","last_fullsized":"2024-09-13T19:10:09.832750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:09.832440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.832440+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:33.388702+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.941102+0000","last_change":"2024-09-13T19:10:30.941102+0000","last_active":"2024-09-13T19:10:30.941102+0000","last_peered":"2024-09-13T19:10:30.941102+0000","last_clean":"2024-09-13T19:10:30.941102+0000","last_became_active":"2024-09-13T19:06:27.300828+0000","last_became_peered":"2024-09-13T19:06:27.300828+0000","last_unstale":"2024-09-13T19:10:30.941102+0000","last_undegraded":"2024-09-13T19:10:30.941102+0000","last_fullsized":"2024-09-13T19:10:30.941102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.940858+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.940858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:05.758351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:28.816736+0000","last_change":"2024-09-13T19:11:28.816810+0000","last_active":"2024-09-13T19:11:28.816736+0000","last_peered":"2024-09-13T19:11:28.816736+0000","last_clean":"2024-09-13T19:11:28.816736+0000","last_became_active":"2024-09-13T19:06:29.323188+0000","last_became_peered":"2024-09-13T19:06:29.323188+0000","last_unstale":"2024-09-13T19:11:28.816736+0000","last_undegraded":"2024-09-13T19:11:28.816736+0000","last_fullsized":"2024-09-13T19:11:28.816736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:28.816510+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:28.816510+0000","last_clean_scrub_stamp":"2024-09-13T19:11:28.816510+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:41:38.169590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.793652+0000","last_change":"2024-09-13T19:10:20.793652+0000","last_active":"2024-09-13T19:10:20.793652+0000","last_peered":"2024-09-13T19:10:20.793652+0000","last_clean":"2024-09-13T19:10:20.793652+0000","last_became_active":"2024-09-13T19:06:21.265881+0000","last_became_peered":"2024-09-13T19:06:21.265881+0000","last_unstale":"2024-09-13T19:10:20.793652+0000","last_undegraded":"2024-09-13T19:10:20.793652+0000","last_fullsized":"2024-09-13T19:10:20.793652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.793393+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.793393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:48.213611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.922009+0000","last_change":"2024-09-13T19:11:02.922064+0000","last_active":"2024-09-13T19:11:02.922009+0000","last_peered":"2024-09-13T19:11:02.922009+0000","last_clean":"2024-09-13T19:11:02.922009+0000","last_became_active":"2024-09-13T19:06:19.291623+0000","last_became_peered":"2024-09-13T19:06:19.291623+0000","last_unstale":"2024-09-13T19:11:02.922009+0000","last_undegraded":"2024-09-13T19:11:02.922009+0000","last_fullsized":"2024-09-13T19:11:02.922009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.921808+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.921808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:23.507567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.412680+0000","last_change":"2024-09-13T19:10:23.412680+0000","last_active":"2024-09-13T19:10:23.412680+0000","last_peered":"2024-09-13T19:10:23.412680+0000","last_clean":"2024-09-13T19:10:23.412680+0000","last_became_active":"2024-09-13T19:06:23.257432+0000","last_became_peered":"2024-09-13T19:06:23.257432+0000","last_unstale":"2024-09-13T19:10:23.412680+0000","last_undegraded":"2024-09-13T19:10:23.412680+0000","last_fullsized":"2024-09-13T19:10:23.412680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:23.412440+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.412440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:25.287249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.127417+0000","last_change":"2024-09-13T19:10:23.127417+0000","last_active":"2024-09-13T19:10:23.127417+0000","last_peered":"2024-09-13T19:10:23.127417+0000","last_clean":"2024-09-13T19:10:23.127417+0000","last_became_active":"2024-09-13T19:06:25.285270+0000","last_became_peered":"2024-09-13T19:06:25.285270+0000","last_unstale":"2024-09-13T19:10:23.127417+0000","last_undegraded":"2024-09-13T19:10:23.127417+0000","last_fullsized":"2024-09-13T19:10:23.127417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:23.127136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.127136+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:43.153291+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":446,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.210977+0000","last_change":"2024-09-13T19:10:13.210977+0000","last_active":"2024-09-13T19:10:13.210977+0000","last_peered":"2024-09-13T19:10:13.210977+0000","last_clean":"2024-09-13T19:10:13.210977+0000","last_became_active":"2024-09-13T19:06:27.327585+0000","last_became_peered":"2024-09-13T19:06:27.327585+0000","last_unstale":"2024-09-13T19:10:13.210977+0000","last_undegraded":"2024-09-13T19:10:13.210977+0000","last_fullsized":"2024-09-13T19:10:13.210977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:13.210704+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.210704+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:44.040477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'13","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.438358+0000","last_change":"2024-09-13T19:10:32.438358+0000","last_active":"2024-09-13T19:10:32.438358+0000","last_peered":"2024-09-13T19:10:32.438358+0000","last_clean":"2024-09-13T19:10:32.438358+0000","last_became_active":"2024-09-13T19:06:29.296644+0000","last_became_peered":"2024-09-13T19:06:29.296644+0000","last_unstale":"2024-09-13T19:10:32.438358+0000","last_undegraded":"2024-09-13T19:10:32.438358+0000","last_fullsized":"2024-09-13T19:10:32.438358+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-13T19:10:32.438073+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.438073+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:11.390223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'12","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.167545+0000","last_change":"2024-09-13T19:10:43.167545+0000","last_active":"2024-09-13T19:10:43.167545+0000","last_peered":"2024-09-13T19:10:43.167545+0000","last_clean":"2024-09-13T19:10:43.167545+0000","last_became_active":"2024-09-13T19:06:21.255358+0000","last_became_peered":"2024-09-13T19:06:21.255358+0000","last_unstale":"2024-09-13T19:10:43.167545+0000","last_undegraded":"2024-09-13T19:10:43.167545+0000","last_fullsized":"2024-09-13T19:10:43.167545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:43.167114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.167114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:09.024776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:14.823006+0000","last_change":"2024-09-13T19:11:14.823070+0000","last_active":"2024-09-13T19:11:14.823006+0000","last_peered":"2024-09-13T19:11:14.823006+0000","last_clean":"2024-09-13T19:11:14.823006+0000","last_became_active":"2024-09-13T19:06:19.283433+0000","last_became_peered":"2024-09-13T19:06:19.283433+0000","last_unstale":"2024-09-13T19:11:14.823006+0000","last_undegraded":"2024-09-13T19:11:14.823006+0000","last_fullsized":"2024-09-13T19:11:14.823006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:14.822802+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:14.822802+0000","last_clean_scrub_stamp":"2024-09-13T19:11:14.822802+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:04.165891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.959117+0000","last_change":"2024-09-13T19:10:22.959117+0000","last_active":"2024-09-13T19:10:22.959117+0000","last_peered":"2024-09-13T19:10:22.959117+0000","last_clean":"2024-09-13T19:10:22.959117+0000","last_became_active":"2024-09-13T19:06:23.261942+0000","last_became_peered":"2024-09-13T19:06:23.261942+0000","last_unstale":"2024-09-13T19:10:22.959117+0000","last_undegraded":"2024-09-13T19:10:22.959117+0000","last_fullsized":"2024-09-13T19:10:22.959117+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:22.958854+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.958854+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:00.913099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.814619+0000","last_change":"2024-09-13T19:10:21.814619+0000","last_active":"2024-09-13T19:10:21.814619+0000","last_peered":"2024-09-13T19:10:21.814619+0000","last_clean":"2024-09-13T19:10:21.814619+0000","last_became_active":"2024-09-13T19:06:25.281045+0000","last_became_peered":"2024-09-13T19:06:25.281045+0000","last_unstale":"2024-09-13T19:10:21.814619+0000","last_undegraded":"2024-09-13T19:10:21.814619+0000","last_fullsized":"2024-09-13T19:10:21.814619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:21.814367+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.814367+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:33.492669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":483,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:23.986876+0000","last_change":"2024-09-13T19:10:23.986876+0000","last_active":"2024-09-13T19:10:23.986876+0000","last_peered":"2024-09-13T19:10:23.986876+0000","last_clean":"2024-09-13T19:10:23.986876+0000","last_became_active":"2024-09-13T19:06:27.320643+0000","last_became_peered":"2024-09-13T19:06:27.320643+0000","last_unstale":"2024-09-13T19:10:23.986876+0000","last_undegraded":"2024-09-13T19:10:23.986876+0000","last_fullsized":"2024-09-13T19:10:23.986876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:23.986531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:23.986531+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:04.057824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.150372+0000","last_change":"2024-09-13T19:10:21.150372+0000","last_active":"2024-09-13T19:10:21.150372+0000","last_peered":"2024-09-13T19:10:21.150372+0000","last_clean":"2024-09-13T19:10:21.150372+0000","last_became_active":"2024-09-13T19:06:29.302973+0000","last_became_peered":"2024-09-13T19:06:29.302973+0000","last_unstale":"2024-09-13T19:10:21.150372+0000","last_undegraded":"2024-09-13T19:10:21.150372+0000","last_fullsized":"2024-09-13T19:10:21.150372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:21.150108+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.150108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:27.355549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.127264+0000","last_change":"2024-09-13T19:10:50.127264+0000","last_active":"2024-09-13T19:10:50.127264+0000","last_peered":"2024-09-13T19:10:50.127264+0000","last_clean":"2024-09-13T19:10:50.127264+0000","last_became_active":"2024-09-13T19:06:21.259970+0000","last_became_peered":"2024-09-13T19:06:21.259970+0000","last_unstale":"2024-09-13T19:10:50.127264+0000","last_undegraded":"2024-09-13T19:10:50.127264+0000","last_fullsized":"2024-09-13T19:10:50.127264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:50.127013+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.127013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.451561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.876607+0000","last_change":"2024-09-13T19:11:03.876751+0000","last_active":"2024-09-13T19:11:03.876607+0000","last_peered":"2024-09-13T19:11:03.876607+0000","last_clean":"2024-09-13T19:11:03.876607+0000","last_became_active":"2024-09-13T19:06:19.291883+0000","last_became_peered":"2024-09-13T19:06:19.291883+0000","last_unstale":"2024-09-13T19:11:03.876607+0000","last_undegraded":"2024-09-13T19:11:03.876607+0000","last_fullsized":"2024-09-13T19:11:03.876607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:03.876376+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.876376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:25.983099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.991613+0000","last_change":"2024-09-13T19:10:09.991613+0000","last_active":"2024-09-13T19:10:09.991613+0000","last_peered":"2024-09-13T19:10:09.991613+0000","last_clean":"2024-09-13T19:10:09.991613+0000","last_became_active":"2024-09-13T19:06:23.277919+0000","last_became_peered":"2024-09-13T19:06:23.277919+0000","last_unstale":"2024-09-13T19:10:09.991613+0000","last_undegraded":"2024-09-13T19:10:09.991613+0000","last_fullsized":"2024-09-13T19:10:09.991613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.991280+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.991280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:39.624094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'49","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.862549+0000","last_change":"2024-09-13T19:10:12.862549+0000","last_active":"2024-09-13T19:10:12.862549+0000","last_peered":"2024-09-13T19:10:12.862549+0000","last_clean":"2024-09-13T19:10:12.862549+0000","last_became_active":"2024-09-13T19:06:25.279915+0000","last_became_peered":"2024-09-13T19:06:25.279915+0000","last_unstale":"2024-09-13T19:10:12.862549+0000","last_undegraded":"2024-09-13T19:10:12.862549+0000","last_fullsized":"2024-09-13T19:10:12.862549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-13T19:10:12.862157+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.862157+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:03.704078+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.251305+0000","last_change":"2024-09-13T19:10:10.251305+0000","last_active":"2024-09-13T19:10:10.251305+0000","last_peered":"2024-09-13T19:10:10.251305+0000","last_clean":"2024-09-13T19:10:10.251305+0000","last_became_active":"2024-09-13T19:06:27.324073+0000","last_became_peered":"2024-09-13T19:06:27.324073+0000","last_unstale":"2024-09-13T19:10:10.251305+0000","last_undegraded":"2024-09-13T19:10:10.251305+0000","last_fullsized":"2024-09-13T19:10:10.251305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:10.250951+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.250951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:14.638874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.857657+0000","last_change":"2024-09-13T19:11:03.857726+0000","last_active":"2024-09-13T19:11:03.857657+0000","last_peered":"2024-09-13T19:11:03.857657+0000","last_clean":"2024-09-13T19:11:03.857657+0000","last_became_active":"2024-09-13T19:06:29.323255+0000","last_became_peered":"2024-09-13T19:06:29.323255+0000","last_unstale":"2024-09-13T19:11:03.857657+0000","last_undegraded":"2024-09-13T19:11:03.857657+0000","last_fullsized":"2024-09-13T19:11:03.857657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-13T19:11:03.857461+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.857461+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:41.355797+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.788819+0000","last_change":"2024-09-13T19:10:22.788819+0000","last_active":"2024-09-13T19:10:22.788819+0000","last_peered":"2024-09-13T19:10:22.788819+0000","last_clean":"2024-09-13T19:10:22.788819+0000","last_became_active":"2024-09-13T19:06:21.265487+0000","last_became_peered":"2024-09-13T19:06:21.265487+0000","last_unstale":"2024-09-13T19:10:22.788819+0000","last_undegraded":"2024-09-13T19:10:22.788819+0000","last_fullsized":"2024-09-13T19:10:22.788819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:22.788534+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.788534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:11.221320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":217,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.047563+0000","last_change":"2024-09-13T19:10:54.047637+0000","last_active":"2024-09-13T19:10:54.047563+0000","last_peered":"2024-09-13T19:10:54.047563+0000","last_clean":"2024-09-13T19:10:54.047563+0000","last_became_active":"2024-09-13T19:06:06.685900+0000","last_became_peered":"2024-09-13T19:06:06.685900+0000","last_unstale":"2024-09-13T19:10:54.047563+0000","last_undegraded":"2024-09-13T19:10:54.047563+0000","last_fullsized":"2024-09-13T19:10:54.047563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-09-13T19:10:54.047370+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.047370+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:04.396516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:18.811825+0000","last_change":"2024-09-13T19:11:18.812003+0000","last_active":"2024-09-13T19:11:18.811825+0000","last_peered":"2024-09-13T19:11:18.811825+0000","last_clean":"2024-09-13T19:11:18.811825+0000","last_became_active":"2024-09-13T19:06:09.222340+0000","last_became_peered":"2024-09-13T19:06:09.222340+0000","last_unstale":"2024-09-13T19:11:18.811825+0000","last_undegraded":"2024-09-13T19:11:18.811825+0000","last_fullsized":"2024-09-13T19:11:18.811825+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:18.811593+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:18.811593+0000","last_clean_scrub_stamp":"2024-09-13T19:11:18.811593+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:54.030654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002852182,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.927200+0000","last_change":"2024-09-13T19:11:07.927265+0000","last_active":"2024-09-13T19:11:07.927200+0000","last_peered":"2024-09-13T19:11:07.927200+0000","last_clean":"2024-09-13T19:11:07.927200+0000","last_became_active":"2024-09-13T19:06:19.292797+0000","last_became_peered":"2024-09-13T19:06:19.292797+0000","last_unstale":"2024-09-13T19:11:07.927200+0000","last_undegraded":"2024-09-13T19:11:07.927200+0000","last_fullsized":"2024-09-13T19:11:07.927200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.926993+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.926993+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:16.838950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.925770+0000","last_change":"2024-09-13T19:10:17.925770+0000","last_active":"2024-09-13T19:10:17.925770+0000","last_peered":"2024-09-13T19:10:17.925770+0000","last_clean":"2024-09-13T19:10:17.925770+0000","last_became_active":"2024-09-13T19:06:23.273546+0000","last_became_peered":"2024-09-13T19:06:23.273546+0000","last_unstale":"2024-09-13T19:10:17.925770+0000","last_undegraded":"2024-09-13T19:10:17.925770+0000","last_fullsized":"2024-09-13T19:10:17.925770+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.925452+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.925452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:48.521596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'87","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.929532+0000","last_change":"2024-09-13T19:10:13.929532+0000","last_active":"2024-09-13T19:10:13.929532+0000","last_peered":"2024-09-13T19:10:13.929532+0000","last_clean":"2024-09-13T19:10:13.929532+0000","last_became_active":"2024-09-13T19:06:25.276807+0000","last_became_peered":"2024-09-13T19:06:25.276807+0000","last_unstale":"2024-09-13T19:10:13.929532+0000","last_undegraded":"2024-09-13T19:10:13.929532+0000","last_fullsized":"2024-09-13T19:10:13.929532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'87","last_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_deep_scrub":"34'87","last_deep_scrub_stamp":"2024-09-13T19:10:13.929281+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.929281+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:35.787824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.567264+0000","last_change":"2024-09-13T19:10:12.567264+0000","last_active":"2024-09-13T19:10:12.567264+0000","last_peered":"2024-09-13T19:10:12.567264+0000","last_clean":"2024-09-13T19:10:12.567264+0000","last_became_active":"2024-09-13T19:06:27.297418+0000","last_became_peered":"2024-09-13T19:06:27.297418+0000","last_unstale":"2024-09-13T19:10:12.567264+0000","last_undegraded":"2024-09-13T19:10:12.567264+0000","last_fullsized":"2024-09-13T19:10:12.567264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.567011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.567011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:35.830195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'84","reported_seq":175,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.197379+0000","last_change":"2024-09-13T19:10:17.197379+0000","last_active":"2024-09-13T19:10:17.197379+0000","last_peered":"2024-09-13T19:10:17.197379+0000","last_clean":"2024-09-13T19:10:17.197379+0000","last_became_active":"2024-09-13T19:06:29.299899+0000","last_became_peered":"2024-09-13T19:06:29.299899+0000","last_unstale":"2024-09-13T19:10:17.197379+0000","last_undegraded":"2024-09-13T19:10:17.197379+0000","last_fullsized":"2024-09-13T19:10:17.197379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'84","last_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_deep_scrub":"34'84","last_deep_scrub_stamp":"2024-09-13T19:10:17.197010+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.197010+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:38:54.433206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":217,"num_read_kb":215,"num_write":162,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.949414+0000","last_change":"2024-09-13T19:10:53.949476+0000","last_active":"2024-09-13T19:10:53.949414+0000","last_peered":"2024-09-13T19:10:53.949414+0000","last_clean":"2024-09-13T19:10:53.949414+0000","last_became_active":"2024-09-13T19:06:21.248414+0000","last_became_peered":"2024-09-13T19:06:21.248414+0000","last_unstale":"2024-09-13T19:10:53.949414+0000","last_undegraded":"2024-09-13T19:10:53.949414+0000","last_fullsized":"2024-09-13T19:10:53.949414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:53.949220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.949220+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:44.541345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:19.790405+0000","last_change":"2024-09-13T19:11:19.790459+0000","last_active":"2024-09-13T19:11:19.790405+0000","last_peered":"2024-09-13T19:11:19.790405+0000","last_clean":"2024-09-13T19:11:19.790405+0000","last_became_active":"2024-09-13T19:06:09.222729+0000","last_became_peered":"2024-09-13T19:06:09.222729+0000","last_unstale":"2024-09-13T19:11:19.790405+0000","last_undegraded":"2024-09-13T19:11:19.790405+0000","last_fullsized":"2024-09-13T19:11:19.790405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:19.790208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:19.790208+0000","last_clean_scrub_stamp":"2024-09-13T19:11:19.790208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:31:03.089596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00094510600000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.495700+0000","last_change":"2024-09-13T19:10:51.495761+0000","last_active":"2024-09-13T19:10:51.495700+0000","last_peered":"2024-09-13T19:10:51.495700+0000","last_clean":"2024-09-13T19:10:51.495700+0000","last_became_active":"2024-09-13T19:06:19.271618+0000","last_became_peered":"2024-09-13T19:06:19.271618+0000","last_unstale":"2024-09-13T19:10:51.495700+0000","last_undegraded":"2024-09-13T19:10:51.495700+0000","last_fullsized":"2024-09-13T19:10:51.495700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.495502+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.495502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:01.844647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:10.969550+0000","last_change":"2024-09-13T19:10:10.969550+0000","last_active":"2024-09-13T19:10:10.969550+0000","last_peered":"2024-09-13T19:10:10.969550+0000","last_clean":"2024-09-13T19:10:10.969550+0000","last_became_active":"2024-09-13T19:06:23.275987+0000","last_became_peered":"2024-09-13T19:06:23.275987+0000","last_unstale":"2024-09-13T19:10:10.969550+0000","last_undegraded":"2024-09-13T19:10:10.969550+0000","last_fullsized":"2024-09-13T19:10:10.969550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:10.969289+0000","last_clean_scrub_stamp":"2024-09-13T19:10:10.969289+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:28.059258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":518,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.847892+0000","last_change":"2024-09-13T19:10:08.847892+0000","last_active":"2024-09-13T19:10:08.847892+0000","last_peered":"2024-09-13T19:10:08.847892+0000","last_clean":"2024-09-13T19:10:08.847892+0000","last_became_active":"2024-09-13T19:06:25.283521+0000","last_became_peered":"2024-09-13T19:06:25.283521+0000","last_unstale":"2024-09-13T19:10:08.847892+0000","last_undegraded":"2024-09-13T19:10:08.847892+0000","last_fullsized":"2024-09-13T19:10:08.847892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'290","last_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_deep_scrub":"34'290","last_deep_scrub_stamp":"2024-09-13T19:10:08.847620+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.847620+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:34.001690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.953784+0000","last_change":"2024-09-13T19:10:31.953784+0000","last_active":"2024-09-13T19:10:31.953784+0000","last_peered":"2024-09-13T19:10:31.953784+0000","last_clean":"2024-09-13T19:10:31.953784+0000","last_became_active":"2024-09-13T19:06:27.305034+0000","last_became_peered":"2024-09-13T19:06:27.305034+0000","last_unstale":"2024-09-13T19:10:31.953784+0000","last_undegraded":"2024-09-13T19:10:31.953784+0000","last_fullsized":"2024-09-13T19:10:31.953784+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.953404+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.953404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:26.886773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.995270+0000","last_change":"2024-09-13T19:10:35.995270+0000","last_active":"2024-09-13T19:10:35.995270+0000","last_peered":"2024-09-13T19:10:35.995270+0000","last_clean":"2024-09-13T19:10:35.995270+0000","last_became_active":"2024-09-13T19:06:29.314369+0000","last_became_peered":"2024-09-13T19:06:29.314369+0000","last_unstale":"2024-09-13T19:10:35.995270+0000","last_undegraded":"2024-09-13T19:10:35.995270+0000","last_fullsized":"2024-09-13T19:10:35.995270+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:35.995027+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.995027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:01.852689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'14","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.429059+0000","last_change":"2024-09-13T19:10:35.429059+0000","last_active":"2024-09-13T19:10:35.429059+0000","last_peered":"2024-09-13T19:10:35.429059+0000","last_clean":"2024-09-13T19:10:35.429059+0000","last_became_active":"2024-09-13T19:06:21.259290+0000","last_became_peered":"2024-09-13T19:06:21.259290+0000","last_unstale":"2024-09-13T19:10:35.429059+0000","last_undegraded":"2024-09-13T19:10:35.429059+0000","last_fullsized":"2024-09-13T19:10:35.429059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:10:35.428796+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.428796+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:58.222147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.088661+0000","last_change":"2024-09-13T19:10:47.088726+0000","last_active":"2024-09-13T19:10:47.088661+0000","last_peered":"2024-09-13T19:10:47.088661+0000","last_clean":"2024-09-13T19:10:47.088661+0000","last_became_active":"2024-09-13T19:06:09.220950+0000","last_became_peered":"2024-09-13T19:06:09.220950+0000","last_unstale":"2024-09-13T19:10:47.088661+0000","last_undegraded":"2024-09-13T19:10:47.088661+0000","last_fullsized":"2024-09-13T19:10:47.088661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.088396+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.088396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:36.829110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092371,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.497142+0000","last_change":"2024-09-13T19:10:49.497201+0000","last_active":"2024-09-13T19:10:49.497142+0000","last_peered":"2024-09-13T19:10:49.497142+0000","last_clean":"2024-09-13T19:10:49.497142+0000","last_became_active":"2024-09-13T19:06:19.274799+0000","last_became_peered":"2024-09-13T19:06:19.274799+0000","last_unstale":"2024-09-13T19:10:49.497142+0000","last_undegraded":"2024-09-13T19:10:49.497142+0000","last_fullsized":"2024-09-13T19:10:49.497142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.496931+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.496931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:47:05.613751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.077141+0000","last_change":"2024-09-13T19:11:01.077169+0000","last_active":"2024-09-13T19:11:01.077141+0000","last_peered":"2024-09-13T19:11:01.077141+0000","last_clean":"2024-09-13T19:11:01.077141+0000","last_became_active":"2024-09-13T19:06:58.363918+0000","last_became_peered":"2024-09-13T19:06:58.363918+0000","last_unstale":"2024-09-13T19:11:01.077141+0000","last_undegraded":"2024-09-13T19:11:01.077141+0000","last_fullsized":"2024-09-13T19:11:01.077141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:01.077063+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.077063+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:41.862042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.258425+0000","last_change":"2024-09-13T19:10:19.258425+0000","last_active":"2024-09-13T19:10:19.258425+0000","last_peered":"2024-09-13T19:10:19.258425+0000","last_clean":"2024-09-13T19:10:19.258425+0000","last_became_active":"2024-09-13T19:06:25.296688+0000","last_became_peered":"2024-09-13T19:06:25.296688+0000","last_unstale":"2024-09-13T19:10:19.258425+0000","last_undegraded":"2024-09-13T19:10:19.258425+0000","last_fullsized":"2024-09-13T19:10:19.258425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:19.258136+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.258136+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:20:12.663138+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.475886+0000","last_change":"2024-09-13T19:10:20.475886+0000","last_active":"2024-09-13T19:10:20.475886+0000","last_peered":"2024-09-13T19:10:20.475886+0000","last_clean":"2024-09-13T19:10:20.475886+0000","last_became_active":"2024-09-13T19:06:27.302300+0000","last_became_peered":"2024-09-13T19:06:27.302300+0000","last_unstale":"2024-09-13T19:10:20.475886+0000","last_undegraded":"2024-09-13T19:10:20.475886+0000","last_fullsized":"2024-09-13T19:10:20.475886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.475636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.475636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:23.310735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:31.740943+0000","last_change":"2024-09-13T19:11:31.740999+0000","last_active":"2024-09-13T19:11:31.740943+0000","last_peered":"2024-09-13T19:11:31.740943+0000","last_clean":"2024-09-13T19:11:31.740943+0000","last_became_active":"2024-09-13T19:06:29.329309+0000","last_became_peered":"2024-09-13T19:06:29.329309+0000","last_unstale":"2024-09-13T19:11:31.740943+0000","last_undegraded":"2024-09-13T19:11:31.740943+0000","last_fullsized":"2024-09-13T19:11:31.740943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:31.740742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:31.740742+0000","last_clean_scrub_stamp":"2024-09-13T19:11:31.740742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:26.313471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.535919+0000","last_change":"2024-09-13T19:10:50.535980+0000","last_active":"2024-09-13T19:10:50.535919+0000","last_peered":"2024-09-13T19:10:50.535919+0000","last_clean":"2024-09-13T19:10:50.535919+0000","last_became_active":"2024-09-13T19:06:21.255197+0000","last_became_peered":"2024-09-13T19:06:21.255197+0000","last_unstale":"2024-09-13T19:10:50.535919+0000","last_undegraded":"2024-09-13T19:10:50.535919+0000","last_fullsized":"2024-09-13T19:10:50.535919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:50.535729+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.535729+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:30.458282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:17.829057+0000","last_change":"2024-09-13T19:11:17.829118+0000","last_active":"2024-09-13T19:11:17.829057+0000","last_peered":"2024-09-13T19:11:17.829057+0000","last_clean":"2024-09-13T19:11:17.829057+0000","last_became_active":"2024-09-13T19:06:09.222083+0000","last_became_peered":"2024-09-13T19:06:09.222083+0000","last_unstale":"2024-09-13T19:11:17.829057+0000","last_undegraded":"2024-09-13T19:11:17.829057+0000","last_fullsized":"2024-09-13T19:11:17.829057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:11:17.828861+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:11:17.828861+0000","last_clean_scrub_stamp":"2024-09-13T19:11:17.828861+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:53:05.067674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002149607,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.086466+0000","last_change":"2024-09-13T19:10:49.086566+0000","last_active":"2024-09-13T19:10:49.086466+0000","last_peered":"2024-09-13T19:10:49.086466+0000","last_clean":"2024-09-13T19:10:49.086466+0000","last_became_active":"2024-09-13T19:06:19.264533+0000","last_became_peered":"2024-09-13T19:06:19.264533+0000","last_unstale":"2024-09-13T19:10:49.086466+0000","last_undegraded":"2024-09-13T19:10:49.086466+0000","last_fullsized":"2024-09-13T19:10:49.086466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:49.086290+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.086290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:02.473416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.413883+0000","last_change":"2024-09-13T19:10:31.413883+0000","last_active":"2024-09-13T19:10:31.413883+0000","last_peered":"2024-09-13T19:10:31.413883+0000","last_clean":"2024-09-13T19:10:31.413883+0000","last_became_active":"2024-09-13T19:06:23.242973+0000","last_became_peered":"2024-09-13T19:06:23.242973+0000","last_unstale":"2024-09-13T19:10:31.413883+0000","last_undegraded":"2024-09-13T19:10:31.413883+0000","last_fullsized":"2024-09-13T19:10:31.413883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:31.413619+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.413619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:53.384956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.988168+0000","last_change":"2024-09-13T19:10:11.988168+0000","last_active":"2024-09-13T19:10:11.988168+0000","last_peered":"2024-09-13T19:10:11.988168+0000","last_clean":"2024-09-13T19:10:11.988168+0000","last_became_active":"2024-09-13T19:06:25.276150+0000","last_became_peered":"2024-09-13T19:06:25.276150+0000","last_unstale":"2024-09-13T19:10:11.988168+0000","last_undegraded":"2024-09-13T19:10:11.988168+0000","last_fullsized":"2024-09-13T19:10:11.988168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-13T19:10:11.987853+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.987853+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:48.357172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:29.896017+0000","last_change":"2024-09-13T19:10:29.896017+0000","last_active":"2024-09-13T19:10:29.896017+0000","last_peered":"2024-09-13T19:10:29.896017+0000","last_clean":"2024-09-13T19:10:29.896017+0000","last_became_active":"2024-09-13T19:06:27.302283+0000","last_became_peered":"2024-09-13T19:06:27.302283+0000","last_unstale":"2024-09-13T19:10:29.896017+0000","last_undegraded":"2024-09-13T19:10:29.896017+0000","last_fullsized":"2024-09-13T19:10:29.896017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:29.895758+0000","last_clean_scrub_stamp":"2024-09-13T19:10:29.895758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:10.680737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:07.809087+0000","last_change":"2024-09-13T19:11:07.809149+0000","last_active":"2024-09-13T19:11:07.809087+0000","last_peered":"2024-09-13T19:11:07.809087+0000","last_clean":"2024-09-13T19:11:07.809087+0000","last_became_active":"2024-09-13T19:06:29.325933+0000","last_became_peered":"2024-09-13T19:06:29.325933+0000","last_unstale":"2024-09-13T19:11:07.809087+0000","last_undegraded":"2024-09-13T19:11:07.809087+0000","last_fullsized":"2024-09-13T19:11:07.809087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:07.808901+0000","last_clean_scrub_stamp":"2024-09-13T19:11:07.808901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:01.709401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.925703+0000","last_change":"2024-09-13T19:10:28.925703+0000","last_active":"2024-09-13T19:10:28.925703+0000","last_peered":"2024-09-13T19:10:28.925703+0000","last_clean":"2024-09-13T19:10:28.925703+0000","last_became_active":"2024-09-13T19:06:21.263680+0000","last_became_peered":"2024-09-13T19:06:21.263680+0000","last_unstale":"2024-09-13T19:10:28.925703+0000","last_undegraded":"2024-09-13T19:10:28.925703+0000","last_fullsized":"2024-09-13T19:10:28.925703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:28.925441+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.925441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:16.061636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.066417+0000","last_change":"2024-09-13T19:10:51.066476+0000","last_active":"2024-09-13T19:10:51.066417+0000","last_peered":"2024-09-13T19:10:51.066417+0000","last_clean":"2024-09-13T19:10:51.066417+0000","last_became_active":"2024-09-13T19:06:19.266721+0000","last_became_peered":"2024-09-13T19:06:19.266721+0000","last_unstale":"2024-09-13T19:10:51.066417+0000","last_undegraded":"2024-09-13T19:10:51.066417+0000","last_fullsized":"2024-09-13T19:10:51.066417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.066198+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.066198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:16.789987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:54.479112+0000","last_change":"2024-09-13T19:10:54.479173+0000","last_active":"2024-09-13T19:10:54.479112+0000","last_peered":"2024-09-13T19:10:54.479112+0000","last_clean":"2024-09-13T19:10:54.479112+0000","last_became_active":"2024-09-13T19:06:09.216971+0000","last_became_peered":"2024-09-13T19:06:09.216971+0000","last_unstale":"2024-09-13T19:10:54.479112+0000","last_undegraded":"2024-09-13T19:10:54.479112+0000","last_fullsized":"2024-09-13T19:10:54.479112+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:54.478927+0000","last_clean_scrub_stamp":"2024-09-13T19:10:54.478927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:49.935597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099332299999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.424395+0000","last_change":"2024-09-13T19:10:33.424395+0000","last_active":"2024-09-13T19:10:33.424395+0000","last_peered":"2024-09-13T19:10:33.424395+0000","last_clean":"2024-09-13T19:10:33.424395+0000","last_became_active":"2024-09-13T19:06:23.246043+0000","last_became_peered":"2024-09-13T19:06:23.246043+0000","last_unstale":"2024-09-13T19:10:33.424395+0000","last_undegraded":"2024-09-13T19:10:33.424395+0000","last_fullsized":"2024-09-13T19:10:33.424395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:33.424001+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.424001+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:59.281664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.564973+0000","last_change":"2024-09-13T19:10:18.564973+0000","last_active":"2024-09-13T19:10:18.564973+0000","last_peered":"2024-09-13T19:10:18.564973+0000","last_clean":"2024-09-13T19:10:18.564973+0000","last_became_active":"2024-09-13T19:06:25.270974+0000","last_became_peered":"2024-09-13T19:06:25.270974+0000","last_unstale":"2024-09-13T19:10:18.564973+0000","last_undegraded":"2024-09-13T19:10:18.564973+0000","last_fullsized":"2024-09-13T19:10:18.564973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-13T19:10:18.564713+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.564713+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:02.178317+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:09.287984+0000","last_change":"2024-09-13T19:10:09.287984+0000","last_active":"2024-09-13T19:10:09.287984+0000","last_peered":"2024-09-13T19:10:09.287984+0000","last_clean":"2024-09-13T19:10:09.287984+0000","last_became_active":"2024-09-13T19:06:27.324275+0000","last_became_peered":"2024-09-13T19:06:27.324275+0000","last_unstale":"2024-09-13T19:10:09.287984+0000","last_undegraded":"2024-09-13T19:10:09.287984+0000","last_fullsized":"2024-09-13T19:10:09.287984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:09.287642+0000","last_clean_scrub_stamp":"2024-09-13T19:10:09.287642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:27.524091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'11","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.573467+0000","last_change":"2024-09-13T19:11:08.573530+0000","last_active":"2024-09-13T19:11:08.573467+0000","last_peered":"2024-09-13T19:11:08.573467+0000","last_clean":"2024-09-13T19:11:08.573467+0000","last_became_active":"2024-09-13T19:06:29.323330+0000","last_became_peered":"2024-09-13T19:06:29.323330+0000","last_unstale":"2024-09-13T19:11:08.573467+0000","last_undegraded":"2024-09-13T19:11:08.573467+0000","last_fullsized":"2024-09-13T19:11:08.573467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-13T19:11:08.573284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.573284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:51.555269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.065219+0000","last_change":"2024-09-13T19:10:40.065315+0000","last_active":"2024-09-13T19:10:40.065219+0000","last_peered":"2024-09-13T19:10:40.065219+0000","last_clean":"2024-09-13T19:10:40.065219+0000","last_became_active":"2024-09-13T19:06:21.255023+0000","last_became_peered":"2024-09-13T19:06:21.255023+0000","last_unstale":"2024-09-13T19:10:40.065219+0000","last_undegraded":"2024-09-13T19:10:40.065219+0000","last_fullsized":"2024-09-13T19:10:40.065219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:40.065006+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.065006+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:29.805720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.432436+0000","last_change":"2024-09-13T19:11:00.432501+0000","last_active":"2024-09-13T19:11:00.432436+0000","last_peered":"2024-09-13T19:11:00.432436+0000","last_clean":"2024-09-13T19:11:00.432436+0000","last_became_active":"2024-09-13T19:06:19.267963+0000","last_became_peered":"2024-09-13T19:06:19.267963+0000","last_unstale":"2024-09-13T19:11:00.432436+0000","last_undegraded":"2024-09-13T19:11:00.432436+0000","last_fullsized":"2024-09-13T19:11:00.432436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.432247+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.432247+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:59.873661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:20.775677+0000","last_change":"2024-09-13T19:11:20.775733+0000","last_active":"2024-09-13T19:11:20.775677+0000","last_peered":"2024-09-13T19:11:20.775677+0000","last_clean":"2024-09-13T19:11:20.775677+0000","last_became_active":"2024-09-13T19:06:09.223008+0000","last_became_peered":"2024-09-13T19:06:09.223008+0000","last_unstale":"2024-09-13T19:11:20.775677+0000","last_undegraded":"2024-09-13T19:11:20.775677+0000","last_fullsized":"2024-09-13T19:11:20.775677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:20.775469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:20.775469+0000","last_clean_scrub_stamp":"2024-09-13T19:11:20.775469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:40.923782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023167420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:32.715403+0000","last_change":"2024-09-13T19:11:32.715455+0000","last_active":"2024-09-13T19:11:32.715403+0000","last_peered":"2024-09-13T19:11:32.715403+0000","last_clean":"2024-09-13T19:11:32.715403+0000","last_became_active":"2024-09-13T19:06:58.355567+0000","last_became_peered":"2024-09-13T19:06:58.355567+0000","last_unstale":"2024-09-13T19:11:32.715403+0000","last_undegraded":"2024-09-13T19:11:32.715403+0000","last_fullsized":"2024-09-13T19:11:32.715403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:32.715216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:32.715216+0000","last_clean_scrub_stamp":"2024-09-13T19:11:32.715216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:30.495286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:07.839664+0000","last_change":"2024-09-13T19:10:07.839664+0000","last_active":"2024-09-13T19:10:07.839664+0000","last_peered":"2024-09-13T19:10:07.839664+0000","last_clean":"2024-09-13T19:10:07.839664+0000","last_became_active":"2024-09-13T19:06:25.288423+0000","last_became_peered":"2024-09-13T19:06:25.288423+0000","last_unstale":"2024-09-13T19:10:07.839664+0000","last_undegraded":"2024-09-13T19:10:07.839664+0000","last_fullsized":"2024-09-13T19:10:07.839664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-13T19:10:07.839234+0000","last_clean_scrub_stamp":"2024-09-13T19:10:07.839234+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:14:57.815476+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":384,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.945197+0000","last_change":"2024-09-13T19:10:27.945197+0000","last_active":"2024-09-13T19:10:27.945197+0000","last_peered":"2024-09-13T19:10:27.945197+0000","last_clean":"2024-09-13T19:10:27.945197+0000","last_became_active":"2024-09-13T19:06:27.321132+0000","last_became_peered":"2024-09-13T19:06:27.321132+0000","last_unstale":"2024-09-13T19:10:27.945197+0000","last_undegraded":"2024-09-13T19:10:27.945197+0000","last_fullsized":"2024-09-13T19:10:27.945197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:27.944956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.944956+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:39.708373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.994412+0000","last_change":"2024-09-13T19:10:55.994412+0000","last_active":"2024-09-13T19:10:55.994412+0000","last_peered":"2024-09-13T19:10:55.994412+0000","last_clean":"2024-09-13T19:10:55.994412+0000","last_became_active":"2024-09-13T19:06:29.310838+0000","last_became_peered":"2024-09-13T19:06:29.310838+0000","last_unstale":"2024-09-13T19:10:55.994412+0000","last_undegraded":"2024-09-13T19:10:55.994412+0000","last_fullsized":"2024-09-13T19:10:55.994412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.994119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.994119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:22:19.655333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.800379+0000","last_change":"2024-09-13T19:10:26.800432+0000","last_active":"2024-09-13T19:10:26.800379+0000","last_peered":"2024-09-13T19:10:26.800379+0000","last_clean":"2024-09-13T19:10:26.800379+0000","last_became_active":"2024-09-13T19:06:21.259507+0000","last_became_peered":"2024-09-13T19:06:21.259507+0000","last_unstale":"2024-09-13T19:10:26.800379+0000","last_undegraded":"2024-09-13T19:10:26.800379+0000","last_fullsized":"2024-09-13T19:10:26.800379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:26.800155+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.800155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:20.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:13.867987+0000","last_change":"2024-09-13T19:11:13.868044+0000","last_active":"2024-09-13T19:11:13.867987+0000","last_peered":"2024-09-13T19:11:13.867987+0000","last_clean":"2024-09-13T19:11:13.867987+0000","last_became_active":"2024-09-13T19:06:19.294307+0000","last_became_peered":"2024-09-13T19:06:19.294307+0000","last_unstale":"2024-09-13T19:11:13.867987+0000","last_undegraded":"2024-09-13T19:11:13.867987+0000","last_fullsized":"2024-09-13T19:11:13.867987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:13.867760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:13.867760+0000","last_clean_scrub_stamp":"2024-09-13T19:11:13.867760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:19.636547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.499876+0000","last_change":"2024-09-13T19:10:55.499929+0000","last_active":"2024-09-13T19:10:55.499876+0000","last_peered":"2024-09-13T19:10:55.499876+0000","last_clean":"2024-09-13T19:10:55.499876+0000","last_became_active":"2024-09-13T19:06:09.218976+0000","last_became_peered":"2024-09-13T19:06:09.218976+0000","last_unstale":"2024-09-13T19:10:55.499876+0000","last_undegraded":"2024-09-13T19:10:55.499876+0000","last_fullsized":"2024-09-13T19:10:55.499876+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:55.499652+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.499652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:20.972903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010402810000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.988381+0000","last_change":"2024-09-13T19:10:08.988381+0000","last_active":"2024-09-13T19:10:08.988381+0000","last_peered":"2024-09-13T19:10:08.988381+0000","last_clean":"2024-09-13T19:10:08.988381+0000","last_became_active":"2024-09-13T19:06:23.275775+0000","last_became_peered":"2024-09-13T19:06:23.275775+0000","last_unstale":"2024-09-13T19:10:08.988381+0000","last_undegraded":"2024-09-13T19:10:08.988381+0000","last_fullsized":"2024-09-13T19:10:08.988381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.988147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.988147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.969133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.913475+0000","last_change":"2024-09-13T19:10:34.913475+0000","last_active":"2024-09-13T19:10:34.913475+0000","last_peered":"2024-09-13T19:10:34.913475+0000","last_clean":"2024-09-13T19:10:34.913475+0000","last_became_active":"2024-09-13T19:06:25.303235+0000","last_became_peered":"2024-09-13T19:06:25.303235+0000","last_unstale":"2024-09-13T19:10:34.913475+0000","last_undegraded":"2024-09-13T19:10:34.913475+0000","last_fullsized":"2024-09-13T19:10:34.913475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:34.913181+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.913181+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:57.790048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.531059+0000","last_change":"2024-09-13T19:10:14.531059+0000","last_active":"2024-09-13T19:10:14.531059+0000","last_peered":"2024-09-13T19:10:14.531059+0000","last_clean":"2024-09-13T19:10:14.531059+0000","last_became_active":"2024-09-13T19:06:27.281520+0000","last_became_peered":"2024-09-13T19:06:27.281520+0000","last_unstale":"2024-09-13T19:10:14.531059+0000","last_undegraded":"2024-09-13T19:10:14.531059+0000","last_fullsized":"2024-09-13T19:10:14.531059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:14.530810+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.530810+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:54.291531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.845668+0000","last_change":"2024-09-13T19:11:08.845731+0000","last_active":"2024-09-13T19:11:08.845668+0000","last_peered":"2024-09-13T19:11:08.845668+0000","last_clean":"2024-09-13T19:11:08.845668+0000","last_became_active":"2024-09-13T19:06:29.326653+0000","last_became_peered":"2024-09-13T19:06:29.326653+0000","last_unstale":"2024-09-13T19:11:08.845668+0000","last_undegraded":"2024-09-13T19:11:08.845668+0000","last_fullsized":"2024-09-13T19:11:08.845668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-13T19:11:08.845463+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.845463+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:58.202633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'12","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.085344+0000","last_change":"2024-09-13T19:10:55.085508+0000","last_active":"2024-09-13T19:10:55.085344+0000","last_peered":"2024-09-13T19:10:55.085344+0000","last_clean":"2024-09-13T19:10:55.085344+0000","last_became_active":"2024-09-13T19:06:21.259943+0000","last_became_peered":"2024-09-13T19:06:21.259943+0000","last_unstale":"2024-09-13T19:10:55.085344+0000","last_undegraded":"2024-09-13T19:10:55.085344+0000","last_fullsized":"2024-09-13T19:10:55.085344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:55.085114+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.085114+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.150695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.957696+0000","last_change":"2024-09-13T19:10:56.957756+0000","last_active":"2024-09-13T19:10:56.957696+0000","last_peered":"2024-09-13T19:10:56.957696+0000","last_clean":"2024-09-13T19:10:56.957696+0000","last_became_active":"2024-09-13T19:06:19.274297+0000","last_became_peered":"2024-09-13T19:06:19.274297+0000","last_unstale":"2024-09-13T19:10:56.957696+0000","last_undegraded":"2024-09-13T19:10:56.957696+0000","last_fullsized":"2024-09-13T19:10:56.957696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:56.957496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.957496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:22.430747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:21.730261+0000","last_change":"2024-09-13T19:11:21.730313+0000","last_active":"2024-09-13T19:11:21.730261+0000","last_peered":"2024-09-13T19:11:21.730261+0000","last_clean":"2024-09-13T19:11:21.730261+0000","last_became_active":"2024-09-13T19:06:09.621449+0000","last_became_peered":"2024-09-13T19:06:09.621449+0000","last_unstale":"2024-09-13T19:11:21.730261+0000","last_undegraded":"2024-09-13T19:11:21.730261+0000","last_fullsized":"2024-09-13T19:11:21.730261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:21.730064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:21.730064+0000","last_clean_scrub_stamp":"2024-09-13T19:11:21.730064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:57.125796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026441699999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.832300+0000","last_change":"2024-09-13T19:10:18.832300+0000","last_active":"2024-09-13T19:10:18.832300+0000","last_peered":"2024-09-13T19:10:18.832300+0000","last_clean":"2024-09-13T19:10:18.832300+0000","last_became_active":"2024-09-13T19:06:23.258270+0000","last_became_peered":"2024-09-13T19:06:23.258270+0000","last_unstale":"2024-09-13T19:10:18.832300+0000","last_undegraded":"2024-09-13T19:10:18.832300+0000","last_fullsized":"2024-09-13T19:10:18.832300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.832064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.832064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:42.939752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'96","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.208010+0000","last_change":"2024-09-13T19:10:20.208010+0000","last_active":"2024-09-13T19:10:20.208010+0000","last_peered":"2024-09-13T19:10:20.208010+0000","last_clean":"2024-09-13T19:10:20.208010+0000","last_became_active":"2024-09-13T19:06:25.296400+0000","last_became_peered":"2024-09-13T19:06:25.296400+0000","last_unstale":"2024-09-13T19:10:20.208010+0000","last_undegraded":"2024-09-13T19:10:20.208010+0000","last_fullsized":"2024-09-13T19:10:20.208010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'96","last_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_deep_scrub":"34'96","last_deep_scrub_stamp":"2024-09-13T19:10:20.207705+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.207705+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:25.171811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.399306+0000","last_change":"2024-09-13T19:10:28.399306+0000","last_active":"2024-09-13T19:10:28.399306+0000","last_peered":"2024-09-13T19:10:28.399306+0000","last_clean":"2024-09-13T19:10:28.399306+0000","last_became_active":"2024-09-13T19:06:27.313049+0000","last_became_peered":"2024-09-13T19:06:27.313049+0000","last_unstale":"2024-09-13T19:10:28.399306+0000","last_undegraded":"2024-09-13T19:10:28.399306+0000","last_fullsized":"2024-09-13T19:10:28.399306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:28.399039+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.399039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:50.175378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.121202+0000","last_change":"2024-09-13T19:10:25.121202+0000","last_active":"2024-09-13T19:10:25.121202+0000","last_peered":"2024-09-13T19:10:25.121202+0000","last_clean":"2024-09-13T19:10:25.121202+0000","last_became_active":"2024-09-13T19:06:29.308350+0000","last_became_peered":"2024-09-13T19:06:29.308350+0000","last_unstale":"2024-09-13T19:10:25.121202+0000","last_undegraded":"2024-09-13T19:10:25.121202+0000","last_fullsized":"2024-09-13T19:10:25.121202+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:25.120954+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.120954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:32.704432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'5","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.073645+0000","last_change":"2024-09-13T19:10:56.073718+0000","last_active":"2024-09-13T19:10:56.073645+0000","last_peered":"2024-09-13T19:10:56.073645+0000","last_clean":"2024-09-13T19:10:56.073645+0000","last_became_active":"2024-09-13T19:06:29.325597+0000","last_became_peered":"2024-09-13T19:06:29.325597+0000","last_unstale":"2024-09-13T19:10:56.073645+0000","last_undegraded":"2024-09-13T19:10:56.073645+0000","last_fullsized":"2024-09-13T19:10:56.073645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:10:56.073454+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.073454+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:48.540359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.077566+0000","last_change":"2024-09-13T19:10:33.077566+0000","last_active":"2024-09-13T19:10:33.077566+0000","last_peered":"2024-09-13T19:10:33.077566+0000","last_clean":"2024-09-13T19:10:33.077566+0000","last_became_active":"2024-09-13T19:06:21.252992+0000","last_became_peered":"2024-09-13T19:06:21.252992+0000","last_unstale":"2024-09-13T19:10:33.077566+0000","last_undegraded":"2024-09-13T19:10:33.077566+0000","last_fullsized":"2024-09-13T19:10:33.077566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:33.077318+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.077318+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:02.423813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:12.905338+0000","last_change":"2024-09-13T19:11:12.905393+0000","last_active":"2024-09-13T19:11:12.905338+0000","last_peered":"2024-09-13T19:11:12.905338+0000","last_clean":"2024-09-13T19:11:12.905338+0000","last_became_active":"2024-09-13T19:06:19.289315+0000","last_became_peered":"2024-09-13T19:06:19.289315+0000","last_unstale":"2024-09-13T19:11:12.905338+0000","last_undegraded":"2024-09-13T19:11:12.905338+0000","last_fullsized":"2024-09-13T19:11:12.905338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:12.905140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:12.905140+0000","last_clean_scrub_stamp":"2024-09-13T19:11:12.905140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:02.168824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:20.945400+0000","last_change":"2024-09-13T19:10:20.945400+0000","last_active":"2024-09-13T19:10:20.945400+0000","last_peered":"2024-09-13T19:10:20.945400+0000","last_clean":"2024-09-13T19:10:20.945400+0000","last_became_active":"2024-09-13T19:06:23.268169+0000","last_became_peered":"2024-09-13T19:06:23.268169+0000","last_unstale":"2024-09-13T19:10:20.945400+0000","last_undegraded":"2024-09-13T19:10:20.945400+0000","last_fullsized":"2024-09-13T19:10:20.945400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:20.945028+0000","last_clean_scrub_stamp":"2024-09-13T19:10:20.945028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:30.264384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.854611+0000","last_change":"2024-09-13T19:10:27.854611+0000","last_active":"2024-09-13T19:10:27.854611+0000","last_peered":"2024-09-13T19:10:27.854611+0000","last_clean":"2024-09-13T19:10:27.854611+0000","last_became_active":"2024-09-13T19:06:25.282403+0000","last_became_peered":"2024-09-13T19:06:25.282403+0000","last_unstale":"2024-09-13T19:10:27.854611+0000","last_undegraded":"2024-09-13T19:10:27.854611+0000","last_fullsized":"2024-09-13T19:10:27.854611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-13T19:10:27.854345+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.854345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:28.517846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:43.951984+0000","last_change":"2024-09-13T19:10:43.951984+0000","last_active":"2024-09-13T19:10:43.951984+0000","last_peered":"2024-09-13T19:10:43.951984+0000","last_clean":"2024-09-13T19:10:43.951984+0000","last_became_active":"2024-09-13T19:06:27.324842+0000","last_became_peered":"2024-09-13T19:06:27.324842+0000","last_unstale":"2024-09-13T19:10:43.951984+0000","last_undegraded":"2024-09-13T19:10:43.951984+0000","last_fullsized":"2024-09-13T19:10:43.951984+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:43.951573+0000","last_clean_scrub_stamp":"2024-09-13T19:10:43.951573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:26.069111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'5","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.546488+0000","last_change":"2024-09-13T19:11:05.546551+0000","last_active":"2024-09-13T19:11:05.546488+0000","last_peered":"2024-09-13T19:11:05.546488+0000","last_clean":"2024-09-13T19:11:05.546488+0000","last_became_active":"2024-09-13T19:06:29.301951+0000","last_became_peered":"2024-09-13T19:06:29.301951+0000","last_unstale":"2024-09-13T19:11:05.546488+0000","last_undegraded":"2024-09-13T19:11:05.546488+0000","last_fullsized":"2024-09-13T19:11:05.546488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:11:05.546296+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.546296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:40:23.305608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.081944+0000","last_change":"2024-09-13T19:10:42.081944+0000","last_active":"2024-09-13T19:10:42.081944+0000","last_peered":"2024-09-13T19:10:42.081944+0000","last_clean":"2024-09-13T19:10:42.081944+0000","last_became_active":"2024-09-13T19:06:21.258044+0000","last_became_peered":"2024-09-13T19:06:21.258044+0000","last_unstale":"2024-09-13T19:10:42.081944+0000","last_undegraded":"2024-09-13T19:10:42.081944+0000","last_fullsized":"2024-09-13T19:10:42.081944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:42.081677+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.081677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:55.468803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.030305+0000","last_change":"2024-09-13T19:10:52.030305+0000","last_active":"2024-09-13T19:10:52.030305+0000","last_peered":"2024-09-13T19:10:52.030305+0000","last_clean":"2024-09-13T19:10:52.030305+0000","last_became_active":"2024-09-13T19:06:19.268306+0000","last_became_peered":"2024-09-13T19:06:19.268306+0000","last_unstale":"2024-09-13T19:10:52.030305+0000","last_undegraded":"2024-09-13T19:10:52.030305+0000","last_fullsized":"2024-09-13T19:10:52.030305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:52.030011+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.030011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:30.173078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.867551+0000","last_change":"2024-09-13T19:10:17.867551+0000","last_active":"2024-09-13T19:10:17.867551+0000","last_peered":"2024-09-13T19:10:17.867551+0000","last_clean":"2024-09-13T19:10:17.867551+0000","last_became_active":"2024-09-13T19:06:23.263154+0000","last_became_peered":"2024-09-13T19:06:23.263154+0000","last_unstale":"2024-09-13T19:10:17.867551+0000","last_undegraded":"2024-09-13T19:10:17.867551+0000","last_fullsized":"2024-09-13T19:10:17.867551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:17.867308+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.867308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:43.159936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:17.561532+0000","last_change":"2024-09-13T19:10:17.561532+0000","last_active":"2024-09-13T19:10:17.561532+0000","last_peered":"2024-09-13T19:10:17.561532+0000","last_clean":"2024-09-13T19:10:17.561532+0000","last_became_active":"2024-09-13T19:06:25.281954+0000","last_became_peered":"2024-09-13T19:06:25.281954+0000","last_unstale":"2024-09-13T19:10:17.561532+0000","last_undegraded":"2024-09-13T19:10:17.561532+0000","last_fullsized":"2024-09-13T19:10:17.561532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-09-13T19:10:17.561274+0000","last_clean_scrub_stamp":"2024-09-13T19:10:17.561274+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:36.904388+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.291104+0000","last_change":"2024-09-13T19:10:11.291104+0000","last_active":"2024-09-13T19:10:11.291104+0000","last_peered":"2024-09-13T19:10:11.291104+0000","last_clean":"2024-09-13T19:10:11.291104+0000","last_became_active":"2024-09-13T19:06:27.308496+0000","last_became_peered":"2024-09-13T19:06:27.308496+0000","last_unstale":"2024-09-13T19:10:11.291104+0000","last_undegraded":"2024-09-13T19:10:11.291104+0000","last_fullsized":"2024-09-13T19:10:11.291104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.290797+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.290797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:52.828167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:06.545599+0000","last_change":"2024-09-13T19:11:06.545599+0000","last_active":"2024-09-13T19:11:06.545599+0000","last_peered":"2024-09-13T19:11:06.545599+0000","last_clean":"2024-09-13T19:11:06.545599+0000","last_became_active":"2024-09-13T19:06:29.310367+0000","last_became_peered":"2024-09-13T19:06:29.310367+0000","last_unstale":"2024-09-13T19:11:06.545599+0000","last_undegraded":"2024-09-13T19:11:06.545599+0000","last_fullsized":"2024-09-13T19:11:06.545599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:06.545207+0000","last_clean_scrub_stamp":"2024-09-13T19:11:06.545207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:31.033367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.350522+0000","last_change":"2024-09-13T19:10:40.350522+0000","last_active":"2024-09-13T19:10:40.350522+0000","last_peered":"2024-09-13T19:10:40.350522+0000","last_clean":"2024-09-13T19:10:40.350522+0000","last_became_active":"2024-09-13T19:06:21.243344+0000","last_became_peered":"2024-09-13T19:06:21.243344+0000","last_unstale":"2024-09-13T19:10:40.350522+0000","last_undegraded":"2024-09-13T19:10:40.350522+0000","last_fullsized":"2024-09-13T19:10:40.350522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.350179+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.350179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:04.457866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:40.272268+0000","last_change":"2024-09-13T19:10:40.272268+0000","last_active":"2024-09-13T19:10:40.272268+0000","last_peered":"2024-09-13T19:10:40.272268+0000","last_clean":"2024-09-13T19:10:40.272268+0000","last_became_active":"2024-09-13T19:06:19.270758+0000","last_became_peered":"2024-09-13T19:06:19.270758+0000","last_unstale":"2024-09-13T19:10:40.272268+0000","last_undegraded":"2024-09-13T19:10:40.272268+0000","last_fullsized":"2024-09-13T19:10:40.272268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:40.271992+0000","last_clean_scrub_stamp":"2024-09-13T19:10:40.271992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:13.748357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.162360+0000","last_change":"2024-09-13T19:10:24.162360+0000","last_active":"2024-09-13T19:10:24.162360+0000","last_peered":"2024-09-13T19:10:24.162360+0000","last_clean":"2024-09-13T19:10:24.162360+0000","last_became_active":"2024-09-13T19:06:23.262894+0000","last_became_peered":"2024-09-13T19:06:23.262894+0000","last_unstale":"2024-09-13T19:10:24.162360+0000","last_undegraded":"2024-09-13T19:10:24.162360+0000","last_fullsized":"2024-09-13T19:10:24.162360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.162112+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.162112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:54.758256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'48","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.521044+0000","last_change":"2024-09-13T19:10:19.521044+0000","last_active":"2024-09-13T19:10:19.521044+0000","last_peered":"2024-09-13T19:10:19.521044+0000","last_clean":"2024-09-13T19:10:19.521044+0000","last_became_active":"2024-09-13T19:06:25.269670+0000","last_became_peered":"2024-09-13T19:06:25.269670+0000","last_unstale":"2024-09-13T19:10:19.521044+0000","last_undegraded":"2024-09-13T19:10:19.521044+0000","last_fullsized":"2024-09-13T19:10:19.521044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-13T19:10:19.520627+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.520627+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:33.918610+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:19.960335+0000","last_change":"2024-09-13T19:10:19.960335+0000","last_active":"2024-09-13T19:10:19.960335+0000","last_peered":"2024-09-13T19:10:19.960335+0000","last_clean":"2024-09-13T19:10:19.960335+0000","last_became_active":"2024-09-13T19:06:27.318769+0000","last_became_peered":"2024-09-13T19:06:27.318769+0000","last_unstale":"2024-09-13T19:10:19.960335+0000","last_undegraded":"2024-09-13T19:10:19.960335+0000","last_fullsized":"2024-09-13T19:10:19.960335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:19.960093+0000","last_clean_scrub_stamp":"2024-09-13T19:10:19.960093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:12.950423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"34'8","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.895273+0000","last_change":"2024-09-13T19:10:51.895273+0000","last_active":"2024-09-13T19:10:51.895273+0000","last_peered":"2024-09-13T19:10:51.895273+0000","last_clean":"2024-09-13T19:10:51.895273+0000","last_became_active":"2024-09-13T19:06:29.309633+0000","last_became_peered":"2024-09-13T19:06:29.309633+0000","last_unstale":"2024-09-13T19:10:51.895273+0000","last_undegraded":"2024-09-13T19:10:51.895273+0000","last_fullsized":"2024-09-13T19:10:51.895273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:51.895017+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.895017+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:46:21.682090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:28.858131+0000","last_change":"2024-09-13T19:10:28.858131+0000","last_active":"2024-09-13T19:10:28.858131+0000","last_peered":"2024-09-13T19:10:28.858131+0000","last_clean":"2024-09-13T19:10:28.858131+0000","last_became_active":"2024-09-13T19:06:21.259214+0000","last_became_peered":"2024-09-13T19:06:21.259214+0000","last_unstale":"2024-09-13T19:10:28.858131+0000","last_undegraded":"2024-09-13T19:10:28.858131+0000","last_fullsized":"2024-09-13T19:10:28.858131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:28.857846+0000","last_clean_scrub_stamp":"2024-09-13T19:10:28.857846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:49.466278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.907072+0000","last_change":"2024-09-13T19:11:00.907072+0000","last_active":"2024-09-13T19:11:00.907072+0000","last_peered":"2024-09-13T19:11:00.907072+0000","last_clean":"2024-09-13T19:11:00.907072+0000","last_became_active":"2024-09-13T19:06:19.275694+0000","last_became_peered":"2024-09-13T19:06:19.275694+0000","last_unstale":"2024-09-13T19:11:00.907072+0000","last_undegraded":"2024-09-13T19:11:00.907072+0000","last_fullsized":"2024-09-13T19:11:00.907072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:00.906816+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.906816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:21.348304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.848901+0000","last_change":"2024-09-13T19:10:16.848901+0000","last_active":"2024-09-13T19:10:16.848901+0000","last_peered":"2024-09-13T19:10:16.848901+0000","last_clean":"2024-09-13T19:10:16.848901+0000","last_became_active":"2024-09-13T19:06:23.269008+0000","last_became_peered":"2024-09-13T19:06:23.269008+0000","last_unstale":"2024-09-13T19:10:16.848901+0000","last_undegraded":"2024-09-13T19:10:16.848901+0000","last_fullsized":"2024-09-13T19:10:16.848901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.848588+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.848588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:18.472297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.179195+0000","last_change":"2024-09-13T19:10:16.179195+0000","last_active":"2024-09-13T19:10:16.179195+0000","last_peered":"2024-09-13T19:10:16.179195+0000","last_clean":"2024-09-13T19:10:16.179195+0000","last_became_active":"2024-09-13T19:06:25.300257+0000","last_became_peered":"2024-09-13T19:06:25.300257+0000","last_unstale":"2024-09-13T19:10:16.179195+0000","last_undegraded":"2024-09-13T19:10:16.179195+0000","last_fullsized":"2024-09-13T19:10:16.179195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:16.178926+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.178926+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:09.694689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:14.208442+0000","last_change":"2024-09-13T19:10:14.208442+0000","last_active":"2024-09-13T19:10:14.208442+0000","last_peered":"2024-09-13T19:10:14.208442+0000","last_clean":"2024-09-13T19:10:14.208442+0000","last_became_active":"2024-09-13T19:06:27.293910+0000","last_became_peered":"2024-09-13T19:06:27.293910+0000","last_unstale":"2024-09-13T19:10:14.208442+0000","last_undegraded":"2024-09-13T19:10:14.208442+0000","last_fullsized":"2024-09-13T19:10:14.208442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:14.208183+0000","last_clean_scrub_stamp":"2024-09-13T19:10:14.208183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:58.825796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:50.929476+0000","last_change":"2024-09-13T19:10:50.929555+0000","last_active":"2024-09-13T19:10:50.929476+0000","last_peered":"2024-09-13T19:10:50.929476+0000","last_clean":"2024-09-13T19:10:50.929476+0000","last_became_active":"2024-09-13T19:06:21.255479+0000","last_became_peered":"2024-09-13T19:06:21.255479+0000","last_unstale":"2024-09-13T19:10:50.929476+0000","last_undegraded":"2024-09-13T19:10:50.929476+0000","last_fullsized":"2024-09-13T19:10:50.929476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:50.929270+0000","last_clean_scrub_stamp":"2024-09-13T19:10:50.929270+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:28.095083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.925896+0000","last_change":"2024-09-13T19:11:01.925896+0000","last_active":"2024-09-13T19:11:01.925896+0000","last_peered":"2024-09-13T19:11:01.925896+0000","last_clean":"2024-09-13T19:11:01.925896+0000","last_became_active":"2024-09-13T19:06:19.291546+0000","last_became_peered":"2024-09-13T19:06:19.291546+0000","last_unstale":"2024-09-13T19:11:01.925896+0000","last_undegraded":"2024-09-13T19:11:01.925896+0000","last_fullsized":"2024-09-13T19:11:01.925896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.925650+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.925650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:26:56.270080+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.424270+0000","last_change":"2024-09-13T19:10:30.424323+0000","last_active":"2024-09-13T19:10:30.424270+0000","last_peered":"2024-09-13T19:10:30.424270+0000","last_clean":"2024-09-13T19:10:30.424270+0000","last_became_active":"2024-09-13T19:06:23.245796+0000","last_became_peered":"2024-09-13T19:06:23.245796+0000","last_unstale":"2024-09-13T19:10:30.424270+0000","last_undegraded":"2024-09-13T19:10:30.424270+0000","last_fullsized":"2024-09-13T19:10:30.424270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.424045+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.424045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:59.405032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:15.538905+0000","last_change":"2024-09-13T19:10:15.538905+0000","last_active":"2024-09-13T19:10:15.538905+0000","last_peered":"2024-09-13T19:10:15.538905+0000","last_clean":"2024-09-13T19:10:15.538905+0000","last_became_active":"2024-09-13T19:06:25.283287+0000","last_became_peered":"2024-09-13T19:06:25.283287+0000","last_unstale":"2024-09-13T19:10:15.538905+0000","last_undegraded":"2024-09-13T19:10:15.538905+0000","last_fullsized":"2024-09-13T19:10:15.538905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-13T19:10:15.538629+0000","last_clean_scrub_stamp":"2024-09-13T19:10:15.538629+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:23.122107+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:12.250870+0000","last_change":"2024-09-13T19:10:12.250870+0000","last_active":"2024-09-13T19:10:12.250870+0000","last_peered":"2024-09-13T19:10:12.250870+0000","last_clean":"2024-09-13T19:10:12.250870+0000","last_became_active":"2024-09-13T19:06:27.302817+0000","last_became_peered":"2024-09-13T19:06:27.302817+0000","last_unstale":"2024-09-13T19:10:12.250870+0000","last_undegraded":"2024-09-13T19:10:12.250870+0000","last_fullsized":"2024-09-13T19:10:12.250870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:12.250631+0000","last_clean_scrub_stamp":"2024-09-13T19:10:12.250631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:10.938731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:03.505486+0000","last_change":"2024-09-13T19:11:03.505486+0000","last_active":"2024-09-13T19:11:03.505486+0000","last_peered":"2024-09-13T19:11:03.505486+0000","last_clean":"2024-09-13T19:11:03.505486+0000","last_became_active":"2024-09-13T19:06:29.299859+0000","last_became_peered":"2024-09-13T19:06:29.299859+0000","last_unstale":"2024-09-13T19:11:03.505486+0000","last_undegraded":"2024-09-13T19:11:03.505486+0000","last_fullsized":"2024-09-13T19:11:03.505486+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-13T19:11:03.505228+0000","last_clean_scrub_stamp":"2024-09-13T19:11:03.505228+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:53.171890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.467256+0000","last_change":"2024-09-13T19:10:52.467319+0000","last_active":"2024-09-13T19:10:52.467256+0000","last_peered":"2024-09-13T19:10:52.467256+0000","last_clean":"2024-09-13T19:10:52.467256+0000","last_became_active":"2024-09-13T19:06:21.257069+0000","last_became_peered":"2024-09-13T19:06:21.257069+0000","last_unstale":"2024-09-13T19:10:52.467256+0000","last_undegraded":"2024-09-13T19:10:52.467256+0000","last_fullsized":"2024-09-13T19:10:52.467256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.467064+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.467064+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:27.284557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:55.992274+0000","last_change":"2024-09-13T19:10:55.992274+0000","last_active":"2024-09-13T19:10:55.992274+0000","last_peered":"2024-09-13T19:10:55.992274+0000","last_clean":"2024-09-13T19:10:55.992274+0000","last_became_active":"2024-09-13T19:06:19.272145+0000","last_became_peered":"2024-09-13T19:06:19.272145+0000","last_unstale":"2024-09-13T19:10:55.992274+0000","last_undegraded":"2024-09-13T19:10:55.992274+0000","last_fullsized":"2024-09-13T19:10:55.992274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:55.991902+0000","last_clean_scrub_stamp":"2024-09-13T19:10:55.991902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:55.741364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:27.038792+0000","last_change":"2024-09-13T19:10:27.038792+0000","last_active":"2024-09-13T19:10:27.038792+0000","last_peered":"2024-09-13T19:10:27.038792+0000","last_clean":"2024-09-13T19:10:27.038792+0000","last_became_active":"2024-09-13T19:06:23.256782+0000","last_became_peered":"2024-09-13T19:06:23.256782+0000","last_unstale":"2024-09-13T19:10:27.038792+0000","last_undegraded":"2024-09-13T19:10:27.038792+0000","last_fullsized":"2024-09-13T19:10:27.038792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:27.038560+0000","last_clean_scrub_stamp":"2024-09-13T19:10:27.038560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:46.381674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:37.966601+0000","last_change":"2024-09-13T19:10:37.966601+0000","last_active":"2024-09-13T19:10:37.966601+0000","last_peered":"2024-09-13T19:10:37.966601+0000","last_clean":"2024-09-13T19:10:37.966601+0000","last_became_active":"2024-09-13T19:06:25.292217+0000","last_became_peered":"2024-09-13T19:06:25.292217+0000","last_unstale":"2024-09-13T19:10:37.966601+0000","last_undegraded":"2024-09-13T19:10:37.966601+0000","last_fullsized":"2024-09-13T19:10:37.966601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:37.966152+0000","last_clean_scrub_stamp":"2024-09-13T19:10:37.966152+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:38.978338+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:11.872063+0000","last_change":"2024-09-13T19:10:11.872063+0000","last_active":"2024-09-13T19:10:11.872063+0000","last_peered":"2024-09-13T19:10:11.872063+0000","last_clean":"2024-09-13T19:10:11.872063+0000","last_became_active":"2024-09-13T19:06:27.317682+0000","last_became_peered":"2024-09-13T19:06:27.317682+0000","last_unstale":"2024-09-13T19:10:11.872063+0000","last_undegraded":"2024-09-13T19:10:11.872063+0000","last_fullsized":"2024-09-13T19:10:11.872063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:11.871702+0000","last_clean_scrub_stamp":"2024-09-13T19:10:11.871702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:34.344253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.920624+0000","last_change":"2024-09-13T19:10:59.920624+0000","last_active":"2024-09-13T19:10:59.920624+0000","last_peered":"2024-09-13T19:10:59.920624+0000","last_clean":"2024-09-13T19:10:59.920624+0000","last_became_active":"2024-09-13T19:06:29.311058+0000","last_became_peered":"2024-09-13T19:06:29.311058+0000","last_unstale":"2024-09-13T19:10:59.920624+0000","last_undegraded":"2024-09-13T19:10:59.920624+0000","last_fullsized":"2024-09-13T19:10:59.920624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.920373+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.920373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:40.967193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'6","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.061617+0000","last_change":"2024-09-13T19:11:02.061682+0000","last_active":"2024-09-13T19:11:02.061617+0000","last_peered":"2024-09-13T19:11:02.061617+0000","last_clean":"2024-09-13T19:11:02.061617+0000","last_became_active":"2024-09-13T19:06:58.364000+0000","last_became_peered":"2024-09-13T19:06:58.364000+0000","last_unstale":"2024-09-13T19:11:02.061617+0000","last_undegraded":"2024-09-13T19:11:02.061617+0000","last_fullsized":"2024-09-13T19:11:02.061617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:02.061439+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.061439+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:36.878931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:49.088366+0000","last_change":"2024-09-13T19:10:49.088366+0000","last_active":"2024-09-13T19:10:49.088366+0000","last_peered":"2024-09-13T19:10:49.088366+0000","last_clean":"2024-09-13T19:10:49.088366+0000","last_became_active":"2024-09-13T19:06:19.273694+0000","last_became_peered":"2024-09-13T19:06:19.273694+0000","last_unstale":"2024-09-13T19:10:49.088366+0000","last_undegraded":"2024-09-13T19:10:49.088366+0000","last_fullsized":"2024-09-13T19:10:49.088366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:49.087937+0000","last_clean_scrub_stamp":"2024-09-13T19:10:49.087937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:38:41.554842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:26.082518+0000","last_change":"2024-09-13T19:10:26.082518+0000","last_active":"2024-09-13T19:10:26.082518+0000","last_peered":"2024-09-13T19:10:26.082518+0000","last_clean":"2024-09-13T19:10:26.082518+0000","last_became_active":"2024-09-13T19:06:23.259559+0000","last_became_peered":"2024-09-13T19:06:23.259559+0000","last_unstale":"2024-09-13T19:10:26.082518+0000","last_undegraded":"2024-09-13T19:10:26.082518+0000","last_fullsized":"2024-09-13T19:10:26.082518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:26.082257+0000","last_clean_scrub_stamp":"2024-09-13T19:10:26.082257+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.108750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'39","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.503964+0000","last_change":"2024-09-13T19:10:21.503964+0000","last_active":"2024-09-13T19:10:21.503964+0000","last_peered":"2024-09-13T19:10:21.503964+0000","last_clean":"2024-09-13T19:10:21.503964+0000","last_became_active":"2024-09-13T19:06:25.265838+0000","last_became_peered":"2024-09-13T19:06:25.265838+0000","last_unstale":"2024-09-13T19:10:21.503964+0000","last_undegraded":"2024-09-13T19:10:21.503964+0000","last_fullsized":"2024-09-13T19:10:21.503964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-13T19:10:21.503707+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.503707+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:01.575001+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.524503+0000","last_change":"2024-09-13T19:10:13.524503+0000","last_active":"2024-09-13T19:10:13.524503+0000","last_peered":"2024-09-13T19:10:13.524503+0000","last_clean":"2024-09-13T19:10:13.524503+0000","last_became_active":"2024-09-13T19:06:27.281708+0000","last_became_peered":"2024-09-13T19:06:27.281708+0000","last_unstale":"2024-09-13T19:10:13.524503+0000","last_undegraded":"2024-09-13T19:10:13.524503+0000","last_fullsized":"2024-09-13T19:10:13.524503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:13.524264+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.524264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:33.550419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:30.753066+0000","last_change":"2024-09-13T19:11:30.753213+0000","last_active":"2024-09-13T19:11:30.753066+0000","last_peered":"2024-09-13T19:11:30.753066+0000","last_clean":"2024-09-13T19:11:30.753066+0000","last_became_active":"2024-09-13T19:06:29.324412+0000","last_became_peered":"2024-09-13T19:06:29.324412+0000","last_unstale":"2024-09-13T19:11:30.753066+0000","last_undegraded":"2024-09-13T19:11:30.753066+0000","last_fullsized":"2024-09-13T19:11:30.753066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-13T19:11:30.752795+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-13T19:11:30.752795+0000","last_clean_scrub_stamp":"2024-09-13T19:11:30.752795+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:42.588247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.480028+0000","last_change":"2024-09-13T19:10:46.480028+0000","last_active":"2024-09-13T19:10:46.480028+0000","last_peered":"2024-09-13T19:10:46.480028+0000","last_clean":"2024-09-13T19:10:46.480028+0000","last_became_active":"2024-09-13T19:06:21.254155+0000","last_became_peered":"2024-09-13T19:06:21.254155+0000","last_unstale":"2024-09-13T19:10:46.480028+0000","last_undegraded":"2024-09-13T19:10:46.480028+0000","last_fullsized":"2024-09-13T19:10:46.480028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:46.479775+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.479775+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:43.497505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.992077+0000","last_change":"2024-09-13T19:10:57.992077+0000","last_active":"2024-09-13T19:10:57.992077+0000","last_peered":"2024-09-13T19:10:57.992077+0000","last_clean":"2024-09-13T19:10:57.992077+0000","last_became_active":"2024-09-13T19:06:19.294697+0000","last_became_peered":"2024-09-13T19:06:19.294697+0000","last_unstale":"2024-09-13T19:10:57.992077+0000","last_undegraded":"2024-09-13T19:10:57.992077+0000","last_fullsized":"2024-09-13T19:10:57.992077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:57.991795+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.991795+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:11.616420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:21.982937+0000","last_change":"2024-09-13T19:10:21.982937+0000","last_active":"2024-09-13T19:10:21.982937+0000","last_peered":"2024-09-13T19:10:21.982937+0000","last_clean":"2024-09-13T19:10:21.982937+0000","last_became_active":"2024-09-13T19:06:23.261844+0000","last_became_peered":"2024-09-13T19:06:23.261844+0000","last_unstale":"2024-09-13T19:10:21.982937+0000","last_undegraded":"2024-09-13T19:10:21.982937+0000","last_fullsized":"2024-09-13T19:10:21.982937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:21.982700+0000","last_clean_scrub_stamp":"2024-09-13T19:10:21.982700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:30.750394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:36.948762+0000","last_change":"2024-09-13T19:10:36.948838+0000","last_active":"2024-09-13T19:10:36.948762+0000","last_peered":"2024-09-13T19:10:36.948762+0000","last_clean":"2024-09-13T19:10:36.948762+0000","last_became_active":"2024-09-13T19:06:25.298210+0000","last_became_peered":"2024-09-13T19:06:25.298210+0000","last_unstale":"2024-09-13T19:10:36.948762+0000","last_undegraded":"2024-09-13T19:10:36.948762+0000","last_fullsized":"2024-09-13T19:10:36.948762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-13T19:10:36.948531+0000","last_clean_scrub_stamp":"2024-09-13T19:10:36.948531+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:54.759393+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":381,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.250351+0000","last_change":"2024-09-13T19:10:08.250351+0000","last_active":"2024-09-13T19:10:08.250351+0000","last_peered":"2024-09-13T19:10:08.250351+0000","last_clean":"2024-09-13T19:10:08.250351+0000","last_became_active":"2024-09-13T19:06:27.316841+0000","last_became_peered":"2024-09-13T19:06:27.316841+0000","last_unstale":"2024-09-13T19:10:08.250351+0000","last_undegraded":"2024-09-13T19:10:08.250351+0000","last_fullsized":"2024-09-13T19:10:08.250351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-09-13T19:10:08.249922+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.249922+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:18:42.550124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:29.770950+0000","last_change":"2024-09-13T19:11:29.771086+0000","last_active":"2024-09-13T19:11:29.770950+0000","last_peered":"2024-09-13T19:11:29.770950+0000","last_clean":"2024-09-13T19:11:29.770950+0000","last_became_active":"2024-09-13T19:06:29.323739+0000","last_became_peered":"2024-09-13T19:06:29.323739+0000","last_unstale":"2024-09-13T19:11:29.770950+0000","last_undegraded":"2024-09-13T19:11:29.770950+0000","last_fullsized":"2024-09-13T19:11:29.770950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:29.770712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:29.770712+0000","last_clean_scrub_stamp":"2024-09-13T19:11:29.770712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:54.367352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.125178+0000","last_change":"2024-09-13T19:10:35.125178+0000","last_active":"2024-09-13T19:10:35.125178+0000","last_peered":"2024-09-13T19:10:35.125178+0000","last_clean":"2024-09-13T19:10:35.125178+0000","last_became_active":"2024-09-13T19:06:21.253344+0000","last_became_peered":"2024-09-13T19:06:21.253344+0000","last_unstale":"2024-09-13T19:10:35.125178+0000","last_undegraded":"2024-09-13T19:10:35.125178+0000","last_fullsized":"2024-09-13T19:10:35.125178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:35.124924+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.124924+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:46.888340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:53.070082+0000","last_change":"2024-09-13T19:10:53.070082+0000","last_active":"2024-09-13T19:10:53.070082+0000","last_peered":"2024-09-13T19:10:53.070082+0000","last_clean":"2024-09-13T19:10:53.070082+0000","last_became_active":"2024-09-13T19:06:19.278524+0000","last_became_peered":"2024-09-13T19:06:19.278524+0000","last_unstale":"2024-09-13T19:10:53.070082+0000","last_undegraded":"2024-09-13T19:10:53.070082+0000","last_fullsized":"2024-09-13T19:10:53.070082+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:53.069807+0000","last_clean_scrub_stamp":"2024-09-13T19:10:53.069807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:13.678239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:18.937733+0000","last_change":"2024-09-13T19:10:18.937733+0000","last_active":"2024-09-13T19:10:18.937733+0000","last_peered":"2024-09-13T19:10:18.937733+0000","last_clean":"2024-09-13T19:10:18.937733+0000","last_became_active":"2024-09-13T19:06:23.271312+0000","last_became_peered":"2024-09-13T19:06:23.271312+0000","last_unstale":"2024-09-13T19:10:18.937733+0000","last_undegraded":"2024-09-13T19:10:18.937733+0000","last_fullsized":"2024-09-13T19:10:18.937733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:18.937494+0000","last_clean_scrub_stamp":"2024-09-13T19:10:18.937494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:07.450855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:13.890226+0000","last_change":"2024-09-13T19:10:13.890226+0000","last_active":"2024-09-13T19:10:13.890226+0000","last_peered":"2024-09-13T19:10:13.890226+0000","last_clean":"2024-09-13T19:10:13.890226+0000","last_became_active":"2024-09-13T19:06:25.275374+0000","last_became_peered":"2024-09-13T19:06:25.275374+0000","last_unstale":"2024-09-13T19:10:13.890226+0000","last_undegraded":"2024-09-13T19:10:13.890226+0000","last_fullsized":"2024-09-13T19:10:13.890226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-13T19:10:13.889956+0000","last_clean_scrub_stamp":"2024-09-13T19:10:13.889956+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:41.379481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:08.586502+0000","last_change":"2024-09-13T19:10:08.586502+0000","last_active":"2024-09-13T19:10:08.586502+0000","last_peered":"2024-09-13T19:10:08.586502+0000","last_clean":"2024-09-13T19:10:08.586502+0000","last_became_active":"2024-09-13T19:06:27.297150+0000","last_became_peered":"2024-09-13T19:06:27.297150+0000","last_unstale":"2024-09-13T19:10:08.586502+0000","last_undegraded":"2024-09-13T19:10:08.586502+0000","last_fullsized":"2024-09-13T19:10:08.586502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:08.586205+0000","last_clean_scrub_stamp":"2024-09-13T19:10:08.586205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:31.058755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.888701+0000","last_change":"2024-09-13T19:11:02.888701+0000","last_active":"2024-09-13T19:11:02.888701+0000","last_peered":"2024-09-13T19:11:02.888701+0000","last_clean":"2024-09-13T19:11:02.888701+0000","last_became_active":"2024-09-13T19:06:29.319706+0000","last_became_peered":"2024-09-13T19:06:29.319706+0000","last_unstale":"2024-09-13T19:11:02.888701+0000","last_undegraded":"2024-09-13T19:11:02.888701+0000","last_fullsized":"2024-09-13T19:11:02.888701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:02.888433+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.888433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:39.723288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:31.067914+0000","last_change":"2024-09-13T19:10:31.067914+0000","last_active":"2024-09-13T19:10:31.067914+0000","last_peered":"2024-09-13T19:10:31.067914+0000","last_clean":"2024-09-13T19:10:31.067914+0000","last_became_active":"2024-09-13T19:06:21.253007+0000","last_became_peered":"2024-09-13T19:06:21.253007+0000","last_unstale":"2024-09-13T19:10:31.067914+0000","last_undegraded":"2024-09-13T19:10:31.067914+0000","last_fullsized":"2024-09-13T19:10:31.067914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:31.067555+0000","last_clean_scrub_stamp":"2024-09-13T19:10:31.067555+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:11.138849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":16,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:25.830492+0000","last_change":"2024-09-13T19:11:25.830654+0000","last_active":"2024-09-13T19:11:25.830492+0000","last_peered":"2024-09-13T19:11:25.830492+0000","last_clean":"2024-09-13T19:11:25.830492+0000","last_became_active":"2024-09-13T19:06:19.294279+0000","last_became_peered":"2024-09-13T19:06:19.294279+0000","last_unstale":"2024-09-13T19:11:25.830492+0000","last_undegraded":"2024-09-13T19:11:25.830492+0000","last_fullsized":"2024-09-13T19:11:25.830492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:25.830176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:25.830176+0000","last_clean_scrub_stamp":"2024-09-13T19:11:25.830176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:49:24.368121+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.089399+0000","last_change":"2024-09-13T19:10:30.089399+0000","last_active":"2024-09-13T19:10:30.089399+0000","last_peered":"2024-09-13T19:10:30.089399+0000","last_clean":"2024-09-13T19:10:30.089399+0000","last_became_active":"2024-09-13T19:06:23.248994+0000","last_became_peered":"2024-09-13T19:06:23.248994+0000","last_unstale":"2024-09-13T19:10:30.089399+0000","last_undegraded":"2024-09-13T19:10:30.089399+0000","last_fullsized":"2024-09-13T19:10:30.089399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:30.089119+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.089119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.043364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:22.454696+0000","last_change":"2024-09-13T19:10:22.454696+0000","last_active":"2024-09-13T19:10:22.454696+0000","last_peered":"2024-09-13T19:10:22.454696+0000","last_clean":"2024-09-13T19:10:22.454696+0000","last_became_active":"2024-09-13T19:06:25.265362+0000","last_became_peered":"2024-09-13T19:06:25.265362+0000","last_unstale":"2024-09-13T19:10:22.454696+0000","last_undegraded":"2024-09-13T19:10:22.454696+0000","last_fullsized":"2024-09-13T19:10:22.454696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-13T19:10:22.454429+0000","last_clean_scrub_stamp":"2024-09-13T19:10:22.454429+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:00.959003+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:35.898752+0000","last_change":"2024-09-13T19:10:35.898752+0000","last_active":"2024-09-13T19:10:35.898752+0000","last_peered":"2024-09-13T19:10:35.898752+0000","last_clean":"2024-09-13T19:10:35.898752+0000","last_became_active":"2024-09-13T19:06:27.314532+0000","last_became_peered":"2024-09-13T19:06:27.314532+0000","last_unstale":"2024-09-13T19:10:35.898752+0000","last_undegraded":"2024-09-13T19:10:35.898752+0000","last_fullsized":"2024-09-13T19:10:35.898752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:35.898496+0000","last_clean_scrub_stamp":"2024-09-13T19:10:35.898496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:27:00.675915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'10","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:27.852384+0000","last_change":"2024-09-13T19:11:27.852450+0000","last_active":"2024-09-13T19:11:27.852384+0000","last_peered":"2024-09-13T19:11:27.852384+0000","last_clean":"2024-09-13T19:11:27.852384+0000","last_became_active":"2024-09-13T19:06:29.316917+0000","last_became_peered":"2024-09-13T19:06:29.316917+0000","last_unstale":"2024-09-13T19:11:27.852384+0000","last_undegraded":"2024-09-13T19:11:27.852384+0000","last_fullsized":"2024-09-13T19:11:27.852384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:11:27.852202+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:11:27.852202+0000","last_clean_scrub_stamp":"2024-09-13T19:11:27.852202+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:30.486125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.041600+0000","last_change":"2024-09-13T19:10:59.041600+0000","last_active":"2024-09-13T19:10:59.041600+0000","last_peered":"2024-09-13T19:10:59.041600+0000","last_clean":"2024-09-13T19:10:59.041600+0000","last_became_active":"2024-09-13T19:06:58.337848+0000","last_became_peered":"2024-09-13T19:06:58.337848+0000","last_unstale":"2024-09-13T19:10:59.041600+0000","last_undegraded":"2024-09-13T19:10:59.041600+0000","last_fullsized":"2024-09-13T19:10:59.041600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:59.041190+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.041190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:59.704690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.456459+0000","last_change":"2024-09-13T19:11:01.456519+0000","last_active":"2024-09-13T19:11:01.456459+0000","last_peered":"2024-09-13T19:11:01.456459+0000","last_clean":"2024-09-13T19:11:01.456459+0000","last_became_active":"2024-09-13T19:06:19.272549+0000","last_became_peered":"2024-09-13T19:06:19.272549+0000","last_unstale":"2024-09-13T19:11:01.456459+0000","last_undegraded":"2024-09-13T19:11:01.456459+0000","last_fullsized":"2024-09-13T19:11:01.456459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:01.456156+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.456156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:12.616137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:24.988040+0000","last_change":"2024-09-13T19:10:24.988040+0000","last_active":"2024-09-13T19:10:24.988040+0000","last_peered":"2024-09-13T19:10:24.988040+0000","last_clean":"2024-09-13T19:10:24.988040+0000","last_became_active":"2024-09-13T19:06:23.252882+0000","last_became_peered":"2024-09-13T19:06:23.252882+0000","last_unstale":"2024-09-13T19:10:24.988040+0000","last_undegraded":"2024-09-13T19:10:24.988040+0000","last_fullsized":"2024-09-13T19:10:24.988040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:24.987790+0000","last_clean_scrub_stamp":"2024-09-13T19:10:24.987790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.492363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.936353+0000","last_change":"2024-09-13T19:10:38.936353+0000","last_active":"2024-09-13T19:10:38.936353+0000","last_peered":"2024-09-13T19:10:38.936353+0000","last_clean":"2024-09-13T19:10:38.936353+0000","last_became_active":"2024-09-13T19:06:25.289147+0000","last_became_peered":"2024-09-13T19:06:25.289147+0000","last_unstale":"2024-09-13T19:10:38.936353+0000","last_undegraded":"2024-09-13T19:10:38.936353+0000","last_fullsized":"2024-09-13T19:10:38.936353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-13T19:10:38.935949+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.935949+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:31.557189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.947969+0000","last_change":"2024-09-13T19:10:39.947969+0000","last_active":"2024-09-13T19:10:39.947969+0000","last_peered":"2024-09-13T19:10:39.947969+0000","last_clean":"2024-09-13T19:10:39.947969+0000","last_became_active":"2024-09-13T19:06:27.318332+0000","last_became_peered":"2024-09-13T19:06:27.318332+0000","last_unstale":"2024-09-13T19:10:39.947969+0000","last_undegraded":"2024-09-13T19:10:39.947969+0000","last_fullsized":"2024-09-13T19:10:39.947969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:39.947716+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.947716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:36:39.389129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:26.818725+0000","last_change":"2024-09-13T19:11:26.818786+0000","last_active":"2024-09-13T19:11:26.818725+0000","last_peered":"2024-09-13T19:11:26.818725+0000","last_clean":"2024-09-13T19:11:26.818725+0000","last_became_active":"2024-09-13T19:06:29.314958+0000","last_became_peered":"2024-09-13T19:06:29.314958+0000","last_unstale":"2024-09-13T19:11:26.818725+0000","last_undegraded":"2024-09-13T19:11:26.818725+0000","last_fullsized":"2024-09-13T19:11:26.818725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:26.818543+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:26.818543+0000","last_clean_scrub_stamp":"2024-09-13T19:11:26.818543+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:39.219857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'12","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.071527+0000","last_change":"2024-09-13T19:10:32.071527+0000","last_active":"2024-09-13T19:10:32.071527+0000","last_peered":"2024-09-13T19:10:32.071527+0000","last_clean":"2024-09-13T19:10:32.071527+0000","last_became_active":"2024-09-13T19:06:21.251662+0000","last_became_peered":"2024-09-13T19:06:21.251662+0000","last_unstale":"2024-09-13T19:10:32.071527+0000","last_undegraded":"2024-09-13T19:10:32.071527+0000","last_fullsized":"2024-09-13T19:10:32.071527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:32.071163+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.071163+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:10.575736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:51.125394+0000","last_change":"2024-09-13T19:10:51.125453+0000","last_active":"2024-09-13T19:10:51.125394+0000","last_peered":"2024-09-13T19:10:51.125394+0000","last_clean":"2024-09-13T19:10:51.125394+0000","last_became_active":"2024-09-13T19:06:19.275847+0000","last_became_peered":"2024-09-13T19:06:19.275847+0000","last_unstale":"2024-09-13T19:10:51.125394+0000","last_undegraded":"2024-09-13T19:10:51.125394+0000","last_fullsized":"2024-09-13T19:10:51.125394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:51.125199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:51.125199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:44.448668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.903047+0000","last_change":"2024-09-13T19:10:16.903047+0000","last_active":"2024-09-13T19:10:16.903047+0000","last_peered":"2024-09-13T19:10:16.903047+0000","last_clean":"2024-09-13T19:10:16.903047+0000","last_became_active":"2024-09-13T19:06:23.273706+0000","last_became_peered":"2024-09-13T19:06:23.273706+0000","last_unstale":"2024-09-13T19:10:16.903047+0000","last_undegraded":"2024-09-13T19:10:16.903047+0000","last_fullsized":"2024-09-13T19:10:16.903047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-13T19:10:16.902806+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.902806+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:19.703828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'40","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:33.918703+0000","last_change":"2024-09-13T19:10:33.918703+0000","last_active":"2024-09-13T19:10:33.918703+0000","last_peered":"2024-09-13T19:10:33.918703+0000","last_clean":"2024-09-13T19:10:33.918703+0000","last_became_active":"2024-09-13T19:06:25.303152+0000","last_became_peered":"2024-09-13T19:06:25.303152+0000","last_unstale":"2024-09-13T19:10:33.918703+0000","last_undegraded":"2024-09-13T19:10:33.918703+0000","last_fullsized":"2024-09-13T19:10:33.918703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-13T19:10:33.918433+0000","last_clean_scrub_stamp":"2024-09-13T19:10:33.918433+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:50.289186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:16.520027+0000","last_change":"2024-09-13T19:10:16.520027+0000","last_active":"2024-09-13T19:10:16.520027+0000","last_peered":"2024-09-13T19:10:16.520027+0000","last_clean":"2024-09-13T19:10:16.520027+0000","last_became_active":"2024-09-13T19:06:27.298876+0000","last_became_peered":"2024-09-13T19:06:27.298876+0000","last_unstale":"2024-09-13T19:10:16.520027+0000","last_undegraded":"2024-09-13T19:10:16.520027+0000","last_fullsized":"2024-09-13T19:10:16.520027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:16.519636+0000","last_clean_scrub_stamp":"2024-09-13T19:10:16.519636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:59.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.888253+0000","last_change":"2024-09-13T19:10:47.888253+0000","last_active":"2024-09-13T19:10:47.888253+0000","last_peered":"2024-09-13T19:10:47.888253+0000","last_clean":"2024-09-13T19:10:47.888253+0000","last_became_active":"2024-09-13T19:06:29.309410+0000","last_became_peered":"2024-09-13T19:06:29.309410+0000","last_unstale":"2024-09-13T19:10:47.888253+0000","last_undegraded":"2024-09-13T19:10:47.888253+0000","last_fullsized":"2024-09-13T19:10:47.888253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:47.887997+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.887997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:30.869982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.028462+0000","last_change":"2024-09-13T19:10:46.028526+0000","last_active":"2024-09-13T19:10:46.028462+0000","last_peered":"2024-09-13T19:10:46.028462+0000","last_clean":"2024-09-13T19:10:46.028462+0000","last_became_active":"2024-09-13T19:06:21.258037+0000","last_became_peered":"2024-09-13T19:06:21.258037+0000","last_unstale":"2024-09-13T19:10:46.028462+0000","last_undegraded":"2024-09-13T19:10:46.028462+0000","last_fullsized":"2024-09-13T19:10:46.028462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:46.028259+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.028259+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:34:47.928830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:46.107911+0000","last_change":"2024-09-13T19:10:46.107973+0000","last_active":"2024-09-13T19:10:46.107911+0000","last_peered":"2024-09-13T19:10:46.107911+0000","last_clean":"2024-09-13T19:10:46.107911+0000","last_became_active":"2024-09-13T19:06:19.269679+0000","last_became_peered":"2024-09-13T19:06:19.269679+0000","last_unstale":"2024-09-13T19:10:46.107911+0000","last_undegraded":"2024-09-13T19:10:46.107911+0000","last_fullsized":"2024-09-13T19:10:46.107911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:46.107689+0000","last_clean_scrub_stamp":"2024-09-13T19:10:46.107689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:25.366762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.467731+0000","last_change":"2024-09-13T19:10:44.467791+0000","last_active":"2024-09-13T19:10:44.467731+0000","last_peered":"2024-09-13T19:10:44.467731+0000","last_clean":"2024-09-13T19:10:44.467731+0000","last_became_active":"2024-09-13T19:06:21.254294+0000","last_became_peered":"2024-09-13T19:06:21.254294+0000","last_unstale":"2024-09-13T19:10:44.467731+0000","last_undegraded":"2024-09-13T19:10:44.467731+0000","last_fullsized":"2024-09-13T19:10:44.467731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:44.467543+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.467543+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:25.126852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.461029+0000","last_change":"2024-09-13T19:10:57.461105+0000","last_active":"2024-09-13T19:10:57.461029+0000","last_peered":"2024-09-13T19:10:57.461029+0000","last_clean":"2024-09-13T19:10:57.461029+0000","last_became_active":"2024-09-13T19:06:19.262596+0000","last_became_peered":"2024-09-13T19:06:19.262596+0000","last_unstale":"2024-09-13T19:10:57.461029+0000","last_undegraded":"2024-09-13T19:10:57.461029+0000","last_fullsized":"2024-09-13T19:10:57.461029+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:57.460837+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.460837+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:40.407423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.983112+0000","last_change":"2024-09-13T19:10:56.983262+0000","last_active":"2024-09-13T19:10:56.983112+0000","last_peered":"2024-09-13T19:10:56.983112+0000","last_clean":"2024-09-13T19:10:56.983112+0000","last_became_active":"2024-09-13T19:06:21.245385+0000","last_became_peered":"2024-09-13T19:06:21.245385+0000","last_unstale":"2024-09-13T19:10:56.983112+0000","last_undegraded":"2024-09-13T19:10:56.983112+0000","last_fullsized":"2024-09-13T19:10:56.983112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:56.982857+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.982857+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:46.123347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:04.828235+0000","last_change":"2024-09-13T19:11:04.828305+0000","last_active":"2024-09-13T19:11:04.828235+0000","last_peered":"2024-09-13T19:11:04.828235+0000","last_clean":"2024-09-13T19:11:04.828235+0000","last_became_active":"2024-09-13T19:06:19.291022+0000","last_became_peered":"2024-09-13T19:06:19.291022+0000","last_unstale":"2024-09-13T19:11:04.828235+0000","last_undegraded":"2024-09-13T19:11:04.828235+0000","last_fullsized":"2024-09-13T19:11:04.828235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:04.828016+0000","last_clean_scrub_stamp":"2024-09-13T19:11:04.828016+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:46:25.320587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.482729+0000","last_change":"2024-09-13T19:10:48.482795+0000","last_active":"2024-09-13T19:10:48.482729+0000","last_peered":"2024-09-13T19:10:48.482729+0000","last_clean":"2024-09-13T19:10:48.482729+0000","last_became_active":"2024-09-13T19:06:21.254592+0000","last_became_peered":"2024-09-13T19:06:21.254592+0000","last_unstale":"2024-09-13T19:10:48.482729+0000","last_undegraded":"2024-09-13T19:10:48.482729+0000","last_fullsized":"2024-09-13T19:10:48.482729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:48.482535+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.482535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:41.806005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:56.473063+0000","last_change":"2024-09-13T19:10:56.473134+0000","last_active":"2024-09-13T19:10:56.473063+0000","last_peered":"2024-09-13T19:10:56.473063+0000","last_clean":"2024-09-13T19:10:56.473063+0000","last_became_active":"2024-09-13T19:06:19.262352+0000","last_became_peered":"2024-09-13T19:06:19.262352+0000","last_unstale":"2024-09-13T19:10:56.473063+0000","last_undegraded":"2024-09-13T19:10:56.473063+0000","last_fullsized":"2024-09-13T19:10:56.473063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:56.472869+0000","last_clean_scrub_stamp":"2024-09-13T19:10:56.472869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:50.986688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'6","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:09.551600+0000","last_change":"2024-09-13T19:11:09.551746+0000","last_active":"2024-09-13T19:11:09.551600+0000","last_peered":"2024-09-13T19:11:09.551600+0000","last_clean":"2024-09-13T19:11:09.551600+0000","last_became_active":"2024-09-13T19:06:58.342822+0000","last_became_peered":"2024-09-13T19:06:58.342822+0000","last_unstale":"2024-09-13T19:11:09.551600+0000","last_undegraded":"2024-09-13T19:11:09.551600+0000","last_fullsized":"2024-09-13T19:11:09.551600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:11:09.551367+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:11:09.551367+0000","last_clean_scrub_stamp":"2024-09-13T19:11:09.551367+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:29.684905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:41.391394+0000","last_change":"2024-09-13T19:10:41.391471+0000","last_active":"2024-09-13T19:10:41.391394+0000","last_peered":"2024-09-13T19:10:41.391394+0000","last_clean":"2024-09-13T19:10:41.391394+0000","last_became_active":"2024-09-13T19:06:19.275424+0000","last_became_peered":"2024-09-13T19:06:19.275424+0000","last_unstale":"2024-09-13T19:10:41.391394+0000","last_undegraded":"2024-09-13T19:10:41.391394+0000","last_fullsized":"2024-09-13T19:10:41.391394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:10:41.391199+0000","last_clean_scrub_stamp":"2024-09-13T19:10:41.391199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:07.114988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:32.939056+0000","last_change":"2024-09-13T19:10:32.939056+0000","last_active":"2024-09-13T19:10:32.939056+0000","last_peered":"2024-09-13T19:10:32.939056+0000","last_clean":"2024-09-13T19:10:32.939056+0000","last_became_active":"2024-09-13T19:06:21.263237+0000","last_became_peered":"2024-09-13T19:06:21.263237+0000","last_unstale":"2024-09-13T19:10:32.939056+0000","last_undegraded":"2024-09-13T19:10:32.939056+0000","last_fullsized":"2024-09-13T19:10:32.939056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:32.938814+0000","last_clean_scrub_stamp":"2024-09-13T19:10:32.938814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:08:06.415179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:59.917014+0000","last_change":"2024-09-13T19:10:59.917125+0000","last_active":"2024-09-13T19:10:59.917014+0000","last_peered":"2024-09-13T19:10:59.917014+0000","last_clean":"2024-09-13T19:10:59.917014+0000","last_became_active":"2024-09-13T19:06:19.274585+0000","last_became_peered":"2024-09-13T19:06:19.274585+0000","last_unstale":"2024-09-13T19:10:59.917014+0000","last_undegraded":"2024-09-13T19:10:59.917014+0000","last_fullsized":"2024-09-13T19:10:59.917014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:59.916701+0000","last_clean_scrub_stamp":"2024-09-13T19:10:59.916701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:49:00.071057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:02.492292+0000","last_change":"2024-09-13T19:11:02.492359+0000","last_active":"2024-09-13T19:11:02.492292+0000","last_peered":"2024-09-13T19:11:02.492292+0000","last_clean":"2024-09-13T19:11:02.492292+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:11:02.492292+0000","last_undegraded":"2024-09-13T19:11:02.492292+0000","last_fullsized":"2024-09-13T19:11:02.492292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:02.492090+0000","last_clean_scrub_stamp":"2024-09-13T19:11:02.492090+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:11.373794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:44.127862+0000","last_change":"2024-09-13T19:10:44.127991+0000","last_active":"2024-09-13T19:10:44.127862+0000","last_peered":"2024-09-13T19:10:44.127862+0000","last_clean":"2024-09-13T19:10:44.127862+0000","last_became_active":"2024-09-13T19:06:19.269757+0000","last_became_peered":"2024-09-13T19:06:19.269757+0000","last_unstale":"2024-09-13T19:10:44.127862+0000","last_undegraded":"2024-09-13T19:10:44.127862+0000","last_fullsized":"2024-09-13T19:10:44.127862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:44.127604+0000","last_clean_scrub_stamp":"2024-09-13T19:10:44.127604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:58.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.994450+0000","last_change":"2024-09-13T19:10:34.994578+0000","last_active":"2024-09-13T19:10:34.994450+0000","last_peered":"2024-09-13T19:10:34.994450+0000","last_clean":"2024-09-13T19:10:34.994450+0000","last_became_active":"2024-09-13T19:06:21.261533+0000","last_became_peered":"2024-09-13T19:06:21.261533+0000","last_unstale":"2024-09-13T19:10:34.994450+0000","last_undegraded":"2024-09-13T19:10:34.994450+0000","last_fullsized":"2024-09-13T19:10:34.994450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-13T19:10:34.994220+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.994220+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:13.946370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:58.454678+0000","last_change":"2024-09-13T19:10:58.454739+0000","last_active":"2024-09-13T19:10:58.454678+0000","last_peered":"2024-09-13T19:10:58.454678+0000","last_clean":"2024-09-13T19:10:58.454678+0000","last_became_active":"2024-09-13T19:06:19.263683+0000","last_became_peered":"2024-09-13T19:06:19.263683+0000","last_unstale":"2024-09-13T19:10:58.454678+0000","last_undegraded":"2024-09-13T19:10:58.454678+0000","last_fullsized":"2024-09-13T19:10:58.454678+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:58.454475+0000","last_clean_scrub_stamp":"2024-09-13T19:10:58.454475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:58.608830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:48.046880+0000","last_change":"2024-09-13T19:10:48.046880+0000","last_active":"2024-09-13T19:10:48.046880+0000","last_peered":"2024-09-13T19:10:48.046880+0000","last_clean":"2024-09-13T19:10:48.046880+0000","last_became_active":"2024-09-13T19:06:21.258747+0000","last_became_peered":"2024-09-13T19:06:21.258747+0000","last_unstale":"2024-09-13T19:10:48.046880+0000","last_undegraded":"2024-09-13T19:10:48.046880+0000","last_fullsized":"2024-09-13T19:10:48.046880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:48.046612+0000","last_clean_scrub_stamp":"2024-09-13T19:10:48.046612+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:06.112193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:05.858499+0000","last_change":"2024-09-13T19:11:05.858555+0000","last_active":"2024-09-13T19:11:05.858499+0000","last_peered":"2024-09-13T19:11:05.858499+0000","last_clean":"2024-09-13T19:11:05.858499+0000","last_became_active":"2024-09-13T19:06:19.292120+0000","last_became_peered":"2024-09-13T19:06:19.292120+0000","last_unstale":"2024-09-13T19:11:05.858499+0000","last_undegraded":"2024-09-13T19:11:05.858499+0000","last_fullsized":"2024-09-13T19:11:05.858499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:05.858284+0000","last_clean_scrub_stamp":"2024-09-13T19:11:05.858284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:18:55.214937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:42.972524+0000","last_change":"2024-09-13T19:10:42.972524+0000","last_active":"2024-09-13T19:10:42.972524+0000","last_peered":"2024-09-13T19:10:42.972524+0000","last_clean":"2024-09-13T19:10:42.972524+0000","last_became_active":"2024-09-13T19:06:21.257170+0000","last_became_peered":"2024-09-13T19:06:21.257170+0000","last_unstale":"2024-09-13T19:10:42.972524+0000","last_undegraded":"2024-09-13T19:10:42.972524+0000","last_fullsized":"2024-09-13T19:10:42.972524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:10:42.972147+0000","last_clean_scrub_stamp":"2024-09-13T19:10:42.972147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:14.740560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:47.526647+0000","last_change":"2024-09-13T19:10:47.526647+0000","last_active":"2024-09-13T19:10:47.526647+0000","last_peered":"2024-09-13T19:10:47.526647+0000","last_clean":"2024-09-13T19:10:47.526647+0000","last_became_active":"2024-09-13T19:06:19.275547+0000","last_became_peered":"2024-09-13T19:06:19.275547+0000","last_unstale":"2024-09-13T19:10:47.526647+0000","last_undegraded":"2024-09-13T19:10:47.526647+0000","last_fullsized":"2024-09-13T19:10:47.526647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:47.526271+0000","last_clean_scrub_stamp":"2024-09-13T19:10:47.526271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:05.850818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.424112+0000","last_change":"2024-09-13T19:10:38.424112+0000","last_active":"2024-09-13T19:10:38.424112+0000","last_peered":"2024-09-13T19:10:38.424112+0000","last_clean":"2024-09-13T19:10:38.424112+0000","last_became_active":"2024-09-13T19:06:21.239943+0000","last_became_peered":"2024-09-13T19:06:21.239943+0000","last_unstale":"2024-09-13T19:10:38.424112+0000","last_undegraded":"2024-09-13T19:10:38.424112+0000","last_fullsized":"2024-09-13T19:10:38.424112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-13T19:10:38.423850+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.423850+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:32.456343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.070971+0000","last_change":"2024-09-13T19:10:45.070971+0000","last_active":"2024-09-13T19:10:45.070971+0000","last_peered":"2024-09-13T19:10:45.070971+0000","last_clean":"2024-09-13T19:10:45.070971+0000","last_became_active":"2024-09-13T19:06:19.283020+0000","last_became_peered":"2024-09-13T19:06:19.283020+0000","last_unstale":"2024-09-13T19:10:45.070971+0000","last_undegraded":"2024-09-13T19:10:45.070971+0000","last_fullsized":"2024-09-13T19:10:45.070971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.070599+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.070599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:23.213665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:01.907546+0000","last_change":"2024-09-13T19:11:01.907590+0000","last_active":"2024-09-13T19:11:01.907546+0000","last_peered":"2024-09-13T19:11:01.907546+0000","last_clean":"2024-09-13T19:11:01.907546+0000","last_became_active":"2024-09-13T19:06:21.261357+0000","last_became_peered":"2024-09-13T19:06:21.261357+0000","last_unstale":"2024-09-13T19:11:01.907546+0000","last_undegraded":"2024-09-13T19:11:01.907546+0000","last_fullsized":"2024-09-13T19:11:01.907546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:11:01.907431+0000","last_clean_scrub_stamp":"2024-09-13T19:11:01.907431+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:01.348844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:57.943573+0000","last_change":"2024-09-13T19:10:57.943633+0000","last_active":"2024-09-13T19:10:57.943573+0000","last_peered":"2024-09-13T19:10:57.943573+0000","last_clean":"2024-09-13T19:10:57.943573+0000","last_became_active":"2024-09-13T19:06:19.274048+0000","last_became_peered":"2024-09-13T19:06:19.274048+0000","last_unstale":"2024-09-13T19:10:57.943573+0000","last_undegraded":"2024-09-13T19:10:57.943573+0000","last_fullsized":"2024-09-13T19:10:57.943573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:57.943383+0000","last_clean_scrub_stamp":"2024-09-13T19:10:57.943383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:35.094936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:38.042199+0000","last_change":"2024-09-13T19:10:38.042199+0000","last_active":"2024-09-13T19:10:38.042199+0000","last_peered":"2024-09-13T19:10:38.042199+0000","last_clean":"2024-09-13T19:10:38.042199+0000","last_became_active":"2024-09-13T19:06:21.255793+0000","last_became_peered":"2024-09-13T19:06:21.255793+0000","last_unstale":"2024-09-13T19:10:38.042199+0000","last_undegraded":"2024-09-13T19:10:38.042199+0000","last_fullsized":"2024-09-13T19:10:38.042199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-13T19:10:38.041895+0000","last_clean_scrub_stamp":"2024-09-13T19:10:38.041895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:59.900437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:08.944353+0000","last_change":"2024-09-13T19:11:08.944495+0000","last_active":"2024-09-13T19:11:08.944353+0000","last_peered":"2024-09-13T19:11:08.944353+0000","last_clean":"2024-09-13T19:11:08.944353+0000","last_became_active":"2024-09-13T19:06:19.289298+0000","last_became_peered":"2024-09-13T19:06:19.289298+0000","last_unstale":"2024-09-13T19:11:08.944353+0000","last_undegraded":"2024-09-13T19:11:08.944353+0000","last_fullsized":"2024-09-13T19:11:08.944353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-13T19:11:08.944070+0000","last_clean_scrub_stamp":"2024-09-13T19:11:08.944070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:24.191489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:30.907486+0000","last_change":"2024-09-13T19:10:30.907486+0000","last_active":"2024-09-13T19:10:30.907486+0000","last_peered":"2024-09-13T19:10:30.907486+0000","last_clean":"2024-09-13T19:10:30.907486+0000","last_became_active":"2024-09-13T19:06:21.263939+0000","last_became_peered":"2024-09-13T19:06:21.263939+0000","last_unstale":"2024-09-13T19:10:30.907486+0000","last_undegraded":"2024-09-13T19:10:30.907486+0000","last_fullsized":"2024-09-13T19:10:30.907486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:30.907226+0000","last_clean_scrub_stamp":"2024-09-13T19:10:30.907226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:52.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:00.891559+0000","last_change":"2024-09-13T19:11:00.891617+0000","last_active":"2024-09-13T19:11:00.891559+0000","last_peered":"2024-09-13T19:11:00.891559+0000","last_clean":"2024-09-13T19:11:00.891559+0000","last_became_active":"2024-09-13T19:06:19.294755+0000","last_became_peered":"2024-09-13T19:06:19.294755+0000","last_unstale":"2024-09-13T19:11:00.891559+0000","last_undegraded":"2024-09-13T19:11:00.891559+0000","last_fullsized":"2024-09-13T19:11:00.891559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:11:00.891365+0000","last_clean_scrub_stamp":"2024-09-13T19:11:00.891365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:24.920169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'16","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:25.753182+0000","last_change":"2024-09-13T19:10:25.753182+0000","last_active":"2024-09-13T19:10:25.753182+0000","last_peered":"2024-09-13T19:10:25.753182+0000","last_clean":"2024-09-13T19:10:25.753182+0000","last_became_active":"2024-09-13T19:06:21.261259+0000","last_became_peered":"2024-09-13T19:06:21.261259+0000","last_unstale":"2024-09-13T19:10:25.753182+0000","last_undegraded":"2024-09-13T19:10:25.753182+0000","last_fullsized":"2024-09-13T19:10:25.753182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-13T19:10:25.752912+0000","last_clean_scrub_stamp":"2024-09-13T19:10:25.752912+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:44.077460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.105311+0000","last_change":"2024-09-13T19:10:34.105311+0000","last_active":"2024-09-13T19:10:34.105311+0000","last_peered":"2024-09-13T19:10:34.105311+0000","last_clean":"2024-09-13T19:10:34.105311+0000","last_became_active":"2024-09-13T19:06:19.277063+0000","last_became_peered":"2024-09-13T19:06:19.277063+0000","last_unstale":"2024-09-13T19:10:34.105311+0000","last_undegraded":"2024-09-13T19:10:34.105311+0000","last_fullsized":"2024-09-13T19:10:34.105311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:34.105056+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.105056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:03.469390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:52.088306+0000","last_change":"2024-09-13T19:10:52.088373+0000","last_active":"2024-09-13T19:10:52.088306+0000","last_peered":"2024-09-13T19:10:52.088306+0000","last_clean":"2024-09-13T19:10:52.088306+0000","last_became_active":"2024-09-13T19:06:21.261811+0000","last_became_peered":"2024-09-13T19:06:21.261811+0000","last_unstale":"2024-09-13T19:10:52.088306+0000","last_undegraded":"2024-09-13T19:10:52.088306+0000","last_fullsized":"2024-09-13T19:10:52.088306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:10:52.088124+0000","last_clean_scrub_stamp":"2024-09-13T19:10:52.088124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:52.751625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:11.880924+0000","last_change":"2024-09-13T19:11:11.880989+0000","last_active":"2024-09-13T19:11:11.880924+0000","last_peered":"2024-09-13T19:11:11.880924+0000","last_clean":"2024-09-13T19:11:11.880924+0000","last_became_active":"2024-09-13T19:06:19.293128+0000","last_became_peered":"2024-09-13T19:06:19.293128+0000","last_unstale":"2024-09-13T19:11:11.880924+0000","last_undegraded":"2024-09-13T19:11:11.880924+0000","last_fullsized":"2024-09-13T19:11:11.880924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-13T19:11:11.880732+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-13T19:11:11.880732+0000","last_clean_scrub_stamp":"2024-09-13T19:11:11.880732+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:05.023046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:11:22.696995+0000","last_change":"2024-09-13T19:11:22.697055+0000","last_active":"2024-09-13T19:11:22.696995+0000","last_peered":"2024-09-13T19:11:22.696995+0000","last_clean":"2024-09-13T19:11:22.696995+0000","last_became_active":"2024-09-13T19:06:19.278957+0000","last_became_peered":"2024-09-13T19:06:19.278957+0000","last_unstale":"2024-09-13T19:11:22.696995+0000","last_undegraded":"2024-09-13T19:11:22.696995+0000","last_fullsized":"2024-09-13T19:11:22.696995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-13T19:11:22.696804+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-13T19:11:22.696804+0000","last_clean_scrub_stamp":"2024-09-13T19:11:22.696804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:30.177091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:34.413754+0000","last_change":"2024-09-13T19:10:34.413754+0000","last_active":"2024-09-13T19:10:34.413754+0000","last_peered":"2024-09-13T19:10:34.413754+0000","last_clean":"2024-09-13T19:10:34.413754+0000","last_became_active":"2024-09-13T19:06:21.260771+0000","last_became_peered":"2024-09-13T19:06:21.260771+0000","last_unstale":"2024-09-13T19:10:34.413754+0000","last_undegraded":"2024-09-13T19:10:34.413754+0000","last_fullsized":"2024-09-13T19:10:34.413754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-13T19:10:34.413506+0000","last_clean_scrub_stamp":"2024-09-13T19:10:34.413506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:35:48.737050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:45.496556+0000","last_change":"2024-09-13T19:10:45.496556+0000","last_active":"2024-09-13T19:10:45.496556+0000","last_peered":"2024-09-13T19:10:45.496556+0000","last_clean":"2024-09-13T19:10:45.496556+0000","last_became_active":"2024-09-13T19:06:19.277272+0000","last_became_peered":"2024-09-13T19:06:19.277272+0000","last_unstale":"2024-09-13T19:10:45.496556+0000","last_undegraded":"2024-09-13T19:10:45.496556+0000","last_fullsized":"2024-09-13T19:10:45.496556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T19:10:45.496261+0000","last_clean_scrub_stamp":"2024-09-13T19:10:45.496261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:03.561842+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'24","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T19:10:39.018270+0000","last_change":"2024-09-13T19:10:39.018270+0000","last_active":"2024-09-13T19:10:39.018270+0000","last_peered":"2024-09-13T19:10:39.018270+0000","last_clean":"2024-09-13T19:10:39.018270+0000","last_became_active":"2024-09-13T19:06:21.254899+0000","last_became_peered":"2024-09-13T19:06:21.254899+0000","last_unstale":"2024-09-13T19:10:39.018270+0000","last_undegraded":"2024-09-13T19:10:39.018270+0000","last_fullsized":"2024-09-13T19:10:39.018270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-13T19:10:39.018018+0000","last_clean_scrub_stamp":"2024-09-13T19:10:39.018018+0000","objects_scrubbed":1,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:18.277091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":83,"num_read_kb":75,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1601,"num_read_kb":1491,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705736,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":153329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":741263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705737,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":741217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":152715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T19:11:50.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T19:11:50.936 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f28ceb640 1 Processor -- start 2024-09-13T19:11:50.937 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f28ceb640 1 -- start start 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f28ceb640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f2412c670 0x7f1f2412ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f28ceb640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f24070d40 con 0x7f1f2412cf90 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f28ceb640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1f24071d80 con 0x7f1f2412c670 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f2259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f2412c670 0x7f1f2412ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f21d9b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f2412cf90 0x7f1f241290f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60974/0 (socket says 172.21.15.12:60974) 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f21d9b640 1 -- 172.21.15.12:0/3926431929 learned_addr learned my addr 172.21.15.12:0/3926431929 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f2259c640 1 -- 172.21.15.12:0/3926431929 >> v1:172.21.15.12:6789/0 conn(0x7f1f2412cf90 legacy=0x7f1f241290f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f2259c640 1 -- 172.21.15.12:0/3926431929 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f24071420 con 0x7f1f2412c670 2024-09-13T19:11:50.938 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.932+0000 7f1f2159a640 1 -- 172.21.15.12:0/3926431929 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3660248517 0 0) 0x7f1f24070d40 con 0x7f1f2412cf90 2024-09-13T19:11:50.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2259c640 1 --2- 172.21.15.12:0/3926431929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f2412ca50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009740 tx=0x7f1f1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdfc2ca775cb2da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2159a640 1 -- 172.21.15.12:0/3926431929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f140b0070 con 0x7f1f2412c670 2024-09-13T19:11:50.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2159a640 1 -- 172.21.15.12:0/3926431929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f140ab530 con 0x7f1f2412c670 2024-09-13T19:11:50.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2159a640 1 -- 172.21.15.12:0/3926431929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f140ab830 con 0x7f1f2412c670 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3926431929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 msgr2=0x7f1f2412ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3926431929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f2412ca50 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009740 tx=0x7f1f1401c370 comp rx=0 tx=0).stop 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3926431929 shutdown_connections 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3926431929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f2412ca50 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3926431929 >> 172.21.15.12:0/3926431929 conn(0x7f1f2409a8a0 msgr2=0x7f1f2409acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3926431929 shutdown_connections 2024-09-13T19:11:50.942 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3926431929 wait complete. 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 Processor -- start 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- start start 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f28ceb640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241355b0 con 0x7f1f2412c670 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57796/0 (socket says 172.21.15.12:57796) 2024-09-13T19:11:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.936+0000 7f1f2259c640 1 -- 172.21.15.12:0/3124225782 learned_addr learned my addr 172.21.15.12:0/3124225782 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-09-13T19:11:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f2259c640 1 -- 172.21.15.12:0/3124225782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f24126da0 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f2259c640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1f14019fa0 tx=0x7f1f1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f140b0050 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f140b1040 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f241302f0 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f140042a0 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f241c4c10 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f241305d0 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1f140be060 con 0x7f1f2412c670 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 0x7f1f04038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T19:11:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f140e2fc0 con 0x7f1f2412c670 2024-09-13T19:11:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f21d9b640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 0x7f1f04038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T19:11:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.940+0000 7f1f21d9b640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 0x7f1f04038270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T19:11:50.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:50.944+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1f14015ff0 con 0x7f1f2412c670 2024-09-13T19:11:51.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.108+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1f2412ca50 con 0x7f1f2412c670 2024-09-13T19:11:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.112+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f1f140b63b0 con 0x7f1f2412c670 2024-09-13T19:11:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.112+0000 7f1f12ffd640 1 -- 172.21.15.12:0/3124225782 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1f140093e0 con 0x7f1f2412c670 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 msgr2=0x7f1f04038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 0x7f1f04038270 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f18007fd0 tx=0x7f1f18007920 comp rx=0 tx=0).stop 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 msgr2=0x7f1f241c46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1f14019fa0 tx=0x7f1f1401abb0 comp rx=0 tx=0).stop 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 shutdown_connections 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.151:6824/3943350610,v1:172.21.15.151:6825/3943350610] conn(0x7f1f04035db0 0x7f1f04038270 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 --2- 172.21.15.12:0/3124225782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f2412c670 0x7f1f241c46d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 >> 172.21.15.12:0/3124225782 conn(0x7f1f2409a8a0 msgr2=0x7f1f240973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T19:11:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 shutdown_connections 2024-09-13T19:11:51.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-09-13T19:11:51.116+0000 7f1f28ceb640 1 -- 172.21.15.12:0/3124225782 wait complete. 2024-09-13T19:11:51.138 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T19:11:51.138 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T19:11:51.139 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T19:11:51.139 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:11:52.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T19:11:57.240 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T19:11:57.241 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T19:11:57.241 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:11:57.307 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T19:11:57.307 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T19:11:57.307 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:11:57.380 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T19:11:57.380 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T19:11:57.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:11:57.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-09-13T19:12:02.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T19:12:02.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T19:12:03.482 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T19:12:03.482 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T19:12:03.483 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T19:12:03.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:12:03.513 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T19:12:03.514 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T19:12:03.514 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T19:12:03.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T19:12:03.537 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T19:12:03.538 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T19:12:03.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-13T19:12:03.596 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-09-13T19:12:03.596 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T19:12:03.808 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:12:03.808 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T19:12:04.022 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:12:04.023 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T19:12:04.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:12:04.190 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T19:12:04.374 INFO:tasks.ceph:Archiving mon data... 2024-09-13T19:12:04.375 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/data/mon.a.tgz 2024-09-13T19:12:04.375 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-09-13T19:12:04.382 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.cu7DPa8lER 2024-09-13T19:12:04.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cu7DPa8lER 2024-09-13T19:12:04.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.cu7DPa8lER 2024-09-13T19:12:04.581 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.cu7DPa8lER is 288KB 2024-09-13T19:12:04.750 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.cu7DPa8lER 2024-09-13T19:12:04.755 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T19:12:04.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:12:04.801 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T19:12:04.860 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:12:04.866 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-13T19:12:04.866 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T19:12:04.868 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi012/crash 2024-09-13T19:12:04.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:12:04.917 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi151/crash 2024-09-13T19:12:04.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T19:12:04.930 INFO:tasks.ceph:Compressing logs... 2024-09-13T19:12:04.931 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:12:04.969 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T19:12:04.985 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22699.log 2024-09-13T19:12:04.985 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25747.log 2024-09-13T19:12:04.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.22699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25263.log 2024-09-13T19:12:04.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25747.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22699.log.gz 2024-09-13T19:12:04.987 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25747.log.gz 2024-09-13T19:12:04.987 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25119.log 2024-09-13T19:12:04.987 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25380.log 2024-09-13T19:12:04.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25263.log: /var/log/ceph/ceph-client.admin.25119.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-13T19:12:04.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25380.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25119.log.gz 2024-09-13T19:12:04.989 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24904.log 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25263.log.gz 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25380.log.gz 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25010.log 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25237.log 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25010.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24904.log.gz 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25614.log 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.25010.log.gz 2024-09-13T19:12:04.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24745.log 2024-09-13T19:12:04.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25614.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25237.log.gz 2024-09-13T19:12:04.994 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25721.log 2024-09-13T19:12:04.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24745.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25614.log.gz 2024-09-13T19:12:04.994 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25211.log 2024-09-13T19:12:04.994 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24745.log.gz 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25107.log 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25721.log.gz 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24847.log 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25107.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25211.log.gz 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25107.log.gz 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25640.log 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24847.log.gz 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23667.log 2024-09-13T19:12:04.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25011.log 2024-09-13T19:12:04.996 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25640.log.gz 2024-09-13T19:12:04.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.23667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22811.log 2024-09-13T19:12:04.996 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.23667.log.gz 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25117.log 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25011.log.gz 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.22811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24873.log 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.22811.log.gz 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25771.log 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.25117.log.gz 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25328.log 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24873.log.gz 2024-09-13T19:12:05.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25484.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25771.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25111.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25328.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25484.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25484.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25302.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21435.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25111.log: /var/log/ceph/ceph-client.admin.25302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24907.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25302.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25111.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.21435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25035.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21435.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25695.log 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24907.log.gz 2024-09-13T19:12:05.015 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24801.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25035.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25695.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25695.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25003.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24801.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25562.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24776.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25003.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25354.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25562.log: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25406.log 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25562.log.gz 2024-09-13T19:12:05.016 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24776.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24821.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25354.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22769.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24821.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25406.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25536.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24821.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.22769.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.22769.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24910.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25536.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25588.log 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.24910.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24910.log.gz 2024-09-13T19:12:05.017 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24911.log 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25458.log 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25588.log: /var/log/ceph/ceph-client.admin.24911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25432.log 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24911.log.gz 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25588.log.gz 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25667.log 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25458.log.gz 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25510.log 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25432.log.gz 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25667.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25667.log.gz 2024-09-13T19:12:05.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.25510.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25510.log.gz 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86743.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30729.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.86743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52553.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.30729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65533.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.52553.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86743.log.gz 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68483.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.65533.log: /var/log/ceph/ceph-client.0.68483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34263.log 2024-09-13T19:12:05.040 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30729.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25154.log 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.34263.log: gzip -5 --verbose -- 91.2% /var/log/ceph/ceph-client.0.47243.log 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.52553.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65533.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25154.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68483.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54323.log 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25154.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71433.log 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.34263.log.gz 2024-09-13T19:12:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.54323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81433.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.71433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37803.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47243.log.gz 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.81433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80843.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37803.log: /var/log/ceph/ceph-client.admin.25082.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83203.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.54323.log.gz 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: 85.7%/var/log/ceph/ceph-client.0.80843.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71433.log.gz 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29398.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81433.log.gz 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.83203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55503.log 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37803.log.gz 2024-09-13T19:12:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51963.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80843.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.55503.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29398.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53733.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59633.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.53733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36033.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83203.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.59633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80253.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51963.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55503.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.36033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82613.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.80253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25106.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53733.log.gz 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.82613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43113.log 2024-09-13T19:12:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79669.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36033.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.59633.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.25106.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.43113.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80253.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.79669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39573.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82613.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42523.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.79669.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.43113.log.gz 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.39573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31319.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.42523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66123.log 2024-09-13T19:12:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83793.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.66123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74973.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39573.log.gz 91.5% -- replaced with /var/log/ceph/ceph-client.0.42523.log.gz 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.83793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75563.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.74973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41343.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.75563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87333.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31319.log.gz 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.83793.log.gz 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.66123.log.gz 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29374.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64943.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74973.log.gz 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29374.log: 91.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57273.log 2024-09-13T19:12:05.045 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.75563.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% 85.8% -- replaced with /var/log/ceph/ceph-client.admin.29374.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.41343.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73203.log 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87333.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32499.log 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.57273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77917.log 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.73203.log: /var/log/ceph/ceph-client.0.32499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67893.log 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.77917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62583.log 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.67893.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64943.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% 91.7% -- replaced with /var/log/ceph/ceph-client.0.77917.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57273.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.73203.log.gz 2024-09-13T19:12:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77333.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.32499.log.gz 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44293.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.62583.log: /var/log/ceph/ceph-client.0.77333.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67893.log.gz 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51373.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44293.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.77333.log.gz 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.51373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44883.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33089.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.44883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33673.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44293.log.gz 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.0.62583.log.gz/var/log/ceph/ceph-client.0.33089.log: 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67303.log 2024-09-13T19:12:05.047 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.51373.log.gz 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.33089.log.gz 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.33673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76743.log 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44883.log.gz 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63173.log 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.67303.log: /var/log/ceph/ceph-client.0.76743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54913.log 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29446.log 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.63173.log: /var/log/ceph/ceph-client.0.54913.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33673.log.gz 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-13T19:12:05.048 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% 92.0% -- replaced with /var/log/ceph/ceph-client.0.76743.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.67303.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29446.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29446.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.63173.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50193.log 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60223.log 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54913.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.50193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63763.log 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.60223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69073.log 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.63763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40163.log 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.69073.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.50193.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.60223.log.gz 2024-09-13T19:12:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49013.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63763.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.40163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56683.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.49013.log: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58453.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.69073.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.56683.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40163.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49013.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.58453.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56683.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34853.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86153.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.0.34853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47833.log 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.86153.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.58453.log.gz 2024-09-13T19:12:05.050 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36623.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34853.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.47833.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86153.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64353.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.36623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84973.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47833.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.64353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29422.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84973.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36623.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.64353.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85563.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.29422.log: 91.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38983.log 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.84973.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29422.log.gz 2024-09-13T19:12:05.051 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.85563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50783.log 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.38983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40753.log 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.50783.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85563.log.gz 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38983.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.70843.log 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50783.log.gz 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.40753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76153.log 2024-09-13T19:12:05.052 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.70843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59043.log 2024-09-13T19:12:05.068 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.76153.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40753.log.gz 2024-09-13T19:12:05.068 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70843.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57863.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.59043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70253.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.57863.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.76153.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.59043.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57863.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87923.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.70253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78501.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.87923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30139.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.78501.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70253.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78501.log.gz 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61403.log 2024-09-13T19:12:05.069 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.87923.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.30139.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35443.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.61403.log: /var/log/ceph/ops-log-ceph-client.0.log: 91.8% 92.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.30139.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61993.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.35443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72613.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr: 92.8%/var/log/ceph/ceph-client.0.61993.log: -- replaced with /var/log/ceph/ceph-client.0.61403.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79085.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.35443.log.gz/var/log/ceph/ceph-client.0.72613.log: 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82023.log 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.79085.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.79085.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72613.log.gz 2024-09-13T19:12:05.070 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46653.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61993.log.gz/var/log/ceph/ceph-client.0.82023.log: 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60813.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46063.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.46653.log: /var/log/ceph/ceph-client.0.60813.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82023.log.gz 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.46653.log.gz 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.60813.log.gz -5 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr: --verbose -- /var/log/ceph/ceph-client.0.73793.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.46063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43703.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.73793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37213.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.43703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84383.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.37213.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46063.log.gz 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56093.log 2024-09-13T19:12:05.071 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.43703.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.84383.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37213.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.73793.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72023.log 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.56093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88519.log 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84383.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.72023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31909.log 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.88519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29470.log 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.31909.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56093.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66713.log 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72023.log.gz/var/log/ceph/ceph-client.admin.29470.log: 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29470.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31909.log.gz 2024-09-13T19:12:05.072 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38393.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.66713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.38393.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45473.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/ceph-client.0.88519.log.gz 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.admin.25130.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41933.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6%/var/log/ceph/ceph-client.0.45473.log: -- replaced with /var/log/ceph/ceph-client.0.66713.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.38393.log.gz 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48423.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.41933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53143.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.48423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49603.log 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.53143.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45473.log.gz 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41933.log.gz 2024-09-13T19:12:05.073 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48423.log.gz 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69663.log 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.53143.log.gz 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.49603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74383.log 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.69663.log: /var/log/ceph/ceph-client.0.74383.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49603.log.gz 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.69663.log.gz 2024-09-13T19:12:05.074 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74383.log.gz 2024-09-13T19:12:05.097 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-13T19:12:05.209 INFO:teuthology.orchestra.run.smithi012.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-13T19:12:06.030 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-13T19:12:06.091 INFO:teuthology.orchestra.run.smithi012.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-13T19:12:06.093 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-09-13T19:12:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m1.122s 2024-09-13T19:12:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m1.340s 2024-09-13T19:12:06.093 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m0.062s 2024-09-13T19:12:06.141 INFO:teuthology.orchestra.run.smithi151.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-13T19:12:06.220 INFO:teuthology.orchestra.run.smithi151.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-13T19:12:06.222 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-09-13T19:12:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m1.245s 2024-09-13T19:12:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m3.553s 2024-09-13T19:12:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m0.199s 2024-09-13T19:12:06.223 INFO:tasks.ceph:Archiving logs... 2024-09-13T19:12:06.223 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi012/log 2024-09-13T19:12:06.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:12:06.429 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi151/log 2024-09-13T19:12:06.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T19:12:06.941 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T19:12:06.953 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T19:12:06.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:12:06.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T19:12:07.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T19:12:07.046 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T19:12:07.047 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:12:07.049 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout:+hv01.front.sepi 67.205.162.81 3 u 37 64 377 0.087 +1.516 2.293 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout:+hv02.front.sepi 96.245.170.99 3 u 37 64 377 0.091 -5.259 3.687 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout:*hv03.front.sepi 74.6.168.72 3 u 39 64 377 0.085 +1.636 2.294 2024-09-13T19:12:07.060 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:12:07.063 INFO:teuthology.orchestra.run.smithi151.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T19:12:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================== 2024-09-13T19:12:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:+hv01.front.sepi 67.205.162.81 3 u 39 64 377 0.105 -0.782 1.267 2024-09-13T19:12:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:+hv02.front.sepi 96.245.170.99 3 u 35 64 377 0.102 -3.530 1.248 2024-09-13T19:12:07.064 INFO:teuthology.orchestra.run.smithi151.stdout:*hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.093 -0.285 1.012 2024-09-13T19:12:07.064 INFO:teuthology.orchestra.run.smithi151.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T19:12:07.065 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T19:12:07.073 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T19:12:07.073 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T19:12:07.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T19:12:07.089 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T19:12:07.097 INFO:teuthology.task.internal:Duration was 965.934271 seconds 2024-09-13T19:12:07.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T19:12:07.106 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T19:12:07.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:12:07.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T19:12:07.146 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T19:12:07.146 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-09-13T19:12:07.147 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:12:07.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-09-13T19:12:07.201 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T19:12:07.211 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T19:12:07.211 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:12:07.245 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T19:12:07.282 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T19:12:07.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:12:07.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T19:12:07.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T19:12:07.393 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T19:12:07.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:12:07.405 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T19:12:07.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T19:12:07.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:12:07.449 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:12:07.459 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-09-13T19:12:07.471 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-09-13T19:12:07.565 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:12:07.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:12:07.571 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T19:12:07.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T19:12:07.614 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T19:12:07.624 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T19:12:07.624 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi012 2024-09-13T19:12:07.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:12:07.648 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-13_16:28:49-rgw-squid-distro-default-smithi/7904033/remote/smithi151 2024-09-13T19:12:07.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T19:12:07.679 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T19:12:07.679 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:12:07.689 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T19:12:07.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T19:12:07.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T19:12:07.734 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T19:12:07.734 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T19:12:07.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T19:12:07.748 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:12:07.751 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T19:12:07.755 INFO:teuthology.orchestra.run.smithi012.stdout: 658634 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:12 /home/ubuntu/cephtest 2024-09-13T19:12:07.771 INFO:teuthology.orchestra.run.smithi151.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 19:12 /home/ubuntu/cephtest 2024-09-13T19:12:07.773 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T19:12:07.786 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T19:12:07.809 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{ubuntu_latest}} duration: 965.9342710971832 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-13T19:12:07.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T19:12:07.898 INFO:teuthology.run:pass